- This event has passed.
Virtual LANS Seminar
December 9, 2020 @ 11:00 - 12:00 CST
Seminar Title: Should We Be Perturbed About Deep Learning?
Speaker: Desmond Higham, Professor of Numerical Analysis, The University of Edinburgh
Date/Time: December 9, 2020 / 11:00 AM – 12:00 PM
Location: See meeting URL on the cels-seminars website (requires Argonne login)
Description: Many commentators are asking whether current AI solutions are sufficiently robust, resilient, and trustworthy; and how such issues should be quantified and addressed. I believe that numerical analysts can contribute to the debate. In part 1 of this talk I will look at the common practice of using low precision floating point formats to speed up computation time. I will focus on evaluating the softmax and log-sum-exp functions, which play an important role in many classification tools. Here, across widely used packages we see mathematically equivalent but computationally different formulations; these variations have been designed in an effort to avoid overflow and underflow. I will show that classical rounding error analysis gives insights into their floating-point accuracy, and suggests a method of choice. In part 2 I will look at a bigger picture question concerning sensitivity to adversarial attacks in deep learning. Adversarial attacks are deliberate, targeted perturbations to input data that have a dramatic effect on the output; for example, a traffic “Stop” sign on the roadside can be misinterpreted as a speed limit sign when minimal graffiti is added. The vulnerability of systems to such interventions raises questions around security, privacy and ethics, and there has been a rapid escalation of attack and defense strategies. I will consider a related higher-level question: under realistic assumptions, do adversarial examples always exist with high probability? I will also introduce and discuss the idea of a stealth attack: an undetectable, targeted perturbation to the trained network itself.
Part 1 is joint work with Pierre Blanchard (ARM) and Nick Higham (Manchester).
Part 2 is joint work with Alexander Gorban and Ivan Tyukin (Leicester).
Please note that the meeting URL for this event can be seen on the cels-seminars website, which requires an Argonne login.