- This event has passed.
Virtual LANS Seminar
September 2, 2020 @ 10:30 - 11:30 CDT
Seminar Title: Derivative-Free Optimization for Hyperparameter Tuning of Deep Neural Networks
Speaker: Dounia Lakhmiri, PhD Student, Polytechnique Montreal, Canada
Date/Time: September 2, 2020 / 10:30 AM – 11:30 AM
Location: See meeting URL on the cels-seminars website (requires Argonne login)
Description: Choosing an adequate neural network for a new application is an intricate and time-consuming process. This task is often split into two phases: the first one determines the architecture of the network while the second decides on the optimization algorithm to apply which is responsible for the training of the network. However, the initial hyperparameter optimization problem can be seen as an expensive blackbox problem and therefore can be handled by derivative-free optimization methods. This talk presents the adaptation of the MADS algorithm for this particular instance and the positive results this approach obtained on computer vision and anomaly detection problems.
Please note that the meeting URL for this event can be seen on the cels-seminars website, which requires an Argonne login.