{"id":3659,"global_id":"wordpress.cels.anl.gov\/lans-seminars?id=3659","global_id_lineage":["wordpress.cels.anl.gov\/lans-seminars?id=3659"],"author":"976","status":"publish","date":"2024-12-02 08:36:20","date_utc":"2024-12-02 14:36:20","modified":"2024-12-02 08:36:20","modified_utc":"2024-12-02 14:36:20","url":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/event\/lans-seminar-153\/","rest_url":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/tribe\/events\/v1\/events\/3659","title":"LANS Seminar","description":"

Seminar Title:<\/strong>Energy Efficient Implementation of the Transformer Architecture for Sequence Modeling using Spiking Neural Networks (SNN)<\/p>\n

Speaker:<\/strong>Adarsha Balaji, Postdoc, Mathematics and Computer Science Division, Argonne National Laboratory<\/p>\n

Date\/Time:<\/strong> December 4, 2024\/ 10:30 AM-11:30 AM
\nLocation:\u00a0<\/strong>See Meeting URL on the cels-seminars website which will require an Argonne login.<\/em><\/p>\n

Description: <\/strong>Neuromorphic architectures implement bio-logical neurons and synapses to execute machine learning algorithms implemented using spiking neural network (SNN) based neurons, encoding and bio-inspired learning algorithms. These architectures are traditionally energy efficient and therefore, suitable for cognitive information processing on resource and power-constrained environments, ones where sensor and edge nodes of internet-of-things (IoT) operate.\u00a0In this talk, we will explore SNNs to design transformer models for vision and natural language modeling tasks. We will address the challenge of the inefficient and time-consuming training of large-scale SNNs using existing surrogate learning methods on existing digital accelerators. The proposed methodology explores principles of knowledge distillation for designing transformer-based SNN for inference.<\/p>\n

Bio: <\/strong>Adarsha Balaji is a postdoc at the Mathematics and Computer Science division at Argonne National Laboratory. He received his master\u2019s and Ph.D. degree from Drexel University, Philadelphia in 2021 with a focus of the hardware software co-design of Neuromorphic Systems. His current research interests include modeling large-scale SNN for scientific tasks and the hardware-software design space exploration of neuromorphic computing systems, particularly data-flow and power-optimization of spiking neural networks (SNN) hardware.<\/p>\n

Please note that the meeting URL for this event can be seen on the cels-seminars website which requires an Argonne login.<\/em><\/p>\n

\n

See all upcoming talks at\u00a0https:\/\/www.anl.gov\/mcs\/lans-seminars<\/a><\/p>\n<\/div>","excerpt":"","slug":"lans-seminar-153","image":false,"all_day":false,"start_date":"2024-12-04 10:30:00","start_date_details":{"year":"2024","month":"12","day":"04","hour":"10","minutes":"30","seconds":"00"},"end_date":"2024-12-04 11:30:00","end_date_details":{"year":"2024","month":"12","day":"04","hour":"11","minutes":"30","seconds":"00"},"utc_start_date":"2024-12-04 16:30:00","utc_start_date_details":{"year":"2024","month":"12","day":"04","hour":"16","minutes":"30","seconds":"00"},"utc_end_date":"2024-12-04 17:30:00","utc_end_date_details":{"year":"2024","month":"12","day":"04","hour":"17","minutes":"30","seconds":"00"},"timezone":"America\/Chicago","timezone_abbr":"CST","cost":"","cost_details":{"currency_symbol":"$","currency_code":"USD","currency_position":"prefix","values":[]},"website":"","show_map":false,"show_map_link":true,"hide_from_listings":false,"sticky":false,"featured":false,"categories":[{"name":"Seminar","slug":"seminar","term_group":0,"term_taxonomy_id":2,"taxonomy":"tribe_events_cat","description":"","parent":0,"count":758,"filter":"raw","id":2,"urls":{"self":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/tribe\/events\/v1\/categories\/2","collection":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/tribe\/events\/v1\/categories"}}],"tags":[],"venue":{"id":3661,"author":"976","status":"publish","date":"2024-12-02 08:35:42","date_utc":"0000-00-00 00:00:00","modified":"2024-12-02 08:35:42","modified_utc":"0000-00-00 00:00:00","url":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/venue\/https-wordpress-cels-anl-gov-cels-seminars-event-lans-seminar-163\/","venue":"https:\/\/wordpress.cels.anl.gov\/cels-seminars\/event\/lans-seminar-163\/","slug":"https-wordpress-cels-anl-gov-cels-seminars-event-lans-seminar-163","json_ld":{"@type":"Place","name":"https:\/\/wordpress.cels.anl.gov\/cels-seminars\/event\/lans-seminar-163\/","description":"","url":"","address":{"@type":"PostalAddress"},"telephone":"","sameAs":""},"show_map":false,"show_map_link":false,"global_id":"wordpress.cels.anl.gov\/lans-seminars?id=3661","global_id_lineage":["wordpress.cels.anl.gov\/lans-seminars?id=3661"]},"organizer":[],"custom_fields":[],"json_ld":{"@context":"http:\/\/schema.org","@type":"Event","name":"LANS Seminar","description":"<p>Seminar Title:Energy Efficient Implementation of the Transformer Architecture for Sequence Modeling using Spiking Neural Networks (SNN) Speaker:Adarsha Balaji, Postdoc, Mathematics and Computer Science Division, Argonne National Laboratory Date\/Time: December 4, 2024\/ 10:30 AM-11:30 AM Location:\u00a0See Meeting URL on the cels-seminars … <a href="https:\/\/wordpress.cels.anl.gov\/lans-seminars\/event\/lans-seminar-153\/">Continue reading <span class="meta-nav">→<\/span><\/a><\/p>\\n","url":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/event\/lans-seminar-153\/","eventAttendanceMode":"https:\/\/schema.org\/OfflineEventAttendanceMode","eventStatus":"https:\/\/schema.org\/EventScheduled","startDate":"2024-12-04T10:30:00-06:00","endDate":"2024-12-04T11:30:00-06:00","location":{"@type":"Place","name":"https:\/\/wordpress.cels.anl.gov\/cels-seminars\/event\/lans-seminar-163\/","description":"","url":"","address":{"@type":"PostalAddress"},"telephone":"","sameAs":""},"performer":"Organization"}}