{"id":3659,"date":"2024-12-02T08:36:20","date_gmt":"2024-12-02T14:36:20","guid":{"rendered":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/?post_type=tribe_events&#038;p=3659"},"modified":"2024-12-02T08:36:20","modified_gmt":"2024-12-02T14:36:20","slug":"lans-seminar-153","status":"publish","type":"tribe_events","link":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/event\/lans-seminar-153\/","title":{"rendered":"LANS Seminar"},"content":{"rendered":"<p><strong>Seminar Title:<\/strong>Energy Efficient Implementation of the Transformer Architecture for Sequence Modeling using Spiking Neural Networks (SNN)<\/p>\n<p><strong>Speaker:<\/strong>Adarsha Balaji, Postdoc, Mathematics and Computer Science Division, Argonne National Laboratory<\/p>\n<p><strong>Date\/Time:<\/strong> December 4, 2024\/ 10:30 AM-11:30 AM<br \/>\n<strong>Location:\u00a0<\/strong><em>See Meeting URL on the cels-seminars website which will require an Argonne login.<\/em><\/p>\n<p class=\"p1\"><strong>Description: <\/strong>Neuromorphic architectures implement bio-logical neurons and synapses to execute machine learning algorithms implemented using spiking neural network (SNN) based neurons, encoding and bio-inspired learning algorithms. These architectures are traditionally energy efficient and therefore, suitable for cognitive information processing on resource and power-constrained environments, ones where sensor and edge nodes of internet-of-things (IoT) operate.\u00a0In this talk, we will explore SNNs to design transformer models for vision and natural language modeling tasks. We will address the challenge of the inefficient and time-consuming training of large-scale SNNs using existing surrogate learning methods on existing digital accelerators. The proposed methodology explores principles of knowledge distillation for designing transformer-based SNN for inference.<\/p>\n<p><strong>Bio: <\/strong>Adarsha Balaji is a postdoc at the Mathematics and Computer Science division at Argonne National Laboratory. He received his master\u2019s and Ph.D. degree from Drexel University, Philadelphia in 2021 with a focus of the hardware software co-design of Neuromorphic Systems. His current research interests include modeling large-scale SNN for scientific tasks and the hardware-software design space exploration of neuromorphic computing systems, particularly data-flow and power-optimization of spiking neural networks (SNN) hardware.<\/p>\n<p class=\"p1\"><em>Please note that the meeting URL for this event can be seen on the cels-seminars website which requires an Argonne login.<\/em><\/p>\n<div class=\"tribe-events-single-event-description tribe-events-content\">\n<p>See all upcoming talks at\u00a0<a href=\"https:\/\/www.anl.gov\/mcs\/lans-seminars\">https:\/\/www.anl.gov\/mcs\/lans-seminars<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Seminar Title:Energy Efficient Implementation of the Transformer Architecture for Sequence Modeling using Spiking Neural Networks (SNN) Speaker:Adarsha Balaji, Postdoc, Mathematics and Computer Science Division, Argonne National Laboratory Date\/Time: December 4, 2024\/ 10:30 AM-11:30 AM Location:\u00a0See Meeting URL on the cels-seminars &hellip; <a href=\"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/event\/lans-seminar-153\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":976,"featured_media":0,"template":"","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_tribe_events_status":"","_tribe_events_status_reason":"","footnotes":""},"tags":[],"tribe_events_cat":[2],"class_list":["post-3659","tribe_events","type-tribe_events","status-publish","hentry","tribe_events_cat-seminar","cat_seminar"],"acf":[],"_links":{"self":[{"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/tribe_events\/3659","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/tribe_events"}],"about":[{"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/types\/tribe_events"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/users\/976"}],"version-history":[{"count":2,"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/tribe_events\/3659\/revisions"}],"predecessor-version":[{"id":3662,"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/tribe_events\/3659\/revisions\/3662"}],"wp:attachment":[{"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/media?parent=3659"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/tags?post=3659"},{"taxonomy":"tribe_events_cat","embeddable":true,"href":"https:\/\/wordpress.cels.anl.gov\/lans-seminars\/wp-json\/wp\/v2\/tribe_events_cat?post=3659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}