More from Events Calendar
- Mar 410:30 AMFirst Time and Expecting ParentsThe first 2 sessions in March will be held on Zoom.Meet other expecting and first time parents of infants under one year to connect, share information, and support each other. Bring your concerns, questions, and experiences to the group. And of course, your babies are welcome! This peer led group is organized by MS&PC members Kathrin and Maria.Contact Kathrin hauserkathrin1994@gmail.com or Maria maria.korompili24@gmail.com for more information.
- Mar 411:30 AMFood Trucks in the Kendall/MIT Open Space
- Mar 412:00 PMCog Lunch: Cheng TangZoom Link: https://mit.zoom.us/j/99672193351Speaker: Cheng TangAffiliation: Jazayeri lab, 4th year PhD candidate (system neuroscience)Title: An explainable transformer circuit for compositional generalizationAbstract: Compositional generalization—the systematic combination of known elements into novel ensembles— is a hallmark of human cognition, enabling flexible problem-solving beyond rote memorization. While transformer models exhibit surprising proficiency in such tasks (Lake et al., 2023), the underlying mechanisms remain poorly understood. In this case study, we reverse-engineer how a transformer achieves compositional generalization at the circuit level, focusing on a function-primitive composition task. In this task, the model infers functions from teaching examples (e.g., interpreting “apple kiki → apple apple” to deduce that “kiki” means double) and generalizes them to new primitives (e.g., applying “kiki” to “tree” to produce “tree tree”). Our trained transformer achieves high test accuracy (~98%), demonstrating robust generalization.In the first half of the presentation, I will introduce the basics of transformer and provide an intuitive account on how attention operations perform information-routing between tokens with a slot-like data structure. Then I will present the human-interpretable algorithm implemented by the model, walk through the circuit discovery procedure, and highlight the correspondence between attention heads and the algorithm’s steps. Lastly, I will show causal perturbation experiments that validates the reverse-engineered circuit. This presentation aims to demystify the black-box impression of transformers to audience in neuroscience and invite discussion between model understanding and model control.
- Mar 412:00 PMOnline Seminar On Undergraduate Mathematics EducationSpeakers: Matt Charnley (Rutgers University)Title: Our PerspectiveAbstract: As interest in STEM fields has grown over the last few decades, enrollment in introductory STEM courses has substantially increased, resulting in either larger sections of these classes or more of them. With increased enrollment in these courses, ensuring consistency and quality across multiple sections has become a widespread challenge. Course coordination has been widely implemented as a structured approach to address this issue. In this talk, we will discuss the literature surrounding course coordination, how it works, and what benefits it can bring to courses and departments. I will also share initial results from a survey of course coordinators that I and several of my colleagues sent to coordinators in our STEM departments to get their understanding of their role as course coordinators, opinions on the role, as well as common challenges or great successes that they had.
- Mar 412:00 PMStructure and function of the norepinephrine systemWhitehead Institute Innovation Intiative Structure and function of the norepinephrine system Presented by Karel Svoboda, Director, Allen Institute for Neural Dynamics12:00 - 1:00 pm Whitehead Institute 455 Main Street Cambridge, MA 02142SCHEDULE 11:30 AM Lunch available - Lobby, 1st floor 12:00 PM Seminar - Audittorium, 1st floor 1:00 PM Dessert and coffee - Library, 2nd floorFor questions, email events@wi.mit.edu.
- Mar 412:10 PMTunnel Walk sponsored by getfitWant to get exercise mid-day but don’t want to go outside? Join the tunnel walk for a 30-minute walk led by a volunteer through MIT’s famous tunnel system. This walk may include stairs/inclines. Wear comfortable shoes. Free.Location details: Meet in the atrium by the staircase. Location photo below.Tunnel Walk Leaders will have a white flag they will raise at the meeting spot for you to find them.Prize Drawing: Attend a walk and scan a QR code from the walk leaders to be entered into a drawing for a getfit tote bag at the end of the getfit challenge. The more walks you attend, the more entries you get. Winner will be drawn and notified at the end of April. Winner does not need to be a getfit participant.Disclaimer: Tunnel walks are led by volunteers. In the rare occasion when a volunteer isn’t able to make it, we will do our best to notify participants. In the event we are unable to notify participants and a walk leader does not show up, we encourage you to walk as much as you feel comfortable doing so. We recommend checking this calendar just before you head out. [As of Feb 12, this calendar is defaulting to the year 1899. Click "today" to be brought to the current month.]Getfit is a 12-week fitness challenge for the entire MIT community. These tunnel walks are open to the entire MIT community and you do not need to be a current getfit participant to join.