The Toronto ML Systems Group: Transformer Accounting

Come hang out with The Toronto ML Systems Group for an evening on Transformer Accounting. Here, we intend to build a deep intuition around transformer math and what parameters cost in data, compute, memory, and GPU time. This is an interactive session, please bring your laptop!

This is the fifth session of The Toronto ML Systems Group , a recurring meetup for people who are new to or working in ML Systems and want to get serious about the full stack: chips, compilers, kernels, model architectures, distributed training, inference optimization, and everything in between.
Relevant resources:…

Hosted by Melani Maheswaran, Shashank Shekhar & Ambition