MLn Club (ML Reading Group) #14: Inside vLLM: Anatomy of a High-Throughput LLM Inference System
🇺🇸 Pittsburgh,
United States
#1374
Nomad Score
6.5
Coords
40.4416941, -79.9900861
Likes
👍 0 👎 0
Actions
📅 MLN CLUB (ML READING GROUP) #14: INSIDE VLLM: ANATOMY OF A HIGH-THROUGHPUT LLM INFERENCE SYSTEM
Starts
Aug 24, 2026 11:00 PM
Ends
Aug 25, 2026 1:00 AM
Type
In person
Views
0
Category
🚀 Tech & Startups
City
🇺🇸 Pittsburgh
ICS URL
DESCRIPTION
Welcome to Week 14: Inside vLLM: Anatomy of a High-Throughput LLM Inference System When hyperscalers are pouring hundreds of billions into AI infrastructure, where does the money a...
Welcome to Week 14: Inside vLLM: Anatomy of a High-Throughput LLM Inference System
When hyperscalers are pouring hundreds of billions into AI infrastructure, where does the money actually go — and how much of it ends up as useful tokens per second?
If prefill is compute-bound and decode is memory-bound, how much of the world's GPU fleet is sitting idle by design, and who captures the value when the serving layer that fixes it is open source?
Join us at CASI for discussion at 8 pm, and (optional) quiet reading from 7 pm.
📖 Reading Recommendations, Questions, or Comments? Contact us here!…
Hosted by Chris Shi
When hyperscalers are pouring hundreds of billions into AI infrastructure, where does the money actually go — and how much of it ends up as useful tokens per second?
If prefill is compute-bound and decode is memory-bound, how much of the world's GPU fleet is sitting idle by design, and who captures the value when the serving layer that fixes it is open source?
Join us at CASI for discussion at 8 pm, and (optional) quiet reading from 7 pm.
📖 Reading Recommendations, Questions, or Comments? Contact us here!…
Hosted by Chris Shi
LINKS
Website
https://luma.com/b097uf0r
Registration
https://luma.com/b097uf0r
🔎 SOURCE
Imported From
Luma
Source City
Pittsburgh
Original Event
Open source event
https://luma.com/b097uf0r
SIMILAR EVENTS
| Event | Place | Date | |
|---|---|---|---|
| Run Club with Girls Who Run 😎💕 | 🇺🇸 New York | Aug 23 | View → |
| American Mahjongg — Lessons for Beginners | 🇺🇸 Washington D.C. | Aug 23 | View → |
| Paws In Progress | 🇺🇸 Los Angeles | Aug 23 | View → |
| Go Raw Walk | 🇺🇸 New York | Aug 23 | View → |
| Women in Design ATL: Coffee Chat | 🇺🇸 Atlanta | Aug 23 | View → |