🌟 vLLM Inference Meetup in Vienna 🌟

Join us for an engaging vLLM Inference Meetup hosted by Red Hat AI, NVIDIA, NTS, and Canva! This exciting event is scheduled for 12 March 2026 at NTS NETZWERK TELEKOM SERVICE AG, Vienna, Austria.

A special thanks to NTS Netzwerk Telekom Service AG for providing the venue! Don't miss out on their NTS Data Day happening earlier the same day—learn more here.

What to Expect

• Deep Technical Sessions from vLLM maintainers and users operating at scale
• Live Demos showcasing real-world workflows
• Hands-On Workshop earlier in the day
• Excellent Networking opportunities with food and drinks 🍽️

Who Should Attend

• vLLM users and contributors
• ML and infrastructure engineers focused on inference and serving
• Platform teams managing GenAI in production
• Anyone interested in efficient inference strategies across local, cloud, and Kubernetes

Agenda

Optional Workshop

• 15:30 — Doors Open (Workshop Attendees)
• 16:00 – 17:00 — Hands-On Workshop: Latest GenAI Compressing Techniques in Practice

Meetup Program (Subject to Modification)

• 17:00 – 17:30 — Doors Open, Check-In
• 17:30 – 17:40 — Welcome and Opening Remarks
• 17:40 – 18:00 — Intro to vLLM and Project Update
• 18:00 – 18:20 — Transforming LLM Quantization
• 18:20 – 18:40 — A Brief Tutorial on Speculative Decoding
• 18:40 – 19:10 — Tackling Inference at Scale with vLLM, NVIDIA Dynamo, and llm-d
• 19:10 – 19:20 — Coffee & Tea Break ☕
• 19:20 – 19:40 — Communications in MoE Architectures
• 19:40 – 20:00 — Real-World vLLM Case Study from Canva: Wins and Challenges in Hosting LLMs for 260 Million Monthly Users
• 20:00 – 21:00 — Networking, Food, and Drinks 🎉

Important Information

• The agenda is subject to change; additional demos or lightning updates may be added.
• Registration closes 24 hours prior to the event; please ensure you're registered to attend.
• Don’t forget to bring a photo ID to verify your registration upon arrival.

We can’t wait to see you in Vienna! If you're involved in building, deploying, or scaling inference, this is a must-attend event! 🎊

Find out more about the event here!