PRETRAIN #1: Build a GPT
- When
- Europe/Zurich (GMT+1)until 20:30
- Where
- Zurich, ZHZurich, ZH
Tickets are sold on Luma. We link straight to the listing — nothing is bought here. Listing details come from the source and can change. Eventovia indexes events; it does not organize them or sell tickets. Terms & Disclaimer
PRETRAIN #1: Build a GPT takes place on Wed, 2 Dec 2026 at 17:00 (GMT+1) in Zurich, ZH, and runs until 20:30. Entry is free; the listing is on Luma.
About this event
In this hands-on workshop, participants build a GPT line by line in PyTorch to generate text from raw data. Attendees tokenize datasets, implement self-attention, train small models on laptops or free GPUs, and sample outputs while learning about tokens and next-token prediction.
Čeština · Deutsch · Deutsch · Español · Español · Français · Français · Français · Italiano · 日本語 · 한국어 · Nederlands · Português · Português · 中文
Full description from organizerShow less
ChatGPT, Claude and Gemini all rest on the same core: an autoregressive transformer that predicts the next token. In this hands-on workshop, you’ll build one yourself, line by line, in PyTorch. You’ll go from raw text to a working model that generates text of its own. By the end, attention, tokens and “next-token prediction” won’t be buzzwords anymore. You’ll know exactly how a GPT works, because you wrote one. What you’ll do• Tokenize a text dataset and set up the training data• Implement self-attention and a transformer block• Train a small GPT on a laptop or free GPU• Sample from your model and see what it learned Who it’s for: Students and builders who are comfortable with:• Python, ideally with some PyTorch basics (tensors, a training loop, .backward())• Basic linear algebra and analysis• Basic probability (distributions, sampling, Gaussians)• ML fundamentals: training vs. test set, overfitting, what a neural network is, and gradient descent at an intuitive level Bring: A laptop. We’ll share a notebook and starter repo.
Keep going
All Zurich events →Similar events
View all →











Details
- When
- Wed, 2 Dec 2026 · 17:00 (GMT+1) · until 20:30
- Where
- Zurich, ZH
- Price
- Free
- Genre
- ai
- Weather
- -2°C · Mainly clear · 28% precipForecast at 17:00 (GMT+1)
Questions
- When is PRETRAIN #1: Build a GPT?
- Wed, 2 Dec 2026 at 17:00 GMT+1.
- How much are tickets for PRETRAIN #1: Build a GPT?
- Entry is free.
- Where is PRETRAIN #1: Build a GPT?
- Zurich, ZH.
- Where can I buy tickets for PRETRAIN #1: Build a GPT?
- Tickets are sold on Luma. This page links straight to that listing; no tickets are sold here.
- What time does PRETRAIN #1: Build a GPT end?
- It runs until 20:30.
