Zurich, ZH

PRETRAIN #1: Build a GPT

When
Europe/Zurich (GMT+1)until 20:30
Where
Zurich, ZHZurich, ZH

Tickets are sold on Luma. We link straight to the listing — nothing is bought here. Listing details come from the source and can change. Eventovia indexes events; it does not organize them or sell tickets. Terms & Disclaimer

PRETRAIN #1: Build a GPT

PRETRAIN #1: Build a GPT takes place on Wed, 2 Dec 2026 at 17:00 (GMT+1) in Zurich, ZH, and runs until 20:30. Entry is free; the listing is on Luma.

About this event

In this hands-on workshop, participants build a GPT line by line in PyTorch to generate text from raw data. Attendees tokenize datasets, implement self-attention, train small models on laptops or free GPUs, and sample outputs while learning about tokens and next-token prediction.

Čeština · Deutsch · Deutsch · Español · Español · Français · Français · Français · Italiano · 日本語 · 한국어 · Nederlands · Português · Português · 中文

Full description from organizer

ChatGPT, Claude and Gemini all rest on the same core: an autoregressive transformer that predicts the next token. In this hands-on workshop, you’ll build one yourself, line by line, in PyTorch. You’ll go from raw text to a working model that generates text of its own. By the end, attention, tokens and “next-token prediction” won’t be buzzwords anymore. You’ll know exactly how a GPT works, because you wrote one. What you’ll do• Tokenize a text dataset and set up the training data• Implement self-attention and a transformer block• Train a small GPT on a laptop or free GPU• Sample from your model and see what it learned Who it’s for: Students and builders who are comfortable with:• Python, ideally with some PyTorch basics (tensors, a training loop, .backward())• Basic linear algebra and analysis• Basic probability (distributions, sampling, Gaussians)• ML fundamentals: training vs. test set, overfitting, what a neural network is, and gradient descent at an intuitive level Bring: A laptop. We’ll share a notebook and starter repo.

Tickets
Luma
Organizer
ETH AI Club
Time zone
GMT+1
Updated

Similar events

View all →

Details

When
Wed, 2 Dec 2026 · 17:00 (GMT+1) · until 20:30
Where
Zurich, ZH
Price
Free
Genre
ai
Weather
-2°C · Mainly clear · 28% precipForecast at 17:00 (GMT+1)

Questions

When is PRETRAIN #1: Build a GPT?
Wed, 2 Dec 2026 at 17:00 GMT+1.
How much are tickets for PRETRAIN #1: Build a GPT?
Entry is free.
Where is PRETRAIN #1: Build a GPT?
Zurich, ZH.
Where can I buy tickets for PRETRAIN #1: Build a GPT?
Tickets are sold on Luma. This page links straight to that listing; no tickets are sold here.
What time does PRETRAIN #1: Build a GPT end?
It runs until 20:30.

Keep browsing