Express
AI Line
AI From Zero: Build a Neural Network with NumPy
Rated 4.7 out of 5 from 3 reviewsBeginner 18 lessons 503 students
Fare
€21
AI Line
New
Train a Small Language Model from Scratch
Build and train your own transformer language model in PyTorch, from tokenizer to text generation.
- Advanced
- 21 lessons · 4h 3m of video
- 147 students
- English
- Updated Oct 2026
The route
Curriculum
5 modules · 21 lessons · 4h 3m of video
-
1
41m
Tokenizers
4 lessons
-
2
58m
Attention from scratch
5 lessons
-
3
49m
The transformer block
4 lessons
-
4
1h 1m
Training at small scale
5 lessons
-
5
34m
Sampling and evaluation
3 lessons
Destination
What you will be able to do
- Build a byte-pair tokenizer
- Implement self-attention and transformer blocks
- Write a stable training loop
- Measure loss and perplexity
- Generate text with temperature and top-k sampling
Before you board
You will need
- Confident Python
- Basic understanding of neural networks
About this course
The journey
The best way to understand language models is to build one. You write every part yourself in PyTorch: a tokenizer, embeddings, self-attention, transformer blocks, the training loop and sampling.
Then you train a small model on a public-domain text collection on a single GPU or a free cloud notebook, measure it, and generate text with it. Nothing is hidden behind a library call.
Frequently asked questions
Still unsure about something? Write to our contact page and a human answers, usually the same working day.
Advanced. It assumes solid everyday experience with the language.
No. You pay once and keep lifetime access, including every future update to this course.
Yes. The preview video at the top of this page shows real code from the course being written and run.
Checkout is handled on our provider's secure payment page. The moment your payment clears we email your personal access link and access code to the address you used at checkout, and the same link appears in your account library. There is nothing to install and nothing to wait for.
Email within 14 days of your purchase, quote your order number, and we refund the full amount to your original payment method. No form to fill in and no questions about how much of the course you watched.
What students say
No reviews yet
Nobody has reviewed this course yet, so there is no score to show. Buy it, work through it, and your review could be the one that helps the next developer decide.
€97
EUR
One-time payment · lifetime access