← ALL PACKS
AIFREE AIFREE AIFREE AIFREE AIFREE AIFREE
SKILL PACKAI
Andrej Karpathy
Curated by Andrej Karpathy
Expert knowledge from Andrej Karpathy — 6 skills extracted from podcast/video content
6 skills
▶ SKILLS IN THIS PACK (6)
AIFREEBuilding a Transformer Language Model from Scratch
character level tokenizationself attentionmatrix multiplication
10 principlesVIEW →
AIFREEBuilding and Understanding Large Language Models from Internet Text to Conversational Assistant
tokenizationpre trainingpost training
14 principlesVIEW →
AIFREEBuilding the GPT Tokenizer with Byte Pair Encoding
byte pair encodingutf8 encodingregex pre tokenization
12 principlesVIEW →
AIFREEPractical LLM Usage: From Zip-File Knowledge to Tool-Augmented Reasoning
new chat per topicmodel tier selectionthinking model toggle
10 principlesVIEW →
AIFREELarge Language Models as Emerging Operating Systems
next word predictionpre trainingfine tuning
14 principlesVIEW →
AIFREEReproducing GPT-2 (124M) from scratch in PyTorch
decoder only transformerpre layer normmulti head self attention
12 principlesVIEW →
Want to explore more?