eqho
/
LLM Lab
model
lab-tiny
the run
08 / 09
Lesson 08
From autocomplete to assistant
A base model finishes your sentence. A chat model answers you.
Next: Inference in production
01
How big is a model?
02
Text becomes tokens
03
Tokens become vectors
04
Attention
05
The transformer block
06
Predicting the next token
07
Training
08
From autocomplete to assistant
The base model
The chat template
Supervised fine-tuning
09
Inference in production
01 / 01
The base model
It only knows how to continue text. Ask it a question and it may write three more questions.
←
→
space