Demonstrates, at very small scale, how a language model is trained (unigram language model).
python mkdocs teaching educational reproducibility language-model softmax-regression ruff computer-science-education n-gram probabilistic-model uv unigram-model pyright src-layout machine-learning-education next-token-prediction toy-gpt toy-model inspectable-model
-
Updated
Jan 19, 2026 - Python