I · Core
Core Theories & Frameworks
The common theoretical ideas and frameworks behind modern foundation models.
Topics
- Representation learning
- Transformers
- Autoregressive modelling
- Masked modelling
- Diffusion models
- Tokenisation
- Scaling laws & pre-training