Module 12: Future of LLMs
Where Large Language Models are headed.
Chapters
- Scaling Laws and Limits: Chinchilla, compute-optimal training
- Emerging Architectures: State space models, Mamba, alternatives
- The Road to AGI: Current capabilities vs AGI, timelines