RumalGPT - Transformer Language Model From Scratch
2026A hands-on language-model engineering project focused on understanding the full training pipeline by building tokenization, transformer architecture, training loops, evaluation, checkpointing, and scaling experiments from scratch.