Tag: ml-engineering
All the articles with the tag "ml-engineering".
-
Intro to LLMs: The Whole Picture in One Post
A standalone map of large language models for beginners: how they evolved, how they are trained, how prompts and context windows work, how to pick one, and how to tell if the output is any good.
-
Distributed Training at Scale: Parallelism, Memory, and the Optimizer Stack
How DDP, tensor/pipeline/sequence parallelism, ZeRO/FSDP, activation recomputation, mixed precision, and the optimizer stack combine to train models no single GPU could hold.
-
Seq2Seq: Teaching Machines to Translate
The encoder-decoder architecture that powered translation before Transformers, the fixed-size bottleneck it created, and the idea that finally fixed it.
-
CNN, RNN, LSTM: The Road to Transformers
The architectures that came before Transformers, the limits they hit, and why each new design was needed to fix the previous one.