Tag: llm
All the articles with the tag "llm".
-
Distributed Training at Scale: Parallelism, Memory, and the Optimizer Stack
How DDP, tensor/pipeline/sequence parallelism, ZeRO/FSDP, activation recomputation, mixed precision, and the optimizer stack combine to train models no single GPU could hold.
-
Transformer Architecture & Key Design Decisions
A deep dive into the transformer architecture, why decoder-only models won, and the key design decisions — RoPE, GQA, Flash Attention, MoE — that define every modern LLM.
-
GenZ to AI Enz: Series Index
Full table of contents for the GenZ to AI Enz series - every post and walkthrough in order.
-
GenZ to AI Enz: A Roadmap for CS Grads Breaking into AI
A complete series taking CS students and early-career engineers from zero ML knowledge to building real AI systems with LLMs and agents.