Tag: llm
All the articles with the tag "llm".
-
Intro to LLMs: The Whole Picture in One Post
A standalone map of large language models for beginners: how they evolved, how they are trained, how prompts and context windows work, how to pick one, and how to tell if the output is any good.
-
Distributed Training at Scale: Parallelism, Memory, and the Optimizer Stack
How DDP, tensor/pipeline/sequence parallelism, ZeRO/FSDP, activation recomputation, mixed precision, and the optimizer stack combine to train models no single GPU could hold.
-
Transformer Architecture & Key Design Decisions
A deep dive into the transformer architecture, why decoder-only models won, and the key design decisions — RoPE, GQA, Flash Attention, MoE — that define every modern LLM.
-
GenZ to AI Enz: Series Index
Full table of contents for the GenZ to AI Enz series - every post and walkthrough in order.