Tag: transformers

All the articles with the tag "transformers".

• Transformer Architecture & Key Design Decisions

  6 May, 2026

  A deep dive into the transformer architecture, why decoder-only models won, and the key design decisions — RoPE, GQA, Flash Attention, MoE — that define every modern LLM.