LLM Timeline

Timeline Color Key

Version: 0.42.0 (Work in Progress)

About this Timeline →
Foundation
Decoder-Only Models
Encoder-Only Models
Encoder-Decoder Models
Mixture-of-Experts
Open-Source Models
Alignment Techniques
Theoretical Advances
Multimodal Models
Hybrid Approaches
Reasoning Models
2017201820192020202120222023202420252026"Attention Is All You Nee...GPT-1: Generative Pre-Tra...BERT: Bidirectional Encod...GPT-2: Scaling UpT5: Text-to-Text Transfer...GPT-3: Few-Shot LearningRetrieval-Augmented Gener...Scaling Laws for Neural L...Switch Transformer (MoE)FLAN: Instruction TuningInstructGPT: RLHF Alignme...Chinchilla: Compute-Optim...ChatGPT: Conversational I...Constitutional AIMamba: State Space ModelsDALL-E 3Gemini Nano: On-Device Mo...Megatron-Turing NLGPaLM 2Claude 1Falcon LLMMidjourneyMeta's OPT: First Major O...Google's PaLMLLaMA 1: Meta's Open Rese...Stanford AlpacaGPT-4: Multimodal Capabil...Anthropic Claude 2LLaMA 2: Commercial Open-...Google's GeminiLlama 3Claude 3 Family: Opus, So...GPT-4o: Omni ModelClaude 3.5 SonnetGPT-4 Turbo with VisionMistral AI ModelsMicrosoft Phi SeriesClaude 3.7 SonnetCLIP: Contrastive Languag...OpenAI Sora: World Simula...Llama 4: Scout and Maveri...Gemini 1.5 Pro and FlashLlama 3.1OpenAI o1-previewQwen 2.5Llama 3.2Claude 3.5 Sonnet (New) a...Claude 3.5 HaikuOpenAI o1Gemini 2.0 FlashLlama 3.3 70BDeepSeek V3DeepSeek R1GPT-4.5Gemini 2.5 ProGPT-4.1OpenAI o3 and o4-miniQwen3Claude 4: Sonnet and OpusMagistralGemini 3.1 ProDeepSeek V4 PreviewClaude Opus 4.8