What Is a Large Language Model?

Key Takeaways

The Simple Answer

A Large Language Model (LLM) is a computer program trained to understand and generate human language. It learned by reading enormous quantities of text, books, articles, websites, code, scientific papers, and learning to predict what word comes next in any sequence. That simple task, repeated billions of times on trillions of words, produces a system capable of writing, reasoning, coding, and conversation.

The 'large' in LLM refers to two things: the size of the model itself (modern LLMs have billions to trillions of numerical parameters, or weights) and the scale of training data (trillions of tokens, roughly equivalent to millions of books). Scale is what makes these models capable, the same architecture trained on 10x more data and compute produces qualitatively different, more capable results.

What Makes LLMs Different from Earlier AI

Before LLMs, most AI systems were narrowly specialized: a sentiment classifier could only classify sentiment, a translation model could only translate. These systems required labeled training data for each specific task and couldn't generalize beyond what they were explicitly trained for.

LLMs are general-purpose: a single model can write Python, explain quantum mechanics, translate French, summarize legal contracts, and play chess, without any task-specific training. This generality emerged spontaneously from training at scale, which is why researchers call capabilities like Few-Shot learning and Chain of Thought reasoning 'emergent', they appear unpredictably as models grow larger. The large pretrained model is called a Foundation Model; after instruction tuning it becomes an Instruct Model aligned to follow user requests.

What LLMs Can and Can't Do

LLMs excel at: generating fluent text in any style or format, summarizing and extracting information from documents, writing and explaining code, translating languages, answering questions based on provided context, and reasoning through multi-step problems when prompted correctly. They are pattern-completion engines of extraordinary breadth.

LLMs struggle with: precise arithmetic (without tools), accessing real-time information (without retrieval), consistently avoiding fabrication (they can hallucinate convincing but false facts), maintaining perfect consistency over very long outputs, and tasks requiring formal guarantees. Understanding these limits is essential to building reliable systems with LLMs.

How LLMs Learn

LLMs are trained using self-supervised learning: the model is given a sequence of text with the last word hidden, makes a prediction, compares its prediction to the actual word, and adjusts its weights to do better next time. No human labels are needed, the training signal comes from the text itself. This simple procedure, applied at massive scale, is responsible for all of an LLM's capabilities.

After this initial pre-training phase, most deployed models undergo additional alignment training, fine-tuning on human-written instructions and feedback (RLHF) that teaches the model to be helpful, to follow directions, and to avoid harmful outputs. This alignment step is what transforms a raw text predictor into the helpful assistant you interact with through a chat interface.

The Architecture Behind It All

All modern LLMs are built on the Transformer architecture, introduced by Google researchers in 2017. The key innovation is the attention mechanism, a mathematical operation that lets every word in a sequence 'look at' every other word to understand context. This gives transformers the ability to understand relationships between words regardless of how far apart they are in the text.

Transformers also train efficiently on parallel hardware (GPUs and TPUs), which is what enabled the scaling from millions to billions to trillions of parameters over just a few years. The combination of the attention mechanism's expressiveness and its GPU-friendliness is why the transformer became the dominant architecture in AI almost overnight.

The LLM Landscape Today

The major LLM providers include OpenAI (GPT-4o, o3, GPT-5), Anthropic (Claude 4 family), Google (Gemini 2.5), Meta (Llama 4), Mistral AI, DeepSeek, xAI (Grok), and Alibaba (Qwen). Each has distinct strengths, pricing models, and licensing terms. Some models are closed (API-only), others are open-weight and can be downloaded and self-hosted.

The pace of progress has been remarkable: models released today would have seemed impossible just three years ago. Understanding how these systems work, and where they're headed, is increasingly essential knowledge for anyone working in technology, business, or research.