In late August 2026, an anonymous model labeled ox-alpha appeared on OpenRouter with a free endpoint, a 1M-token context window, and early reports of strong coding and tool-use performance. For six days it climbed the leaderboards while the internet guessed who made it. Then Z.ai stepped forward: it was GLM-5.3-Flash, and the launch post contained a sentence that had nothing to do with benchmarks:
“It quickly became the most popular model of the week, with all of this traffic served on Chinese AI chips.”
This guide begins with that sentence. A frontier-class model, 320B parameters, 1M context, image and video inputs, ran a week of internet-scale traffic on hardware that isn't NVIDIA, and priced itself at $0.15 per million input tokens (50% launch promo: $0.075). A million tokens is roughly 750,000 English words, or several long books. At the launch price, reading that much text costs seven and a half cents.
A price like that is not a discount decision, it's an architecture. Nothing about serving a model is free: every token someone sends has to be read by the whole network, every token of conversation history has to be remembered, and every output token has to be computed. Most models pay full price for all three. GLM-5.3-Flash quietly stopped paying for most of it, and this series is a guided dissection of exactly where the money went. This chapter is the tour; the next seven take the machine apart, mechanism by mechanism, until that price looks inevitable instead of impossible.
The internet didn't wait for the reveal, by the way. Before Z.ai said a word, users on r/LocalLLaMA ran roughly 60 probe strings through the anonymous endpoint. A tokenizer, the component that chops text into tokens, leaves fingerprints in odd places: how it counts emoji, whether it merges certain word pairs, which rare character sequences it splits. Match those quirks against every known model's tokenizer and you can guess the family tree without any announcement. The probe results all pointed at GLM. When the launch post dropped, the prediction was already on the board. The Hacker News thread hit 1,129 points / 576 comments in a day; the top question was predictably: “is it cheaper than DeepSeek?” (Short answer: yes. Chapter 6 shows the arithmetic.)
The family, at a glance
Flash isn't a distilled mini of the GLM-5 flagship, it's a deliberate redesign down the same research lineage. One vocabulary note before the table: this is a Mixture-of-Experts (MoE) model, which means its 320B parameters are not one giant brain but a shelf of 288 smaller specialist networks, called experts, plus a tiny traffic controller called a router that wakes only the handful of specialists each token needs. So every MoE model carries two parameter counts: total (everything on the shelf) and active (the ones actually working on your token). The gap between those two numbers is where most of this series lives. Watch the pattern across three generations:
Compare the two shelf sizes and something odd jumps out: Flash actually carries a similar amount of inventory to GLM-4.5 (320B vs 355B). What changed is the staffing. Only 18B parameters wake per token, half of GLM-4.5's 32B, and the model runs 45 layers instead of 92, so a token makes half as many stops on its way through. Every one of those decisions exists to serve one goal: intelligence per watt per dollar. The other half of the story is what it ships as. The published checkpoint is native FP8 (a compact 8-bit number format the model was trained in, not squeezed into after the fact), released under the MIT license, which means anyone can run it, modify it, or build a business on it with no permission asked. It takes text, images, and video as input and produces text, with reasoning always on: you pick the effort level (low / high / max) the way you would pick a speed setting on a drill. The next chapters show the cheaper attention scheme that made the halving possible.
The machine we're dissecting
Everything from here on hangs off this one picture. A token flows up through 45 layers, and each layer does two jobs: attention (deciding which earlier tokens matter) and feed-forward computation (thinking about what it just read). GLM-5.3-Flash splits the attention job unevenly. Three of every four layers use linear attention, a scheme that keeps a fixed-size running summary of everything seen so far, cheap and constant in cost no matter how long the conversation gets. The remaining one in four uses sparse attention, which does the full precise job but only looks at the handful of earlier tokens that actually matter. And in most layers, a tiny router wakes only 8 of 288 feed-forward experts. Each part exists to delete work nobody needs done, and that's the whole thesis of the model.
The router gets its own chapter next. Choose a prompt there and see which experts it wakes.
The route map
Here is the order of the dissection. Each chapter takes one component, explains what problem it solves, and shows the receipts.
- Ch 2, the 18B trick: mixture-of-experts, and who decides what wakes up
- Ch 3, attention rewired: linear + sparse, and the lightning indexer
- Ch 4, the memory squeeze: how 1M context fits in gigabytes, not terabytes
- Ch 5, two tokens per step: multi-token prediction
- Ch 6, anatomy of the price: every discount stacked into one waterfall
- Ch 7, any chip will do: the Chinese-silicon week, and the math behind it
- Ch 8, does it deliver? scores, receipts, and honest caveats