Local / Private AI — Your Brain, Your Machine, Your Rules

Alibaba's latest 27B dense model doesn't just succeed the previous local AI king — it surpasses their own 397B flagship on every major agentic coding benchmark while running on a single consumer GPU. SWE-bench Verified 77.2, Terminal-Bench 2.0 59.3, native vision and video, Apache 2.0. The local inference turning point.

Beats Qwen3.5-397B-A17B (a 397B MoE model) on SWE-bench Verified (77.2), SWE-bench Pro (53.5), Terminal-Bench 2.0 (59.3), and SkillsBench Avg5 (48.2). GPQA Diamond 87.8. Native multimodal with thinking preservation. r/LocalLLaMA calls it "the biggest release of the year" and "a turning point for local inference."

Similar VRAM profile to predecessor (~17–20 GB in 4-bit); very new so quantized options are still rolling out; thinking mode can be verbose on simpler tasks (toggleable). Not quite closed-model SOTA on the absolute hardest long-horizon agent runs.

Moonshot AI's trillion-parameter open-weight beast — a Mixture-of-Experts colossus that only fires 32 billion parameters per token, yet sweeps agentic coding benchmarks harder than most closed models. Open weights, multimodal input, 256K context, and agent swarms that coordinate hundreds of sub-agents. The frontier just went open.

SWE-Bench Pro 58.6 (beats GPT-5.4 and Claude Opus 4.6), Terminal-Bench 66.7, BrowseComp 83.2, HLE-Full with tools 54.0. Artificial Analysis ranks it #4 overall — the highest any open model has ever reached. Multimodal vision input where GLM-5.1 was text-only.

One trillion total parameters means ~600+ GB VRAM even at INT4 — this is not a laptop model. You'll use it via API ($0.95/M input tokens) or self-host on enterprise GPU clusters. Real-world vibe-coding tests show occasional polish gaps. Token usage runs high on long agentic sessions.

Google's answer to 'what if a frontier AI ran on your phone?' Gemma 4 isn't one model — it's a family of four, from a 2-billion-parameter edge model that fits in 1.5 GB of RAM to a 31-billion-parameter dense powerhouse. The E2B and E4B variants bring multimodal intelligence — text, images, and audio — to smartphones, without an internet connection.

E4B scores 42.5% on AIME 2026, doubling the previous generation's 27B model. Full Apache 2.0 license. Native audio input on edge models. 140+ language support. Four distinct sizes covering every deployment scenario from Raspberry Pi to workstation.

Smaller edge models (E2B, E4B) lack the raw reasoning depth of desktop-class models. No video input on the edge variants (only 26B and 31B). Google ecosystem tooling preferred — less out-of-the-box compatibility with non-Google deployment stacks.

Alibaba's 27B hybrid monster runs on a single 24 GB GPU and genuinely competes with cloud frontier models — vision, coding, 262K context, and 201 languages, all Apache 2.0 licensed. The first local model where you stop compromising.

Benchmark-leading in its class (GPQA 85.5, SWE-Bench 72.4, LiveCodeBench 80.7). First local model with real multimodal — vision, video, OCR. Excellent agent and tool-calling. r/LocalLLaMA calls it "the new daily driver."

Needs ~17–18 GB VRAM in 4-bit — great on 24 GB cards, tight on 16 GB setups. Thinking mode on by default (easy to turn off). Not quite frontier-closed-model level on the absolute hardest multi-turn agent tasks.