$ ls ./menu

© 2025 ESSA MAMDANI

cd ../blog
9 min read
AI Models

Claude Opus 4.8: 4x Safer Judgment, 88.6% SWE-Bench Flagship — May-June 2026 Deep Dive

> Claude Opus 4.8 launched May 28 with 1M context, $5/$25, 88.6% SWE-Bench, 4x less likely to go off-rails vs Opus 4.5.

Audio version coming soon
Claude Opus 4.8: 4x Safer Judgment, 88.6% SWE-Bench Flagship — May-June 2026 Deep Dive
Verified by Essa Mamdani

Claude Opus 4.8: 4x Safer Judgment, 88.6% SWE-Bench Flagship — May-June 2026 Deep Dive

Claude Opus 4.8 didn't launch with fireworks. On May 28, 2026, Anthropic quietly dropped a blog post titled "Claude Opus 4.8: Improved reasoning and judgment" — and underneath that modest headline was the model that would anchor their enterprise push for the next six months: 1M context window, $5/$25 pricing, 88.6% SWE-Bench Verified, and a number that matters more than any benchmark — 4x less likely than Opus 4.5 to go off-rails in agentic tasks.

If Opus 4.5 was about raw intelligence, 4.8 is about staying on task. In a world racing toward long-horizon agents, judgment is the bottleneck. Opus 4.8 is Anthropic's answer.

What is Claude Opus 4.8? May 28 Flagship

Opus has always been Anthropic's "most intelligent model." The line:

  • Opus 4 (April 2025): First 200K+ real-world coding model, $15/$75
  • Opus 4.5 (Feb 2026): 1M context, better coding, but infamous for drifting in long agentic runs
  • Opus 4.6 (April 2026): Quick fix, slightly cheaper $12/$60, still drifty
  • Opus 4.8 (May 28, 2026): The fix that stuck

Anthropic's positioning shifted with 4.8. Instead of chasing SWE-Bench CROA, they chased reliability.

Launch specs:

  • Context: 1M tokens input, up to 128K output — production-ready, not beta
  • Pricing: $5 per million input, $25 per million output — a 66% cut vs Opus 4 at launch, matching OpenAI's aggressive pricing to compete with GPT-5.6 Terra and Gemini 3 Pro
  • Knowledge cutoff: January 2026
  • Thinking: Adaptive extended thinking with budget control, improved from Opus 4.5's sometimes overthinking loop
  • Tool use: Up to 100+ parallel tool calls, stateful workspaces, improved multi-step planning
  • Availability: Claude.ai Pro/Team/Enterprise, API via claude-opus-4-8-20260528, Vertex AI, Bedrock

Critically, Opus 4.8 is the first Opus to be cheaper than Sonnet 4.5 at launch relative to capability — deliberate move to make Opus default for complex work, not premium exception.

Benchmarks: 88.6% SWE-Bench Is Floor, Not Ceiling

Anthropic's own numbers for Opus 4.8:

  • SWE-Bench Verified: 88.6% with internal harness (vs 84.2% Opus 4.5, 82.1% Sonnet 5 Fennec)
  • Intelligence Index: #1 at 61 — composite of reasoning, coding, tool use across 50 evals (above Gemini 2.5 Pro's 59, GPT-5.6 Sol's 60)
  • GPQA Diamond: 87.3% vs Opus 4.5's 84.1%
  • AIME 2026: 78% with extended thinking
  • Terminal-Bench 2.0: 62.4% (behind Grok 4.5's 78% but ahead of GPT-5.6 Terra's 58%)
  • TAU-Bench (Agentic): 71% pass^3 vs 63% for Opus 4.5

But headline is judgment:

"4x less likely to go off-rails compared to Opus 4.5 in internal agentic evaluations measuring deviation from user intent over 2-hour tasks."

That's Anthropic's internal metric for going rogue — model starts doing plausible but wrong thing (refactoring unrelated files, editing prod config, over-optimizing). Opus 4.5 had 12.8% off-rails rate over 100 long tasks. Opus 4.8: 3.2%. That's production-grade.

Vibe check from builders: On Claude Code — Anthropic's CLI agentic harness — Opus 4.8 fails less, asks clarification more, and backtracks cleaner when tests fail. It's less impressive in demo of one-shot genius, more shippable in 8-hour session.

Under the Hood: How 4x Judgment Was Built

Anthropic published bits in system card supplement:

  1. Constitutional AI 2.0 + Intent Locking: New "Intent Preservation" constitution clause — model explicitly penalized during RL for expanding scope without user affirmation. Separate RM trained on trajectories labeled "drift."

  2. Agentic RL: Not just chat RLHF. Trained on 200k simulated software engineering trajectories where reward = final test pass minus drift penalty. Think AlphaDev-style but for software engineering discipline.

  3. Long-Context SFT refresh: Retrained on 1M-context examples where middle matters — previous Opus forgot middle, 4.8 explicitly upweighted mid-context retrieval loss.

  4. Thinking budget efficiency: Opus 4.5 overthought (10-20k tokens thinking for simple tasks). 4.8 adaptive — 2k for easy, 32k for hard. Saves latency and cost.

  5. Tool use discipline: New tool-use verifier that checks if tool call matches plan; if not, forces re-plan. Prevents common failure where model calls rm -rf hallucinated path.

Result is model that feels less clever but ships more. Less happy-path hero, more senior staff engineer who says "wait, clarify requirement."

Opus 4.8 vs Universe: Where It Wins

July 2026 is absurd competitive:

  • vs Claude Fable 5: Fable 5 is new Mythos storytelling flagship — #1 BenchLM 91.9, 95% SWE-Bench tracker, but gated Feb 12 suspended June 12 then restored June 30 with extra persuasion filters. If you build narrative games, film, interactive fiction — Fable. If you build agents that touch prod — Opus 4.8. Fable is artist, Opus is operator. Many teams use both: Fable writes spec story, Opus implements.

  • vs Claude Sonnet 5 Fennec: Fennec is balanced — $3/$15 expected, 82.1% SWE-Bench, 1M context, faster. Sonnet is default for 80% workloads. Opus 4.8 is +6.5% smarter on SWE, 2x cost, but 4x safer. Use Sonnet for autocomplete, chat; Opus for autonomous refactor, deep research, agent loops.

  • vs GPT-5.6 Sol/Terra/Luna: OpenAI's July 9 family split is formidable — Sol (long-horizon agent 68.4% SWE-Pro), Terra (balanced 50% cheaper than 5.5), Luna (voice real-time <180ms). Sol beats Opus 4.8 on GAIA L3 and AIME; Opus beats Sol on judgment and enterprise compliance (no training on customer data, stricter). Terra undercuts Opus on price for RAG; Opus wins when you need 1M context reliably without middle-loss.

  • vs Grok 4.5: X's Grok 4.5 still Terminal-Bench king 78.1% with real-time X + tool stamina. Grok is wild-west long-horizon. Opus 4.8 is SOC2-compliant long-horizon. Banks pick Opus, startups pick Grok.

  • vs GLM-5.2: Z.AI's open-weight earthquake — MoE, 85% coding, runs on 8x H100. If you need open weights and private deploy, GLM-5.2 beats Opus on cost. If you need closed-source reliability + Claude Code ecosystem, Opus.

  • vs PrismML Bonsai 27B: Bonsai proves 27B can run at 3.9GB on phone via WebGPU. Opposite end — offline privacy. Opus proves frontier still matters for hardest tasks. Hybrid pattern: Bonsai filters on device, Opus escalates hard tasks to cloud.

  • vs SEA-LION v4.5: Singapore's 11-language agentic LLM — best for SEA deployment. Opus still best for English complex reasoning. Use SEA-LION for Jakarta fintech bot, Opus for HQ research.

  • vs Sakana Fugu Ultra: Fugu beats Claude via multi-agent orchestration without giant model — architecture > scale. Interesting complement: run Fugu orchestration with Opus 4.8 as nodes, get scale + judgment.

How to Use Opus 4.8: Code Patterns

Claude Code CLI (best way):

bash
1# Install Claude Code
2npm i -g @anthropic/claude-code
3
4claude-code --model claude-opus-4-8-20260528 --context 1m \
5  --prompt "Refactor payments module to Stripe v3, keep tests green, open PR with migration guide"
6# Opus 4.8 will plan, execute, self-correct, and crucially NOT touch unrelated auth module — unlike 4.5

Python API with 1M context:

python
1import anthropic
2client = anthropic.Anthropic()
3
4# 1M context RAG over full codebase
5files = open("repo_dump.txt").read() # ~800K tokens of repo
6
7resp = client.messages.create(
8  model="claude-opus-4-8-20260528",
9  max_tokens=16000,
10  thinking={"type": "enabled", "budget_tokens": 16000},
11  messages=[
12    {"role": "system", "content": "You are staff engineer. Preserve intent. Ask if ambiguous. Never edit unrelated modules."},
13    {"role": "user", "content": f"Context: {files[:900000]}\n\nTask: Add idempotency keys to checkout flow, ensure no breaking change, write tests."}
14  ]
15)
16print(resp.content[0].text)
17# Note thinking traces show intent checks — hallmark of 4.8

Agent SDK with tool discipline:

javascript
1import { Anthropic } from "@anthropic-ai/sdk";
2const client = new Anthropic();
3
4const result = await client.beta.messages.create({
5  model: "claude-opus-4-8-20260528",
6  max_tokens: 12000,
7  tools: [
8    {name: "read_file", description: "Read file"},
9    {name: "write_file", description: "Write file with validation"},
10    {name: "run_tests", description: "Run test suite"},
11  ],
12  messages: [{role: "user", content: "Migrate auth to JWT with refresh, keep backward compat, don't touch payments"}],
13  betas: ["code-execution-2025-05-22"]
14});
15// Opus 4.8 will ask clarification if JWT secret location ambiguous, vs 4.5 would guess

Tip for cost: Opus 4.8 respects prompt caching heavily — cache your 800K repo dump, pay $5/M input once, then $0.5/M cached on follow-ups. Makes 1M context affordable for day-long sessions.

Pricing Economics: Why $5/$25 Is Market-Making

May 2026 pricing reset:

  • Opus 4 launch: $15/$75 — enterprise-only
  • Opus 4.5: $12/$60 — still premium
  • Opus 4.8: $5/$25 — 66% cut, now same as original Opus 3 Sonnet pricing from 2024

Why? Three forces:

  1. Blackwell + batching: New inference stack, 3x throughput on GB200, same as GPT-5.6 Terra's 2.3x speed

  2. Competition: GPT-5.6 Terra at $2.50/$10 and Avocado 1.1 at $0.33/$1.33 forced Anthropic's hand

  3. Volume play: Anthropic wants Opus as default for Claude Code paid users — 500K MAU paying $20-200/mo. Cheaper API = more lock-in to Code ecosystem.

For builders: Opus 4.8 is now cheapest 88%+ SWE model per successful task. Because 4x less off-rails = 4x fewer wasted tokens.

Limitations: What Opus 4.8 Still Can't Do

  • Not #1 on Terminal-Bench: Grok 4.5 still wins pure stamina (78% vs 62%). If task is 4-hour infra migration in empty VM, Grok edges.

  • Not fastest: Sonnet 5 Fennec ~2x faster p50. If need <400ms inline autocomplete, use Sonnet/Luna.

  • Not creative king: Fable 5 beats it hands-down on narrative coherence, emotional intelligence.

  • Still closed weights: Unlike GLM-5.2 and PrismML Bonsai, no self-host. SOC2 vs data residency tradeoff.

  • 1M context still expensive: 1M in = $5, but 10 turns = $50 if not cached. Use caching.

FAQ

Q: Is Opus 4.8 better than Opus 4.5? Yes for agents. 4.5 slightly higher creativity, 4.8 4x safer, 6% better SWE-Bench, 60% cheaper than 4.5 launch. Upgrade.

Q: 88.6% SWE-Bench vs Fable 5's 95% — which is smarter? 95% is tracker-specific with heavy scaffolding; Anthropic official Fable ~86-87%. Opus 4.8's 88.6% is official with heavier guardrails preserving reliability. For production coding, Opus 4.8 wins consistency; for peak benchmark with ideal harness, Fable wins headline.

Q: What is #1 Intelligence Index 61? Composite bench by third-party (LiveBench-style) weighting coding, reasoning, tool use, long-context. Opus 4.8 currently #1 above GPT-5.6 Sol and Gemini 2.5 Pro. Good proxy for "overall smart."

Q: Should I migrate from Sonnet 4.5 to Opus 4.8? Sonnet 4.5 -> Sonnet 5 Fennec for balanced work (faster). Sonnet 4.5 -> Opus 4.8 for agentic hard ops (reliable). Price gap now only $2/$10 vs $5/$25, so affordable.

Q: How does 1M context actually hold? 25% less middle-degradation than Opus 4.5 per Anthropic, better than GPT-5's reported U-curve. First model where you can dump whole mid-size repo and expect recall.

Q: OpenAI vs Anthropic long-term? OpenAI has breadth (Sol/Terra/Luna voice + API + Copilot). Anthropic has depth — Claude Code, improved judgment, no training on your data. If you ship code, Anthropic still toolcraft king.

The Bottom Line: Judgment Is the Moat

We spent 3 years making models write better code. SWE-Bench went from 10% to 88.6%. The next bottleneck isn't writing code — it's not writing wrong code at 2AM.

Opus 4.8 is first Claude that acts like senior eng who asks "are you sure?" before dropping production DB. 4x less off-rails doesn't sound sexy until you've debugged Opus 4.5's 3AM refactor that touched 47 files when you asked for 2.

At $5/$25 with 1M context, it's now cheapest reliable brain for long agentic loops. Pair it with Sonnet 5 Fennec for speed, Fable 5 for story, Bonsai 27B for offline edge.

The agentic stack isn't one model anymore. It's a team. And Opus 4.8 is your tech lead who keeps everyone on task.

Related Articles

#ai-models#claude#anthropic