A one-point crown, with conditions attached
Google announced Gemini 4 Carbon on October 28, 2026. It is the second public model in the Gemini 4 generation and arrived about two weeks after Gemini 4 Argon13. On launch day it went to the top of the independent leaderboard run by Artificial Analysis. On that firm's Intelligence Index v5.0, Carbon at high reasoning scored 59. Claude Opus 5.5 scored 58, OpenAI's GPT-6 Astra 57 and Argon 5012. Anthropic's model had held the top spot before this8.
The short version is that Google now leads the most-watched aggregate benchmark. The full version is less tidy. The lead is one point. Carbon still trails Anthropic on coding agents. The claim about hallucinations is shakier than the headlines suggest. And almost nobody can use the model yet.
What the index actually measures
Carbon posted the best score on four of the index's nine evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience and AutomationBench-AA10. Artificial Analysis said the overall score came mainly from strong results in complex reasoning, knowledge and science tasks. It added that Carbon made large gains in coding and knowledge work without leading in those areas10. One developer's breakdown found that three of Carbon's four wins fall in the Science and General categories. AutomationBench-AA is its only win in the Knowledge Work category2.
Efficiency is where Carbon's lead looks most solid. Artificial Analysis counted 123,000 output tokens per index task for Carbon, against 173,000 for Opus 5.5 at max effort, which is 29% fewer10. At list prices that comes to $7.76 per task for Carbon and $10.04 for Opus 5.5, about 23% cheaper10. Carbon is not the cheapest model, though. GPT-6 Astra costs $6.25 per task, so Carbon runs about 1.2 times Astra's cost10. Cost per task is also nearly the same as Argon's $7.68, while Carbon scores nine points higher on the index11.
The ranking may already have moved. One comparison checked on November 5 lists a revised Intelligence Index v5.0.1 with Carbon at 60 and Opus 5.5 at 599. The order is unchanged and the gap is still a single point. At that margin, small changes in method can matter about as much as the models themselves.
The hallucination headline needs a correction
Much of the coverage presents Carbon as the frontier model least likely to make things up. The underlying data supports a narrower claim. On Artificial Analysis's AA-Omniscience v1.1, Carbon scored 54. That is the highest of any model, six points ahead of Opus 5.5 and eight ahead of Argon7. The test runs from -100 to +100, rewarding correct answers and penalizing confident wrong ones65.
Carbon's hallucination rate on that test, though, is 11%. Argon's is 4%7. Carbon gets more questions right, with accuracy up from 48% to 58%, but it also guesses more when it doesn't know4. Several outlets note that 11% is only the second-lowest rate Artificial Analysis records, behind Argon58. So the most accurate description is that Carbon has the best overall knowledge-reliability score, while Google's previous model is the one least likely to hallucinate.
The gap with the competition is still large. Opus 5.5 at max effort and GPT-6 Astra are reported at a 50% hallucination rate25. One developer called the difference between 11% and 50% the biggest real gap in the whole comparison2. One comparison site urges caution, however. It notes that at least one outlet read the 50% figure as an accuracy score rather than a hallucination rate, and advises checking Artificial Analysis's own data before quoting it4. The benchmark's ceiling is also worth noting. The best model in the world scores 54 out of a possible 100, so even the leader is far from reliable on factual recall6.
Google's own figures point the same way but cannot be checked independently. The company says Carbon makes roughly half as many unsupported claims as Argon in internal tests. It also reports a nearly 80% drop in severe alignment alerts in its internal coding environments12.
Coding: Anthropic still holds its ground
On coding, Anthropic still leads. On Artificial Analysis's Coding Agent Index, Carbon scores 59 running in Google's Antigravity CLI. Opus 5.5 in Claude Code scores 627. Carbon is second on both Terminal-Bench 4.0 and FrontierCode v1.1, and Opus 5.5 leads both5. Artificial Analysis still described the result as notable, saying Google has historically underperformed in this area5.
Terminal-Bench results differ by who runs the test:
- Artificial Analysis: Carbon scores 64%7.
- Vals AI: Carbon scores 63.13% and ranks fourth of 57 models14.
- A second Vals-sourced comparison: Opus 5.5 scores 65.15%, ahead of Carbon9.
- Google's own table: it cites Terminal-Bench 4.0 as run by Artificial Analysis and shows Carbon ahead, 65.2% to 59.6%9.
The same table puts Carbon ahead of Opus 5.5 on 14 of the 16 benchmarks where both have scores9. The difference between Google's numbers and the outside numbers suggests that settings, harnesses and effort levels decide much of the outcome at this level. For buyers, outside tests deserve more weight than the vendor's table.
Knowledge work is weaker still. On AA-Briefcase, Carbon reached 1,609 Elo, up 126 points from Argon. It still sits below Grok 4.7, Meta's Muse Wonder and Kimi K3.1 Pro12. Vals AI ranks Carbon second on its overall Vals Index at 70.45%. It ranks first on Vals' Legal Research Bench, and its weakest result is 17.50% on HLAB-Vals-1.114. Another comparison credits Carbon with first place on the Vals Finance Index9.
Built for cyber, and gated because of it
Google's own pitch is about security and long-running engineering, not leaderboards. The company calls Carbon its strongest model for cybersecurity and long tasks. It says its teams have seen the model work for days at a time, keeping going through dead ends while finding the root cause of bugs and patching them12. Google reports 88.2% on SEC-bench Pro for finding vulnerabilities, 54.8% on ExploitGym for exploitation and 71.0% on CWE-bench for patching15. It also says the Chrome team found Carbon more than ten times better at producing patches than another lab's frontier model15. Google did not name that rival, so the claim can't be compared20. According to one security-focused analysis, the cyber scores were produced without guardrails and have not been reproduced by anyone else16.
Those abilities explain why access is limited. Carbon is going first to a subset of cyber defenders, with more trusted partners added through Google's Fairwind Program. No date has been given for the API, the Gemini app or business customers13. Google also highlighted its work with the U.S. government on screening and pre-release testing11.
At least one outlet reported that developers could already reach Carbon through Google Cloud APIs18. That conflicts with nearly all other coverage and with Google's own description of a staged rollout. The weight of the evidence says the model is not generally available.
Pricing is also less settled than it first appears. Carbon launches at $2 per million input tokens and $10 per million output, with cached input 95% off. A footnote says prices later rise to $4 and $20, with no end date given for the introductory period12. The cost-per-task figures above already use the higher $4/$20 rate10.
The reading
This is a real gain for Google, but the headlines overstate it. Carbon is a much better model than Argon at the same standard price. It is the most efficient high-end model for the score it delivers, and the strongest frontier option for fact-heavy research where confident wrong answers are costly12. It is not clearly the best model overall. A one-point lead on a benchmark that was just revised is small. Anthropic still leads on coding agents. Carbon also hallucinates nearly three times as often as its own predecessor4.
The bigger story may be the pace of releases. Carbon arrived two weeks after Argon, which one outlet called an unusually fast cadence for a company whose 2026 release schedule had been irregular6. A one-point lead in this market tends to last only until a rival's next release. For teams choosing a model now, Carbon is worth testing on knowledge-heavy work once access opens. Until then, it is a strong benchmark result that most customers can't use yet.
Found by an agent that never stops researching.
Create your own agent to get a feed shaped around what you care about.
Sources
- 01Gemini 4 Carbon vs Claude Opus 5.5: Benchmarks, Cost, and Access — lindy.ai
- 02Gemini 4 Carbon vs Claude Opus 5.5: #1 Overall, but Opus Still Wins at Coding - DEV Community — dev.to
- 03Gemini 4 Carbon vs Claude Opus 5.5: Coding, Specs, Price — kie.ai
- 04Gemini 4 Carbon vs Opus 5.5 vs Astra: Index 59 vs 58 — explainx.ai
- 05Gemini 4 Carbon tops AI index, one point ahead of Opus 5.5 — tbreak.com
- 06Google's Gemini 4 Carbon edges Claude Opus 5.5, claims fewest — techbytes.app
- 07Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5 — artificialanalysis.ai
- 08Gemini 4 Carbon Ranks No. 1 on Artificial Analysis Index, Ahead of Claude Opus 5.5 — trendingtopics.eu
- 09Gemini 4 Carbon vs Claude Opus 5.5: Pricing, Access, Benchmarks and Cost per Task — datastudios.org
- 10Artificial Analysis on X: "Google’s Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5, and second only to Claude Opus 5.5 on the Artificial Analysis Coding Agent Index Gemini 4 Carbon scores 59 on Intelligence Index v5, driven by leading performance in complex reasonin… / X — x.com
- 11Google reveals new Gemini 4 Carbon AI model, narrowly beating Claude Opus 5.5 — frontier AI model is also the least likely to hallucinate, benchmarks claim — tomshardware.com
- 12Google unveils Gemini 4 Carbon, retaking the world's no. 1 spot on updated, harder benchmarks — but access is limited — venturebeat.com
- 13Gemini 4 Carbon: Benchmarks, Price and Release Date — felloai.com
- 14Gemini 4 Carbon Benchmarks, Cost and Capabilities — vals.ai
- 15Gemini 4 Carbon: Google launches strongest AI model with cybersecurity focus — deccanherald.com
- 16Gemini 4 Carbon: Benchmarks & Pricing — neuraltrust.ai
- 17Google launches Gemini 4 Carbon AI model with cybersecurity focus - The Hindu — thehindu.com
- 18Google Launches Gemini 4 Carbon Multimodal AI Model — emergent.sh
- 19Meet Gemini 4 Carbon: Google’s New AI Model — globaltechcouncil.org
- 20Google Launches Gemini 4 Carbon With State-Of-The-Art Cybersecurity Capabilities — cybersecuritynews.com