Grok Voice 3.0 Claims Top Speech-to-Speech Index Score
Marcus Chen-Ramirez2 days ago
AI benchmarks
35 stories tagged AI benchmarks.
AI. Marcus Chen-Ramirez2 days ago
Grok Voice 3.0 Claims Top Speech-to-Speech Index Score
Grok Voice 3.0 claims an 86.9 speech-to-speech score. Its tool-enabled voice loop could change how apps work, but buyers still need to test reliability.
Grok 4.7 Shows Why Cheap AI Tokens Can Cost More
Yuki Okonkwo3 weeks ago
AI. Yuki Okonkwo3 weeks ago
Grok 4.7 Shows Why Cheap AI Tokens Can Cost More
Grok 4.7 looks cheap by the token, but benchmark data shows why agent requests, task completion and retries can reshape the final AI bill for buyers.
Gemini 3.8 Flash: Strong Benchmarks, Sharper Pricing
Yuki Okonkwo1 month ago
AI. Yuki Okonkwo1 month ago
Gemini 3.8 Flash: Strong Benchmarks, Sharper Pricing
Google's Gemini 3.8 Flash posts competitive benchmark scores at a fraction of rival prices. Here's what the numbers actually mean for enterprises choosing AI models.
Ox Alpha: Anonymous AI Model Stumps the Industry
Marcus Chen-Ramirez2 months ago
AI. Marcus Chen-Ramirez2 months ago
Ox Alpha: Anonymous AI Model Stumps the Industry
An anonymous AI model called Ox Alpha appeared on OpenRouter, beat top coding benchmarks, and triggered a forensic manhunt. Nobody's claimed it yet.
Harvey Tenet Legal AI Model: Cool Tech, Thin Proof
Yuki Okonkwo2 months ago
AI. Yuki Okonkwo2 months ago
Harvey Tenet Legal AI Model: Cool Tech, Thin Proof
Harvey's Tenet model applies async RL to long-horizon legal tasks—genuinely interesting tech. But verified benchmarks are scarce. Here's what we know and what we don't.
Data Is Now the Hard Part of Building AI
Marcus Chen-Ramirez2 months ago
AI. Marcus Chen-Ramirez2 months ago
Data Is Now the Hard Part of Building AI
At a recent YC Paper Club session, three AI researchers made the case that training data—not models or chips—is where the real work of building AI happens now.
AI Coding Agents Still Need a Human in the Loop
Bob Reynolds2 months ago
AI. Bob Reynolds2 months ago
AI Coding Agents Still Need a Human in the Loop
Dexter Horthy built a fully automated software factory—then watched it corrupt his codebase. His case for keeping humans in the loop is harder to dismiss than most.
Claude Opus 5 Beats Fable 5 on Benchmarks at Half the Price
Dev Kapoor3 months ago
AI. Dev Kapoor3 months ago
Claude Opus 5 Beats Fable 5 on Benchmarks at Half the Price
Anthropic's Claude Opus 5 outperforms Claude Fable 5 on most benchmarks at half the price. Here's what the numbers actually mean for developers.
Kimi K3 Benchmarks vs. Real-World Performance
Bob Reynolds3 months ago
AI. Bob Reynolds3 months ago
Kimi K3 Benchmarks vs. Real-World Performance
Moonshot's Kimi K3 posts frontier-class benchmarks, but early testing reveals real gaps in reliability, speed, and cost. Here's what the numbers actually show.
How AI Is Actually Tested for Human-Level Intelligence
Bob Reynolds3 months ago
AI. Bob Reynolds3 months ago
How AI Is Actually Tested for Human-Level Intelligence
ARC AGI 3 tasks AI with figuring out video games from scratch — and current models can barely start them. Here's what that reveals about the gap between AI and human reasoning.
Tencent HY3 Reviewed: Free, Open Source, and Uneven
Dev Kapoor3 months ago
AI. Dev Kapoor3 months ago
Tencent HY3 Reviewed: Free, Open Source, and Uneven
Tencent's HY3 is a free, 295B open-source model with real agentic strengths—but benchmark scores and real-world output quality tell different stories.
GPT 5.6 Sol vs Fable 5: Early Numbers, Real Tradeoffs
Yuki Okonkwo4 months ago
AI. Yuki Okonkwo4 months ago
GPT 5.6 Sol vs Fable 5: Early Numbers, Real Tradeoffs
GPT 5.6 Sol is half the price of Fable 5 — but is it half as good? Early benchmark comparisons, alignment regressions, and the politics reshaping who gets access.
AI Leaderboards Are Lying to You About State-of-the-Art
Yuki Okonkwo5 months ago
AI. Yuki Okonkwo5 months ago
AI Leaderboards Are Lying to You About State-of-the-Art
Bertrand Charpentier of Pruna AI makes the case that 'state-of-the-art' is a broken concept—and that efficiency belongs in the same sentence as quality.
AI Benchmark Scores Are Broken. Here's Who's Fixing Them.
Rachel "Rach" Kovacs5 months ago
AI. Rachel "Rach" Kovacs5 months ago
AI Benchmark Scores Are Broken. Here's Who's Fixing Them.
AI benchmark scores are less trustworthy than they look. Google DeepMind's Kaggle team is building open infrastructure to fix that—here's what you need to know.
GPT-5.5 Is Great, But You Might Not Notice—Here's Why
Yuki Okonkwo6 months ago
AI. Yuki Okonkwo6 months ago
GPT-5.5 Is Great, But You Might Not Notice—Here's Why
OpenAI's GPT-5.5 dominates benchmarks and handles complex coding tasks, but many users won't feel the upgrade. We dig into the paradox.
GPT 5.5 vs DeepSeek V4: The Benchmarks Tell a Jagged Story
Mike Sullivan6 months ago
AI. Mike Sullivan6 months ago
GPT 5.5 vs DeepSeek V4: The Benchmarks Tell a Jagged Story
OpenAI and DeepSeek released flagship models within 20 hours. The benchmark results reveal something more interesting than who's winning.
The Benchmark Paradox: What Qwen 3.6's Numbers Actually Mean
Zara Chen6 months ago
AI. Zara Chen6 months ago
The Benchmark Paradox: What Qwen 3.6's Numbers Actually Mean
Qwen's new 27B model is beating models 10x its size—on paper. Here's what those benchmarks aren't telling you about AI performance.
OpenAI's GPT-5.5 Claims Speed Crown—But Costs 20% More
Tyler Nakamura6 months ago
AI. Tyler Nakamura6 months ago
OpenAI's GPT-5.5 Claims Speed Crown—But Costs 20% More
GPT-5.5 promises faster AI coding with fewer tokens, but WorldofAI's tests reveal where it excels—and where it disappoints at premium pricing.
OpenAI's GPT-5.5: When the Benchmarks Don't Tell the Whole Story
Dev Kapoor6 months ago
AI. Dev Kapoor6 months ago
OpenAI's GPT-5.5: When the Benchmarks Don't Tell the Whole Story
GPT-5.5 arrives with impressive real-world benchmarks and doubled pricing. But the coding results reveal tensions in how we measure AI capability.
Anthropic's Opus 4.7: The Enterprise Model You Can't Afford
Mike Sullivan6 months ago
AI. Mike Sullivan6 months ago
Anthropic's Opus 4.7: The Enterprise Model You Can't Afford
Anthropic's Opus 4.7 excels at enterprise tasks but costs 35% more due to tokenizer changes. The upgrade everyone's complaining about, explained.