AI Patched Firefox Before Pwn2Own - OpenAI's Security Pivot
OpenAI's GPT-5.5-Cyber found CVE-2026-8390 in Firefox's WebAssembly engine before Pwn2Own Berlin - five of six registered exploit entries withdrew.
Articles Tagged "Benchmarks"
Sakana Fugu
Sakana AI's orchestrator model that dynamically coordinates Claude Opus 4.8, GPT-5.5, and Gemini 3.1 Pro to beat each of them individually on SWE-Bench Pro, GPQA-Diamond, and eight other benchmarks.
AI Research: Orchestration Beats Scale, Small Models Win
Sakana Fugu tops SWE-Bench Pro by routing tasks across rival LLMs, Microsoft's 9B browser agent beats OpenAI Operator, and a 3B model from Weibo matches DeepSeek V3.2 on math.
VibeThinker-3B
WeiboAI's 3B dense reasoning model fine-tuned from Qwen2.5-Coder-3B, posting AIME 2026 scores that match DeepSeek V3.2 (671B) using the Spectrum-to-Signal training pipeline.
Fara-1.5
Microsoft Research's family of open-weight browser computer use agents (4B, 9B, 27B) that beat OpenAI Operator and Gemini 2.5 Computer Use on Online-Mind2Web.
ERNIE 5.1
Baidu's ERNIE 5.1 is a text-focused MoE model that claims the top Chinese model slot on LMArena with 800B parameters built at 6% of comparable training costs.
OpenAI Catches Hidden Misalignment with Deployment Replay
OpenAI's Deployment Simulation replays 1.3M real user conversations through candidate models to catch misalignment before release - and found a novel reward-hacking bug in GPT-5.1.
MAI-Transcribe-1.5
Microsoft's second-generation speech-to-text model with 2.4% WER, 43-language support, keyword biasing, and 5x faster long-audio processing than comparable accuracy models.
Voxtral TTS
Mistral's first open-weight text-to-speech model: 4B parameters, 70ms latency, voice cloning from 3 seconds of audio, and a 68.4% win rate over ElevenLabs Flash v2.5 in blind tests.
Best AI Models for Voice and Speech - June 2026
ElevenLabs Scribe v2 leads ASR at 2.2% WER after a price cut to $3.67/1000 min, Microsoft MAI-Transcribe-1.5 debuted at #3, and Gemini 3.1 Flash TTS now tops the naturalness leaderboard.
Faster Agents, Skewed Evals, and Brand Bias in LLMs
Three new papers: agents that compile runs into 8-13x faster state machines, benchmark scores that shift with compute budget, and big brands monopolizing LLM recommendations.
Mistral Medium 3.5 Review: Open Agent, Sharp Teeth
Mistral's 128B open-weight model consolidates reasoning, coding, and vision into one checkpoint, with remote agents that file pull requests autonomously.
