Skip to main content

Share story

Science AI

AI agents benchmarked on quantum circuit visual understanding with cost-accuracy tradeoffs

Researchers introduced Quantum Circuit Vision, a cost-aware evaluation framework testing whether multimodal AI agents can visually comprehend quantum circuit diagrams and generate verified executable code. The benchmark spans 132 circuits across 13 categories (1-10 qubits) with executable Amazon Braket code and unitary-fidelity verification. Evaluating three frontier Claude-family models at different capability-cost tiers over five repeated trials, the mid-tier model (Sonnet 4.6, 1.30× credits) achieved a 91% pass rate on the core subset at 18% of the per-call cost of the strongest model (Opus 4.6), whose accuracy advantage was not statistically significant (paired t-test, p=0.083). Circuit depth, not qubit count, was the primary predictor of failure (p<0.001). Chain-of-thought prompting showed no statistically significant effect (all p>0.18), suggesting visual pattern recognition outweighs explicit reasoning for structurally coupled diagrams. A cascade routing strategy (cheap → expensive models) reached 84% accuracy at 38% of single-model cost, demonstrating that model routing dominates prompt engineering as a cost lever. The QCV-Dataset (132 circuits, five modalities, 1,931 files) and all evaluation code, cost logs, and verification scripts were released on Hugging Face Hub and GitHub.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from arXiv and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital AI
Capital AI

Nevis raises $70M with Schwab joining wealth software investors

Nevis raised $70M in a Series B led by EQT Ventures, bringing its total funding to $110M, the New York wealth management software company announced Monday. Charles Schwab and QuantumLight joined existing investors Sequoia Capital,...

Robotics Capital
Robotics Capital

Bedrock Robotics raises $600M at a $4.1B valuation

Bedrock Robotics raised a $600M Series C at a $4.1B valuation, Bloomberg reported. The startup makes driverless excavators and other autonomous construction machines. The financing adds capital to a company developing autonomous ...

Capital
Capital

Matiks raises $10 million to expand puzzle games and game creation

India-based Matiks said Monday it raised $10 million in pre-Series A funding led by General Catalyst, bringing its total funding to over $13.5 million. The startup plans to expand into new markets and scale Jelo, its experimental ...

AI Products
AI Products

AWS makes GPT-6.1 Terra generally available on Bedrock

AWS announced general availability of OpenAI's GPT-6.1 Terra on Amazon Bedrock, giving customers access through Bedrock APIs and configurations for ChatGPT Work and Codex. The model accepts text and images and supports up to 1 mil...

AI
AI

OpenAI releases GPT-6.1 Terra at $1 per million input tokens

OpenAI has released GPT-6.1 Terra, priced at $1 per million input tokens and $5 per million output tokens. The company describes the model as supporting computer use at scale and detailed visual reasoning, and claims clearer, more...