A Practical Framework for Evaluating Quantum Computing Claims

Olivier Ezratty presented a framework for evaluating quantum computing claims at Q2B25 Silicon Valley. Ezratty is the author of the open access book Understanding Quantum Technologies. The approach provides criteria for buyers at high performance computing centers, government programs and enterprises to assess announcements. Ezratty models evaluation through three dimensions. Industry value examines whether work addresses a problem with commercial or scientific importance. Working hardware requires execution on real quantum computers with actual input data and output results. Provable quantum advantage requires demonstrated improvements over classical alternatives that can be independently verified. The framework also defines seven categories of quantum work. These range from theoretical papers and proof of concept demonstrations to useful case studies that meet all three dimensions. Examples include quantum supremacy experiments, toy model case studies, quantum inspired solutions and prospective use cases. Ezratty proposed five criteria for assessment. The criteria cover problem size, resource estimates, nature of advantage, classical benchmarking and documentation quality. He advised buyers to demand specific quantitative answers from vendors on production scale resource needs, benchmarking against classical solutions and peer reviewed documentation. The presentation noted stronger evidence in fundamental physics and chemical simulation than in optimization and machine learning. Ezratty observed that most progress over the past five years has come from software optimization rather than hardware improvements. IBM and other vendors have announced roadmaps for fault tolerant systems.