Shortcut Beats Top Analysts 89.1% in Blind Study

Shortcut's AI agent for Excel has demonstrated superhuman performance against first-year analysts from McKinsey and Goldman Sachs,two of the most prestigious firms in consulting and finance.

The results are staggering: When blindly evaluated by the analysts' own managers, Shortcut won 89.1% of comparisons (220 out of 247), while human analysts managed only 27 wins – despite being given 10 times more time to work. Shortcut's performance represents an early paradigm shift in what's possible with AI-powered Excel automation.

The study consists of five comprehensive financial modeling and data analysis tasks that first-year analysts at top-tier firms handle daily. Blind evaluation by their managers revealed near indistinguishability between AI and human output. This validates that Shortcut doesn't just work faster; it produces professional-grade results at the caliber of expert human work.

Study Methodology and Design

To ensure absolute fairness and credibility, the benchmark study was designed with multiple safeguards against bias and structured to actually favor human participants:

Study Design and Parameters

Blind Evaluation Process

The most critical aspect of the study was the blind evaluation by the analysts' own managers – the people who normally review and approve their work. Each task was evaluated through pairwise comparisons:

1. Pairwise Comparison: Managers compared two submissions (A vs B) for each task without knowing which was AI or human
2. Multiple Evaluations: Each task received multiple rounds of evaluation from different managers, resulting in 247 total comparisons across 5 tasks
3. Output Standardization: All work products (human and AI) uploaded to Google Sheets with identical formatting
4. Professional Standards: Evaluation based on completeness, accuracy, and professionalism
5. No AI Indicators: Any potential "tells" that might identify AI work were removed

The 89.1% Win Rate Explained

The headline number – 89.1% win rate for Shortcut versus approximately 11% for human analysts – demonstrates overwhelming AI superiority. Across 247 blind pairwise comparisons covering 5 comprehensive tasks, managers consistently chose Shortcut's work as more complete, accurate, and professional:

Performance by Task Category

Why the Performance Gap Exists

Several factors contribute to Shortcut's overwhelming performance advantage:

The 10x Time Advantage Analyzed

Perhaps the most striking aspect of the study is that human analysts were given 10 times more time than Shortcut to complete each task – yet still dramatically underperformed. This time advantage should have leveled the playing field, but instead highlighted the fundamental efficiency gap:

Time Efficiency Analysis

Even with 10x more time, human analysts struggled with:

• Cognitive Load: Managing multiple complex requirements simultaneously
• Attention to Detail: Catching all edge cases and special conditions
• Formula Accuracy: Implementing complex nested formulas without errors
• Consistency: Maintaining quality standards across repetitive tasks
• Completeness: Addressing all aspects of multi-part problems

Real-World Business Impact

The benchmark results have profound implications for how businesses approach Excel-based work and analyst-level tasks:

Immediate Business Impact

Industry Transformation Potential

This level of performance advantage suggests we're at an inflection point for professional services:

Human + AI: Augmentation Strategy

While the benchmark results are dramatic, the goal isn't to replace human analysts but to augment their capabilities. The most powerful configuration is human strategic thinking combined with AI execution:

The New Analyst Workflow

This hybrid approach leverages the unique strengths of both humans and AI:

• Humans excel at: Context understanding, relationship building, creative problem-solving, ethical judgment
• AI excels at: Data processing, calculation accuracy, pattern recognition, consistent execution
• Together: Deliver superior outcomes faster than either could achieve alone

How Shortcut Achieves 89.1% Accuracy

Shortcut's dominant performance isn't accidental – it's the result of sophisticated architecture and continuous innovation:

Multi-Agent Architecture

Native Excel Understanding

While other AI tools struggle with Excel's complex binary format, Shortcut has native understanding of XLSX files, enabling it to:

• Read and interpret complex spreadsheet structures accurately
• Understand relationships between cells, sheets, and workbooks
• Preserve formatting, styles, and Excel-specific features
• Handle macros, pivot tables, and advanced Excel functionality
• Work with large files that would overwhelm text-based AI

Manager Validation of Results

The blind evaluation by managers provides crucial validation. Here's what evaluators noted about the work products (without knowing which were AI-generated):

Future of Work Implications

The benchmark results signal a fundamental shift in how knowledge work will be performed. We're not just seeing incremental improvement – we're witnessing a step change in capability:

The New Competitive Landscape

The Evolution of the Analyst Role

Shortcut elevates, rather than eliminates, the analyst position. The future analyst will:

1. Become Strategic Advisors: Focus on interpreting results and making recommendations rather than building models
2. Manage AI Workflows: Orchestrate multiple AI agents to solve complex business problems
3. Specialize in Edge Cases: Handle the 10.9% of tasks that still require human judgment
4. Build Client Relationships: Spend more time on communication and less on Excel
5. Drive Innovation: Use freed capacity to explore new analyses and insights

Getting Started with Shortcut

The benchmark study proves what's possible. Now it's time to experience it yourself:

Conclusion: Evidence Summary

The benchmark study reveals an 89.1% win rate across 247 blind comparisons versus human analysts achieved in 1/10th the time, representing early signs of a paradigm shift in Excel automation.

Amplifying human intelligence . When first-year analysts at the world's most prestigious firms are outperformed 8-to-1 by AI across comprehensive financial modeling tasks – from DCF models to M&A analysis – even with a 10x time advantage, we're witnessing the emergence of truly superhuman capabilities in spreadsheet work.

The question isn't whether AI will transform Excel work. It's whether your organization will leverage the advantage or be left behind by competitors who do.