Best Legal AI Application (Overall)
Industry LeaderContender · Q3 2026
Legal BenchmarksQ3 2026
Acme Legal AI
Legal Benchmarks Full Evaluation Report
What this report coversA detailed view of Acme Legal AI’s results, including benchmark comparisons, strengths, and areas for improvement.
Methodology & summarySee how tasks, scoring, comparison groups, and repeat runs work on the methodology page, then read the headline results in the Executive Summary.
How to read this reportThe report is divided into sections, and each section into measured subsections. The What to improve note under a subsection is its highest-rate error, typically with an example of that type of failure.
Provisional Q3 results. Q3 scores and ratings are provisional and may change during validation. Final results will be confirmed on 15 August 2026.
Report date:
Overview
Overview
Substance and form
Task pass rate
The percentage of tasks for which every applicable criterion was satisfied.
Acme Legal AI31.4%
Legal AI25.4%
General-purpose26.6%
Criteria met
The percentage of applicable lawyer-authored criteria satisfied.
Acme Legal AI75.8%
Legal AI62.8%
General-purpose59.3%
Delivery rate
How many tasks received any response?
Acme Legal AI100.0%
Legal AI95.9%
General-purpose91.5%
Task pass rate - The percentage of tasks for which every applicable criterion was satisfied.Substance - is the legal work correct, complete, and responsive?Form - is the output ready to use as written?
Details
Core Performance
Overview of tasks and their criteria across core attributes.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Work Types
Overview of main work types Contract Drafting and Data Extraction.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Document Inputs
Overview of handling different inputs.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Document Outputs
Overview of output correctness.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Hallucinations
When given missing information, does it make up answers or handle it gracefully?
Acme Legal AILegal AI averageGeneral-purpose average
Details
Repeatability
Overview of repeatable results and determinism across 2 runs.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Edge Cases
Specialized tasks that are especially difficult for AI applications.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Product Experience
Lawyer overview of navigation, files, responsiveness, outputs, and continuity.
Acme Legal AILegal AI averageGeneral-purpose average
Details
Biggest opportunities
Where Acme Legal AI stands weakest against other legal AI, and what reaching the level its peers already hold would be worth.
4.6%Potential gain at peer level
Deliverable compliance
Whether the requested file type and output format were delivered.
Example
An execution-ready final arrived with formatting residue: bracketed placeholder text, a stray punctuation mark, and unresolved blanks in signature fields, instead of a clean final with every field resolved. On other tasks a requested two-file package arrived as one combined document.
3.1%Potential gain at peer level
Hallucination resistance
Whether answers stay grounded in the supplied facts and documents.
Example
Asked for the consideration payable under a phased purchase agreement, Acme Legal AI reported one grand total the document never states: it summed the per-phase amounts and presented the sum as a term of the agreement, instead of reporting each component as stated and labeling any computed figure as derived.
1.8%Potential gain at peer level
OCR and scan handling
Performance on scanned, photographed, image-based, redacted, or otherwise imperfect source material.
Example
A scanned letter of intent stated per-phase acreage figures with poor print quality. Acme Legal AI reported a materially different set of acreages as settled figures, instead of flagging that the readings were unclear.
Details
LB Certifications
Independent certifications for performance measured against published legal AI application benchmarks.
Contract Drafting
Industry LeaderContender · Q3 2026
Information Extraction
Industry LeaderBand 1 · Q2 2026
Top 30% of this vertical
The High Bar
Industry LeaderContender · Q3 2026
User Experience
Industry LeaderContender · Q3 2026