Legal Benchmarks
Acme Legal AI · Q3 2026
Legal Benchmarks · Independent Evaluation
Confidential
Legal Benchmarks
Q3 2026

Acme Legal AI

Legal Benchmarks Executive Summary

What this report coversA summary of Acme Legal AI’s results across contract drafting and data extraction, including strengths, areas for improvement, and five certification categories.

Methodology & full resultsSee how tasks, scoring, comparison groups, and repeat runs work on the methodology page, then explore every measure in the Full Evaluation Report.

Provisional Q3 results. Q3 scores and ratings are provisional and may change during validation. Final results will be confirmed on 15 August 2026.

Report date:

Section 01

Overview

Substance and formTask pass rate · Score (1 to 3)
10%20%30%2.02.42.8SUBSTANCE · TASK PASS RATEFORM · SCORE (1 TO 3)Acme Legal AILegal AI averageGeneral-purpose average
Task pass rate - The percentage of tasks for which every applicable criterion was satisfied.Substance - is the legal work correct, complete, and responsive?Form - is the output ready to use as written?
Section 02

Contract Drafting

Creating, amending, redlining, transforming, or completing contractual language or instruments.

SubstanceTask pass rate
Acme Legal AI
26.2%
General-purpose average
23.9%
FormScore (1 to 3)
Acme Legal AI
2.53
General-purpose average
2.44
Section 03

Data Extraction

Extracting, comparing, or synthesising facts, clauses, obligations, dates, entities, or terms from documents.

SubstanceTask pass rate
Acme Legal AI
37.9%
General-purpose average
29.3%
FormScore (1 to 3)
Acme Legal AI
2.72
General-purpose average
2.47
Section 04

Product Experience

Lawyer overview of navigation, files, responsiveness, outputs, and continuity.

Product ExperienceScore (1 to 3)
Acme Legal AI
3.0
General-purpose average
2.4
Section 05

Highlight - Data Extraction

Biggest differentiator compared to other Legal AI tools

Acme Legal AILegal AI averageGeneral-purpose average

Data Extraction

Extracting, comparing, or synthesising facts, clauses, obligations, dates, entities, or terms from documents. Acme Legal AI ranked first across every system evaluated, including frontier general-purpose AI.

Section 06

Acme Legal AI Strengths

Where Acme Legal AI performs most strongly against other legal AI

Acme Legal AILegal AI averageGeneral-purpose average

Repeatable results

Acme Legal AI completed the same task successfully in both independent runs more often than any other system evaluated, legal or general-purpose.

Legal accuracy and risk

Acme Legal AI got governing rules, obligations, and risk positions right more often than any other legal AI application.

Product Experience

Lawyer overview of navigation, files, responsiveness, outputs, and continuity.

Section 07

Biggest Opportunities

Where Acme Legal AI stands weakest against other legal AI, and what reaching the level its peers already hold would be worth.

4.6%Potential gain at peer level

Deliverable compliance

Whether the requested file type and output format were delivered.

Example

An execution-ready final arrived with formatting residue: bracketed placeholder text, a stray punctuation mark, and unresolved blanks in signature fields, instead of a clean final with every field resolved. On other tasks a requested two-file package arrived as one combined document.

3.1%Potential gain at peer level

Hallucination resistance

Whether answers stay grounded in the supplied facts and documents.

Example

Asked for the consideration payable under a phased purchase agreement, Acme Legal AI reported one grand total the document never states: it summed the per-phase amounts and presented the sum as a term of the agreement, instead of reporting each component as stated and labeling any computed figure as derived.

1.8%Potential gain at peer level

OCR and scan handling

Performance on scanned, photographed, image-based, redacted, or otherwise imperfect source material.

Example

A scanned letter of intent stated per-phase acreage figures with poor print quality. Acme Legal AI reported a materially different set of acreages as settled figures, instead of flagging that the readings were unclear.

Section 08

LB Certifications

Independent certifications for performance measured against published legal AI application benchmarks.

Legal Benchmarks certification

Best Legal AI Application (Overall)

Industry Leader

Contender · Q3 2026

Legal Benchmarks certification

Contract Drafting

Industry Leader

Contender · Q3 2026

Legal Benchmarks certification

Information Extraction

Industry Leader

Band 1 · Q2 2026

Top 30% of this vertical

Legal Benchmarks certification

The High Bar

Industry Leader

Contender · Q3 2026

Legal Benchmarks certification

User Experience

Industry Leader

Contender · Q3 2026