The evals we run in production — published.

Completion rate

90%

Share of dispatched jobs closed successfully (30d).

NTE variance

±9%

Absolute variance between quoted NTE and final invoice.

Quote turnaround

<2hr

Time from work-order intake to NTE returned.

Dispatch latency (p50)

340ms

API latency from work-order accept to contractor notification.

Dispatch latency (p95)

890ms

Tail latency for routing + contractor outreach.

Human override rate

3%

Share of agent decisions escalated or reversed by human operator.

Policy-violation catch rate

Tracking

Publication pending more sample size. Currently gated via Zod schemas + policy layer.

Cost per decision

Private

Internal; not published publicly to preserve contractor-margin confidentiality.