Jev
Text only
jev-latest
Waiting
Jev reads text. OpenAI Decisions can also read a photo. Score them on the same 24 support cases — photos never enter the board.
Step 1 · not scored
Paste a message. Add a photo only if you want OpenAI to read it — Jev will sit out.
Text only
jev-latest
Waiting
Text and photos
gpt-6-luna
Waiting
OpenAI-only. These never feed the scoreboard.
Step 2 · scored
0/24 done. Text only, with gold labels. Click a row for the full ticket.
| Case | Gold | Jev | OpenAI | Lead |
|---|---|---|---|---|
| Charged twice | billing | — | — | — |
| Checkout crash | technical | — | — | — |
| Package not arrived | shipping | — | — | — |
| Password reset email | account | — | — | — |
| Volume discount | sales | — | — | — |
| Wrong VAT on invoice | billing | — | — | — |
| Payroll tomorrow | yes | — | — | — |
| Gift wrapping whenever | no | — | — | — |
| Production down | yes | — | — | — |
| Just browsing | no | — | — | — |
| Ten-minute deadline | yes | — | — | — |
| Newsletter follow-up | no | — | — | — |
| Button color | 0 | — | — | — |
| Need invoice today | 1 | — | — | — |
| Checkout failing for all | 3 | — | — | — |
| SSO blocks launch | 2 | — | — | — |
| Dark mode someday | 0 | — | — | — |
| Payment webhooks failing | 3 | — | — | — |
| Refund before statement | billing · yes · 2 | — | — | — |
| Delivered but missing | shipping · no · 1 | — | — | — |
| Company lockout | account · yes · 3 | — | — | — |
| Annual billing curiosity | sales · no · 0 | — | — | — |
| Receipts tab crash | technical · no · 1 | — | — | — |
| Site is down | technical · yes · 3 | — | — | — |
Empty until you score the 24 labeled tickets. Photos never count here.
| Metric | Jev | OpenAI |
|---|---|---|
Winner On correctness | — | — |
Reads Not a score | Text | Text + photo |
Price Input tokens | — | — |
Correct Gold labels | — | — |
Latency Mean round trip | — | — |
| p95 | — | — |
| Tokens | — | — |
| Schema | — | — |
| Misses | — | — |
| Brier | — | — |