Own tickets: Merchant ticket triage (BG/EN), guidelines v2 + real tickets (ABCD train)
Upload 100 to 1000 of your own tickets. Emails, phone numbers, IBANs, card numbers and long digit runs are masked on this server before anything is stored or sent to Claude. Claude labels each ticket twice; you review the labels, freeze the set, and the base model and the served adapter are scored on it.
Status
- Tickets
- 0
- Labelled
- 0
- Unstable
- 0
- Not judged yet
- 0
- Dropped
- 0
Judge usage: 300 requests, 217,220 input and 45,706 output tokens.
Own tickets
146 of the shop's own tickets, masked and frozen as a separate slice. Labels: 128 by the Claude judge, 0 by a person and 18 by Claude Code on the owner's delegation (not a person) (4 dropped in review). The tickets themselves are private to the run owner.
| Model | Accuracy | Macro-F1 | category | urgency | needs_human |
|---|---|---|---|---|---|
| Base model | 67.8% | 58.5% | 67.8% | 47.9% | 76.7% |
| Served adapter (iteration 2) | 71.2% | 60.2% | 71.2% | 80.1% | 85.6% |
Accuracy is on the primary field; the field columns are the accuracy of each field on its own.