fixture-exact
n 8 · exact 8/8 · schema 8/8
damagedexact 1.000 · schema 1.000 · judge 1.000
Customer Jane Doe (jane@example.com) says order #A-1042 arrived damaged.
21.8 ms · 65 in / 25 out · $2.47e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Jane Doe | Jane Doe | match |
| jane@example.com | jane@example.com | match | |
| order_id | A-1042 | A-1042 | match |
| issue | arrived damaged | arrived damaged | match |
Judge: field overlap 1.000
{"name": "Jane Doe","email": "jane@example.com","order_id": "A-1042","issue": "arrived damaged"}
missingexact 1.000 · schema 1.000 · judge 1.000
Luis Ortega (luis.ortega@example.com) cannot find order #B-2201; the item is missing.
11.5 ms · 68 in / 27 out · $2.64e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Luis Ortega | Luis Ortega | match |
| luis.ortega@example.com | luis.ortega@example.com | match | |
| order_id | B-2201 | B-2201 | match |
| issue | missing item | missing item | match |
Judge: field overlap 1.000
{"name": "Luis Ortega","email": "luis.ortega@example.com","order_id": "B-2201","issue": "missing item"}
billingexact 1.000 · schema 1.000 · judge 1.000
Priya Shah (priya.shah@example.com) was charged twice for order #C-118.
9.4 ms · 65 in / 26 out · $2.53e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Priya Shah | Priya Shah | match |
| priya.shah@example.com | priya.shah@example.com | match | |
| order_id | C-118 | C-118 | match |
| issue | charged twice | charged twice | match |
Judge: field overlap 1.000
{"name": "Priya Shah","email": "priya.shah@example.com","order_id": "C-118","issue": "charged twice"}
addressexact 1.000 · schema 1.000 · judge 1.000
Kenji Sato (kenji.sato@example.com) received order #D-9 at the wrong address.
14.1 ms · 66 in / 26 out · $2.55e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Kenji Sato | Kenji Sato | match |
| kenji.sato@example.com | kenji.sato@example.com | match | |
| order_id | D-9 | D-9 | match |
| issue | wrong address | wrong address | match |
Judge: field overlap 1.000
{"name": "Kenji Sato","email": "kenji.sato@example.com","order_id": "D-9","issue": "wrong address"}
lateexact 1.000 · schema 1.000 · judge 1.000
Amira Hassan (amira.hassan@example.com) is still waiting on order #E-440; delivery is late.
12.1 ms · 70 in / 27 out · $2.67e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Amira Hassan | Amira Hassan | match |
| amira.hassan@example.com | amira.hassan@example.com | match | |
| order_id | E-440 | E-440 | match |
| issue | late delivery | late delivery | match |
Judge: field overlap 1.000
{"name": "Amira Hassan","email": "amira.hassan@example.com","order_id": "E-440","issue": "late delivery"}
sizeexact 1.000 · schema 1.000 · judge 1.000
Noah Williams (noah.williams@example.com) got the wrong size in order #F-17.
9.8 ms · 66 in / 27 out · $2.61e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Noah Williams | Noah Williams | match |
| noah.williams@example.com | noah.williams@example.com | match | |
| order_id | F-17 | F-17 | match |
| issue | wrong size | wrong size | match |
Judge: field overlap 1.000
{"name": "Noah Williams","email": "noah.williams@example.com","order_id": "F-17","issue": "wrong size"}
refundexact 1.000 · schema 1.000 · judge 1.000
Sofia Rossi (sofia.rossi@example.com) has not received the refund for order #G-303.
7.2 ms · 68 in / 28 out · $2.70e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Sofia Rossi | Sofia Rossi | match |
| sofia.rossi@example.com | sofia.rossi@example.com | match | |
| order_id | G-303 | G-303 | match |
| issue | refund not received | refund not received | match |
Judge: field overlap 1.000
{"name": "Sofia Rossi","email": "sofia.rossi@example.com","order_id": "G-303","issue": "refund not received"}
cancelexact 1.000 · schema 1.000 · judge 1.000
Jonah Kim (jonah.kim@example.com) asked to cancel order #H-88.
6.8 ms · 62 in / 25 out · $2.43e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Jonah Kim | Jonah Kim | match |
| jonah.kim@example.com | jonah.kim@example.com | match | |
| order_id | H-88 | H-88 | match |
| issue | cancel order | cancel order | match |
Judge: field overlap 1.000
{"name": "Jonah Kim","email": "jonah.kim@example.com","order_id": "H-88","issue": "cancel order"}
fixture-mutate
n 8 · exact 0/8 · schema 4/8
damagedexact 0.000 · schema 1.000 · judge 0.750
Customer Jane Doe (jane@example.com) says order #A-1042 arrived damaged.
8.1 ms · 65 in / 25 out · $2.47e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Jane Doe | Jane Doe | match |
| jane@example.com | jane@example.com | match | |
| order_id | A-1042 | a-1042 | differs |
| issue | arrived damaged | arrived damaged | match |
Judge: field overlap 0.750
{"name": "Jane Doe","email": "jane@example.com",- "order_id": "A-1042",+ "order_id": "a-1042","issue": "arrived damaged"}
missingexact 0.000 · schema 0.000 · judge 0.750
Luis Ortega (luis.ortega@example.com) cannot find order #B-2201; the item is missing.
8.9 ms · 68 in / 18 out · $2.10e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Luis Ortega | Luis Ortega | match |
| luis.ortega@example.com | — | missing | |
| order_id | B-2201 | B-2201 | match |
| issue | missing item | missing item | match |
- email: Field required
Judge: field overlap 0.750
{"name": "Luis Ortega",- "email": "luis.ortega@example.com","order_id": "B-2201","issue": "missing item"}
billingexact 0.000 · schema 1.000 · judge 0.750
Priya Shah (priya.shah@example.com) was charged twice for order #C-118.
9.6 ms · 65 in / 26 out · $2.53e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Priya Shah | Priya Shah | match |
| priya.shah@example.com | priya.shah@example.com | match | |
| order_id | C-118 | c-118 | differs |
| issue | charged twice | charged twice | match |
Judge: field overlap 0.750
{"name": "Priya Shah","email": "priya.shah@example.com",- "order_id": "C-118",+ "order_id": "c-118","issue": "charged twice"}
addressexact 0.000 · schema 0.000 · judge 0.750
Kenji Sato (kenji.sato@example.com) received order #D-9 at the wrong address.
9.2 ms · 66 in / 17 out · $2.01e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Kenji Sato | Kenji Sato | match |
| kenji.sato@example.com | — | missing | |
| order_id | D-9 | D-9 | match |
| issue | wrong address | wrong address | match |
- email: Field required
Judge: field overlap 0.750
{"name": "Kenji Sato",- "email": "kenji.sato@example.com","order_id": "D-9","issue": "wrong address"}
lateexact 0.000 · schema 1.000 · judge 0.750
Amira Hassan (amira.hassan@example.com) is still waiting on order #E-440; delivery is late.
8.2 ms · 70 in / 27 out · $2.67e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Amira Hassan | Amira Hassan | match |
| amira.hassan@example.com | amira.hassan@example.com | match | |
| order_id | E-440 | e-440 | differs |
| issue | late delivery | late delivery | match |
Judge: field overlap 0.750
{"name": "Amira Hassan","email": "amira.hassan@example.com",- "order_id": "E-440",+ "order_id": "e-440","issue": "late delivery"}
sizeexact 0.000 · schema 0.000 · judge 0.750
Noah Williams (noah.williams@example.com) got the wrong size in order #F-17.
7.8 ms · 66 in / 17 out · $2.01e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Noah Williams | Noah Williams | match |
| noah.williams@example.com | — | missing | |
| order_id | F-17 | F-17 | match |
| issue | wrong size | wrong size | match |
- email: Field required
Judge: field overlap 0.750
{"name": "Noah Williams",- "email": "noah.williams@example.com","order_id": "F-17","issue": "wrong size"}
refundexact 0.000 · schema 1.000 · judge 0.750
Sofia Rossi (sofia.rossi@example.com) has not received the refund for order #G-303.
6.9 ms · 68 in / 28 out · $2.70e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Sofia Rossi | Sofia Rossi | match |
| sofia.rossi@example.com | sofia.rossi@example.com | match | |
| order_id | G-303 | g-303 | differs |
| issue | refund not received | refund not received | match |
Judge: field overlap 0.750
{"name": "Sofia Rossi","email": "sofia.rossi@example.com",- "order_id": "G-303",+ "order_id": "g-303","issue": "refund not received"}
cancelexact 0.000 · schema 0.000 · judge 0.750
Jonah Kim (jonah.kim@example.com) asked to cancel order #H-88.
7.1 ms · 62 in / 17 out · $1.95e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Jonah Kim | Jonah Kim | match |
| jonah.kim@example.com | — | missing | |
| order_id | H-88 | H-88 | match |
| issue | cancel order | cancel order | match |
- email: Field required
Judge: field overlap 0.750
{"name": "Jonah Kim",- "email": "jonah.kim@example.com","order_id": "H-88","issue": "cancel order"}
fixture-prose
n 8 · exact 0/8 · schema 0/8
damagedexact 0.000 · schema 0.000 · judge 0.000
Customer Jane Doe (jane@example.com) says order #A-1042 arrived damaged.
7.7 ms · 65 in / 15 out · $1.87e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Jane Doe | — | no JSON |
| jane@example.com | — | no JSON | |
| order_id | A-1042 | — | no JSON |
| issue | arrived damaged | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Jane Doe",- "email": "jane@example.com",- "order_id": "A-1042",- "issue": "arrived damaged"- }+ I extracted a ticket but this fixture does not emit JSON.
missingexact 0.000 · schema 0.000 · judge 0.000
Luis Ortega (luis.ortega@example.com) cannot find order #B-2201; the item is missing.
8.3 ms · 68 in / 15 out · $1.92e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Luis Ortega | — | no JSON |
| luis.ortega@example.com | — | no JSON | |
| order_id | B-2201 | — | no JSON |
| issue | missing item | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Luis Ortega",- "email": "luis.ortega@example.com",- "order_id": "B-2201",- "issue": "missing item"- }+ I extracted a ticket but this fixture does not emit JSON.
billingexact 0.000 · schema 0.000 · judge 0.000
Priya Shah (priya.shah@example.com) was charged twice for order #C-118.
7.9 ms · 65 in / 15 out · $1.87e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Priya Shah | — | no JSON |
| priya.shah@example.com | — | no JSON | |
| order_id | C-118 | — | no JSON |
| issue | charged twice | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Priya Shah",- "email": "priya.shah@example.com",- "order_id": "C-118",- "issue": "charged twice"- }+ I extracted a ticket but this fixture does not emit JSON.
addressexact 0.000 · schema 0.000 · judge 0.000
Kenji Sato (kenji.sato@example.com) received order #D-9 at the wrong address.
6.9 ms · 66 in / 15 out · $1.89e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Kenji Sato | — | no JSON |
| kenji.sato@example.com | — | no JSON | |
| order_id | D-9 | — | no JSON |
| issue | wrong address | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Kenji Sato",- "email": "kenji.sato@example.com",- "order_id": "D-9",- "issue": "wrong address"- }+ I extracted a ticket but this fixture does not emit JSON.
lateexact 0.000 · schema 0.000 · judge 0.000
Amira Hassan (amira.hassan@example.com) is still waiting on order #E-440; delivery is late.
7.1 ms · 70 in / 15 out · $1.95e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Amira Hassan | — | no JSON |
| amira.hassan@example.com | — | no JSON | |
| order_id | E-440 | — | no JSON |
| issue | late delivery | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Amira Hassan",- "email": "amira.hassan@example.com",- "order_id": "E-440",- "issue": "late delivery"- }+ I extracted a ticket but this fixture does not emit JSON.
sizeexact 0.000 · schema 0.000 · judge 0.000
Noah Williams (noah.williams@example.com) got the wrong size in order #F-17.
6.9 ms · 66 in / 15 out · $1.89e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Noah Williams | — | no JSON |
| noah.williams@example.com | — | no JSON | |
| order_id | F-17 | — | no JSON |
| issue | wrong size | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Noah Williams",- "email": "noah.williams@example.com",- "order_id": "F-17",- "issue": "wrong size"- }+ I extracted a ticket but this fixture does not emit JSON.
refundexact 0.000 · schema 0.000 · judge 0.000
Sofia Rossi (sofia.rossi@example.com) has not received the refund for order #G-303.
8.5 ms · 68 in / 15 out · $1.92e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Sofia Rossi | — | no JSON |
| sofia.rossi@example.com | — | no JSON | |
| order_id | G-303 | — | no JSON |
| issue | refund not received | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Sofia Rossi",- "email": "sofia.rossi@example.com",- "order_id": "G-303",- "issue": "refund not received"- }+ I extracted a ticket but this fixture does not emit JSON.
cancelexact 0.000 · schema 0.000 · judge 0.000
Jonah Kim (jonah.kim@example.com) asked to cancel order #H-88.
6.2 ms · 62 in / 15 out · $1.83e-5
| Field | Expected | Predicted | Match |
|---|---|---|---|
| name | Jonah Kim | — | no JSON |
| jonah.kim@example.com | — | no JSON | |
| order_id | H-88 | — | no JSON |
| issue | cancel order | — | no JSON |
- output is not valid JSON
Judge: field overlap 0.000
- {- "name": "Jonah Kim",- "email": "jonah.kim@example.com",- "order_id": "H-88",- "issue": "cancel order"- }+ I extracted a ticket but this fixture does not emit JSON.