json_extract

8892d52811974d4b9e0a16513745eaca

CPU

Intel(R) Xeon(R) Processor

family 6 · model 207 · stepping 2 · 4 logical CPUs

Memory

15.63 GiB

3.45 GiB available when this file was written

Server

Ollama 0.40.5

llamacpp · libggml-cpu-sapphirerapids.so

Recorded

2026-10-16 05:09:30.501 UTC

Linux 6.12.94+ x86_64

qwen2.5:0.5b

Q4_K_M · n 8 · exact 1/8 · schema 8/8

damagedexact 0.000 · schema 1.000 · judge not run

Customer Jane Doe (jane@example.com) says order #A-1042 arrived damaged.

1852.7 ms · 75 in / 47 out · $0

Field	Expected	Predicted	Match
name	Jane Doe	Jane Doe	match
email	jane@example.com	jane@example.com	match
order_id	A-1042	A-1042	match
issue	arrived damaged	Order arrived damaged	differs

  {
    "name": "Jane Doe",
    "email": "jane@example.com",
    "order_id": "A-1042",
-   "issue": "arrived damaged"
+   "issue": "Order arrived damaged"
  }

missingexact 0.000 · schema 1.000 · judge not run

Luis Ortega (luis.ortega@example.com) cannot find order #B-2201; the item is missing.

749.2 ms · 83 in / 49 out · $0

Field	Expected	Predicted	Match
name	Luis Ortega	Luis Ortega	match
email	luis.ortega@example.com	luis.ortega@example.com	match
order_id	B-2201	B-2201	match
issue	missing item	The item is missing	differs

  {
    "name": "Luis Ortega",
    "email": "luis.ortega@example.com",
    "order_id": "B-2201",
-   "issue": "missing item"
+   "issue": "The item is missing"
  }

billingexact 0.000 · schema 1.000 · judge not run

Priya Shah (priya.shah@example.com) was charged twice for order #C-118.

760.7 ms · 77 in / 52 out · $0

Field	Expected	Predicted	Match
name	Priya Shah	Priya Shah	match
email	priya.shah@example.com	priya.shah@example.com	match
order_id	C-118	C-118	match
issue	charged twice	Charge twice for order #C-118	differs

  {
    "name": "Priya Shah",
    "email": "priya.shah@example.com",
    "order_id": "C-118",
-   "issue": "charged twice"
+   "issue": "Charge twice for order #C-118"
  }

addressexact 0.000 · schema 1.000 · judge not run

Kenji Sato (kenji.sato@example.com) received order #D-9 at the wrong address.

719.8 ms · 77 in / 47 out · $0

Field	Expected	Predicted	Match
name	Kenji Sato	Kenji Sato	match
email	kenji.sato@example.com	kenji.sato@example.com	match
order_id	D-9	D-9	match
issue	wrong address	Order received at the wrong address	differs

  {
    "name": "Kenji Sato",
    "email": "kenji.sato@example.com",
    "order_id": "D-9",
-   "issue": "wrong address"
+   "issue": "Order received at the wrong address"
  }

lateexact 0.000 · schema 1.000 · judge not run

Amira Hassan (amira.hassan@example.com) is still waiting on order #E-440; delivery is late.

713.1 ms · 82 in / 46 out · $0

Field	Expected	Predicted	Match
name	Amira Hassan	Amira Hassan	match
email	amira.hassan@example.com	amira.hassan@example.com	match
order_id	E-440	E-440	match
issue	late delivery	delivery is late	differs

  {
    "name": "Amira Hassan",
    "email": "amira.hassan@example.com",
    "order_id": "E-440",
-   "issue": "late delivery"
+   "issue": "delivery is late"
  }

sizeexact 0.000 · schema 1.000 · judge not run

Noah Williams (noah.williams@example.com) got the wrong size in order #F-17.

658.6 ms · 78 in / 46 out · $0

Field	Expected	Predicted	Match
name	Noah Williams	Noah Williams	match
email	noah.williams@example.com	noah.williams@example.com	match
order_id	F-17	F-17	match
issue	wrong size	got the wrong size	differs

  {
    "name": "Noah Williams",
    "email": "noah.williams@example.com",
    "order_id": "F-17",
-   "issue": "wrong size"
+   "issue": "got the wrong size"
  }

refundexact 0.000 · schema 1.000 · judge not run

Sofia Rossi (sofia.rossi@example.com) has not received the refund for order #G-303.

681.5 ms · 82 in / 49 out · $0

Field	Expected	Predicted	Match
name	Sofia Rossi	Sofia Rossi	match
email	sofia.rossi@example.com	sofia.rossi@example.com	match
order_id	G-303	G-303	match
issue	refund not received	Refund not received	differs

  {
    "name": "Sofia Rossi",
    "email": "sofia.rossi@example.com",
    "order_id": "G-303",
-   "issue": "refund not received"
+   "issue": "Refund not received"
  }

cancelexact 1.000 · schema 1.000 · judge not run

Jonah Kim (jonah.kim@example.com) asked to cancel order #H-88.

582.3 ms · 75 in / 43 out · $0

Field	Expected	Predicted	Match
name	Jonah Kim	Jonah Kim	match
email	jonah.kim@example.com	jonah.kim@example.com	match
order_id	H-88	H-88	match
issue	cancel order	cancel order	match

  {
    "name": "Jonah Kim",
    "email": "jonah.kim@example.com",
    "order_id": "H-88",
    "issue": "cancel order"
  }

smollm2:360m

F16 · n 8 · exact 0/8 · schema 7/8

damagedexact 0.000 · schema 0.000 · judge not run

Customer Jane Doe (jane@example.com) says order #A-1042 arrived damaged.

2669.2 ms · 87 in / 53 out · $0

Field	Expected	Predicted	Match
name	Jane Doe	—	no JSON
email	jane@example.com	—	no JSON
order_id	A-1042	—	no JSON
issue	arrived damaged	—	no JSON

output is not valid JSON

  {
    "name": "Jane Doe",
    "email": "jane@example.com",
    "order_id": "A-1042",
-   "issue": "arrived damaged"
- }
+   "issue": "order #A-1042 arrived damaged."

missingexact 0.000 · schema 1.000 · judge not run

Luis Ortega (luis.ortega@example.com) cannot find order #B-2201; the item is missing.

1143.8 ms · 95 in / 54 out · $0

Field	Expected	Predicted	Match
name	Luis Ortega	Luis Ortega	match
email	luis.ortega@example.com	luis.ortega@example.com	match
order_id	B-2201	B-2201	match
issue	missing item	The item is missing.	differs

  {
    "name": "Luis Ortega",
    "email": "luis.ortega@example.com",
    "order_id": "B-2201",
-   "issue": "missing item"
+   "issue": "The item is missing."
  }

billingexact 0.000 · schema 1.000 · judge not run

Priya Shah (priya.shah@example.com) was charged twice for order #C-118.

1156.0 ms · 90 in / 55 out · $0

Field	Expected	Predicted	Match
name	Priya Shah	Priya Shah	match
email	priya.shah@example.com	priya.shah@example.com	match
order_id	C-118	C-118	match
issue	charged twice	order #C-118	differs

  {
    "name": "Priya Shah",
    "email": "priya.shah@example.com",
    "order_id": "C-118",
-   "issue": "charged twice"
+   "issue": "order #C-118"
  }

addressexact 0.000 · schema 1.000 · judge not run

Kenji Sato (kenji.sato@example.com) received order #D-9 at the wrong address.

989.7 ms · 89 in / 49 out · $0

Field	Expected	Predicted	Match
name	Kenji Sato	Kenji Sato	match
email	kenji.sato@example.com	kenji.sato@example.com	match
order_id	D-9	D-9	match
issue	wrong address	wrong_address	differs

  {
    "name": "Kenji Sato",
    "email": "kenji.sato@example.com",
    "order_id": "D-9",
-   "issue": "wrong address"
+   "issue": "wrong_address"
  }

lateexact 0.000 · schema 1.000 · judge not run

Amira Hassan (amira.hassan@example.com) is still waiting on order #E-440; delivery is late.

1053.8 ms · 93 in / 50 out · $0

Field	Expected	Predicted	Match
name	Amira Hassan	Amira Hassan	match
email	amira.hassan@example.com	amira.hassan@example.com	match
order_id	E-440	E-440	match
issue	late delivery	delivery is late	differs

  {
    "name": "Amira Hassan",
    "email": "amira.hassan@example.com",
    "order_id": "E-440",
-   "issue": "late delivery"
+   "issue": "delivery is late"
  }

sizeexact 0.000 · schema 1.000 · judge not run

Noah Williams (noah.williams@example.com) got the wrong size in order #F-17.

1315.4 ms · 90 in / 60 out · $0

Field	Expected	Predicted	Match
name	Noah Williams	Noah Williams	match
email	noah.williams@example.com	noah.williams@example.com	match
order_id	F-17	F-17	match
issue	wrong size	The order was incorrectly sized. Please contact support to correct the issue.	differs

  {
    "name": "Noah Williams",
    "email": "noah.williams@example.com",
    "order_id": "F-17",
-   "issue": "wrong size"
+   "issue": "The order was incorrectly sized. Please contact support to correct the issue."
  }

refundexact 0.000 · schema 1.000 · judge not run

Sofia Rossi (sofia.rossi@example.com) has not received the refund for order #G-303.

1176.2 ms · 94 in / 57 out · $0

Field	Expected	Predicted	Match
name	Sofia Rossi	Sofia Rossi	match
email	sofia.rossi@example.com	sofia.rossi@example.com	match
order_id	G-303	G-303	match
issue	refund not received	order #G-303	differs

  {
    "name": "Sofia Rossi",
    "email": "sofia.rossi@example.com",
    "order_id": "G-303",
-   "issue": "refund not received"
+   "issue": "order #G-303"
  }

cancelexact 0.000 · schema 1.000 · judge not run

Jonah Kim (jonah.kim@example.com) asked to cancel order #H-88.

1015.0 ms · 88 in / 49 out · $0

Field	Expected	Predicted	Match
name	Jonah Kim	Jonah Kim	match
email	jonah.kim@example.com	jonah.kim@example.com	match
order_id	H-88	H-88	match
issue	cancel order	cancelled	differs

  {
    "name": "Jonah Kim",
    "email": "jonah.kim@example.com",
    "order_id": "H-88",
-   "issue": "cancel order"
+   "issue": "cancelled"
  }

llama3.2:1b

Q8_0 · n 8 · exact 3/8 · schema 8/8

damagedexact 0.000 · schema 1.000 · judge not run

Customer Jane Doe (jane@example.com) says order #A-1042 arrived damaged.

3733.2 ms · 85 in / 40 out · $0

Field	Expected	Predicted	Match
name	Jane Doe	Jane Doe	match
email	jane@example.com	jane@example.com	match
order_id	A-1042	A-1042	match
issue	arrived damaged	damaged	differs

  {
    "name": "Jane Doe",
    "email": "jane@example.com",
    "order_id": "A-1042",
-   "issue": "arrived damaged"
+   "issue": "damaged"
  }

missingexact 0.000 · schema 1.000 · judge not run

Luis Ortega (luis.ortega@example.com) cannot find order #B-2201; the item is missing.

1166.2 ms · 93 in / 47 out · $0

Field	Expected	Predicted	Match
name	Luis Ortega	Luis Ortega	match
email	luis.ortega@example.com	luis.ortega@example.com	match
order_id	B-2201	B-2201	match
issue	missing item	The item is missing.	differs

  {
    "name": "Luis Ortega",
    "email": "luis.ortega@example.com",
    "order_id": "B-2201",
-   "issue": "missing item"
+   "issue": "The item is missing."
  }

billingexact 1.000 · schema 1.000 · judge not run

Priya Shah (priya.shah@example.com) was charged twice for order #C-118.

1034.3 ms · 87 in / 42 out · $0

Field	Expected	Predicted	Match
name	Priya Shah	Priya Shah	match
email	priya.shah@example.com	priya.shah@example.com	match
order_id	C-118	C-118	match
issue	charged twice	charged twice	match

  {
    "name": "Priya Shah",
    "email": "priya.shah@example.com",
    "order_id": "C-118",
    "issue": "charged twice"
  }

addressexact 0.000 · schema 1.000 · judge not run

Kenji Sato (kenji.sato@example.com) received order #D-9 at the wrong address.

1223.1 ms · 89 in / 51 out · $0

Field	Expected	Predicted	Match
name	Kenji Sato	Kenji Sato	match
email	kenji.sato@example.com	kenji.sato@example.com	match
order_id	D-9	D-9	match
issue	wrong address	received order #D-9 at the wrong address.	differs

  {
    "name": "Kenji Sato",
    "email": "kenji.sato@example.com",
    "order_id": "D-9",
-   "issue": "wrong address"
+   "issue": "received order #D-9 at the wrong address."
  }

lateexact 0.000 · schema 1.000 · judge not run

Amira Hassan (amira.hassan@example.com) is still waiting on order #E-440; delivery is late.

1081.5 ms · 92 in / 44 out · $0

Field	Expected	Predicted	Match
name	Amira Hassan	Amira Hassan	match
email	amira.hassan@example.com	amira.hassan@example.com	match
order_id	E-440	E-440	match
issue	late delivery	delivery is late	differs

  {
    "name": "Amira Hassan",
    "email": "amira.hassan@example.com",
    "order_id": "E-440",
-   "issue": "late delivery"
+   "issue": "delivery is late"
  }

sizeexact 1.000 · schema 1.000 · judge not run

Noah Williams (noah.williams@example.com) got the wrong size in order #F-17.

1042.9 ms · 89 in / 43 out · $0

Field	Expected	Predicted	Match
name	Noah Williams	Noah Williams	match
email	noah.williams@example.com	noah.williams@example.com	match
order_id	F-17	F-17	match
issue	wrong size	wrong size	match

  {
    "name": "Noah Williams",
    "email": "noah.williams@example.com",
    "order_id": "F-17",
    "issue": "wrong size"
  }

refundexact 0.000 · schema 1.000 · judge not run

Sofia Rossi (sofia.rossi@example.com) has not received the refund for order #G-303.

1164.5 ms · 92 in / 48 out · $0

Field	Expected	Predicted	Match
name	Sofia Rossi	Sofia Rossi	match
email	sofia.rossi@example.com	sofia.rossi@example.com	match
order_id	G-303	G-303	match
issue	refund not received	has not received the refund	differs

  {
    "name": "Sofia Rossi",
    "email": "sofia.rossi@example.com",
    "order_id": "G-303",
-   "issue": "refund not received"
+   "issue": "has not received the refund"
  }

cancelexact 1.000 · schema 1.000 · judge not run

Jonah Kim (jonah.kim@example.com) asked to cancel order #H-88.

1012.6 ms · 86 in / 42 out · $0

Field	Expected	Predicted	Match
name	Jonah Kim	Jonah Kim	match
email	jonah.kim@example.com	jonah.kim@example.com	match
order_id	H-88	H-88	match
issue	cancel order	cancel order	match

  {
    "name": "Jonah Kim",
    "email": "jonah.kim@example.com",
    "order_id": "H-88",
    "issue": "cancel order"
  }