Workflows / paytm-settlement-queries · Gold

Reference answers (gold set)

Done: v1 picked · 216 rows

Gold v1 proposed by Dvar · Review · 216 of 216 accepted · Dropped —

216 rows in gold v1 · 216 ready · 0 not ready

216

Rows

7

Topics

3

Languages

216 of 216

Verified

216 rows give a pass rate within ±7 points (95% confidence), with 10% spare.

Rows

A member can swap or drop a row.

Topics

Language

en 129
hi 17
Rows. One row per customer message in this version.
Customer messageTopicGroupScoreState
Tool results: get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlement","settlement_cycle_change","holds","failed_settlements","refunds_and_disputes","payouts","bank_account_change"]} get_bank_account_status: {Account and plan changes—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-842200","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-326518","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-225945","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-595679","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"}Account and plan changes—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-124445","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"section":"bank_account_change","text":"The assistant never changes the settlement bank account and never settAccount and plan changes—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-841140","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—1.00Accepted Today's reply
Tool results: get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlement","settlement_cycle_change","holds","failed_settlements","refunds_and_disputes","payouts","bank_account_change"]} get_merchant_profile: {"meAccount and plan changes—0.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-842200","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—0.83Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-842200","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—0.67Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-595679","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"}Account and plan changes—0.67Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-225945","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—0.67Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-124445","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"section":"bank_account_change","text":"The assistant never changes the settlement bank account and never settAccount and plan changes—0.67Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-326518","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_policy: {"error":"unknown section","sections":["settlement_cycle","holidays_and_cutoff","fees_and_gst","instant_settlemAccount and plan changes—0.67Accepted Today's reply
Rows by topic and language
Row counts. How many rows each topic has in each language.
Topicenhi-LatnhiAll
Settlement status3823566
Amount and deductions2615445
Delayed, on hold or failed1817338
UTR and proof179127
Account and plan changes144018
Payouts121316
Instant settlement4116
All1297017216
Version history1 version
  • Gold v1 Proposed by Dvar · 20 Oct · Locked with rubric v1 · 216 of 216 verified
——