Sanctions Desk gathers and checks the evidence for every sanctions-screening alert and recommends an outcome; a person with the right entitlement approves it. One alert, start to finish · The problem it works on
Recorded runs / ALR-0073
ALR-0073: Payment reference names a watched place
What happened: The decision step proposed a close once; the critic approved it; the policy guard raised it to ESCALATE_L2 (rule: jurisdiction). Outcome: Escalate to level 2 (ESCALATE_L2), as the label expects.
Outcomes: CLOSE_FALSE_POSITIVE = close as a false positive · ESCALATE_L2 = escalate to level 2 · NEED_MORE_INFO = ask for more information · RECOMMEND_BLOCK = recommend a block (two people must confirm). Raise-only: the policy guard can make an outcome more cautious, never less.
A payment whose reference names a watched place: the decision step proposed a close, the critic approved it, and the raise-only policy guard stopped it.
Outcome
- Desk recommendation
- Escalate to level 2 (ESCALATE_L2)
- Label in the case file
- Escalate to level 2 (ESCALATE_L2); also acceptable: RECOMMEND_BLOCK (eval/cases/exam.json, case EX-064)
- Compared with the label
- matches the label
- Code's first finding
- Close as a false positive (CLOSE_FALSE_POSITIVE)
- Critic
- 1 round(s), final: approved
- Model calls
- 3 (1 local, 2 cloud); 3 with a signed receipt, all verified
- Run
- routed-20261023T133311Z, policy version 5, 32 steps in 45.6 s
Case note from the case file: The name alone would not hold the payment; the route touches a watched jurisdiction, so a person decides.
What the reviewer does next: The sealed record holds no human decision yet, so nothing has been prepared. The reviewer approves Escalate to level 2 (ESCALATE_L2) or overrides it with a reason. On approval the desk prepares an escalation ticket for a level-2 review for ALR-0073, and, for this payment alert, a draft hold instruction for the pending payment. Nothing is sent.
Why the close was stopped
The decision step proposed a close once; the run ended at Escalate to level 2 (ESCALATE_L2). What each check said, in order:
- critic (step 29): approved
- policy guard (raise-only rules in code): CLOSE_FALSE_POSITIVE raised to ESCALATE_L2. Checks that raised or flagged: jurisdiction: block (watched jurisdiction: IR (payment reference mentions "[free text withheld]"))
Steps in order
Each line is one event from the run's trace (trace.jsonl.gz). The model is the one that served the call, as the signed receipt records it.
| # | Agent | Action | Status | What happened | Model | Receipt | Zetaris read |
|---|---|---|---|---|---|---|---|
| 0 | triage | plan | ok | in: customer alert ALR-0073 path: customer review; the critic may send the recommendation back up to 3 times | |||
| 1 | evidence | read_semantic_layer | ok | screening_usl v4efa3ddddfbe: 14 tables | |||
| 2 | evidence | find_alert | ok | in: alert_id=ALR-0073 1 rows | alert, 1 rows85ee178c-bd11-4e43-b928-eef5a2720801 | ||
| 3 | evidence | find_customer | ok | in: customer_id=CUST-0062 1 rows | customer, 1 rowse2f75950-7d3a-4f69-bf16-427036f4c713 | ||
| 4 | evidence | find_payment | ok | in: payment_id=PAY-00014 1 rows | payment, 1 rows049f6cbf-a4c8-40e7-9ea9-29076922f08a | ||
| 5 | evidence | find_customer_identifier | ok | in: customer_id=CUST-0062 1 rows | customer_identifier, 1 rows351610b4-0084-4272-88ec-460368bf65c4 | ||
| 6 | evidence | find_list_entry | ok | in: entry_id=OFAC-17015 2 rows | list_entry, 2 rows0089edce-f6d1-4283-a3d4-8abc98282bc8 | ||
| 7 | evidence | find_list_alias | ok | in: entry_id=OFAC-17015 26 rows | list_alias, 26 rowsbab119ca-d51b-48c9-ad61-5e08d64ff42d | ||
| 8 | evidence | find_list_dob | ok | in: entry_id=OFAC-17015 0 rows | list_dob, 0 rows9e90b65f-1ff7-445f-84d0-54eec7817bf4 | ||
| 9 | evidence | find_list_country | ok | in: entry_id=OFAC-17015 8 rows | list_country, 8 rowsa65433f6-cac0-40f6-af51-8a7cee9353d5 | ||
| 10 | evidence | find_list_identifier | ok | in: entry_id=OFAC-17015 8 rows | list_identifier, 8 rows885f23fe-7040-4492-9915-fb82582ca4a9 | ||
| 11 | evidence | find_business_definition | ok | in: status=approved 6 rows | business_definition, 6 rowsaa151aff-ce41-4941-af30-63ee125e90fc | ||
| 12 | evidence | definitions | ok | counterparty_match@1, effective_ownership_threshold@1, false_positive@2, strong_identifier@1, true_match@1 | |||
| 13 | evidence | identifier_overlap | ok | no identifier matches | customer_identifier, 0 rowsb79f6982-25c1-4b52-b2be-5a8961ff959a | ||
| 14 | evidence | data_quality | ok | in: customer.dob_present_for_individuals for CUST-0062 record passes this rule | customer, 15 rowsa14e09ed-733d-479e-9ba3-87a515bb56bb | ||
| 15 | evidence | data_quality | ok | in: customer.nationality_is_iso2 for CUST-0062 record passes this rule | customer, 1 rows176d3b59-6a4b-4b96-a028-d5de539adad8 | ||
| 16 | evidence | data_quality | ok | in: payment.payment_amount_positive for PAY-00014 record passes this rule | payment, 0 rows9838752d-ef2f-4ee0-be96-99e6a0f61867 | ||
| 17 | evidence | data_quality | ok | in: payment.counterparty_country_valid for PAY-00014 record passes this rule | payment, 4 rowsa7416eba-ec1a-4734-a31b-57d69a9e974c | ||
| 18 | evidence | data_quality | ok | in: payment.payment_bank_countries_valid for PAY-00014 record passes this rule | payment, 0 rows02674618-c9c8-4311-9777-046c8d42eb4c | ||
| 19 | policy_guard | model_answer | ok | valid answer on attempt 1 | Nemotron 3.5 Lightning 30B-A3B (Runtime GGUF) (local, Lightning) | rcpt_req_26fcegh5signature valid, key pinned | |
| 20 | policy_guard | screen_inbound | ok | in: 31 text field(s) from the data no instruction-like text | |||
| 21 | matching | compare_party | ok | in: CUST-0062 vs OFAC-17015 weak: name 1.00 (exact) vs primary "STATE CORPORATION BANK FOR DEVELOPMENT AND FOREIGN ECONOMIC AFFAIRS VNESHECONOMBANK"; date of birth: missing_customer; country: conflict | |||
| 22 | triage | difficulty | ok | contested (weak; date of birth missing_customer; country conflict) | |||
| 23 | memory | recall | ok | in: customer CUST-0062 and OFAC-17015 no earlier decision about this pair | disposition, 0 rowscf5cdb20-cc2b-4b52-9337-3e1a3ee9cd13 | ||
| 24 | triage | path | ok | reason: the structured evidence points to CLOSE_FALSE_POSITIVE, but there is free text to weigh: the payment reference | |||
| 25 | decision | model_answer | ok | valid answer on attempt 1 | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_t9gx190bsignature valid, key pinned | |
| 26 | decision | recommend | ok | CLOSE_FALSE_POSITIVE: The counterparty name matches exactly but the counterparty country NL is not among the listed party's address countries (CN, IN, RU). The comparison block flags false_positive as true, and per rules f | |||
| 27 | critic | verify_facts | ok | in: 5 cited facts 5 verified, 0 issues | |||
| 28 | critic | model_answer | ok | valid answer on attempt 1 | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_w1li6vf1signature valid, key pinned | |
| 29 | critic | judge | ok | approved | |||
| 30 | policy_guard | apply_policy | blocked | CLOSE_FALSE_POSITIVE raised to ESCALATE_L2 | |||
| 31 | reporter | seal_record | ok | record rec-eval-routed-EX-064 sealed |
Model calls and receipts
Each signature was checked when this page was built, with the same code as npm run evidence:verify (Ed25519 over the receipt body in receipts.jsonl.gz); the build stops if one does not verify, is missing, or names a different model from the trace. The Nightshift runtime's receipt key is pinned in config/default.json, so signature valid, key pinned shows the receipt was not changed and that this runtime signed it; a receipt signed by any other key stops the build.
| # | Step | Mode asked for | Model that served it | Receipt | App | Checked now | At run time | Time | Tokens in / out |
|---|---|---|---|---|---|---|---|---|---|
| 19 | policy_guard | meterless/fast | Nemotron 3.5 Lightning 30B-A3B (Runtime GGUF) (local, Lightning) | rcpt_req_26fcegh5 | sanctions-desk-guard | signature valid, key pinned | valid_pinned | 0.6 s | 853 / 19 |
| 25 | decision | meterless/deep | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_t9gx190b | sanctions-desk-reasoning | signature valid, key pinned | valid_pinned | 33.5 s | 6272 / 520 |
| 28 | critic | meterless/judge | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_w1li6vf1 | sanctions-desk-reasoning | signature valid, key pinned | valid_pinned | 6.0 s | 4812 / 150 |
The whole run passes the same check: 260 receipts with valid signatures, 260 model calls in the trace that name a receipt, none missing and none naming a different model from its receipt.
Signing key fingerprint (first 16 hex of SHA-256): 1835d1eab9211f97.
Zetaris queries
The statements are exactly as the sealed decision record of this run keeps them (output_examples/close-stopped-by-policy-guard/decision-record.json; its hash matches the one the trace logged when it was sealed). The record keeps each statement and a hash of each row returned, not the rows themselves.
| Agent | Table | Rows | Statement | Query id |
|---|---|---|---|---|
| evidence | alert | 1 | SELECT `alert_id`, `alert_type`, `alert_source`, `customer_id`, `payment_id`, `list_id`, `entry_id`, `matched_name`, `match_score`, `raised_at`, `status` FROM lightning.metastore.sanctions.screening_usl.alert WHERE `alert_id` = 'ALR-0073' ORDER BY `alert_id` LIMIT 200 | 85ee178c-bd11-4e43-b928-eef5a2720801 |
| evidence | customer | 1 | SELECT `customer_id`, `customer_type`, `full_name`, `date_of_birth`, `nationality`, `residence_country`, `onboarding_date`, `risk_rating`, `desk`, `notes`, `data_origin` FROM lightning.metastore.sanctions.screening_usl.customer WHERE `customer_id` = 'CUST-0062' ORDER BY `customer_id` LIMIT 200 | e2f75950-7d3a-4f69-bf16-427036f4c713 |
| evidence | payment | 1 | SELECT `payment_id`, `customer_id`, `account_id`, `direction`, `amount`, `currency`, `counterparty_name`, `counterparty_country`, `counterparty_bank_bic`, `beneficiary_bank_country`, `intermediary_bank_country`, `payment_reference`, `value_date`, `status` FROM lightning.metastore.sanctions.screening_usl.payment WHERE `payment_id` = 'PAY-00014' ORDER BY `payment_id` LIMIT 200 | 049f6cbf-a4c8-40e7-9ea9-29076922f08a |
| evidence | customer_identifier | 1 | SELECT `identifier_id`, `customer_id`, `id_type`, `id_number`, `issuing_country` FROM lightning.metastore.sanctions.screening_usl.customer_identifier WHERE `customer_id` = 'CUST-0062' ORDER BY `identifier_id` LIMIT 200masked in the result: id_number | 351610b4-0084-4272-88ec-460368bf65c4 |
| evidence | list_entry | 2 | SELECT `entry_id`, `list_id`, `source_uid`, `party_kind`, `primary_name`, `primary_name_script`, `name_normalised`, `listed_on`, `sanctions_list`, `remarks`, `snapshot_id`, `content_hash` FROM lightning.metastore.sanctions.screening_usl.list_entry WHERE `entry_id` = 'OFAC-17015' ORDER BY `entry_id` LIMIT 200 | 0089edce-f6d1-4283-a3d4-8abc98282bc8 |
| evidence | list_alias | 26 | SELECT `alias_id`, `entry_id`, `alias_name`, `alias_type`, `script`, `name_normalised`, `is_primary`, `is_strong` FROM lightning.metastore.sanctions.screening_usl.list_alias WHERE `entry_id` = 'OFAC-17015' ORDER BY `alias_id` LIMIT 200 | bab119ca-d51b-48c9-ad61-5e08d64ff42d |
| evidence | list_dob | 0 | SELECT `dob_id`, `entry_id`, `dob_value`, `dob_precision`, `range_from`, `range_to`, `is_approximate` FROM lightning.metastore.sanctions.screening_usl.list_dob WHERE `entry_id` = 'OFAC-17015' ORDER BY `dob_id` LIMIT 200 | 9e90b65f-1ff7-445f-84d0-54eec7817bf4 |
| evidence | list_country | 8 | SELECT `country_link_id`, `entry_id`, `country_iso2`, `country_name`, `role`, `place` FROM lightning.metastore.sanctions.screening_usl.list_country WHERE `entry_id` = 'OFAC-17015' ORDER BY `country_link_id` LIMIT 200 | a65433f6-cac0-40f6-af51-8a7cee9353d5 |
| evidence | list_identifier | 8 | SELECT `identifier_id`, `entry_id`, `id_type`, `id_number`, `issuing_country`, `note` FROM lightning.metastore.sanctions.screening_usl.list_identifier WHERE `entry_id` = 'OFAC-17015' ORDER BY `identifier_id` LIMIT 200 | 885f23fe-7040-4492-9915-fb82582ca4a9 |
| evidence | business_definition | 6 | SELECT `definition_key`, `definition_id`, `version`, `name`, `statement`, `status`, `owner`, `effective_from` FROM lightning.metastore.sanctions.screening_usl.business_definition WHERE `status` = 'approved' ORDER BY `definition_key` LIMIT 200 | aa151aff-ce41-4941-af30-63ee125e90fc |
| evidence | customer_identifier | 0 | SELECT ci.id_type AS id_type, COUNT(*) AS n FROM lightning.metastore.sanctions.screening_usl.customer_identifier ci JOIN lightning.metastore.sanctions.screening_usl.list_identifier li ON regexp_replace(upper(ci.id_number), '[^A-Z0-9]', '') = regexp_replace(upper(li.id_number), '[^A-Z0-9]', '') WHERE ci.customer_id = 'CUST-0062' AND li.entry_id = 'OFAC-17015' GROUP BY ci.id_type | b79f6982-25c1-4b52-b2be-5a8961ff959a |
| evidence | customer | 15 | SHOW DQ INVALID RECORD dob_present_for_individuals TABLE lightning.metastore.sanctions.screening_usl.customer | a14e09ed-733d-479e-9ba3-87a515bb56bb |
| evidence | customer | 1 | SHOW DQ INVALID RECORD nationality_is_iso2 TABLE lightning.metastore.sanctions.screening_usl.customer | 176d3b59-6a4b-4b96-a028-d5de539adad8 |
| evidence | payment | 0 | SHOW DQ INVALID RECORD payment_amount_positive TABLE lightning.metastore.sanctions.screening_usl.payment | 9838752d-ef2f-4ee0-be96-99e6a0f61867 |
| evidence | payment | 4 | SHOW DQ INVALID RECORD counterparty_country_valid TABLE lightning.metastore.sanctions.screening_usl.payment | a7416eba-ec1a-4734-a31b-57d69a9e974c |
| evidence | payment | 0 | SHOW DQ INVALID RECORD payment_bank_countries_valid TABLE lightning.metastore.sanctions.screening_usl.payment | 02674618-c9c8-4311-9777-046c8d42eb4c |
| memory | disposition | 0 | SELECT `disposition_id`, `alert_id`, `customer_id`, `entry_id`, `decision`, `reason_codes`, `decided_at`, `decided_by`, `entry_content_hash`, `list_snapshot_id` FROM lightning.metastore.sanctions.screening_usl.disposition WHERE `customer_id` = 'CUST-0062' ORDER BY `disposition_id` LIMIT 200 | cf5cdb20-cc2b-4b52-9337-3e1a3ee9cd13 |
| critic | payment | 1 | SELECT `payment_id`, `customer_id`, `account_id`, `direction`, `amount`, `currency`, `counterparty_name`, `counterparty_country`, `counterparty_bank_bic`, `beneficiary_bank_country`, `intermediary_bank_country`, `payment_reference`, `value_date`, `status` FROM lightning.metastore.sanctions.screening_usl.payment WHERE `payment_id` = 'PAY-00014' ORDER BY `payment_id` LIMIT 200 | 78da2798-2834-4e29-93f9-a6fa35e7f7f8 |
| critic | list_entry | 2 | SELECT `entry_id`, `list_id`, `source_uid`, `party_kind`, `primary_name`, `primary_name_script`, `name_normalised`, `listed_on`, `sanctions_list`, `remarks`, `snapshot_id`, `content_hash` FROM lightning.metastore.sanctions.screening_usl.list_entry WHERE `entry_id` = 'OFAC-17015' ORDER BY `entry_id` LIMIT 200 | 8037ef9c-def9-4aca-ac5e-ef5951c4bda4 |
| critic | list_country | 2 | SELECT `country_link_id`, `entry_id`, `country_iso2`, `country_name`, `role`, `place` FROM lightning.metastore.sanctions.screening_usl.list_country WHERE `country_link_id` = 'OFAC-17015-c-5da301bf' ORDER BY `country_link_id` LIMIT 200 | e1a894f5-5838-439a-ad3c-d4a3670b06d2 |
| critic | list_country | 2 | SELECT `country_link_id`, `entry_id`, `country_iso2`, `country_name`, `role`, `place` FROM lightning.metastore.sanctions.screening_usl.list_country WHERE `country_link_id` = 'OFAC-17015-c-49650b18' ORDER BY `country_link_id` LIMIT 200 | 7d292de8-1b53-4d7a-a01e-0094172ca26e |
| critic | list_country | 2 | SELECT `country_link_id`, `entry_id`, `country_iso2`, `country_name`, `role`, `place` FROM lightning.metastore.sanctions.screening_usl.list_country WHERE `country_link_id` = 'OFAC-17015-c-0eede6ec' ORDER BY `country_link_id` LIMIT 200 | c6d389ed-339d-4d51-9a56-f8b0cc7cd3fb |
Check it yourself
Clone the repository and run npm run evidence:verify -- eval/runs/routed-20261023T133311Z. What the export left out: tokens, local paths, hostnames and addresses other than the local machine, usernames, e-mail addresses and secret environment values were removed from results.json and trace.jsonl.gz; receipts.jsonl.gz is untouched.