Sanctions Desk gathers and checks the evidence for every sanctions-screening alert and recommends an outcome; a person with the right entitlement approves it. One alert, start to finish · The problem it works on
Recorded runs / ALR-0058
ALR-0058: Cleared before; the listed entry's date of birth changed in the latest list
What happened: The decision step recommended RECOMMEND_BLOCK; the critic approved it; the policy guard let it stand. Outcome: Recommend a block (two people must confirm) (RECOMMEND_BLOCK), an outcome the label accepts.
Outcomes: CLOSE_FALSE_POSITIVE = close as a false positive · ESCALATE_L2 = escalate to level 2 · NEED_MORE_INFO = ask for more information · RECOMMEND_BLOCK = recommend a block (two people must confirm). Raise-only: the policy guard can make an outcome more cautious, never less.
An earlier clearance that no longer holds: the listed entry changed after the earlier decision, so the memory step marked it stale and the case was reviewed again.
Outcome
- Desk recommendation
- Recommend a block (two people must confirm) (RECOMMEND_BLOCK)
- Label in the case file
- Escalate to level 2 (ESCALATE_L2); also acceptable: RECOMMEND_BLOCK (eval/cases/exam.json, case EX-051)
- Compared with the label
- acceptable
- Code's first finding
- Escalate to level 2 (ESCALATE_L2)
- Critic
- 1 round(s), final: approved
- Model calls
- 3 (1 local, 2 cloud); 3 with a signed receipt, all verified
- Run
- sys2b-routed-20261023T195504Z, policy version 6, 32 steps in 72.5 s
Case note from the case file: The earlier clearance no longer holds because the entry changed; the case must be re-opened.
Checks along the way
No close was proposed in this run. What each check said:
- memory: 1 earlier decision(s): CLOSE_FALSE_POSITIVE (stale)
- critic (step 29): approved
- policy guard (raise-only rules in code): RECOMMEND_BLOCK stands
Steps in order
Each line is one event from the run's trace (trace.jsonl.gz). The model is the one that served the call, as the signed receipt records it.
| # | Agent | Action | Status | What happened | Model | Receipt | Zetaris read |
|---|---|---|---|---|---|---|---|
| 0 | triage | plan | ok | in: customer alert ALR-0058 path: customer review; the critic may send the recommendation back up to 3 times | |||
| 1 | evidence | read_semantic_layer | ok | screening_usl v4efa3ddddfbe: 14 tables | |||
| 2 | evidence | find_alert | ok | in: alert_id=ALR-0058 1 rows | alert, 1 rows90bdc8be-e141-4fbc-b467-22f3d27f8742 | ||
| 3 | evidence | find_customer | ok | in: customer_id=CUST-0051 1 rows | customer, 1 rowsa3dca1ca-ee63-4a88-99ba-9b70c83c8fbc | ||
| 4 | evidence | find_customer_identifier | ok | in: customer_id=CUST-0051 0 rows | customer_identifier, 0 rowsd358de32-07b4-46f0-a65a-480376fd6424 | ||
| 5 | evidence | find_list_entry | ok | in: entry_id=OFAC-30969 1 rows | list_entry, 1 rows33ac2069-67c4-478c-863c-3ad065c87049 | ||
| 6 | evidence | find_list_alias | ok | in: entry_id=OFAC-30969 4 rows | list_alias, 4 rows77a85b0d-dcc2-4730-802b-c96d95de6150 | ||
| 7 | evidence | find_list_dob | ok | in: entry_id=OFAC-30969 1 rows | list_dob, 1 rowsac9f38cb-a587-4cda-962a-10160667b0a7 | ||
| 8 | evidence | find_list_country | ok | in: entry_id=OFAC-30969 4 rows | list_country, 4 rows518d207a-1863-4aea-8bc2-d04809d3120f | ||
| 9 | evidence | find_list_identifier | ok | in: entry_id=OFAC-30969 0 rows | list_identifier, 0 rows96a72594-8c32-498d-ba75-808af177831e | ||
| 10 | evidence | find_business_definition | ok | in: status=approved 6 rows | business_definition, 6 rows0f906471-d2f8-4760-b02d-350f9211be90 | ||
| 11 | evidence | definitions | ok | counterparty_match@1, effective_ownership_threshold@1, false_positive@2, strong_identifier@1, true_match@1 | |||
| 12 | evidence | identifier_overlap | ok | no identifier matches | identifier_overlapc2d4de0b-3d57-4a1e-b7cd-8be978f77899 | ||
| 13 | evidence | data_quality | ok | in: customer.dob_present_for_individuals for CUST-0051 record passes this rule | data_quality79829753-9f20-4ab5-a41f-0938fbd27f2e | ||
| 14 | evidence | data_quality | ok | in: customer.nationality_is_iso2 for CUST-0051 record passes this rule | data_qualitycbcdd219-6909-4580-b71b-e615d9d9f7d3 | ||
| 15 | policy_guard | model_answer | ok | valid answer on attempt 1 | Nemotron 3.5 Lightning 30B-A3B (Runtime GGUF) (local, Lightning) | rcpt_req_hifmcaujsignature valid, key pinned | |
| 16 | policy_guard | screen_inbound | ok | in: 6 text field(s) from the data no instruction-like text | |||
| 17 | screener | screen_text | skipped | no customer note, payment reference or list remark to read | |||
| 18 | matching | compare_party | ok | in: CUST-0051 vs OFAC-30969 strong: name 1.00 (exact) vs primary "Yiu-chung Tam"; date of birth: exact; country: match | |||
| 19 | triage | difficulty | ok | clear (strong; date of birth exact; country match) | |||
| 20 | memory | recall | blocked | in: customer CUST-0051 and OFAC-30969 1 earlier decision(s): CLOSE_FALSE_POSITIVE (stale) | recall29953943-7aa9-4401-88b0-ed686f32090d | ||
| 21 | triage | path | ok | confirm: the structured evidence settles it (an approved match definition is met, or a document number agrees with the listed party) | |||
| 22 | triage | route | ok | earlier clearance still valid: fast path, no reasoning | |||
| 23 | decision | cloud_payload | ok | sent 17 fields, 5800 characters, hash 42be4b0e201e38f6; free text withheld | |||
| 24 | decision | model_answer | ok | valid answer on attempt 1 | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_ft7i8tv6signature valid, key pinned | |
| 25 | decision | recommend | ok | RECOMMEND_BLOCK: The customer and listed party have an exact name match (score 1.000), the date of birth agrees to the day (1936-09-06), and the customer's nationality (CN) matches a listed citizenship (CN). These thr | |||
| 26 | critic | verify_facts | ok | in: 6 cited facts 6 verified, 0 issues | |||
| 27 | critic | cloud_payload | ok | sent 17 fields, 5790 characters, hash 5f479b96b19d239b; free text withheld | |||
| 28 | critic | model_answer | ok | valid answer on attempt 1 | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_wee5pzlpsignature valid, key pinned | |
| 29 | critic | judge | ok | approved | |||
| 30 | policy_guard | apply_policy | ok | RECOMMEND_BLOCK stands | |||
| 31 | reporter | seal_record | ok | record rec-eval-sys2b-routed-EX-051 sealed |
Model calls and receipts
Each signature was checked when this page was built, with the same code as npm run evidence:verify (Ed25519 over the receipt body in receipts.jsonl.gz); the build stops if one does not verify, is missing, or names a different model from the trace. The Nightshift runtime's receipt key is pinned in config/default.json, so signature valid, key pinned shows the receipt was not changed and that this runtime signed it; a receipt signed by any other key stops the build.
| # | Step | Mode asked for | Model that served it | Receipt | App | Checked now | At run time | Time | Tokens in / out |
|---|---|---|---|---|---|---|---|---|---|
| 15 | policy_guard | meterless/fast | Nemotron 3.5 Lightning 30B-A3B (Runtime GGUF) (local, Lightning) | rcpt_req_hifmcauj | sanctions-desk-guard | signature valid, key pinned | valid_pinned | 0.5 s | 473 / 19 |
| 24 | decision | meterless/deep | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_ft7i8tv6 | sanctions-desk-reasoning | signature valid, key pinned | valid_pinned | 28.0 s | 4485 / 461 |
| 28 | critic | meterless/judge | Nemotron 3 Ultra 550B A55B (cloud, Ultra) | rcpt_req_wee5pzlp | sanctions-desk-reasoning | signature valid, key pinned | valid_pinned | 40.6 s | 2827 / 109 |
The whole run passes the same check: 305 receipts with valid signatures, 305 model calls in the trace that name a receipt, none missing and none naming a different model from its receipt.
Signing key fingerprint (first 16 hex of SHA-256): 1835d1eab9211f97.
Zetaris queries
This run's export keeps the table, the row count and the Zetaris query id of each read, not the statement text; the statements are not reconstructed here.
| Agent | Table | Rows | Statement | Query id |
|---|---|---|---|---|
| evidence | alert | 1 | not kept in this run's export (step: find_alert, alert_id=ALR-0058) | 90bdc8be-e141-4fbc-b467-22f3d27f8742 |
| evidence | customer | 1 | not kept in this run's export (step: find_customer, customer_id=CUST-0051) | a3dca1ca-ee63-4a88-99ba-9b70c83c8fbc |
| evidence | customer_identifier | 0 | not kept in this run's export (step: find_customer_identifier, customer_id=CUST-0051) | d358de32-07b4-46f0-a65a-480376fd6424 |
| evidence | list_entry | 1 | not kept in this run's export (step: find_list_entry, entry_id=OFAC-30969) | 33ac2069-67c4-478c-863c-3ad065c87049 |
| evidence | list_alias | 4 | not kept in this run's export (step: find_list_alias, entry_id=OFAC-30969) | 77a85b0d-dcc2-4730-802b-c96d95de6150 |
| evidence | list_dob | 1 | not kept in this run's export (step: find_list_dob, entry_id=OFAC-30969) | ac9f38cb-a587-4cda-962a-10160667b0a7 |
| evidence | list_country | 4 | not kept in this run's export (step: find_list_country, entry_id=OFAC-30969) | 518d207a-1863-4aea-8bc2-d04809d3120f |
| evidence | list_identifier | 0 | not kept in this run's export (step: find_list_identifier, entry_id=OFAC-30969) | 96a72594-8c32-498d-ba75-808af177831e |
| evidence | business_definition | 6 | not kept in this run's export (step: find_business_definition, status=approved) | 0f906471-d2f8-4760-b02d-350f9211be90 |
| evidence | identifier_overlap | no identifier matches | not kept in this run's export (step: identifier_overlap) | c2d4de0b-3d57-4a1e-b7cd-8be978f77899 |
| evidence | data_quality | record passes this rule | not kept in this run's export (step: data_quality, customer.dob_present_for_individuals for CUST-0051) | 79829753-9f20-4ab5-a41f-0938fbd27f2e |
| evidence | data_quality | record passes this rule | not kept in this run's export (step: data_quality, customer.nationality_is_iso2 for CUST-0051) | cbcdd219-6909-4580-b71b-e615d9d9f7d3 |
| memory | recall | 1 earlier decision(s): CLOSE_FALSE_POSITIVE (stale) | not kept in this run's export (step: recall, customer CUST-0051 and OFAC-30969) | 29953943-7aa9-4401-88b0-ed686f32090d |
Check it yourself
Clone the repository and run npm run evidence:verify -- eval/runs/sys2b-routed-20261023T195504Z. What the export left out: tokens, local paths, hostnames and addresses other than the local machine, usernames, e-mail addresses and secret environment values were removed from results.json and trace.jsonl.gz; receipts.jsonl.gz is untouched.