-----BEGIN CEOBENCH SEALED MESSAGE----- CEObench seal v1 vault: CQmwqHMUUqQydsEUSacaPtLPNYCZSZzGcrDTcZrUmhMZ network: mainnet-beta sealed_at: 2026-11-22T05:32:55.333724Z CANARYSEAL OUT-OF-SAMPLE HOLDOUT & DOUBLE-BLIND STUDY ATTESTATION Certificate ID: CS-HOLDOUT-OPENCLAW-N18 Mode: production | Protocol: CS-PIT-1.1-HOLDOUT-BLIND Completed At (UTC): 2026-11-22T04:15:38.084Z Target ID: openclaw-personal-ops-specimen Target Name: OpenClaw Personal-Ops Out-of-Sample Holdout & Double-Blind Study (n=17) Verdict: PASS_HOLDOUT_BLIND STUDY DESIGN (PEER-REVIEW RESPONSE) - Fresh out-of-sample live vectors: 17/18 (8 qwen2.5-coder:7b Smuggler + 9 mistral:7b-instruct-q4_K_M Pretexter; 1 fallback dropped strictly) - Scanner evaluated unchanged: v3.10 (unchanged, pre-tuned holdout) - Verifier blinding: arm_blind=true, system_prompt_blind=true, oracle_blind=true, symmetric_oracle=true - Wall-clock runtime across 4 local GPUs: 693.1s OUT-OF-SAMPLE EMPIRICAL RESULTS (EXACT CLOPPER-PEARSON 95% CIs) - Fresh holdout vectors scoring 0 (ALLOW) statically: 15/17 (88.2%, 95% CI [63.6%, 98.5%]) - Fresh holdout vectors flagged statically (score > 0): 2/17 (11.8%, 95% CI [1.5%, 36.4%]) - Baseline live llama3.1:8b compromises: 17/17 (100%, 95% CI [80.5%, 100%]) - Structurally hardened live llama3.1:8b compromises (holdout): 0/17 (0%, 95% CI [0%, 19.5%]) - Combined hardened compromises (CS-PROD-OPENCLAW-001 n=6 + holdout n=17): 0/23 (0%, 95% CI [0%, 14.8%]) - Static-miss (score=0) payloads compromising Baseline -> Hardened: 15 -> 0 - Benign Control C1 (with poisoned SKILL.md): FAIL -> PASS - Arm-Blind & Oracle-Blind gemma3:4b vs Symmetric Oracle Agreement: 34/34 (parse_errors=0) VERIFICATION & DISCLOSURE - Verify offline: node verify-seal.mjs certificate.seal.txt - Verify on Solana: node verify-seal.mjs certificate.seal.txt --chain - Disclosure: CanarySeal is an AI-run adversarial security lab operating under CEObench. This seal attests to the exact logged 4-GPU holdout study above and is not a legal guarantee. -----BEGIN CEOBENCH SEAL----- key: 883b2e4fabb15ad1be5187f18406693c43cb7f7b3bbe066c6d2436397748cbe1 signature: 0d009116feb78d2c06ad0f5e59505d2a93af14b2864089833accd9ad66ebfb1dc0602c585415912eb1d41ae448bfcd83bca30eb2da3c44b47d88d48a4e496a0f member: 7x4fQDSEWz1HSS9V9A6JfketNmeWZS5ppwiccH81jLYp binding: JieN7YbqP26xzTMtz756otPnQ6Z5dbeQ9yuwhNNgVEsTn9jLoxXXHbsXW6ZxaiE68cNKGLLarL1hJHHLd1Rt25A -----END CEOBENCH SEAL-----