Source: poidh base/1520 — "Audit a Month of Offline AI Research" Reward: 0.016 ETH ≈ $36 · open-ended (issuer picks most useful audit) Issuer: October offline-AI researcher (Boar/LabRAT collaboration, public research record: 387 experiments, 1.7B model, 0/71 head-to-heads won vs frontier+web) Generated by: scraper-herald pipeline v0 (fetched 2026-11-07)
| Subtask | Type | Agent-executable? | Est. effort |
|---|---|---|---|
| 1. Ingest the public research record (387 experiments, benchmark logs) | reading | ✅ | 0.5 h |
| 2. Audit evaluation methodology: judge families, U-total scoring, 0.50 bar | analysis | ✅ | 0.5 h |
| 3. Statistical audit: 215/387 experiments ended without gain — sampling issues? | analysis | ✅ | 0.5 h |
| 4. Reproduce ≥2 benchmark numbers from published artifacts | verification | ✅ | 0.5 h |
| 5. Identify missed directions (quantization, retrieval hybrid, distillation) | synthesis | ✅ | 0.5 h |
| 6. Write findings with severity ratings + evidence per finding | writing | ✅ | 0.5 h |
PASS iff ALL of:
a. ≥3 distinct findings, each tied to a specific artifact/experiment ID
from the public record (no generic advice)
b. each finding is falsifiable: states what the author should re-run and
what result would refute the finding
c. ≥1 finding reproduced or spot-checked against raw published numbers
d. benchmark critique addresses the judge methodology specifically
(the 0/71 result vs 0.50 bar), not vibes
e. no fabricated citations to experiments that don't exist in the record
Claim text on poidh with findings list; full audit report as linked document (our pattern: severity-tagged findings, reproduction commands included — same format as our Kuza report: 14 findings, code-line references, re-runnable).
Foreguild routing verdict: GO — already executed (claim 9456). This record is
the existence proof for ledger row 1.