ladder → emitter → marketplace loop.

panel is a captcha-shaped feedback layer. the friction is the dataset. operators emit, raters judge, signal returns. one rater pool, three layers, one sdk.

   operator stack                        panel surface                 raters
   ─────────────                         ─────────────                 ──────
   agent / model ──┐
                   │  emitMedia()
   modal worker ───┤  emitProcessOutput()        ┌── L1 · taste captcha ──┐
                   ├─────────────────►  panel  ──┤   (any visitor, gated) │──┐
   comfyui  ──────┤  panel-sdk        ingest      │                        │  │
   replicate ─────┤  hmac · batch     api         ├── L2 · agent rating ───┤  │  judgments
   elevenlabs ────┘                                │   (trusted raters)     │  ├──────────►
                                                   │                        │  │
                                                   └── L3 · expert review ──┘  │
                                                                               │
                                       ◄──── signed preference rows ──────────┘
                                       ◄──── rater balance ledger
                                            (paid-train · coming)

1 · ladder

three layers of human signal, one shared rater pool. trust scores propagate up — raters that handle L1 cleanly get promoted to L2, L2 performers with verified credentials get gated into L3.

• L1 — taste captcha. drop-in replacement for recaptcha/turnstile. visitors solve a 3-second taste judgment. operator gets a verification token and a labelled row.
• L2 — agent-output rating. trusted raters judge agent outputs, skill diffs, process traces. pairwise, rubric, free-form. preference data flows back to the operator stack.
• L3 — expert review. credentialed domain reviewers for high-stakes outputs. medical, legal, regulated trades. paid per unit, audit trail per row.

2 · emitter

panel-sdk is the operator side. it handles hmac signing, batching, retries, and the ingest contract. adapters wrap common generation surfaces so operators don't have to wire a webhook from scratch.

• modal dev-gen — shipping. emit from inside the worker.
• comfyui · replicate — incoming via v6b. webhook adapter for image/video.
• elevenlabs — incoming via v6c. tts/voice into dub-sync rubric.
• raw escape hatch — emitRaw(units) for anything else.

3 · marketplace loop

raters earn balance per accepted unit. balance converts to inference credits and finetune runs against the dataset they helped label. the operator that paid for the rating uses the resulting model on the same surface that produced the data. no broker in between.

paid-train is private alpha. request access.