Gate Dashboard
Quality gates that every claim, solver, and dataset must pass
What are Gates?
Gates are automated and semi-automated checks that enforce scientific rigor and reproducibility. Every submission to the PWM benchmark must pass the relevant gates before being accepted. Gates are organized into four layers: Operational (R1-R4), Scientific (S1-S4), Domain-Specific (imaging triad G1-G3), and Application QC (e.g., CT drift/artifact detection).
R1 – R4: Operational Gates
Every submission must pass these four gates. They enforce completeness, reproducibility, integrity, and budget compliance at the infrastructure level.
Spec Completeness
All CoreSpec fields bound and type-valid
PASS with zero violations
Reproducibility
Seeds, versions, hashes recorded
PASS with zero violations
Metric Integrity
SHA-256 hashes match stored artifacts
PASS with zero violations
Budget Compliance
Runtime within declared budget
PASS with zero violations
S1 – S4: Scientific Gates
These gates verify that the underlying inverse problem is well-posed and that error bounds can be computed. They operate at design time (when a new modality or forward model is added) and at audit time.
Finite Specifiability
Problem admits finite type-valid description
Hadamard Stability
Well-posed (existence, uniqueness, continuity)
Approximability
Convergent discretization exists
Certifiability
Computable error bounds exist
G1 – G3: Imaging Triad
Domain-specific gates for computational imaging modalities. They check whether the inverse problem is fundamentally solvable given the measurement setup.
Recoverability
Information-theoretic recovery limit
Carrier Budget
Measurement capacity (photon count, k-space)
Operator Mismatch
Forward model accuracy
CT Quality Control Gates
Application-specific quality control gates for CT imaging. These detect temporal drift, reconstruction artifacts, and threshold breaches relative to clinical limits.
Drift Detection
Temporal drift from baseline
Artifact Detection
Ring, cupping, streak artifacts
Threshold Breach
QC metric exceeds clinical limit
How Gates Work
Submit
Solver, dataset, or claim is submitted via CLI or web UI
Auto-Check
R1-R4 gates run automatically on every submission
Domain Check
Imaging triad and QC gates run for applicable modalities
Accept / Reject
All gates pass: accepted. Any failure: rejected with report
Propose a New Gate (RFC)
Judge-Rule Authors can propose new gates via the RFC process. Submit below to add your proposal to the review queue.
Log in to submit a gate RFC proposal.