Dev
SIM — Dev Tier
(5 scenes)Blind evaluation tier — no ground truth available.
What you get
Measurements (y), ideal forward operator (H), and spec ranges only.
How to use
Apply your pipeline from the Public tier. Use consistency as self-check.
What to submit
Reconstructed signals and corrected spec. Scored server-side.
Parameter Specifications
🔒
True spec hidden — estimate parameters from spec ranges below.
| Parameter | Spec Range | Unit |
|---|---|---|
| pattern_phase | -0.06 – 0.09 | rad |
| pattern_freq | -1.2 – 1.8 | % |
| modulation_depth | -6.0 – 9.0 | % |
Dev Tier Leaderboard
| # | Method | Score | PSNR | SSIM | Consistency | Trust | Source |
|---|---|---|---|---|---|---|---|
| 1 | SIMformer + gradient | 0.791 | 33.78 | 0.959 | 0.85 | ✓ Certified | SIM reconstruction transformer, 2024 |
| 2 | Wiener-SIM + gradient | 0.662 | 26.24 | 0.839 | 0.82 | ✓ Certified | Gustafsson, J. Microsc. 2000 |
| 3 | DL-SIM + gradient | 0.660 | 25.49 | 0.817 | 0.89 | ✓ Certified | Jin et al., Nat. Methods 2023 |
| 4 | PnP-SIM + gradient | 0.648 | 25.21 | 0.809 | 0.86 | ✓ Certified | PnP with SIM forward model |
Visible Data Fields
y
H_ideal
spec_ranges
Dataset
Format: HDF5
Scenes: 5
Scoring Formula
0.4 × PSNR_norm + 0.4 × SSIM + 0.2 × (1 − ‖y − Ĥx̂‖/‖y‖)
PSNR: 40%
SSIM: 40%
Consistency: 20%