Dev
XFEL Serial Femtosecond Crystallography (SFX) — Dev Tier
(5 scenes)Blind evaluation tier — no ground truth available.
What you get
Measurements (y), ideal forward operator (H), and spec ranges only.
How to use
Apply your pipeline from the Public tier. Use consistency as self-check.
What to submit
Reconstructed signals and corrected spec. Scored server-side.
Parameter Specifications
🔒
True spec hidden — estimate parameters from spec ranges below.
| Parameter | Spec Range | Unit |
|---|---|---|
| hit_rate | 5.2 – 17.2 | - |
| indexing_ambiguity | -2.4 – 3.6 | - |
| partiality_model_error | -4.8 – 7.2 | - |
| background_from_jet/carrier | -7.2 – 10.8 | - |
Dev Tier Leaderboard
| # | Method | Score | PSNR | SSIM | Consistency | Trust | Source |
|---|---|---|---|---|---|---|---|
| 1 | CrysFormer + gradient | 0.663 | 26.2 | 0.838 | 0.83 | ✓ Certified | Crystallographic transformer, 2024 |
| 2 | CNN Hit-Finder + gradient | 0.619 | 24.49 | 0.785 | 0.8 | ✓ Certified | Ke et al., J. Synchrotron Rad. 2018 |
| 3 | CrystFEL + gradient | 0.533 | 20.95 | 0.643 | 0.83 | ✓ Certified | White et al., J. Appl. Cryst. 2012 |
| 4 | EMC + gradient | 0.505 | 20.25 | 0.611 | 0.79 | ✓ Certified | Loh & Elser, Phys. Rev. E 2009 |
Visible Data Fields
y
H_ideal
spec_ranges
Dataset
Format: HDF5
Scenes: 5
Scoring Formula
0.4 × PSNR_norm + 0.4 × SSIM + 0.2 × (1 − ‖y − Ĥx̂‖/‖y‖)
PSNR: 40%
SSIM: 40%
Consistency: 20%