Time-of-Flight Depth Camera

tof_camera Depth Imaging Time Of Flight Ray
View Benchmarks (1)

ToF cameras measure per-pixel depth by emitting modulated near-infrared light and measuring the phase delay of the reflected signal relative to the emitted signal. In amplitude-modulated continuous-wave (AMCW) ToF, the phase offset phi = 2*pi*f*2d/c encodes the round-trip distance 2d. Multiple modulation frequencies resolve depth ambiguity. Primary degradations include multi-path interference (MPI), motion blur, and systematic errors at depth discontinuities (flying pixels).

Forward Model

Phase Delay Depth

Noise Model

Gaussian

Default Solver

tv fista

Sensor

TOF_SENSOR

Forward-Model Signal Chain

Each primitive represents a physical operation in the measurement process. Arrows show signal flow left to right.

P modulated Modulated Light Sigma correlation Correlation Integration D g, η₁ ToF Sensor
Spec Notation

P(modulated) → Σ(correlation) → D(g, η₁)

Benchmark Variants & Leaderboards

ToF Camera

Time-of-Flight Depth Camera

Full Benchmark Page →
Contribute Dataset Compete
Spec Notation

P(modulated) → Σ(correlation) → D(g, η₁)

Standard Leaderboard (Top 10)

# Method Score PSNR (dB) SSIM Trust Source
🥇 MPI-Former 0.782 34.0 0.930 ✓ Certified Multi-path interference correction, 2023
🥈 DeepToF 0.742 32.5 0.900 ✓ Certified Marco et al., ECCV 2018
🥉 PnP-ToF 0.617 28.0 0.800 ✓ Certified PnP with depth prior for ToF
4 Phase Unwrap 0.480 24.0 0.660 ✓ Certified Bamji et al., IEEE SSC 2015
Mismatch Parameters (3) click to expand
Name Symbol Description Nominal Perturbed
modulation_freq Δf_m Modulation frequency error (MHz) 20 20.1
multipath I_mp Multipath interference intensity (%) 0 5.0
phase_nonlinearity Δφ Phase nonlinearity (deg) 0 2.0

Reconstruction Triad Diagnostics

The three diagnostic gates (G1, G2, G3) characterize how reconstruction quality degrades under different error sources. Each bar shows the relative attribution.

G1 — Forward Model Accuracy How well does the mathematical model match reality?

Model: phase delay depth — Mismatch modes: multipath interference, flying pixels, motion blur, ambient light saturation

G2 — Noise Characterization Is the noise model correctly specified?

Noise: gaussian — Typical SNR: 15.0–35.0 dB

G3 — Calibration Quality Are instrument parameters accurately measured?

Requires: modulation frequency, phase offset, lens distortion, depth nonlinearity

Modality Deep Dive

Principle

A Time-of-Flight depth camera measures the round-trip time of modulated light (typically near-infrared LEDs at 850 nm) reflected from the scene. The sensor measures the phase shift between emitted and received modulated signals at each pixel, which is proportional to the target distance: d = c·Δφ/(4π·f_mod). Typical modulation frequencies are 20-100 MHz, providing depth ranges of 0.5-10 meters with mm-cm precision.

How to Build the System

Use an integrated ToF camera module (e.g., Microsoft Azure Kinect DK, PMD CamBoard pico, Texas Instruments OPT8241). The module contains the NIR light source, modulation driver, and ToF sensor with per-pixel demodulation circuits. Mount rigidly and calibrate intrinsic parameters (lens distortion, depth offset) and phase-to-depth nonlinearities. For multi-camera setups, synchronize or frequency-multiplex to avoid interference.

Common Reconstruction Algorithms

  • Four-phase demodulation for distance extraction
  • Multi-frequency unwrapping for extended unambiguous range
  • Flying-pixel filtering (mixed pixels at depth discontinuities)
  • Multi-path interference correction
  • Deep-learning depth denoising and completion

Common Mistakes

  • Multi-path interference causing systematic depth errors in concave scenes
  • Flying pixels at depth edges producing incorrect intermediate depth values
  • Phase wrapping ambiguity when objects exceed the unambiguous range
  • Interference from ambient NIR light (sunlight) degrading outdoor performance
  • Systematic depth errors from non-ideal sensor response not calibrated out

How to Avoid Mistakes

  • Use multi-path correction algorithms or multi-frequency modulation
  • Apply flying-pixel detection and removal based on amplitude and neighbor consistency
  • Use dual-frequency operation to extend the unambiguous range
  • Use narrow-band optical filter and higher modulation power for outdoor use
  • Perform per-pixel depth calibration with a known flat reference at multiple distances

Forward-Model Mismatch Cases

  • The widefield fallback produces a 2D intensity image, but ToF cameras measure depth via phase shift of modulated near-infrared light — the distance information (d = c*dphi/(4*pi*f_mod)) is entirely absent from the blurred image
  • ToF measurement involves demodulation of the reflected modulated signal at each pixel, producing amplitude, phase, and confidence maps — the widefield intensity-only blur cannot produce depth or distinguish multi-path interference

How to Correct the Mismatch

  • Use the ToF camera operator that models modulated illumination and per-pixel demodulation: four-phase sampling extracts the phase shift proportional to target distance at each pixel
  • Apply phase-to-depth conversion, multi-path correction, and flying-pixel filtering using the correct modulation frequency, amplitude, and phase measurement model

Experimental Setup

Instrument

Intel RealSense L515 / Microsoft Azure Kinect DK

Depth Resolution

640x480

Range M

0.1-6.0

Frame Rate Fps

30

Wavelength Nm

850

Depth Accuracy Mm

2.0

Modulation

AMCW (amplitude-modulated continuous wave)

Signal Chain Diagram

Experimental setup diagram for Time-of-Flight Depth Camera

Key References

  • Hansard et al., 'Time-of-Flight Cameras: Principles, Methods and Applications', Springer (2013)

Canonical Datasets

  • NYU Depth V2 (Silberman et al.)
  • KITTI depth benchmark (adapted)

Related Modalities

Structured Light LiDAR Flash LiDAR Photometric Stereo

Benchmark Pages

ToF Camera