HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset
Dynamic Scenes with Ground Truth
Generating per-frame ground- truth HDR for dynamic videos is very challenging. Following the strategy used for capturing dynamic HDR image [Deep high dynamic range imaging of dynamic scenes, TOG 2017], we propose to create image pairs consisting of input LDR frames and the HDR of the center frame. We considered static environment and used a human subject to simulate motion in videos.
For each scene, we first asked the subject to stay still for 1 − 2 seconds, where we can find 2 consecutive still frames (or 3 frames for three-exposure) without motions for generating the HDR image for this timestamp. We then asked the subject to move back-and-forth (e.g., waving hands or walking). We selected an image sequence whose center frame was the static frame, and arranged this sequence to be the proper LDRs-HDR pairs. For each reference frame with GT HDR, we also created a pair with a larger motion by sampling the neighboring frames in a frame interval of 2, which doubles the number of pairs. In total, we created 76 and 108 pairs for the case of two-exposure (5 input frames) and three-exposure (7 input frames), respectively.
(a) Dynamic Scenes with Ground Truth (2-exposure)
Each pair is named as the combination of the scene name, the exposure of the reference frame (low or high), and the sampling step between neighboring (1 or 3) frames when preparing the LDR-HDR pairs.
scene_000_ref_high_step1 |
scene_000_ref_high_step3 |
scene_000_ref_low_step1 |
scene_000_ref_low_step3 |
scene_001_ref_high_step1 |
scene_001_ref_high_step3 |
scene_001_ref_low_step1 |
scene_001_ref_low_step3 |
scene_002_ref_high_step1 |
scene_002_ref_high_step3 |
scene_002_ref_low_step1 |
scene_002_ref_low_step3 |
scene_003_ref_high_step1 |
scene_003_ref_high_step3 |
scene_003_ref_low_step1 |
scene_003_ref_low_step3 |
scene_004_ref_high_step1 |
scene_004_ref_high_step3 |
scene_004_ref_low_step1 |
scene_004_ref_low_step3 |
scene_005_ref_high_step1 |
scene_005_ref_high_step3 |
scene_005_ref_low_step1 |
scene_005_ref_low_step3 |
scene_006_ref_high_step1 |
scene_006_ref_high_step3 |
scene_006_ref_low_step1 |
scene_006_ref_low_step3 |
scene_007_ref_high_step1 |
scene_007_ref_high_step3 |
scene_007_ref_low_step1 |
scene_007_ref_low_step3 |
scene_008_ref_high_step1 |
scene_008_ref_high_step3 |
scene_008_ref_low_step1 |
scene_008_ref_low_step3 |
scene_009_ref_high_step1 |
scene_009_ref_high_step3 |
scene_009_ref_low_step1 |
scene_009_ref_low_step3 |
scene_010_ref_high_step1 |
scene_010_ref_high_step3 |
scene_010_ref_low_step1 |
scene_010_ref_low_step3 |
scene_011_ref_high_step1 |
scene_011_ref_high_step3 |
scene_011_ref_low_step1 |
scene_011_ref_low_step3 |
scene_012_ref_high_step1 |
scene_012_ref_high_step3 |
scene_012_ref_low_step1 |
scene_012_ref_low_step3 |
scene_013_ref_high_step1 |
scene_013_ref_high_step3 |
scene_013_ref_low_step1 |
scene_013_ref_low_step3 |
scene_014_ref_high_step1 |
scene_014_ref_high_step3 |
scene_014_ref_low_step1 |
scene_014_ref_low_step3 |
scene_015_ref_high_step1 |
scene_015_ref_high_step3 |
scene_015_ref_low_step1 |
scene_015_ref_low_step3 |
scene_016_ref_high_step1 |
scene_016_ref_high_step3 |
scene_016_ref_low_step1 |
scene_016_ref_low_step3 |
scene_017_ref_high_step1 |
scene_017_ref_high_step3 |
scene_017_ref_low_step1 |
scene_017_ref_low_step3 |
scene_018_ref_high_step1 |
scene_018_ref_high_step3 |
scene_018_ref_low_step1 |
scene_018_ref_low_step3 |
(b) Dynamic Scenes with Ground Truth (3-exposure)
Each pair is named as the combination of the scene name, the exposure of the reference frame (low, middle, or high), and the sampling step between neighboring (1 or 4) frames when preparing the LDR-HDR pairs.
scene_000_ref_high_step1 |
scene_000_ref_mid_step1 |
scene_000_ref_low_step1 |
scene_000_ref_high_step4 |
scene_000_ref_mid_step4 |
scene_000_ref_low_step4 |
scene_001_ref_high_step1 |
scene_001_ref_mid_step1 |
scene_001_ref_low_step1 |
scene_001_ref_high_step4 |
scene_001_ref_mid_step4 |
scene_001_ref_low_step4 |
scene_001_ref_high_step1 |
scene_001_ref_mid_step1 |
scene_001_ref_low_step1 |
scene_001_ref_high_step4 |
scene_001_ref_mid_step4 |
scene_001_ref_low_step4 |
scene_002_ref_high_step1 |
scene_002_ref_mid_step1 |
scene_002_ref_low_step1 |
scene_002_ref_high_step4 |
scene_002_ref_mid_step4 |
scene_002_ref_low_step4 |
scene_003_ref_high_step1 |
scene_003_ref_mid_step1 |
scene_003_ref_low_step1 |
scene_003_ref_high_step4 |
scene_003_ref_mid_step4 |
scene_003_ref_low_step4 |
scene_004_ref_high_step1 |
scene_004_ref_mid_step1 |
scene_004_ref_low_step1 |
scene_004_ref_high_step4 |
scene_004_ref_mid_step4 |
scene_004_ref_low_step4 |
scene_005_ref_high_step1 |
scene_005_ref_mid_step1 |
scene_005_ref_low_step1 |
scene_005_ref_high_step4 |
scene_005_ref_mid_step4 |
scene_005_ref_low_step4 |
scene_006_ref_high_step1 |
scene_006_ref_mid_step1 |
scene_006_ref_low_step1 |
scene_006_ref_high_step4 |
scene_006_ref_mid_step4 |
scene_006_ref_low_step4 |
scene_007_ref_high_step1 |
scene_007_ref_mid_step1 |
scene_007_ref_low_step1 |
scene_007_ref_high_step4 |
scene_007_ref_mid_step4 |
scene_007_ref_low_step4 |
scene_008_ref_high_step1 |
scene_008_ref_mid_step1 |
scene_008_ref_low_step1 |
scene_008_ref_high_step4 |
scene_008_ref_mid_step4 |
scene_008_ref_low_step4 |
scene_009_ref_high_step1 |
scene_009_ref_mid_step1 |
scene_009_ref_low_step1 |
scene_009_ref_high_step4 |
scene_009_ref_mid_step4 |
scene_009_ref_low_step4 |
scene_010_ref_high_step1 |
scene_010_ref_mid_step1 |
scene_010_ref_low_step1 |
scene_010_ref_high_step4 |
scene_010_ref_mid_step4 |
scene_010_ref_low_step4 |
scene_011_ref_high_step1 |
scene_011_ref_mid_step1 |
scene_011_ref_low_step1 |
scene_011_ref_high_step4 |
scene_011_ref_mid_step4 |
scene_011_ref_low_step4 |
scene_012_ref_high_step1 |
scene_012_ref_mid_step1 |
scene_012_ref_low_step1 |
scene_012_ref_high_step4 |
scene_012_ref_mid_step4 |
scene_012_ref_low_step4 |
scene_013_ref_high_step1 |
scene_013_ref_mid_step1 |
scene_013_ref_low_step1 |
scene_013_ref_high_step4 |
scene_013_ref_mid_step4 |
scene_013_ref_low_step4 |
scene_014_ref_high_step1 |
scene_014_ref_mid_step1 |
scene_014_ref_low_step1 |
scene_014_ref_high_step4 |
scene_014_ref_mid_step4 |
scene_014_ref_low_step4 |
scene_015_ref_high_step1 |
scene_015_ref_mid_step1 |
scene_015_ref_low_step1 |
scene_015_ref_high_step4 |
scene_015_ref_mid_step4 |
scene_015_ref_low_step4 |
scene_016_ref_high_step1 |
scene_016_ref_mid_step1 |
scene_016_ref_low_step1 |
scene_016_ref_high_step4 |
scene_016_ref_mid_step4 |
scene_016_ref_low_step4 |
scene_017_ref_high_step1 |
scene_017_ref_mid_step1 |
scene_017_ref_low_step1 |
scene_017_ref_high_step4 |
scene_017_ref_mid_step4 |
scene_017_ref_low_step4 |