HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset

Dynamic Scenes with Ground Truth

Generating per-frame ground- truth HDR for dynamic videos is very challenging. Following the strategy used for capturing dynamic HDR image [Deep high dynamic range imaging of dynamic scenes, TOG 2017], we propose to create image pairs consisting of input LDR frames and the HDR of the center frame. We considered static environment and used a human subject to simulate motion in videos. For each scene, we first asked the subject to stay still for 1 − 2 seconds, where we can find 2 consecutive still frames (or 3 frames for three-exposure) without motions for generating the HDR image for this timestamp. We then asked the subject to move back-and-forth (e.g., waving hands or walking). We selected an image sequence whose center frame was the static frame, and arranged this sequence to be the proper LDRs-HDR pairs. For each reference frame with GT HDR, we also created a pair with a larger motion by sampling the neighboring frames in a frame interval of 2, which doubles the number of pairs. In total, we created 76 and 108 pairs for the case of two-exposure (5 input frames) and three-exposure (7 input frames), respectively.

(a) Dynamic Scenes with Ground Truth (2-exposure)

Each pair is named as the combination of the scene name, the exposure of the reference frame (low or high), and the sampling step between neighboring (1 or 3) frames when preparing the LDR-HDR pairs.


scene_000_ref_high_step1 scene_000_ref_high_step3 scene_000_ref_low_step1 scene_000_ref_low_step3
scene_001_ref_high_step1 scene_001_ref_high_step3 scene_001_ref_low_step1 scene_001_ref_low_step3
scene_002_ref_high_step1 scene_002_ref_high_step3 scene_002_ref_low_step1 scene_002_ref_low_step3
scene_003_ref_high_step1 scene_003_ref_high_step3 scene_003_ref_low_step1 scene_003_ref_low_step3
scene_004_ref_high_step1 scene_004_ref_high_step3 scene_004_ref_low_step1 scene_004_ref_low_step3
scene_005_ref_high_step1 scene_005_ref_high_step3 scene_005_ref_low_step1 scene_005_ref_low_step3
scene_006_ref_high_step1 scene_006_ref_high_step3 scene_006_ref_low_step1 scene_006_ref_low_step3
scene_007_ref_high_step1 scene_007_ref_high_step3 scene_007_ref_low_step1 scene_007_ref_low_step3
scene_008_ref_high_step1 scene_008_ref_high_step3 scene_008_ref_low_step1 scene_008_ref_low_step3
scene_009_ref_high_step1 scene_009_ref_high_step3 scene_009_ref_low_step1 scene_009_ref_low_step3
scene_010_ref_high_step1 scene_010_ref_high_step3 scene_010_ref_low_step1 scene_010_ref_low_step3
scene_011_ref_high_step1 scene_011_ref_high_step3 scene_011_ref_low_step1 scene_011_ref_low_step3
scene_012_ref_high_step1 scene_012_ref_high_step3 scene_012_ref_low_step1 scene_012_ref_low_step3
scene_013_ref_high_step1 scene_013_ref_high_step3 scene_013_ref_low_step1 scene_013_ref_low_step3
scene_014_ref_high_step1 scene_014_ref_high_step3 scene_014_ref_low_step1 scene_014_ref_low_step3
scene_015_ref_high_step1 scene_015_ref_high_step3 scene_015_ref_low_step1 scene_015_ref_low_step3
scene_016_ref_high_step1 scene_016_ref_high_step3 scene_016_ref_low_step1 scene_016_ref_low_step3
scene_017_ref_high_step1 scene_017_ref_high_step3 scene_017_ref_low_step1 scene_017_ref_low_step3
scene_018_ref_high_step1 scene_018_ref_high_step3 scene_018_ref_low_step1 scene_018_ref_low_step3







(b) Dynamic Scenes with Ground Truth (3-exposure)

Each pair is named as the combination of the scene name, the exposure of the reference frame (low, middle, or high), and the sampling step between neighboring (1 or 4) frames when preparing the LDR-HDR pairs.


scene_000_ref_high_step1 scene_000_ref_mid_step1 scene_000_ref_low_step1
scene_000_ref_high_step4 scene_000_ref_mid_step4 scene_000_ref_low_step4
scene_001_ref_high_step1 scene_001_ref_mid_step1 scene_001_ref_low_step1
scene_001_ref_high_step4 scene_001_ref_mid_step4 scene_001_ref_low_step4
scene_001_ref_high_step1 scene_001_ref_mid_step1 scene_001_ref_low_step1
scene_001_ref_high_step4 scene_001_ref_mid_step4 scene_001_ref_low_step4
scene_002_ref_high_step1 scene_002_ref_mid_step1 scene_002_ref_low_step1
scene_002_ref_high_step4 scene_002_ref_mid_step4 scene_002_ref_low_step4
scene_003_ref_high_step1 scene_003_ref_mid_step1 scene_003_ref_low_step1
scene_003_ref_high_step4 scene_003_ref_mid_step4 scene_003_ref_low_step4
scene_004_ref_high_step1 scene_004_ref_mid_step1 scene_004_ref_low_step1
scene_004_ref_high_step4 scene_004_ref_mid_step4 scene_004_ref_low_step4
scene_005_ref_high_step1 scene_005_ref_mid_step1 scene_005_ref_low_step1
scene_005_ref_high_step4 scene_005_ref_mid_step4 scene_005_ref_low_step4
scene_006_ref_high_step1 scene_006_ref_mid_step1 scene_006_ref_low_step1
scene_006_ref_high_step4 scene_006_ref_mid_step4 scene_006_ref_low_step4
scene_007_ref_high_step1 scene_007_ref_mid_step1 scene_007_ref_low_step1
scene_007_ref_high_step4 scene_007_ref_mid_step4 scene_007_ref_low_step4
scene_008_ref_high_step1 scene_008_ref_mid_step1 scene_008_ref_low_step1
scene_008_ref_high_step4 scene_008_ref_mid_step4 scene_008_ref_low_step4
scene_009_ref_high_step1 scene_009_ref_mid_step1 scene_009_ref_low_step1
scene_009_ref_high_step4 scene_009_ref_mid_step4 scene_009_ref_low_step4
scene_010_ref_high_step1 scene_010_ref_mid_step1 scene_010_ref_low_step1
scene_010_ref_high_step4 scene_010_ref_mid_step4 scene_010_ref_low_step4
scene_011_ref_high_step1 scene_011_ref_mid_step1 scene_011_ref_low_step1
scene_011_ref_high_step4 scene_011_ref_mid_step4 scene_011_ref_low_step4
scene_012_ref_high_step1 scene_012_ref_mid_step1 scene_012_ref_low_step1
scene_012_ref_high_step4 scene_012_ref_mid_step4 scene_012_ref_low_step4
scene_013_ref_high_step1 scene_013_ref_mid_step1 scene_013_ref_low_step1
scene_013_ref_high_step4 scene_013_ref_mid_step4 scene_013_ref_low_step4
scene_014_ref_high_step1 scene_014_ref_mid_step1 scene_014_ref_low_step1
scene_014_ref_high_step4 scene_014_ref_mid_step4 scene_014_ref_low_step4
scene_015_ref_high_step1 scene_015_ref_mid_step1 scene_015_ref_low_step1
scene_015_ref_high_step4 scene_015_ref_mid_step4 scene_015_ref_low_step4
scene_016_ref_high_step1 scene_016_ref_mid_step1 scene_016_ref_low_step1
scene_016_ref_high_step4 scene_016_ref_mid_step4 scene_016_ref_low_step4
scene_017_ref_high_step1 scene_017_ref_mid_step1 scene_017_ref_low_step1
scene_017_ref_high_step4 scene_017_ref_mid_step4 scene_017_ref_low_step4