The SIDD Benchmark has been hosted as a challenge at the New Trends in Image Restoration and Enhancement (NTIRE 2019) workshop in conjunction with CVPR 2019.
The participating solutions and results will be published in the challenge report in the CVPR Workshop proceedings.
Challenge preliminary results can be viewed at the following Codalab competitions:
NTIRE 2019 Real Image Denoising Challenge - Track 1: Raw-RGB
NTIRE 2019 Real Image Denoising Challenge - Track 2: sRGB
The benchmark is currently hosted here on this website.
The last decade has seen an astronomical shift from imaging with DSLR and point-and-shoot cameras to imaging with smartphone cameras. Due to the small aperture and sensor size, smartphone images have notably more noise than their DSLR counterparts. While denoising for smartphone images is an active research area, the research community currently lacks a denoising image dataset representative of real noisy images from smartphone cameras with high-quality ground truth. We address this issue in this paper with the following contributions. We propose a systematic procedure for estimating ground truth for noisy images that can be used to benchmark denoising performance for smartphone cameras. Using this procedure, we have captured a dataset, the Smartphone Image Denoising Dataset (SIDD), of ~30,000 noisy images from 10 scenes under different lighting conditions using five representative smartphone cameras and generated their ground truth images. We used this dataset to benchmark a number of denoising algorithms. We show that CNN-based methods perform better when trained on our high-quality dataset than when trained using alternative strategies, such as low-ISO images used as a proxy for ground truth data.
Abdelrahman Abdelhamed, Lin S., Brown M. S. "A High-Quality Denoising Dataset for Smartphone Cameras", IEEE Computer Vision and Pattern Recognition (CVPR'18), June 2018.
A simple camera pipeline for rendering raw-RGB images into sRGB.
For any questions, remarks, or comments, please contact: Abdelrahman Abdelhamed.