Understanding the In-Camera Image Processing Pipeline for Computer Vision

IEEE Conference on Computer Vision and Pattern Recognition 2016

June 26, 2016
Michael S. Brown, NUS/York

Tutorial Slides (link)

Reference:
M. S. Brown, "Understanding the In-Camera Image Processing Pipeline for Computer Vision", IEEE Computer Vision and Pattern Recognition - Tutorial, June 26, 2016

Additional Materials

Books
G. Sharma, Digital Color Imaging Handbook, CRC Press , 2003
M. Fairchild, Color Appearance Models, Wiley , 2005
D. Forsyth and J. Ponce, Computer Vision: A modern approach, Prentice Hall, 2011
R. Lukac, Single-Sensor Imaging: Methods and Applications for Digital Cameras, CRC Press , 2008

Articles/Conference Papers
R. Ramantha et al. "Color Image Processing Pipeline: a general survey of digital still cameras", IEEE Signal Processing Magazine , Jan 2005
H. Fairman et al. "How the CIE 1931 Color-Matching Functions Were Derived from Wright–Guild Data", Color Research & Application , Feb 1997
G. Meyer, "Tutorial on Color Science", The Visual Computer , 1986
S. J. Kim et al. "A New In-Camera Imaging Model for Color Computer Vision and its Application", IEEE Transactions on Pattern Analysis and Machine Intelligence , Dec 2012
H.T. Lin et al. "Nonuniform Lattice Regression for Modeling the Camera Imaging Pipeline", European Conference on Computer Vision , 2012
E. Garcia and M. Gupta "Building accurate and smooth ICC profiles by lattice regression", Color and Imaging Conference , 2009
A. Chakrabarti et al. "Modeling Radiometric Uncertainty for Vision with Tone-mapped Color Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014 
Cheng D. L. et al. “Beyond White: Ground Truth Colors for Color Constancy Correction”, IEEE International Conference on Computer Vision, Dec 2015
Tai Y.-W. et al. "Nonlinear Camera Response Functions and Image Deblurring: Theoretical Analysis and Practice",  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 35(10), Oct 2013

Online Resources
ICC – ISO 22028 (2012) Document (link)
Photo Tech Edu Series Jan 2007 (Google)
    Available on youtube
    Richard Lyon: Digital Camera Image Processing Pipeline
Mark Meyer Photography
Professional photography blog with nice tie-ins to color from a photographer’s point of view
Doug Kerr postings
A large collection of self-published articles on various aspects of imaging in an "accessible language" to most readers.

Preparation of this tutorial was supported by gifts from Adobe Research and Google Research (Google Faculty Research Award 2016)