Awesome Image Signal Processing

A collection of Image Signal Processing (ISP) papers.

Contents

• Review & Tutorial
• Demosaicing
• White Balance
• Tone mapping
• Gamut mapping
• Image retouching
• End-to-end ISP
• Raw image reconstruction

Review & Tutorial

• ⭐⭐⭐ Mobile Computational Photography: A Tour, arXiv 2021
  [Paper]

• ⭐⭐⭐ Understanding the in-camera rendering pipeline & the role of AI and deep learning, ICCV 2023 Tutorial
  [Slides]

• Camera Processing Pipeline, lecture
  [Slides]

Gamut mapping

• Gamut Extension for Cinema, TIP 2017
  [Paper]

• Vision Models for Wide Color Gamut Imaging in Cinema, TPAMI 2021
  [Paper]

• Improving Color Space Conversion for Camera-Captured Images via Wide-Gamut Metadata, CIC 2020
  [Paper] [Code]

• GamutMLP: A Lightweight MLP for Color Loss Recovery, CVPR 2024
  [Paper] [Project] [Code]

• GamutNet: Restoring Wide-Gamut Colors for Camera-Captured Images, CIC 2022
  [Paper] [Code]

Tone mapping

Image retouching

• Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs, CVPR 2018
  [Paper] [Code]

• Underexposed Photo Enhancement using Deep Illumination Estimation, CVPR 2019
  [Paper] [Code]

3DLUT

• Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-time, TPAMI 2020
  [Paper] [Code]

• AdaInt: Learning Adaptive Intervals for 3D Lookup Tables on Real-time Image Enhancement, CVPR 2022
  [Paper] [Code]

• 4D LUT: Learnable Context-Aware 4D Lookup Table for Image Enhancement, TIP 2023
  [Paper] [Code]

• Learning Pixel-Adaptive Weights for Portrait Photo Retouching
  [Paper] [Code]

• CLUT-Net: Learning Adaptively Compressed Representations of 3DLUTs for Lightweight Image Enhancement, ACMMM 2022
  [Paper] [Code]

• Adaptively Hashing 3DLUTs for Lightweight Real-time Image Enhancement, ICME 2023
  [Paper] [Code]

• NILUT: Conditional Neural Implicit 3D Lookup Tables for Image Enhancement, AAAI 2024
  [Paper] [Code]

• Taming Lookup Tables for Efficient Image Retouching, ECCV 2024
  [Paper] [Code]

Tone curving

• CURL: Neural Curve Layers for Global Image Enhancement, ICPR 2020
  [Paper] [Code]

• Multi-Curve Translator for High-Resolution Photorealistic Image Translation, ECCV 2022
  [Paper]

• FlexiCurve: Flexible Piecewise Curves Estimation for Photo Retouching, CVPRW 2023
  [Paper] [Project] [Code]

• NamedCurves: Learned Image Enhancement via Color Naming, ECCV 2024
  [Paper] [Project] [Code]

Filter

• DeepLPF: Deep Local Parametric Filters for Image Enhancement, CVPR 2020
  [Paper] [Code]

Demosaicing

White Balance

End-to-end ISP

• Replacing Mobile Camera ISP with a Single Deep Learning Model, CVPR 2020
  [Paper] [Code]

• Invertible Image Signal Processing, CVPR 2021
  [Paper] [Project] [Code]

• End-to-end High Dynamic Range Camera Pipeline Optimization, CVPR 2021
  [Paper]

• CameraNet: A Two-Stage Framework for Effective Camera ISP Learning, TIP 2021
  [Paper] [Code]

• AWNet: Attentive Wavelet Network for Image ISP, ECCVW 2020
  [Paper] [Code]

• PyNET-CA: Enhanced PyNET with Channel Attention for End-to-End Mobile Image Signal Processing, ECCV 2020 AIM workshop
  [Paper] [Code]

• CSANet: High Speed Channel Spatial Attention Network for Mobile ISP, CVPRW 2021
  [Paper]

• CIE XYZ Net: Unprocessing Images for Low-Level Computer Vision Tasks, TPAMI 2020
  [Paper] [Code]

• CycleISP: Real Image Restoration via Improved Data Synthesis, TPAMI 2020
  [Paper] [Code]

• RAWtoBit: A Fully End-to-end Camera ISP Network, ECCV 2022
  [Paper]

• Model-Based Image Signal Processors via Learnable Dictionaries, AAAI 2022
  [Paper] [Code]

• Self-Supervised Reversed Image Signal Processing via Reference-Guided Dynamic Parameter Selection, arXiv 2023
  [Paper]

• ParamISP: Learned Forward and Inverse ISPs using Camera Parameters, CVPR 2024
  [Paper] [Project] [Code]

• Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPs, ECCV 2024
  [Paper] [Code]

• MetaISP – Exploiting Global Scene Structure for Accurate Multi-Device Color Rendition, VMV 2023
  [Paper] [Code]

Raw image reconstruction

• Spatially Aware Metadata for Raw Reconstruction, WACV 2021
  [Paper]

• Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata, CVPR 2022
  [Paper] [Code]

• Raw Image Reconstruction with Learned Compact Metadata, CVPR 2023
  [Paper] [Code]

• Metadata-Based RAW Reconstruction via Implicit Neural Functions, CVPR 2023
  [Paper]