Reversed Image Signal Processing and RAW Reconstruction. AIM 2022 Challenge Report

Marcos V. Conde*, Radu Timofte, Yibin Huang, Jingyang Peng, Chang Chen, Cheng Li, Eduardo Pérez-Pellitero, Fenglong Song, Furui Bai, Shuai Liu, Chaoyu Feng, Xiaotao Wang, Lei Lei, Yu Zhu, Chenghua Li, Yingying Jiang, Yong A, Peisong Wang, Cong Leng, Jian ChengXiaoyu Liu, Zhicun Yin, Zhilu Zhang, Junyi Li, Ming Liu, Wangmeng Zuo, Jun Jiang, Jinha Kim, Yue Zhang, Beiji Zou, Zhikai Zong, Xiaoxiao Liu, Juan Marín Vega, Michael Sloth, Peter Schneider-Kamp, Richard Röttger, Furkan Kınlı, Barış Özcan, Furkan Kıraç, Li Leyi, S. M.Nadim Uddin, Dipon Kumar Ghosh, Yong Ju Jung

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

Cameras capture sensor RAW images and transform them into pleasant RGB images, suitable for the human eyes, using their integrated Image Signal Processor (ISP). Numerous low-level vision tasks operate in the RAW domain (e.g. image denoising, white balance) due to its linear relationship with the scene irradiance, wide-range of information at 12bits, and sensor designs. Despite this, RAW image datasets are scarce and more expensive to collect than the already large and public RGB datasets. This paper introduces the AIM 2022 Challenge on Reversed Image Signal Processing and RAW Reconstruction. We aim to recover raw sensor images from the corresponding RGBs without metadata and, by doing this, “reverse” the ISP transformation. The proposed methods and benchmark establish the state-of-the-art for this low-level vision inverse problem, and generating realistic raw sensor readings can potentially benefit other tasks such as denoising and super-resolution.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2022 Workshops, Proceedings
EditorsLeonid Karlinsky, Tomer Michaeli, Ko Nishino
PublisherSpringer
Publication date2023
Pages3-26
ISBN (Print)978-3-031-25065-1
ISBN (Electronic)978-3-031-25066-8
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event17th European Conference on Computer Vision, ECCV 2022 - Tel Aviv, Israel
Duration: 23. Oct 202227. Oct 2022

Conference

Conference17th European Conference on Computer Vision, ECCV 2022
Country/TerritoryIsrael
CityTel Aviv
Period23/10/202227/10/2022
SeriesLecture Notes in Computer Science
Volume13803 LNCS
ISSN0302-9743

Bibliographical note

Funding Information:
Acknowledgments. This work was supported by the Humboldt Foundation. We thank the sponsors of the AIM and Mobile AI 2022 workshops and challenges: AI Witchlabs, MediaTek, Huawei, Reality Labs, OPPO, Synaptics, Raspberry Pi, ETH Zürich (Com- puter Vision Lab) and University of Würzburg (Computer Vision Lab). We also thank Andrey Ignatov and Eli Schwartz for their datasets used in this challenge.

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Keywords

  • Computational photography
  • Image signal processing
  • Image synthesis
  • Inverse problems
  • Low-level vision
  • Raw images

Fingerprint

Dive into the research topics of 'Reversed Image Signal Processing and RAW Reconstruction. AIM 2022 Challenge Report'. Together they form a unique fingerprint.

Cite this