Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering

Jonathan Dyssel Stets, Alessandro Dal Corso, Jannik Boll Nielsen, Rasmus Ahrenkiel Lyngby, Sebastian Hoppe Nesgaard Jensen, Jakob Wilm, Mads Brix Doest, Carsten Gundlach, Eythor Runar Eiriksson, Knut Conradsen, Anders Bjorholm Dahl, Jakob Andreas Bærentzen, Jeppe Revall Frisvad, Henrik Aanæs

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Resumé

Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.
OriginalsprogEngelsk
TidsskriftApplied Optics
Vol/bind56
Udgave nummer27
Sider (fra-til)7679-7690
ISSN1559-128X
DOI
StatusUdgivet - 2017
Udgivet eksterntJa

Fingeraftryk

Analog to digital conversion
Pipelines
evaluation
bidirectional reflectance
surface geometry
photographs
illuminating
dynamic range
Distribution functions
acquisition
Optical properties
Lighting
distribution functions
Scanning
reflectance
Imaging techniques
optical properties
scanning
Geometry
synthesis

Citer dette

Stets, J. D., Corso, A. D., Nielsen, J. B., Lyngby, R. A., Jensen, S. H. N., Wilm, J., ... Aanæs, H. (2017). Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering. Applied Optics, 56(27), 7679-7690. https://doi.org/10.1364/AO.56.007679
Stets, Jonathan Dyssel ; Corso, Alessandro Dal ; Nielsen, Jannik Boll ; Lyngby, Rasmus Ahrenkiel ; Jensen, Sebastian Hoppe Nesgaard ; Wilm, Jakob ; Doest, Mads Brix ; Gundlach, Carsten ; Eiriksson, Eythor Runar ; Conradsen, Knut ; Dahl, Anders Bjorholm ; Bærentzen, Jakob Andreas ; Frisvad, Jeppe Revall ; Aanæs, Henrik. / Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering. I: Applied Optics. 2017 ; Bind 56, Nr. 27. s. 7679-7690.
@article{9c958623306143caa39cd2a5eb289d3a,
title = "Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering",
abstract = "Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.",
author = "Stets, {Jonathan Dyssel} and Corso, {Alessandro Dal} and Nielsen, {Jannik Boll} and Lyngby, {Rasmus Ahrenkiel} and Jensen, {Sebastian Hoppe Nesgaard} and Jakob Wilm and Doest, {Mads Brix} and Carsten Gundlach and Eiriksson, {Eythor Runar} and Knut Conradsen and Dahl, {Anders Bjorholm} and B{\ae}rentzen, {Jakob Andreas} and Frisvad, {Jeppe Revall} and Henrik Aan{\ae}s",
year = "2017",
doi = "10.1364/AO.56.007679",
language = "English",
volume = "56",
pages = "7679--7690",
journal = "Applied Optics",
issn = "1559-128X",
publisher = "Optical Society of America",
number = "27",

}

Stets, JD, Corso, AD, Nielsen, JB, Lyngby, RA, Jensen, SHN, Wilm, J, Doest, MB, Gundlach, C, Eiriksson, ER, Conradsen, K, Dahl, AB, Bærentzen, JA, Frisvad, JR & Aanæs, H 2017, 'Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering', Applied Optics, bind 56, nr. 27, s. 7679-7690. https://doi.org/10.1364/AO.56.007679

Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering. / Stets, Jonathan Dyssel; Corso, Alessandro Dal; Nielsen, Jannik Boll; Lyngby, Rasmus Ahrenkiel; Jensen, Sebastian Hoppe Nesgaard; Wilm, Jakob; Doest, Mads Brix; Gundlach, Carsten; Eiriksson, Eythor Runar; Conradsen, Knut; Dahl, Anders Bjorholm; Bærentzen, Jakob Andreas; Frisvad, Jeppe Revall; Aanæs, Henrik.

I: Applied Optics, Bind 56, Nr. 27, 2017, s. 7679-7690.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

TY - JOUR

T1 - Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering

AU - Stets, Jonathan Dyssel

AU - Corso, Alessandro Dal

AU - Nielsen, Jannik Boll

AU - Lyngby, Rasmus Ahrenkiel

AU - Jensen, Sebastian Hoppe Nesgaard

AU - Wilm, Jakob

AU - Doest, Mads Brix

AU - Gundlach, Carsten

AU - Eiriksson, Eythor Runar

AU - Conradsen, Knut

AU - Dahl, Anders Bjorholm

AU - Bærentzen, Jakob Andreas

AU - Frisvad, Jeppe Revall

AU - Aanæs, Henrik

PY - 2017

Y1 - 2017

N2 - Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.

AB - Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.

U2 - 10.1364/AO.56.007679

DO - 10.1364/AO.56.007679

M3 - Journal article

VL - 56

SP - 7679

EP - 7690

JO - Applied Optics

JF - Applied Optics

SN - 1559-128X

IS - 27

ER -