{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,4]],"date-time":"2025-10-04T08:02:14Z","timestamp":1759564934480,"version":"3.41.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,4,18]],"date-time":"2020-04-18T00:00:00Z","timestamp":1587168000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2020,4,18]]},"abstract":"<jats:p>Image-Based Rendering (IBR) has made impressive progress towards highly realistic, interactive 3D navigation for many scenes, including cityscapes. However, cars are ubiquitous in such scenes; multi-view stereo reconstruction provides proxy geometry for IBR, but has difficulty with shiny car bodies, and leaves holes in place of reflective, semi-transparent windows on cars. We present a new approach allowing free-viewpoint IBR of cars based on an approximate analytic reflection flow computation on curved windows. Our method has three components: a refinement step of reconstructed car geometry guided by semantic labels, that provides an initial approximation for missing window surfaces and a smooth completed car hull; an efficient reflection flow computation using an ellipsoid approximation of the curved car windows that runs in real-time in a shader and a reflection\/background layer synthesis solution. These components allow plausible rendering of reflective, semi-transparent windows in free viewpoint navigation. We show results on several scenes casually captured with a single consumer-level camera, demonstrating plausible car renderings with significant improvement in visual quality over previous methods.<\/jats:p>","DOI":"10.1145\/3384535","type":"journal-article","created":{"date-parts":[[2021,3,23]],"date-time":"2021-03-23T17:44:11Z","timestamp":1616521451000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Image-Based Rendering of Cars using Semantic Labels and Approximate Reflection Flow"],"prefix":"10.1145","volume":"3","author":[{"given":"Simon","family":"Rodriguez","sequence":"first","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur and Inria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siddhant","family":"Prakash","sequence":"additional","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur and Inria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Hedman","sequence":"additional","affiliation":[{"name":"University College London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Drettakis","sequence":"additional","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur and Inria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,5,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015718"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487238"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2699184"},{"volume-title":"Rendering Techniques' 98","author":"Debevec Paul","key":"e_1_2_2_5_1","unstructured":"Paul Debevec , Yizhou Yu , and George Borshukov . 1998. Efficient view-dependent image-based rendering with projective texture-mapping . In Rendering Techniques' 98 . Springer , 105--116. Paul Debevec, Yizhou Yu, and George Borshukov. 1998. Efficient view-dependent image-based rendering with projective texture-mapping. In Rendering Techniques' 98. Springer, 105--116."},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of Vision, Modeling and Visualization. Eurographics Association. http:\/\/www-sop.inria.fr\/reves\/Basilic\/2005\/EMDTDC05","author":"Estalella Pau","year":"2005","unstructured":"Pau Estalella , Ignacio Martin , George Drettakis , Dani Tost , Olivier Devillers , and Fr\u00e9d\u00e9ric Cazals . 2005 . Accurate interactive specular reflections on curved objects . In Proceedings of Vision, Modeling and Visualization. Eurographics Association. http:\/\/www-sop.inria.fr\/reves\/Basilic\/2005\/EMDTDC05 Pau Estalella, Ignacio Martin, George Drettakis, Dani Tost, Olivier Devillers, and Fr\u00e9d\u00e9ric Cazals. 2005. Accurate interactive specular reflections on curved objects. In Proceedings of Vision, Modeling and Visualization. Eurographics Association. http:\/\/www-sop.inria.fr\/reves\/Basilic\/2005\/EMDTDC05"},{"volume-title":"International Conference on 3D Vision. IEEE, 19--27","author":"Godard Clement","key":"e_1_2_2_7_1","unstructured":"Clement Godard , Peter Hedman , Wenbin Li , and Gabriel J. Brostow . 2015. Multi-view reconstruction of highly specular surfaces in uncontrolled environments . In International Conference on 3D Vision. IEEE, 19--27 . Clement Godard, Peter Hedman, Wenbin Li, and Gabriel J. Brostow. 2015. Multi-view reconstruction of highly specular surfaces in uncontrolled environments. In International Conference on 3D Vision. IEEE, 19--27."},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1--8.","author":"Goesele Michael","key":"e_1_2_2_8_1","unstructured":"Michael Goesele , Noah Snavely , Brian Curless , Hugues Hoppe , and Steven M. Seitz . 2007. Multi-view stereo for community photo collections . In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1--8. Michael Goesele, Noah Snavely, Brian Curless, Hugues Hoppe, and Steven M. Seitz. 2007. Multi-view stereo for community photo collections. In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1--8."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.89"},{"key":"e_1_2_2_11_1","first-page":"6","article-title":"Deep blending for free-viewpoint image-based rendering","volume":"37","author":"Hedman Peter","year":"2018","unstructured":"Peter Hedman , Julien Philip , True Price , Jan-Michael Frahm , George Drettakis , and Gabriel Brostow . 2018 . Deep blending for free-viewpoint image-based rendering . ACM Transactions on Graphics (TOG) 37 , 6 (November 2018). http:\/\/www-sop.inria.fr\/reves\/Basilic\/2018\/HPPFDB18 Peter Hedman, Julien Philip, True Price, Jan-Michael Frahm, George Drettakis, and Gabriel Brostow. 2018. Deep blending for free-viewpoint image-based rendering. ACM Transactions on Graphics (TOG) 37, 6 (November 2018). http:\/\/www-sop.inria.fr\/reves\/Basilic\/2018\/HPPFDB18","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982420"},{"volume-title":"Eurographics State Of The Art Report (STAR)","author":"Ihrke Ivo","key":"e_1_2_2_13_1","unstructured":"Ivo Ihrke , Kiriakos N. Kutulakos , Hendrik P.A. Lensch , Marcus Magnor , and Wolfgang Heidrich . 2008. State of the art in transparent and specular object reconstruction . In Eurographics State Of The Art Report (STAR) . Eurographics Association . Ivo Ihrke, Kiriakos N. Kutulakos, Hendrik P.A. Lensch, Marcus Magnor, and Wolfgang Heidrich. 2008. State of the art in transparent and specular object reconstruction. In Eurographics State Of The Art Report (STAR). Eurographics Association."},{"volume-title":"Computer Graphics Forum","author":"Ihrke Ivo","key":"e_1_2_2_14_1","unstructured":"Ivo Ihrke , Kiriakos N. Kutulakos , Hendrik P.A. Lensch , Marcus Magnor , and Wolfgang Heidrich . 2010. Transparent and specular object reconstruction . In Computer Graphics Forum , Vol. 29 . Wiley Online Library , 2400--2426. Ivo Ihrke, Kiriakos N. Kutulakos, Hendrik P.A. Lensch, Marcus Magnor, and Wolfgang Heidrich. 2010. Transparent and specular object reconstruction. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 2400--2426."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.94"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508369"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882264"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1106"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_2_21_1","article-title":"Local light field fusion: practical view synthesis with prescriptive sampling guidelines","volume":"34","author":"Mildenhall Ben","year":"2019","unstructured":"Ben Mildenhall , Pratul P. Srinivasan , Rodrigo Ortiz-Cayon , Nima Khademi Kalantari , Ravi Ramamoorthi , Ren Ng , and Abhishek Kar . 2019 . Local light field fusion: practical view synthesis with prescriptive sampling guidelines . ACM Transactions on Graphics (TOG) 34 , 4 (2019). Ben Mildenhall, Pratul P. Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019. Local light field fusion: practical view synthesis with prescriptive sampling guidelines. ACM Transactions on Graphics (TOG) 34, 4 (2019).","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280929"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130855"},{"key":"e_1_2_2_24_1","unstructured":"Capturing Reality. 2018. RealityCapture reconstruction software. https:\/\/www.capturingreality.com\/Product.  Capturing Reality. 2018. RealityCapture reconstruction software. https:\/\/www.capturingreality.com\/Product."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185596"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2000.855826"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_31_1","volume-title":"International Conference on Learning Representations. ICLR. https:\/\/openreview.net\/forum?id=Hyg9anEFPS","author":"Thies Justus","year":"2020","unstructured":"Justus Thies , Michael Zollh\u00f6fer , Christian Theobalt , Marc Stamminger , and Matthias Nie\u00dfner . 2020 . Image-guided neural object rendering . In International Conference on Learning Representations. ICLR. https:\/\/openreview.net\/forum?id=Hyg9anEFPS Justus Thies, Michael Zollh\u00f6fer, Christian Theobalt, Marc Stamminger, and Matthias Nie\u00dfner. 2020. Image-guided neural object rendering. In International Conference on Learning Representations. ICLR. https:\/\/openreview.net\/forum?id=Hyg9anEFPS"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.244"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201319"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/358876.358882"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01261-8_6"},{"key":"e_1_2_2_36_1","first-page":"1","article-title":"Full 3D reconstruction of transparent objects","volume":"37","author":"Wu Bojian","year":"2018","unstructured":"Bojian Wu , Yang Zhou , Yiming Qian , Minglun Cong , and Hui Huang . 2018 . Full 3D reconstruction of transparent objects . ACM Transactions on Graphics (TOG) 37 , 4 (2018), 1 -- 11 . Bojian Wu, Yang Zhou, Yiming Qian, Minglun Cong, and Hui Huang. 2018. Full 3D reconstruction of transparent objects. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1--11.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766940"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.167"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.544"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-018-1140-0"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3384535","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3384535","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:12Z","timestamp":1750199592000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3384535"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,18]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,4,18]]}},"alternative-id":["10.1145\/3384535"],"URL":"https:\/\/doi.org\/10.1145\/3384535","relation":{},"ISSN":["2577-6193"],"issn-type":[{"type":"electronic","value":"2577-6193"}],"subject":[],"published":{"date-parts":[[2020,4,18]]},"assertion":[{"value":"2020-05-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}