Assessment of 3D Videogrammetry Modeling using SfM-MVS and NeRF Algorithms to Support Interoperability Heritage BIM
Article Sidebar
Main Article Content
Abstract
The heritage building information model (H-BIM) is a digital representation of a historic building, which combines real-world representations with spatial data in the field of preservation of historic buildings and sites. In Indonesia, especially on the island of Java, many temple buildings are historical sites. To build the H-BIM, appropriate 3D modeling technology is required. In this study, videogrammetry techniques are used for temple data acquisition and 3D modeling using the Structure from Motion/Multi-View Stereo (SfM-MVS) and neural radiance field (NeRF) algorithms. To support interoperability, the resulting 3D model is stored in a boundary representation (B-Rep) data structure. As Hindu heritage temples in Indonesia have complex surface textures, the video-recorded data used in 3D modeling are processed with two scenarios of 70% and 95% overlap. The results of 3D modeling with 70% overlap exhibit superiority in terms of the detail of the temple surface objects and their completeness. The 3D model processed with the SfM-MVS algorithm shows advantages in terms of geometric accuracy and is suitable for large temple buildings. By contrast, the 3D model processed with the NeRF algorithm shows advantages in terms of the density of point clouds and better visualization and is suitable for small temple buildings. The use of the B-Rep data structure can describe object boundaries well and can be stored in multiple formats. In this study, the OBJ, KMZ, FBX, and CityGML formats were used, thus having the potential to support interoperability.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
From 18 May 2018, the contents of Studies in Digital Heritage are licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). Our submitting authors pay no fee and retain the copyright to their own work.
How this works: to submit their work to the journal, authors grant Studies in Digital Heritage a nonexclusive license to distribute the work according to a CC BY-NC 4.0 license. Once an article is published, anyone is free to share and adapt its contents—provided only that they do so for noncommercial purposes and properly attribute the shared or adapted information. Details of these terms can be found on the Creative Commons website.
Download SDH’s full author agreement here
Studies in Digital Heritage will insert the following note at the end of any work published in the journal:
© [Year] by the authors. This article is an open-access article distributed under the terms and conditions of the Creative Commons Attribution License CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).
References
Abdelfattah, Mohamed, Rania Reda, Mohammed A.-M. Salem, and Slim Abdennadher. 2023. "3D mesh reconstruction from 2D images: a NeRF based approach." In 2023 Intelligent Methods, Systems, and Applications (IMSA), 394–399.
Agustina, Lee Kristi, Agung Budi Harto, Deni Suwardhi, and Ketut Wikantika. 2024. "Mapping technology of cultural heritage for sustainable urban area management at Indonesia." AIP Conference Proceedings 3077, no. 1: 040009.
Barszcz, Marcin, Jerzy Montusiewicz, Magdalena Paśnikowska-Łukaszuk, and Anna Sałamacha. 2021. "Comparative analysis of digital models of objects of cultural heritage obtained by the '3D SLS' and 'SfM' methods." Applied Sciences 11, no. 12: 6121.
Bello, Saifullahi Aminu, Shangshu Yu, Cheng Wang, Jibril Muhammad Adam, and Jonathan Li. 2020. "Review: deep learning on 3D point clouds." Remote Sensing 12, no. 11: 1729.
Costantino, Domenica, Massimiliano Pepe, and Alfredo Restuccia Garofalo. 2021. "Scan-to-HBIM for conservation and preservation of cultural heritage building: the case study of san nicola in montedoro church (Italy)." Applied Geomatics 14: 1–15.
Croce, Valeria, Dario Billi, Gabriella Caroti, Andrea Piemonte, Livio De Luca, and Philippe Véron. 2024. "Comparative assessment of neural radiance fields and photogrammetry in digital heritage: impact of varying image conditions on 3D reconstruction." Remote Sensing 16, no. 2: 365.
Döllner, Jürgen. 2020. "Geospatial artificial intelligence: potentials of machine learning for 3D point clouds and geospatial digital twins." PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science 88, no. 1: 15–24.
Gaber, Jomana Ahmed, Sherin Moustafa Youssef, and Karma Mohamed Fathalla. 2023. "The role of artificial intelligence and machine learning in preserving cultural heritage and art works via virtual restoration." ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 10: 185–190.
Gao, Zan, Yinming Li, and Shaohua Wan. 2020. "Exploring deep learning for view-based 3D model retrieval." ACM Transactions on Multimedia Computing, Communications, and Applications 16, no. 1: 1–21.
Kaneda, Akihiro, Tomomi Nakagawa, Kohei Tamura, Koji Noshita, and Hisashi Nakao. 2022. "A proposal of a new automated method for SfM/MVS 3D reconstruction through comparisons of 3D data by SfM/MVS and handheld laser scanners." PLoS ONE 17, no. 7: e0270374.
Lee, Byong-Kwon. 2024. "A study on the design and production of 3D traditional stone pagoda dataset for artificial intelligence learning." Journal of the Korea Convergence Society 15, no. 1: 231–238.
Marčiš, Marián. 2014. "Quality of 3D Models Generated by SFM Technology." Slovak Journal of Civil Engineering 21, no. 4: 13–24.
Mildenhall, Ben, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng. 2022. "NeRF: representing scenes as neural radiance fields for view synthesis." Communications of the ACM 65, no. 1: 99–106.
Murtiyoso, Arnadi, Deni Suwardhi, Pierre Grussenmeyer, Pierre Grussenmeyer, Widiatmoko Azis Fadilah, Kamal Nur Fauzan, Shafarina Wahyu Trisyanti, Hélène Macher. 2021. "Heritage documentation and knowledge transfer: a report on the CIPA tropical school in Candi Sewu (Indonesia)." International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 46: 493–497.
Nesbit, Paul Ryan, and Christopher H. Hugenholtz. 2019. "Enhancing UAV-SfM 3D model accuracy in high-relief landscapes by incorporating oblique images." Remote Sensing 11, no. 3: 358.
Pepe, Massimiliano, Vincenzo Saverio Alfio, and Domenica Costantino. 2022. "UAV platforms and the SfM-MVS approach in the 3D surveys and modeling: a review in the cultural heritage field." Applied Sciences 12, no. 21: 11266.
Petrovska, Ivana, and Boris Jutzi. 2024. "Vision through obstacles—3D geometric reconstruction and evaluation of neural radiance fields (NeRFs)." Remote Sensing 16, no. 7: 1121.
Remondino, Fabio, Ali Karami, Ziyang Yan, Gabriele Mazzacca, Simone Rigon, and Rongjun Qin. 2023. "A critical analysis of NeRF-based 3D reconstruction." Remote Sensing 15, no. 14: 3621.
Róg, Marta, and Antoni Rzonca. 2021. "The impact of photo overlap, the number of control points and the method of camera calibration on the accuracy of 3D model reconstruction." Geomatics and Environmental Engineering 15, no. 2: 67–87.
Sekretariat Negara. 2011. Law of the republic of Indonesia number 11 of 2010 concerning cultural heritage. Jakarta: Ministry of Culture and Tourism.
Tancik, Matthew, Ethan Weber, Evonne Ng, Ruilong Li, Brent Yi, Justin Kerr, Terrance Wang, Alexander Kristoffersen, Jake Austin, Kamyar Salahi, Abhik Ahuja, David McAllister, Angjoo Kanazawa. 2023. "Nerfstudio: a modular framework for neural radiance field development." In ACM SIGGRAPH 2023 Conference Proceedings. New York: Association for Computing Machinery.
Walstra, Jan, Neil Dixon, and Jim H. Chandler. 2007. "Historical aerial photographs for landslide assessment: two case histories." Quarterly Journal of Engineering Geology and Hydrogeology 40, no. 3: 315–332.
Wojtkowska, Michalina, Michal Kedzierski, and Paulina Delis. 2021. "Validation of terrestrial laser scanning and artificial intelligence for measuring deformations of cultural heritage structures." Measurement 167: 108291.
Zhu, Junxiang, Yi Tan, Xiangyu Wang, and Peng Wu. 2021. "BIM/GIS Integration for Web GIS-Based Bridge Management." Annals of GIS 27, no. 1: 99–109.