3D Heterogeneous Dataset for Structural Analysis of Historic Buildings. A Discussion on Process Pipelines

Main Article Content

Umair Shafqat Malik
Andrea Garzulino
Davide Del Curto


This paper presents a methodology for creating a comprehensive heterogeneous 3D dataset for the structural evaluation of a historic building by using both non-destructive and destructive surveys combined with historical information. The availability of adequate data on the actual conditions is crucial when assessing the seismic vulnerability and structural behavior of a historic building and validating the results. A reliable 3D dataset must accept different kinds of data, e.g., the results of destructive/non-destructive surveys, historical information, etc., which can be interrogated and enriched at any time. Therefore, creating such a 3D dataset may present several challenges in terms of data-gathering pipeline, comprehensiveness/redundancy, interpretation, organization, and integration with other heterogeneous data. The methodology we present in this paper includes 3D laser scanning, thermal imaging, and endoscopy combined with information regarding the state of conservation, construction history, materials, and techniques. We tested such methodology to create a dataset that was later used for Finite Element Modeling (FEM) to assess the seismic vulnerability of Diotti Palace, a neoclassical building that has been the seat of the Prefect of Milan since 1859. The results are analytically presented here. In conclusion, we highlight the pros and cons of the proposed methodology by means of a comparative discussion with the state of the art about 3D documentation pipelines for historic buildings and sites.


Download data is not yet available.

Article Details

How to Cite
Malik, U. S., Garzulino, A., & Del Curto, D. (2023). 3D Heterogeneous Dataset for Structural Analysis of Historic Buildings. A Discussion on Process Pipelines . Studies in Digital Heritage, 7(1), 17–46. https://doi.org/10.14434/sdh.v7i1.36296
Research Articles


Alfio, V.S., Costantino, D., Pepe, M., and Restuccia Garofalo, A. 2022. A Geomatics Approach in Scan to FEM Process Applied to Cultural Heritage Structure: The Case Study of the “Colossus of Barletta.” Remote Sensing 14, 3, 664.

Allegra, V., Di Paola, F., Lo Brutto, M., and Vinci, C. 2020. Scan-to-BIM for the management of heritage buildings: the case study of the castle of Maredolce (Palermo, Italy). International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences 43.

Alshawabkeh, Y., Baik, A., and Miky, Y. 2021. Integration of laser scanner and photogrammetry for heritage BIM enhancement. ISPRS International Journal of Geo-Information 10, 5, 316.

Altuntas, C., Yildiz, F., and Scaioni, M. 2016. Laser Scanning and Data Integration for Three-Dimensional Digital Recording of Complex Historical Structures: The Case of Mevlana Museum. ISPRS International Journal of Geo-Information 5, 2, 18.

Antón, D., Pineda, P., Medjdoub, B., and Iranzo, A. 2019. As-built 3D heritage city modelling to support numerical structural analysis: Application to the assessment of an archaeological remain. Remote Sensing 11, 11, 1276.

Arnold, D. and Geser, G. 2008. EPOCH Research Agenda for the Applications of ICT to Cultural Heritage. Final Report, 273.

Barazzetti, L., Banfi, F., Brumana, R., et al. 2015. BIM from laser clouds and finite element analysis: combining structural analysis and geometric complexity. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 40, 345–350.

Barontini, A., Alarcon, C., Sousa, H.S., Oliveira, D.V., Masciotta, M.G., and Azenha, M. 2022. Development and demonstration of an HBIM framework for the preventive conservation of cultural heritage. International Journal of Architectural Heritage 16, 10, 1451–1473.

Bologna, G. 1981. In: Milano Palazzo Diotti. Sede della Prefettura. Comune di Milano, Milano, Italy, 1–67.

Castellazzi, G., Altri, A.M.D., Bitelli, G., Selvaggi, I., and Lambertini, A. 2015. From Laser Scanning to Finite Element Analysis of Complex Buildings by Using a Semi-Automatic Procedure. Sensors 15, 8, 18360–18380.

Conti, A., Fiorini, L., Massaro, R., Santoni, C., and Tucci, G. 2020. HBIM for the preservation of a historic infrastructure: The Carlo III bridge of the Carolino Aqueduct. Applied Geomatics, 1–11.

Costantino, D., Pepe, M., and Restuccia, A. 2021. Scan-to-HBIM for conservation and preservation of Cultural Heritage building: The case study of San Nicola in Montedoro church (Italy). Applied Geomatics, 1–15.

De Luca, L., Veron, P., and Florenzano, M. 2006. Reverse engineering of architectural buildings based on a hybrid modeling approach. Computers & Graphics 30, 2, 160–176.

El-Din Fawzy, H. 2019. 3D laser scanning and close-range photogrammetry for buildings documentation: A hybrid technique towards a better accuracy. Alexandria Engineering Journal 58, 4, 1191–1204.

El-Hakim, S.F., Beraldin, J.A., and Blais, F. 1995. Comparative evaluation of the performance of passive and active 3D vision systems. SPIE, 14–25.

Evident. 2023. Olympus IPLEX GX technical specifications. https://www.olympus-ims.com/en/rvi-products/iplex-gx/#!cms[focus]=cmsContent14416.

Fang, J., Sun, Z., and Zhang, Y. 2021. TLS-FEM integrated structural deformation analysis on the Beamless Hall at Nanjing, China. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences 46, 215–220.

FARO. 2023. FARO Focus 3D laser scanners technical specifications. FARO Knowledge Base. https://knowledge.faro.com/Hardware/Focus/Focus/Technical_Specification_Sheet_for_the_Focus_Laser_Scanner.

Fassi, F. and Parri, S. 2012. Complex architecture in 3D: from survey to web. International journal of heritage in the digital era 1, 3, 379–398.

Fiorillo, F., Jiménez Fernández-Palacios, B., Remondino, F., and Barba, S. 2015. 3d Surveying and modelling of the Archaeological Area of Paestum, Italy. Virtual Archaeology Review 4, 8, 55.

Fortunato, G., Funari, M.F., and Lonetti, P. 2017. Survey and seismic vulnerability assessment of the Baptistery of San Giovanni in Tumba (Italy). Journal of Cultural Heritage 26, 64–78.

Funari, M.F., Hajjat, A.E., Masciotta, M.G., Oliveira, D.V., and Lourenço, P.B. 2021. A parametric scan-to-FEM framework for the digital twin generation of historic masonry structures. Sustainability 13, 19, 11088.

Godinho, M., Machete, R., Ponte, M., Falcao, A.P., Goncalves, A.B., and Bento, R. 2020. BIM as a resource in heritage management: An application for the National Palace of Sintra, Portugal. Journal of Cultural Heritage 43, 153–162.

Gomes, L., Bellon, O.R.P., and Silva, L. 2014. 3D reconstruction methods for digital preservation of cultural heritage: A survey. Pattern Recognition Letters 50, 3–14.

Grilli, E. and Remondino, F. 2019. Classification of 3D digital heritage. Remote Sensing 11, 7, 847.

Guidi, G. and Frischer, B. 2020. 3D Digitization of Cultural Heritage. In: Y. Liu, N. Pears, P.L. Rosin and P. Huber, eds., 3D Digitization of Cultural Heritage. Springer International Publishing, Cham.

Guidi, G., Russo, M., Ercoli, S., Remondino, F., Rizzi, A., and Menna, F. 2009. A Multi-Resolution Methodology for the 3D Modeling of Large and Complex Archeological Areas. International Journal of Architectural Computing 7, 1, 39–55.

Khan, M.S., Khan, M., Bughio, M., Talpur, B.D., Kim, I.S., and Seo, J. 2022. An integrated hbim framework for the management of heritage buildings. Buildings 12, 7, 964.

Korumaz, M., Betti, M., Conti, A., et al. 2017. An integrated Terrestrial Laser Scanner (TLS), Deviation Analysis (DA) and Finite Element (FE) approach for health assessment of historical structures. A minaret case study. Engineering Structures 153, 224–238.

Lanza, A. and Somarè, M. 1993. In: Milano e i suoi palazzi. Edizioni Meravigli, Milano Italy, 1–400.

Lasaponara, R., Coluzzi, R., and Masini, N. 2011. Flights into the past: full-waveform airborne laser scanning data for archaeological investigation. Journal of Archaeological Science 38, 9, 2061–2070.

Lemmens, M. 2011. Terrestrial laser scanning. Geo-information: technologies, applications and the environment, 101–121.

Li, H., Zhang, C., Song, S., Demirkesen, S., and Chang, R. 2020. Improving tolerance control on modular construction project with 3D laser scanning and bim: A case study of removable floodwall project. Applied Sciences 10, 23, 8680.

Lo Brutto, M., Iuculano, E., and Lo Giudice, P. 2021. Integrating topographic, photogrammetric and laser scanning techniques for a scan-to-bim process. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 43, 883–890.

Machete, R., Silva, J.R., Bento, R., et al. 2021. Information transfer between two heritage BIMs for reconstruction support and facility management: The case study of the Chalet of the Countess of Edla, Sintra, Portugal. Journal of Cultural Heritage 49, 94–105.

Meyer, D., Fraijo, E., Lo, E., Rissolo, D., and Kuester, F. 2015. Optimizing UAV systems for rapid survey and reconstruction of large scale cultural heritage sites. 2015 Digital Heritage, 151–154.

Micoli, L., Barsanti, S.G., Malik, U., and Guidi, G. 2018. 3D data integration for the digital reconstruction of cultural heritage monuments. IOP Conference Series: Materials Science and Engineering 364, 012043.

Micoli, L., Guidi, G., Angheleddu, D., and Russo, M. 2013. A multidisciplinary approach to 3D survey and reconstruction of historical buildings. 2013 Digital Heritage International Congress (DigitalHeritage), IEEE, 241–248.

Oreni, D., Brumana, R., Torre, S.D., Banfi, F., Barazzetti, L., and Previtali, M. 2014. Survey turned into HBIM: the restoration and the work involved concerning the Basilica di Collemaggio after the earthquake (L’Aquila). ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences II–5, June, 267–273.

Patias, P. and Hanke, P.G.& K. 2008. Applications in cultural heritage documentation. In: Advances in Photogrammetry, Remote Sensing and Spatial Information Sciences: 2008 ISPRS Congress Book. CRC Press.

Pepe, M., Costantino, D., and Restuccia Garofalo, A. 2020. An Efficient Pipeline to Obtain 3D Model for HBIM and Structural Analysis Purposes from 3D Point Clouds. Applied Sciences 10, 4, 1235.

Previtali, M., Barazzetti, L., Brumana, R., et al. 2014. Automatic façade modelling using point cloud data for energy-efficient retrofitting. Applied Geomatics 6, 2, 95–113.

Quintero, M.S., Georgopoulos, A., Stylianidis, E., Lerma, J.L., and Remondino, F. 2017. CIPA’s Mission: Digitally Documenting Cultural Heritage. APT Bulletin: The Journal of Preservation Technology 48, 4, 51–54.

Raponi, N. and Scotti, A. 2005. In: Palazzo Diotti a Milano. Storia, arte, istituzioni. Fondazione Cariplo, Milano, Italy, 1–520.

Razali, A.F., Ariff, M.F.M., Majid, Z., Darwin, N., Aspuri, A., and Salleh, M.F.M. 2020. Three-Dimensional (3D) As-Built Reconstruction from Laser Scanning Dataset. IEEE, 150–155.

Remondino, F., Barazzetti, L., Nex, F., Scaioni, M., and Sarazzi, D. 2012. UAV photogrammetry for mapping and 3d modeling – current status and future perspectives. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-1/C22, 25–31.

Rinaudo, F., Chiabrando, F., Lingua, A., and Spanò, A. 2012. Archaeological site monitoring: UAV photogrammetry can be an answer. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXIX-B5, 583–588.

Rinaudo, F. and Scolamiero, V. 2021. Comparison of multi-source data, integrated survey for complex architecture documentation. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLVI-M-1–2021, 625–631.

Rocha, G., Mateus, L., Fernández, J., and Ferreira, V. 2020. A scan-to-BIM methodology applied to heritage buildings. Heritage 3, 1, 47–67.

Rolin, R., Antaluca, E., Batoz, J.-L., Lamarque, F., and Lejeune, M. 2019. From point cloud data to structural analysis through a geometrical hBIM-oriented model. Journal on Computing and Cultural Heritage (JOCCH) 12, 2, 1–26.

Russo, M. and Manferdini, A.M. 2014. Integration of image and range-based techniques for surveying complex architectures. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II–5, 305–312.

Rüther, H., Chazan, M., Schroeder, R., et al. 2009. Laser scanning for conservation and research of African cultural heritage sites: the case study of Wonderwerk Cave, South Africa. Journal of Archaeological Science 36, 9, 1847–1856.

Sacco, G.L.S., Ferrero, C., Battini, C., and Calderini, C. 2023. Combined use of deformation and structural analysis for the structural damage assessment of heritage buildings: a case study in the Liguria region (Italy). Engineering Failure Analysis, 107154.

Sauerbier, M. and Eisenbeiss, H. 2010. UAVs for the documentation of archaeological excavations. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 38, 5, 526–531.

Soler, F., Melero, F.J., and Luzón, M.V. 2017. A complete 3D information system for cultural heritage documentation. Journal of Cultural Heritage 23, 49–57.

Sony Electronics INC. 2023a. Sony Alpha 1 technical specifications. SONY ELECTRONICS INC. https://electronics.sony.com/imaging/interchangeable-lens-cameras/all-interchangeable-lens-cameras/p/ilce1-b.

Sony Electronics INC. 2023b. Sony FE 16-35mm F2.8 GM technical specifications. SONY ELECTRONICS INC. https://www.sony.com/en-ae/electronics/camera-lenses/sel1635gm/specifications.

Suchocki, C. 2020. Comparison of time-of-flight and phase-shift TLS intensity data for the diagnostics measurements of buildings. Materials 13, 2, 353.

Suwardhi, D., Menna, F., Remondino, F., Hanke, K., and Akmalia, R. 2015. Digital 3D Borobudur – Integration of 3D surveying and modeling techniques. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W7, 417–423.

Tan, Y., Li, S., and Wang, Q. 2020. Automated geometric quality inspection of prefabricated housing units using BIM and LiDAR. Remote Sensing 12, 15, 2492.

Teledyne FLIR LLC. 2023. Technical specifications of FLIR T1020 HD Thermal Camera with Viewfinder. https://www.flir.co.uk/products/t1020?vertical=condition+monitoring&segment=solutions.

Themistocleous, K. 2020. The Use of UAVs for Cultural Heritage and Archaeology. In: D.G. Hadjimitsis, K. Themistocleous, B. Cuca, et al., eds., Remote Sensing for Archaeology and Cultural Landscapes. Springer International Publishing, Cham, 241–269.

Tsilimantou, E., Delegou, E.T., Nikitakos, I.A., Ioannidis, C., and Moropoulou, A. 2020. GIS and BIM as integrated digital environments for modeling and monitoring of historic buildings. Applied Sciences 10, 3, 1078.

Tucci, G., Conti, A., Fiorini, L., Corongiu, M., Valdambrini, N., and Matta, C. 2019. M-BIM: a new tool for the Galleria dell’Accademia di Firenze. Virtual Archaeology Review 10, 21, 40–55.

Ursini, A., Grazzini, A., Matrone, F., and Zerbinatti, M. 2022. From scan-to-BIM to a structural finite elements model of built heritage for dynamic simulation. Automation in Construction 142, 104518.

Usmani, A.R.A., Elshafey, A., Gheisari, M., Chai, C., Aminudin, E.B., and Tan, C.S. 2020. A scan to as-built building information modeling workflow: a case study in Malaysia. Journal of Engineering, Design and Technology 18, 4, 923–940.

Valero, E., Mohanty, D.D., Ceklarz, M., et al. 2021. An integrated scan-to-bim approach for buildings energy performance evaluation and retrofitting. ISARC, 204–211.

Woo, J., Wilsmann, J., and Kang, D. 2010. Use of as-built building information modeling. 538–548.

Yang, X., Grussenmeyer, P., Koehl, M., Macher, H., Murtiyoso, A., and Landes, T. 2020. Review of built heritage modelling: Integration of HBIM and other information techniques. Journal of Cultural Heritage 46, 350–360.

Zhao, L., Zhang, H., Wang, Q., and Wang, H. 2021. Digital-Twin-based evaluation of nearly zero-energy building for existing buildings based on scan-to-BIM. Advances in Civil Engineering 2021, 1–11.