A metadata enriched system for the documentation of multi-modal digital imaging surveys

Main Article Content

Anthony Pamart
Livio De Luca
Philippe Véron


In the field of Digital Heritage Studies, data provenance has always been an open and challenging issue. As Cultural Heritage objects are unique by definition, the methods, the practices and the strategies to build digital documentation are not homogeneous, universal or standardized. Metadata is a minimalistic  yet powerful form to source and describe a digital document. They are often required or mandatory at an advanced stage of a Digital Heritage project. Our approach is to integrate since data capture steps meaningful information to document a Digital Heritage asset as it is moreover being composed nowadays from multiple sources or multimodal imaging surveys. This article exposes the methodological and technical aspects related to the ongoing development of MEMoS; standing for Metadata Enriched Multimodal documentation System. MEMoS aims to contribute to data provenance issues in current multimodal imaging surveys. It explores a way to document CH oriented capture data sets with a versatile descriptive metadata scheme inspired from the W7 ontological model. In addition, an experiment illustrated by several case studies, explores the possibility to integrate those metadata encoded into 2D barcodes directly to the captured image set. The article lays the foundation of a three parted methodology namely describe - encode and display toward metadata enriched documentation of CH objects.


Download data is not yet available.

Article Details

How to Cite
Pamart, A., De Luca, L., & Véron, P. (2022). A metadata enriched system for the documentation of multi-modal digital imaging surveys. Studies in Digital Heritage, 6(1), 1–24. https://doi.org/10.14434/sdh.v6i1.33767
Research Articles


Azizi Abas, Yuhanis Yusof, and Farzana Kabir Ahmad. 2016. Improving Data Capacity of QR Code Version 40 Using Multiplexing and Multilayered Techniques: Embedding Text Based Short Story in QR Code. Advanced Science Letters 22, (2016), 2841–2846. DOI: https://doi.org/10.1166/asl.2016.7098

Abdullah Al-Barakati, Martin White, and Zeeshan Patoli. 2014. The application of workflow management to digital heritage resources. International Journal of Information Management 34, 5 (2014), 660–671. DOI: https://doi.org/10.1016/j.ijinfomgt.2014.06.003

Waldemar Berchtold, Huajian Liu, Martin Steinebach, Dominik Klein, Tobias Senger, and Nicolas Thenee. 2020. JAB Code - A Versatile Polychrome 2D Barcode. Electronic Imaging 2020, 3 (2020), 207-1-207–7. DOI: https://doi.org/10.2352/ISSN.2470-1173.2020.3.MOBMU-207

Iwona Dudek and Jean-Yves Blaise. 2017. What Comes before a Digital Output? Eliciting and Documenting Cultural Heritage Research Processes. IJCH 3, 1 (2017), 86–97. DOI: https://doi.org/10.18178/ijch.2017.3.1.083

Nicola Carboni, George Bruseker, Anais Guillem, Diego Bellido, Chance Coughenour, M. Domajnko, M. Kramer, Magda Calles, Ellie Stathopoulou, and Rssella Suma. "Data Provenance in Photogrammetry Through Documentation Protocols." ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences III-5. (2016), 57–64.

Claudia Daffara, Enrico Gobbetti, and Andrea Giachetti. 2018. A DICOM-Inspired Metadata Architecture for Managing Multimodal Acquisitions in Cultural Heritage. In M. Ioannides, ed. Digital Cultural Heritage: Final Conference of the Marie Sklodowska-Curie Initial Training Network for Digital Cultural Heritage, ITN-DCH 2017, Olimje, Slovenia, May 23–25, 2017, Revised Selected Papers, Springer International Publishing, 37-49.

Andrea D’Andrea and Kate Fernie. 2013. CARARE 2.0: A metadata schema for 3D cultural objects. In 2013 Digital Heritage International Congress (DigitalHeritage), 137–143. DOI: https://doi.org/10.1109/DigitalHeritage.2013.6744745

Harold Dibble, Curtis Marean, and Shannon Mcpherron. 2007. The Use of Barcodes in Excavation Projects: Examples from Mossel Bay (South Africa) and Roc de Marsal (France). SAA Archaeol. Rec. (2007) 7, 33-38.

Antonio Grillo, Alessandro Lentini, Marco Querini, and Guiseppe F. Italiano. 2010. High Capacity Colored Two Dimensional codes. In Proceedings of the International Multiconference on Computer Science and Information Technology, 709–716. DOI: https://doi.org/10.1109/IMCSIT.2010.5679869

A Grillo, A Lentini, M Querini, and G F Italiano. 2010. High Capacity Colored Two Dimensional codes. In Proceedings of the International Multiconference on Computer Science and Information Technology, IEEE, Wisla, 709–716. DOI: https://doi.org/10.1109/IMCSIT.2010.5679869

Tony Hey and Anne Trefethen. 2003. The Data Deluge: An e-Science Perspective. In Fran Berman, Geoffrey Fox and Tony Hey, eds. Wiley Series in Communications Networking & Distributed Systems. Chichester, UK: John Wiley & Sons, Ltd., 809–824. DOI: https://doi.org/10.1002/0470867167.ch36

Gareth N. Hill and Mark A. Whitty. 2021. Embedding metadata in images at time of capture using physical Quick Response (QR) codes. Information Processing & Management 58, 3 (2021), 102504. DOI: https://doi.org/10.1016/j.ipm.2021.102504

Maximiliaan Huisman, Mathias Hammer, Alex Rigano, Ulrike Boehm, James J. Chambers, Nathalie Gaudreault, Alison J. North, Jaime A. Pimentel, Damir Sudar, Peter Bajcsy, Claire M. Brown, Alexander D. Corbett, Orestis Faklaris, Judith Lacoste, Alex Laude, Glyn Nelson, Roland Nitschke, David Grunwald, and Caterina Strambio-De-Castillia. 2021. A perspective on Microscopy Metadata: data provenance and quality control. Retrieved August 18, 2021 from http://arxiv.org/abs/1910.11370

William Limp, Angelina Payne, Snow Winters, Adam Barnes and Jackson D. Cothren. 2010. Approaching 3D Digital Heritage Data from a Multi- technology, Lifecycle Perspective. In Francisco Contreras Cortes, M. Farajas, and F.J. Melero, eds. CAA2010: fusion of cultures: proceedings of the 38th Annual Conference on Computer Applications and Quantitative Methods in Archaeology. Granada, Spain., April 2010. Oxford: Archaeopress. 15–22.

Max E. Vizcarra Melgar and Mylène C. Q. Farias. 2019. High density two-dimensional color code. Multimed Tools Appl 78, 2 (January 2019), 1949–1970. DOI: https://doi.org/10.1007/s11042-018-6299-4

Laurence Nigay and Joëlle Coutaz. 1993. A design space for multimodal systems: concurrent processing and data fusion. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). Association for Computing Machinery, New York, NY, USA, 172–178. DOI: https://doi.org/10.1145/169059.169143

Kinjal H. Pandya, and Hiren J. Galiyawala. 2014. A Survey on QR Codes: in context of Research and Application. International Journal of Emerging Technology and Advanced Engineering 4,3 (2014): 258-262.

Denis Pitzalis, Franco Niccolucci, and Matthieu Cord. 2011. Using LIDO to handle 3D cultural heritage documentation data provenance. In 9th International Workshop on Content-Based Multimedia Indexing (CBMI 2011), Madrid, Spain, 37–42. Retrieved October 4, 2018 from https://hal.archives-ouvertes.fr/hal-00742323

Christine Plumejeaud-Perreau, Eric Quinton, Cécile Pignol, Hector Linyer, Julin Ancelin, Sébastien Cipière, Wilfried Heintz, Mathias Rouan, Sylvie Damy, and Vincent Bretagnolle. 2019. Towards better traceability of field sampling data. Computers & Geosciences 129, (August 2019), 82–91. DOI: https://doi.org/10.1016/j.cageo.2019.04.009

Eric Quinton. Pour citer la version v2.5 – Collec-Science. Retrieved August 18, 2021 from https://www.collec-science.org/2019/08/14/pour-citer-la-version-v2-3/

Sudha Ram and Jun Liu. 2008. A Semiotics Framework for Analyzing Data Provenance Research. Journal of Computing Science and Engineering 2, 3 (2008), 221–248. DOI: https://doi.org/10.5626/JCSE.2008.2.3.221

Sudha Ram and Jun Liu. 2009. A new perspective on semantics of data provenance. In Proceedings of the First International Conference on Semantic Web in Provenance Management - Volume 526 (SWPM'09). CEUR-WS.org, Aachen, DEU, 35–40.

Magdalena Magda Ramos and Fabio Remondino. 2015. Data fusion in Cultural Heritage - A Review. ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W7, (August 2015), 359–363. DOI: https://doi.org/10.5194/isprsarchives-XL-5-W7-359-2015

Greg Reser. 2012. What Not to Embed: is it better not to embed certain cultural heritage metadata in images? Visual Resources Association Bulletin 39, 1 (2012). Retrieved August 18, 2021 from https://online.vraweb.org/index.php/vrab/article/view/123

Paola Ronzino, Sorin Hermon, and Franco Niccolucci. 2012. A Metadata Schema for Cultural Heritage Documentation. In Electronic Imaging & the Visual Arts: EVA 2012 Florence, 9-11 May 2012. Firenze University Press, 36–41. - Permalink: http://digital.casalini.it/10.1400/187333

Emad I Saleh. Image Embedded Metadata in Cultural Heritage Digital Collections on the Web: An Analytical Study. Library Hi Tech, 36, 2 (2018), 339–357. https://doi.org/10.1108/LHT-03-2017-0053.

Pedro Santos, Martin Ritz, Constanze Fuhrmann, Rafael Monroy, Hendrik Schmedt, Reimar Tausch, Matevz Domajnko, Martin Knuth, and Dieter Fellner. 2017. Acceleration of 3D Mass Digitization Processes: Recent Advances and Challenges. In Marinos Ioannides, Nadia Magnenat-Thalmann and George Papagiannakis, eds. Mixed Reality and Gamification for Cultural Heritage. Springer International Publishing, Cham, 99–128. DOI: https://doi.org/10.1007/978-3-319-49607-8_4

Carla Schroer and Mark Mudge. 2017. A Context Metadata Collection and Management Tool for Computational Photography Projects. Archiving Conference 2017, 1 (May 2017), 99–104. DOI: https://doi.org/10.2352/issn.2168-3204.2017.1.0.99

Yogesh L. Simmhan, Beth Plale, and Dennis Gannon. 2005. A survey of data provenance in e-science. SIGMOD Rec. 34, 3 (September 2005), 31–36. https://doi.org/10.1145/1084805.1084812

Elisabeth Steiner and Carina Koch. 2015. A Digital Archive of Cultural Heritage Objects: Standardized Metadata and Annotation Categories. New Rev. Inf. Netw. 20, 1–2 (July 2015), 255–260. DOI: https://doi.org/10.1080/13614576.2015.1112171

Zeyu Wang, Weiqi Shi, Kiraz Akoglu, Eleni Kotoula, Ying Yang, and Holly Rushmeier. 2018. CHER-Ob: A Tool for Shared Analysis and Video Dissemination. J. Comput. Cult. Herit. 11, 4, Article 18 (December 2018), 22 pages. https://doi.org/10.1145/3230673

Xiying Mi and Bonita M Pollock. 2018. Metadata Schema to Facilitate Linked Data for 3D Digital Models of Cultural Heritage Collections: A University of South Florida Libraries Case Study. Cat. Classif. Q. 56, 2–3 (February 2018), 273–286. DOI: https://doi.org/10.1080/01639374.2017.1388894