Browsing and Experiencing Repositories of Spatially Oriented Historic Photographic Images

Main Article Content

Jonas Bruschke
Ferdinand Maiwald
Sander Münster
Florian Niebling

Abstract

Many institutions archive historical images of architecture in urban areas and make them available to scholars and the general public through online platforms. Users can explore these often huge repositories by faceted browsing or keyword-based searching. Metadata that enable these kinds of investigations, however, are often incomplete, imprecise, or even wrong. Thus, retrieving images of interest can be a cumbersome task for users such as art and architectural historians trying to answer their research questions. Many of these images, often containing historic buildings and landscapes, can be oriented spatially using automatic methods such as “structure from motion” (SfM). Providing spatially and temporally oriented images of urban architecture, in combination with advanced searching and exploration techniques, offers new potential in supporting historians in their research. We are developing a 3D web environment useful to historians enabling them to search and access historic photographic images in a spatial context. Related projects use 2D maps, showing only a planar view of the current urban situation. In this paper, we present an approach to create interactive views of 4D city models, i.e., 3D spatial models that show changes over time, to provide a better understanding of the urban building situation regarding the photographer’s position and surroundings. A major feature of the application is to make it possible to spatially align 3D reconstruction models to photogrammetric digitized models based on historical photographs. At the same time, this mixed methods approach is used for validation of the 3D reconstructions.

Downloads

Download data is not yet available.

Article Details

How to Cite
Bruschke, J., Maiwald, F., Münster, S., & Niebling, F. (2018). Browsing and Experiencing Repositories of Spatially Oriented Historic Photographic Images. Studies in Digital Heritage, 2(2), 138–149. https://doi.org/10.14434/sdh.v2i2.24460
Section
Cultural Heritage and New Technologies 2017

References

Sameer Agarwal, Yasutaka Furukawa, Noah Snavely, Ian Simon, Brian Curless, Steven M. Seitz, and Richard Szeliski. 2011. Building Rome in a Day. Communications of the ACM 54, 10 (2011), 105-112. DOI:http://dx.doi.org/10.1145/2001269.2001293

Maxwell Alexander. 2010. Digital archives and history research: feedback from an end-user. Library Review 59, 1, 24-39. DOI:http://dx.doi.org/doi:10.1108/00242531011014664

Heider K. Ali and Anthony Whitehead. 2014. Feature Matching for Aligning Historical and Modern Images. International Journal of Computers and Their Applications 21, 3, 188-201.

Fabrizio I. Apollonio. 2016. Classification Schemes for Visualization of Uncertainty in Digital Hypothetical Reconstruction. In Sander Münster, Mieke Pfarr-Harfst, Piotr Kuroczyński, and Marinos Ioannides, eds. 3D Research Challenges in Cultural Heritage II: How to Manage Data and Knowledge Related to Interpretative Digital 3D Reconstructions of Cultural Heritage. Cham: Springer International Publishing, 173-197. DOI: http://dx.doi.org/10.1007/978-3-319-47647-6_9

Joan E. Beaudoin and Jessica Evans Brady. 2011. Finding Visual Information: A Study of Image Resources Used by Archaeologists, Architects, Art Historians, and Artists. Art Documentation: Journal of the Art Libraries Society of North America 30, 2 (2011), 24-36.

Anna Bentkowska-Kafel, Hugh Denard, and Drew Baker. 2012. Paradata and Transparency in Virtual Heritage. Burlington: Ashgate.

Jonas Bruschke, Florian Niebling, Ferdinand Maiwald, Kristina Friedrichs, Markus Wacker, and Marc Erich Latoschik. 2017. Towards Browsing Repositories of Spatially Oriented Historic Photographic Images in 3D Web Environments. In Proceedings of the 22nd International Conference on 3D Web Technology (Web3D '17). Brisbane, Australia, ACM. DOI:http://dx.doi.org/10.1145/3055624.3075947

Clément Chagnaud, John Samuel, Sylvie Servigne, and Gilles Gesquière. 2016. Visualization of Documented 3D Cities. In Eurographics Workshop on Urban Data Modelling and Visualisation Liège, Belgium, The Eurographics Association. DOI: http://dx.doi.org/10.2312/udmv.20161425

Weiqin Chen and Thomas Nottveit. 2010. Digital Map Application for Historical Photos. In Gobinda Chowdhury, Chris Koo, and Jane Hunter, eds. The Role of Digital Libraries in a Time of Global Change: 12th International Conference on Asia-Pacific Digital Libraries, ICADL 2010, Gold Coast, Australia, June 21-25, 2010. Proceedings. Berlin, Heidelberg: Springer, 158-167. DOI:http://dx.doi.org/10.1007/978-3-642-13654-2_20

City of Philadelphia. 2019. The Philadelphia City Archive. Retrieved February 25, 2019 from https://www.phillyhistory.org

Sächsische Landesbibliothek - Staats - und Universitätsbibliothek Dresden. 2019. Deutsche Fotothek. Retrieved February 25, 2019 from http://www.deutschefotothek.de

Iwona Dudek, Jean-Yves Blaise, Livio De Luca, Laurent Bergerot, and Noémie Renaudin. 2015. How was this done? An attempt at formalising and memorising a digital asset's making-of. In Proceedings of the 2nd International Congress on Digital Heritage Vol. 2. IEEE, 343-346. DOI:http://dx.doi.org/10.1109/DigitalHeritage.2015.7419519

Götz Echtenacher. 2011. Wissenschaftliche Erkenntnisse durch manuelles Konstruieren von 3DModellen. In Katja Heine, Klaus Rheidt, Frank Henze, and Alexandra Riedel, eds. Von Handaufmaß bis High Tech III. Darmstadt/Mainz: Verlag Philipp von Zabern, 49-57.

Estonian Photographic Heritage Society. 2019. Ajapaik, a crowdsourcing platform for geotagging historic images. Retrieved February 25, 2019 from https://ajapaik.ee

Peter L. Falkingham, Karl T. Bates, and James O. Farlow. 2014. Historical Photogrammetry: Bird's Paluxy River Dinosaur Chase Sequence Digitally Reconstructed as It Was prior to Excavation 70 Years Ago. PLOS ONE, 9, 4 (2014), e93247. DOI:http://dx.doi.org/10.1371/journal.pone.0093247

George Fitzmaurice, Justin Matejka, Igor Mordatch, Azam Khan, and Gordon Kurtenbach. 2008. Safe 3D Navigation. In Proceedings of the 2008 Symposium on Interactive 3D Graphics and Games. Redwood City, California, ACM, 7-15. DOI:http://dx.doi.org/10.1145/1342250.1342252

Kristina Friedrichs, Sander Münster, Cindy Kröber, and Jonas Bruschke. 2018. Creating Suitable Tools for Art and Architectural Research with Historic Media Repositories. In Sander Münster, Kristina Friedrichs, Florian Niebling, and Agnieszka Seidel-Grzesińska, eds. Digital Research and Education in Architectural Heritage. UHDL 2017, DECH 2017. Cham: Springer International Publishing, 117-138. DOI:http://dx.doi.org/10.1007/978-3-319-76992-9_8

Jérémy Gaillard, Alexandre Vienne, Rémi Baume, Frédéric Pedrinis, Adrien Peytavie, and Gilles Gesquière. 2015. Urban Data Visualisation in a web browser. In Proceedings of the 20th International Conference on 3D Web Technology (Web3D '15). Heraklion, Crete, Greece, ACM, 8188. DOI:http://dx.doi.org/10.1145/2775292.2775302

João Gouveia, Fernando Branco, Armanda Rodrigues, and Nuno Correia. 2015. Travelling Through Space and Time in Lisbon's Religious Buildings. In Proceedings of the 2nd International Congress on Digital Heritage Vol. 2. IEEE, 407-408. DOI:https://doi.org/10.1109/DigitalHeritage.2015.7413916

Armin Grün, Fabio Remondino, and Li Zhang. 2004. Photogrammetric Reconstruction of the Great Buddha of Bamiyan, Afghanistan. The Photogrammetric Record, 19, 107 (2004), 177-199. DOI:http://dx.doi.org/10.1111/j.0031-868X.2004.00278.x

Historypin. 2019. Connecting communities with local history. Retrieved February 26, 2019 from https://www.historypin.org

Max Kemman, Martijn Kleppe, and Stef Scagliola. 2014. Just Google It - Digital Research Practices of Humanities Scholars. In Clare Mills, Michael Pidd, and Esther Ward, eds. Proceedings of the Digital Humanities Congress 2012. Studies in the Digital Humanities. Sheffield: HRI Online Publications.

Karen M. Kensek, Lynn Swartz Dodd, and Nicholas Cipolla. 2004. Fantastic reconstructions or reconstructions of the fantastic? Tracking and presenting ambiguity, alternatives, and documentation in virtual worlds. Automation in Construction, 13, 175-186.

Kun-Ting Lee, Sheng-Jie Luo, and Bing-Yu Chen. 2011. Rephotography Using Image Collections. Computer Graphics Forum, 30, 7 (2011), 1895-1901. DOI:http://dx.doi.org/10.1111/j.14678659.2011.02042.x

Dominik Lengyel and Catherine Toulouse. 2011. Darstellung von unscharfem Wissen in der Rekonstruktion historischer Bauten. In Katja Heine, Klaus Rheidt, Frank Henze, and Alexandra Riedel, eds. Von Handaufmaß bis High Tech III. Darmstadt/Mainz: Verlag Philipp von Zabern, 182-187.

Jose Llamas, Pedro M. Lerones, Eduardo Zalama, and Jaime Gómez-García-Bermejo. 2016. Applying Deep Learning Techniques to Cultural Heritage Images Within the INCEPTION Project. In Marinos Ioannides, Eleanor Fink, Antonia Moropoulou, Monika Hagedorn-Saupe, Antonella Fresa, Gunnar Liestøl, Vlatka Rajcic, and Pierre Grussenmeyer, eds. Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection: 6th International Conference, EuroMed 2016, Nicosia, Cyprus, October 31 – November 5, 2016, Proceedings, Part II. Cham: Springer International Publishing, 25-32. DOI:http://dx.doi.org/10.1007/978-3-319-48974-2_4

David G. Lowe. 2004. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision 60, 2 (2004), 91-110. DOI:http://dx.doi.org/10.1023/b:visi.0000029664.99615.94

Thomas Luhmann. 2010. Nahbereichsphotogrammetrie: Grundlagen, Methoden und Anwendung. Berlin: Wichmann.

Ferdinand Maiwald, Danilo Schneider, and Frank Henze. 2018. Bestimmung der Korrespondenz zwischen historischen Gebäudeaufnahmen basierend auf der Zuordnung geometrischer Merkmale. In Publikationen der Deutschen Gesellschaft für Photogrammetrie, Fernerkundung und Geoinformation e.V., 38. Wissenschaftlich-Technische Jahrestagung der DGPF, 07.-09. März 2018 in München.

Ferdinand Maiwald, Theresa Vietze, Danilo Schneider, Frank Henze, Sander Münster, and Florian Niebling. 2017. Photogrammetric Analysis of Historical Image Repositories for Virtual Reconstruction in the Field of Digital Humanities. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XLII-2/W3 (2017), 447-452. DOI:http://dx.doi.org/10.5194/isprs-archives-XLII-2-W3-4472017

Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze. 2008. Introduction to Information Retrieval. Cambridge: Cambridge University Press. DOI:http://dx.doi.org/10.1017/CBO9780511809071

Quoc-Dinh Nguyen, Mathieu Bredif, Didier Richard, and Nicolas Paparoditis. 2016. Progressive streaming and massive rendering of 3D city models on web-based virtual globe. In Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. Burlingame, California, ACM. DOI:http://dx.doi.org/10.1145/2996913.2997008

Federico Prandi, Federico Devigili, Marco Soave, Umberto Di Staso, and Raffaele De Amicis. 2015. 3D web visualization of huge CityGML models. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XL-3/W3 (2015), 601-605. DOI:http://dx.doi.org/10.5194/isprsarchives-XL-3-W3-601-2015

Grant Schindler and Frank Dellaert. 2010. Probabilistic Temporal Inference on Reconstructed 3D Scenes. In 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1410-1417. DOI:http://dx.doi.org/10.1109/CVPR.2010.5539803

Grant Schindler and Frank Dellaert. 2012. 4D Cities: Analyzing, Visualizing, and Interacting with Historical Urban Photo Collections. Journal of Multimedia 7, 2(2012), 124-131. URI:http://hdl.handle.net/1853/48719

Noah Snavely, Steven M. Seitz, and Richard Szeliski. 2006. Photo Tourism: Exploring Photo Collections in 3D. ACM Transactions on Graphics (SIGGRAPH Proceedings) 25, 3 (2006), 835-846. DOI:http://dx.doi.org/10.1145/1141911.1141964

Abby Stylianou, Austin Abrams, and Robert Pless. 2015. Characterizing Feature Matching Performance over Long Time Periods. In 2015 IEEE Winter Conference on Applications of Computer Vision. Waikoloa, HI, USA, IEEE, 892-898. DOI:http://dx.doi.org/10.1109/WACV.2015.123

Reinier H. van Leuken, Lluis Garcia, Ximena Olivares, and Roelof van Zwol. 2009. Visual Diversification of Image Search Results. In Proceedings of the 18th International Conference on World Wide Web. Madrid, Spain, ACM, 341-350. DOI:http://dx.doi.org/10.1145/1526709.1526756

Ilya Varlamov and Alex Duk. 2017. PastVu - project to collect vintage images. A look at the history of humanity habitat. Retrieved February 25, 2019 from https://pastvu.com

N. S. Vassilieva. 2009. Content-based image retrieval methods. Programming and Computer Software 35, 3 (2009), 158-180. DOI:http://dx.doi.org/10.1134/s0361768809030049

Wissam Wahbeh and Stephan Nebiker. 2017. Three Dimensional Reconstruction Workflows for Lost Cultural Heritage Monuments Exploiting Public Domain and Professional Photogrammetric Imagery. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci. IV-2/W2 (2017), 319-325. DOI:http://dx.doi.org/10.5194/isprs-annals-IV-2-W2-319-2017

Ji Wan, Dayong Wang, Steven Chu Hong Hoi, Pengcheng Wu, Jianke Zhu, Yongdong Zhang, and Jintao Li. 2014. Deep Learning for Content-Based Image Retrieval: A Comprehensive Study. In Proceedings of the 22nd ACM international conference on Multimedia. Orlando, Florida, USA, ACM, 157-166. DOI:http://dx.doi.org/10.1145/2647868.2654948

Claire Warwick. 2012. Studying users in digital humanities. In Claire Warwick, Melissa Terras, and Nyhan Julianne, eds. Digital Humanities in Practice. London: Facet Publishing, 1-21.

Christoph Wieser, François Bry, Alexandre Bérard, and Richard Lagrange. 2013. ARTigo: Building an Artwork Search Engine with Games and Higher-Order Latent Semantic Analysis. In Proceedings of Disco 2013, Workshop on Human Computation and Machine Learning in Games. Palm Springs, CA, USA.