Automatic Underwater Image Enhancement using Improved Dark Channel Prior

Main Article Content

Marco Block
Benjamin Gehmlich
Damian Hettmanczyk

Abstract

Images taken under water are often of a monochromatic appearance, due to the physical interaction (absorption and reflection) between particles and light sources. Enhanced images with improved saturation, for which the monochromatic character has been corrected, are more suitable for generating 3D models and for identifying structures and materials by human experts. In this paper, we present an automatic method to identify the mean water color from a set of images. This mean color represents an average gray and is used to describe a new axis in CIELab color space. An extended color variance and a histogram equalization are simultaneously applied to the image. The main advantage of this method is the fully automatic enhancement process. An UUV (Unmanned Underwater Vehicle) can operate without providing a color reference scheme. The presented method was implemented in the software JEnhancer, which is freely available. JEnhancer was successfully tested in several documentation campaigns, and was integrated into the videogrammetric software pipeline Archaeo3D to produce 3D models from videos.

Downloads

Download data is not yet available.

Article Details

How to Cite
Block, M., Gehmlich, B., & Hettmanczyk, D. (2017). Automatic Underwater Image Enhancement using Improved Dark Channel Prior. Studies in Digital Heritage, 1(2), 566–589. https://doi.org/10.14434/sdh.v1i2.23214
Section
Special Issue "Cultural Heritage and New Technologies 2016"
Author Biography

Marco Block, Hochschule für Technik und Wirtschaft Dresden University of Applied Sciences Dresden

Marco Block-Berlitz received both his first diploma in Computer Sciences (2004) and his PhD degree (2009) from Freie Universität Berlin, Germany (Department of Artificial Intelligence).
From 2009 to 2012 he taught Game Design and Development at Berlin’s Mediadesign Hochschule. Since 2012 he is a full professor for Computer Graphics and Artificial Intelligence at the Department of Computer Science and Mathematics of the University of Applied Sciences in Dresden, Germany.
As a computer scientist with a passion for archaeology and cultural heritage, Marco Block-Berlitz is committed to research on UAVs, UUVs and 4d data management  (www.archaeocopter.de), with a focus on low-cost and efficient 3d reconstruction. He has participated in several international excavation and survey projects, cooperating with a range of international professionals and institutions.
Marco Block-Berlitz has served as a committee member for several international conferences, including ICAISC, CHNT, CONCIBE, CGAMES, GAMEON-ARABIA, CGAT, GHTCE, CV, CGIM, AIA, CI, ICDS, ICCE-Berlin, ICCVE, ISIEA, GHTCE, ICCSII, ICCE, IBERAMIA, etc. and reviewer for international journals, including IJHCI, IMS, MVA, NCA, ITSMC, Autosoft Journal, e-gnosis, IARIA, etc. He received best paper awards at CONCIBE 2008, ICDS 2009 and CAA-DE 2016 and a best video award at CHNT 2014.

References

C. Balletti et al. 2015. Underwater Photogrammetry and 3D Reconstruction of Marble Cargos Shipwreck. In The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W5 (2015), 7-13.

Herbert Bay et al. 2008. Speeded-up Robust Features (SURF). Computer Vision and Image Understanding (CVIU) 110, 3 (2008), 346–359.

Stéphane Bazeille et al. 2006. Automatic Underwater Image Pre-processing. In Proceedings of the Caracterisation du Milieu Marin (CMM ’06).

Nicholas Carlevaris-Bianco, Anush Mohan, and Ryan M. Eustice. 2010. Initial Results in Underwater Single Image Dehazing. In Proceedings of the IEEE/MTS OCEANS Conference and Exhibition, Seattle, WA, USA, September 2010, 1-8.

Juli Berwald et al. 1995. Influences of Absorption and Scattering on Vertical Changes in the Average Cosine of the Underwater Light Field. Journal of Limnology and Oceanography 40, 8 (1995), 1347–1357.

Gianfranco Bianco et al. 2015. A New Color Correction Method for Underwater Imaging. In The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W5 (2015), 25–32.

Marco Block et al. 2016. Eckbert-II: Mini-U-Boot zur Sondierung und Dokumentation von archäologischen Fundstellen. Technical Report. DD-2016-01, FIITS, HTW Dresden, Germany.

Marco Block, et al. 2016. Underwater Videogrammetry with Adaptive Feature Detection at “See am Mondsee”, Austria. Studies in Digital Heritage 1 (2017).

Fabio Bruno et al. 2015. 3d Documentation of Archeological Remains in the Underwater Park of Baiae. In The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W5 (2015), 41–46.

Commission Internationale de L'Eclairage. 1976. CIE Colorimetry - Part 4: 1976 L*a*b* Colour Space. ISO 11664-4:2008(E).

Fabio Cozman and Eric Krotkov. 1997. Depth from Scattering. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 31 (1997), 801-806.

Marc Pierrot Deseilligny and Isabelle Cléry. 2011. Apero, an Open Source Bundle Adjustment Software for Automatic Calibration and Orientation of Set of Images. In ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XXXVIII-5/W16 (2011), 269-276.

Raanan Fattal. 2008. Single Image Dehazing. In ACM Transactions on Graphics (TOG) 27, 3 (2008), 72:1–72:9.

Benjamin Gehmlich and Marco Block. 2015. Diversity of Flight Strategies in UAV Recording. In 20th Conference on Cultural Heritage and New Technologies, Vienna, Austria.

John A. Greenwood. 1999. Large Component Deformation Studies Using Videogrammetry. In The 6th International Workshop on Accelerator Alignment, Grenoble, France (IWAA) 32, 50 (1999), 133.

Richard Hartley and Andrew Zisserman. 2004. Multiple View Geometry in Computer Vision. Second edition. Cambridge: Cambridge University Press.

Kaiming He et al. 2011. Single Image Haze Removal Using Dark Channel Prior. In IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 12 (2011), 2341–2353.

Ewald Hering. 1878. Zur Lehre vom Lichtsinne - Sechs Mittheilungen an die Kaiserl. Akademie der Wissenschaften in Wien. Zweiter, unveränderter Abdruck. Gerold. Wien.

Kashif Iqbal et al. 2007. Underwater Image Enhancement Using an Integrated Colour Model. In IAENG International Journal of Computer Science (IJCS) 34, 2 (2007), 529–534.

Kashif Iqbal et al. 2010. Enhancing The Low Quality Images Using Unsupervised Colour Correction Method. In IEEE International Conference on Systems Man and Cybernetics (SMC), (2010), 1703– 1709.

Jules S. Jaffe et al. 2001. Underwater Optical Imaging: Status and Prospects. Oceanography 14, 3 (2001), 64–75.

Michal Jancosek and Tomas Pajdla. 2011. Multi-View Reconstruction Preserving Weakly-Supported Surfaces. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Vol. #? (2011), 3121–3128.

Harald Koschmieder. 1924. Theorie der horizontalen Sichtweite: Kontrast und Sichtweite, Beiträge zur Physik der freien Atmosphäre (1924), 33-53 and 171–181.

Hyon Lim et al. 2014. Online 3D Reconstruction and 6-DoF Pose Estimation for RGB-D Sensors. In 5th Workshop at the European Conference on Computer Vision. Zurich, Switzerland (2014), 238– 254.

David G. Lowe. 1999. Object Recognition from Local Scale-invariant Keypoints. In IEEE International Conference on Computer Vision (ICCV) 99, 2 (1999), 1150–1157.

Huimin Lu et al. 2013. Underwater Image Enhancement Using Guided Trigonometric Bilateral Filter and Fast Automatic Color Correction. In 20th IEEE International Conference on Image Processing (ICIP) (2013), 3412–3416.

Lena E. Mertens and Frank S. Replogle. 1977. Use of Point Spread and Beam Spread Functions for Analysis of Imaging Systems in Water. Journal of the Optical Society of America 67, 8 (1977), 1105–1117.

Ondrej Miksik and Krystian Mikolajczik. 2012. Evaluation of Local Detectors and Descriptors for Fast Feature Matching. In 21st International Conference on Pattern Recognition (ICPR) (2012), 2681-2685.

Curtis D. Mobley. 2001. Radiative Transfer in the Ocean. In Encyclopedia of Ocean Sciences. Cambridge, MA, Academic Press 2001, 2321–2330.

Emmanuel Moisan et al. 2015. Building a 3D Reference Model for Canal Tunnel Surveying Using Sonar and Laser Scanning. In The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-5/W5 (2015), 153-159.

Pierre Moulon et al. 2013. Global Fusion of Relative Motions for Robust, Accurate and Scalable Structure from Motion. In IEEE International Conference on Computer Vision (ICCV) (2013), 3248–3255.

David Nistér. 2004. Automatic Passive Recovery of 3D from Images and Video. In Proceedings of The Second International Symposium on 3D Data Processing, Visualization & Transmission (3DPVT04). Thessaloniko, Greece, (2004), 438-445.

Kimon Papadimitriou. 2015. Course Outline for a Scuba Diving Speciality “Underwater Survey Diver.” In The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W5K (2015), 161-166.

Richard S. Pappa et al. 2003. Dot-Projection Photogrammetry and Videogrammetry of Gossamer Space Structures. Journal of Spacecraft and Rockets 40, No. 6 (2003), 858-867.

Marc Pollefeys et al. 2004. Visual modeling with a hand-held camera. In International Journal of Computer Vision 59, 3 (2004), 207–232.

Elisa Pruno et al. 2015. Underwater Photogrammetry Methods for a Peculiar Case-Study: San Domenico (Prato, Italy). In The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W5 (2015), 171-176.

Fabio Remondino. 2011. Heritage Recording and 3D Modeling with Photogrammetry and 3D Scanning. Remote Sensing 3, 6 (2011), 1104–1138.

Pedro Santos and Martin Ritz. 2013. CultLab3D - Fast and Economic, High Quality 3D Digitization of Cultural Heritage Artifacts. Photogrametric Week ’13, 29. Stuttgart, Germany.

János Schanda. 2007. Colorimetry: Understanding the CIE system. Hoboken, New Jersey, John Wiley & sons.

Yoav Y. Schechner and Nir Karpel. 2005. Recovery of Underwater Visibility and Structure by Polarization Analysis. IEEE Journal of Oceanic Engineering 30, 3 (2005), 570–587.

Raimondo Schettini and Silvia Corchs. 2010. Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods. In EURASIP Journal on Advances in Signal Processing (2010), 1-14.

Roman Scholz et al. 2016. Shipwreck Documentation in Veruda Using Photo- and Videogrammetry. In 21st Conference on Cultural Heritage and New Technologies (CHNT 21), Vienna, Austria.

Noah Snavely et al. 2006. Photo Tourism: Exploring Photo Collections in 3D. In ACM transactions on graphics (TOG) 25, 3 (2006), 835–846.

Dariusz Stramski et al. 2004. The Role of Seawater Constituents in Light Backscattering in the Ocean. Progress in Oceanography 61, 1 (2004), 27–56.

Robby T. Tan. 2008. Visibility in Bad Weather from a Single Image. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) (2008), 1-8.

Salvatore Troisi et al. 2015. 3D Models Comparison of Complex Shell in Underwater and Dry Environments. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W5 (2015), 215-222.

Ying-mei Wei et al. 2013. Applications of Structure from Motion: A Survey. Journal of Zhejiang University 14, 7 (2013), 486–494.

Haocheng Wen et al. 2013. Single Underwater Image Enhancement with a New Optical Model. In IEEE International Symposium on Circuits and Systems (ISCAS) (2013), 753-756.

Changchang Wu. 2007. SIFTGPU: A GPU Implementation of Scale Invariant Feature Transform. http://www.cs.unc.edu/~ccwu/siftgpu/