3D Virtual Reconstruction and Augmented Reality Visualization of Damaged Stone Sculptures

https://iopscience.iop.org/article/10.1088/1757-899X/364/1/012018 

Abstract

This paper proposes the integration of photogrammetric reconstruction, 3D modelling and augmented reality application in order to achieve the complete visualization of a stone sculpture even if highly damaged or fragmentary. The first part of the research aims to the reconstruction of the original aspect of an incomplete sculpture, by using photogrammetry techniques based on standard resolution photos and free software in order to obtain a first model; then, we integrate this model with other 3D digital data (from other sculptures of the same period) or with 3D modelling based on historical sources and views from historians, aiming to achieve the original aspect of the sculpture. The second part of the research consists of the embedding of the obtained model in a custom application able to render in real-time the 3D reconstruction of the lion. Then, the rendering is overlaid to the video stream of the real scene and, as a result, a complete 3D digital model of the sculpture is achieved and could be visualized through a VR viewer. As a case study, we focus on a Roman stone sculpture of a male lion conserved in the Museo Estense of Modena (Italy), which lacks of its head and its four legs. The original aspect of the lion may be achieved by integrating the damaged sculpture with other photogrammetric reconstructions of lions sculptures of the same period and with 3D model based on historical sources. Finally, the lion is visualized through an augmented reality application which digitally overlays the reconstructed models on the original one.

An Augmented Reality Application for the Visualization and the Pattern Analysis of a Roman Mosaic

https://iopscience.iop.org/article/10.1088/1757-899X/364/1/012094/meta

Abstract

The visualization and analysis of mosaics and pavements are often compromised by their large sizes, which do not enable the observer to perceive their whole arrangement or to focus on details placed in farthest areas from its boundaries. Moreover, the usual precarious state of conservation of these artefacts, often with damaged or missing areas, makes it difficult to perceive their original aesthetic value. To overcome these limitations, we propose an application of augmented reality able to support the observer in two ways: first, the application completes the missing surface of the mosaic or pavement by integrating the existent surface with a virtual reconstruction; second, it enables the analysis of the geometric pattern of the mosaic/pavement by overlaying virtual lines and geometric figures in order to explicit its geometric arrangements. The result is achieved via a custom Android application able to recognize and track the mosaic figure pattern and extra marker board, obtaining in that way a coordinate system used to render in real-time the reconstruction of the mosaic. Such rendering is overlaid to the video stream of the real scene. The application runs on a standard smartphone embedded in a Google Cardboard-compatible viewer and therefore is extremely affordable. As a case study, in order to reconstruct its aspects and to analyse its geometric pattern, we chose the roman mosaic re-found in Savignano sul Panaro (near Modena, Italy) in 2011, after 115 years from its first discovery, which is preserved less than half of its original 4.5 x 6.9 m surface.