Computer Sciences and Information Technology
Title : | Cultural Heritage Preservation and Restoration using Digital 3D Models |
Area of research : | Computer Sciences and Information Technology, Engineering Sciences |
Focus area : | Conservation of cultural artifacts and monuments |
Principal Investigator : | Dr Shanmuganathan Raman, Associate Professor, Indian Institute of Technology (IIT) Gandhinagar |
Timeline Start Year : | 2019 |
Contact info : | shanmuga@iitgn.ac.in ; nithin@iitgn.ac.in ; vinaypn@iitk.ac.in |
Details
Executive Summary : | The main aim of this project is to demonstrate and spread awareness about the conservation of cultural artifacts and monuments among Indian citizens. Initially, five cultural heritage sites (such as Adalaj and Sarkhej Roza, in Ahmedabad’s vicinity) and around ten artifacts will be shortlisted for scanning considering proximity and structural diversity. Onsite 3D scanning of the cultural heritage sites using a long-range laser scanner and high-resolution DSLR cameras will be performed to gather data for processing. Iterative closest point algorithm and its variants will be used to align the scans using high-performance workstations. Investigators shall also employ the multi-view stereo technique on the images captured to compute 3D geometry and cover any missing areas from the previous step. 3D depth estimation in limited scenarios will also be explored such as using a single image. They shall use state-of-the-art deep learning tools to restore the digital 3D models. They shall perform intensity and color transfer from the images onto the 3D surfaces. For small 3D cultural heritage artifacts, a short-range hand-held scanner will be used instead. The 3D models developed will be made compatible with any standard 3D printer. Robotic platforms will be integrated with the scanning equipment and algorithms will be developed for autonomous operation and navigation of the standard terrestrial and aerial robots. The 3D models reconstructed will be used for virtual walkthroughs of heritage sites to promote heritage awareness and tourism, and 3D models of artifacts will be 3D printed. An augmented reality platform will be built. The 3D models will also be made commercially available to the gaming industry for developing futuristic video games with Indian heritage sites. Besides, government bodies and agencies engaged in museology and heritage conservation will be assisted so as to develop a program of fingerprinting of valuable artifacts, with applications in conservation, showcasing of heritage and forensic identification of heritage pieces. Short courses and workshops will be organized along with the industrial partner NVidia. These events are meant to be outreach programs targeting academics, industry professionals, students, and public servants. The events will also feature high-quality demonstrations and talks by leading experts in the areas of cultural heritage and archaeology. Investigators shall also create a public repository of the 3D models reconstructed which could be downloaded by the users for cultural, educational and other purposes. Investigators also aim to generate intellectual property in the restoration of the defective 3D point cloud in the presence of noise, 3D printing modality for cultural heritage artifacts, rendering of the 3D models of cultural heritage structures in VR/AR domain, fingerprinting and dating of cultural heritage artifacts, and working model of the entire project. |
Co-PI: | Dr Gaurav, Associate Professor, Dr Vineet Vashista, Assistant Professor, Dr Nithin V George, Associate Professor, Indian Institute of Technology (IIT) Gandhinagar, Dr Vinay P Namboodiri, Assistant Professor, Indian Institute of Technology Kanpur |
Total Budget (INR): | 72,40,200 |
Achievements : | Scanning and digitization of large amount of artefacts from Lothal and Dholavira. Scanning and digitization of a Dwarka temple. 3D Mesh denoising framework. 3D symmetry detection framework. 3D shape retrieval framework. Setting up of state of the art 3D scanning, processing, and printing facility. |
Publications : | 4 |
Organizations involved
