AI-driven specular removal for 3D asset creation

Abstract

Specular highlights negatively affect photogrammetric 3D reconstructions. To mitigate this problem, we developed an AI-driven image processing technique able to remove specular highlights. We created a synthetic image dataset that reflects the objects, viewpoints, and specular behaviors found in real-world photogrammetric campaigns, and used it to train a U-Net model that can batch-process input images for photogrammetric reconstruction. The process was tested on both synthetic and real-world photos, demonstrating superior results compared to existing models in the literature.

Marco Callieri
Marco Callieri
Senior Researcher

Digital Technologies for Cultural Heritage

Massimiliano Corsini
Massimiliano Corsini
Senior Researcher

Imaging, 3D, and AI

Somnath Dutta
Somnath Dutta
Researcher

Geometry Processing

Daniela Giorgi
Daniela Giorgi
Senior Researcher

This is my bio