Digital Renaissance: Neuralangelo by NVIDIA Research Reconstructs 3D Scenes from 2D Video Clips

Neuralangelo, a new AI model by NVIDIA Research for 3D reconstruction using neural networks, turns 2D video clips into detailed 3D structures — generating lifelike virtual replicas of buildings, sculptures and other real-world objects. Like Michelangelo sculpting stunning, life-like visions from blocks of marble, Neuralangelo generates 3D structures with intricate details and textures. Neuralangelo’s ability to translate the textures of complex materials — including roof shingles, panes of glass and smooth marble — from 2D videos to 3D assets significantly surpasses prior methods. The high fidelity makes its 3D reconstructions easier for developers and creative professionals to rapidly create usable virtual objects for their projects using footage captured by smartphones. Neuralangelo is one of nearly 30 projects by NVIDIA Research to be presented at the Conference on Computer Vision and Pattern Recognition (CVPR), taking place June 18-22 in Vancouver. The papers span topics including pose estimation, 3D reconstruction and video generation. Read more: Learn more about NVIDIA Research at CVPR: NVIDIA Research: Join the NVIDIA Developer Program: Read and subscribe to the NVIDIA Technical Blog: 3D, Artificial Intelligence, AI, NVIDIA Research, Graphics, CVPR, CVPR2023, Neural Networks, Computer Vision