The Difference Between NeRF And Photogrammetry 3D Scan
Last week, I made my first 3D scan using Polycam. It uses a technology called photogrammetry to generate a 3D model from a series of photos taken at multiple angles. This 3D model can then be used in AR or VR applications, so that’s why it’s so interesting.
Recently a new technology appeared, called NeRF (Neural Radiance Fields) and made a ton of headlines. It’s similar to photogrammetry, because it’s also a way to visualise a 3D scene or object using images as an input. But it differs from photogrammetry a lot.
The main difference between these two technologies is that photogrammetry generates a 3D model with meshes and textures and is stored in a way that traditional 3D tools can use it. So we can use it in 3D animation, games or VR and AR applications.
A NeRF generates a ‘radiance field’, instead of a traditional 3D model. So the way the 3D models are stored, is very different.
NeRF uses machine learning to create this “radiance field”. With this, you can render new viewpoints of an object from new angles, so when moving the 3D model around, it appears to be 3D to your eyes. The Radiance Field has learnt and can guess what an object would look like from any angle and renders the image you see on your screen.
To give an example: 10 years ago we used a series of images with a slider to make an object on a website appear three dimensional. I remember this cool slider on the apple website, to see the iPod touch from multiple angles. When twirling around, it almost seems like a 3D-model right?
But if I want to see the iPod from a different angle that was not captured by any of the pictures, I am out of luck. With NeRF, we can train the machine learning algorithm and then with the Radiance Field that is created, we can generate images to see the iPod from new perspectives too.
I recreated the iPod touch slider at home and used the images in Luma, this was the result. The original iPod slider images did not work, because there is no background.
The nice thing about NeRF is that reflections and light effects can be captured very accurately. Water, glass, and shiny surfaces usually don’t work well with photogrammetry and the traditional 3D model it creates.
Currently, a downside of NeRF is that it’s not easily applied in AR or VR applications yet! However that will improve over time, with better exporting tools and special viewing applications.
For my own experimentation, I used Luma and Polycam. I edited the AR scenes with
Follow me for more insights about augmented, mixed and virtual reality. Bye!
1 view
231
69
9 months ago 00:00:48 1
Say hi, Mimi!
9 months ago 00:08:14 1
EL Condor Pasa - El Dorado Orchestra 🇵🇪🦅🇵🇪Anthem of the Andes
9 months ago 00:12:27 1
The Complex World of Digging | Resident Advisor
9 months ago 00:06:40 13
Remember Zenab harake looks? sumuko’t masakit na daw. #katusok
9 months ago 00:04:06 1
LISA “YES!OK!“ Theme song dancing tutorial 舞蹈导师LISA 主题曲教学视频 | Youth With You 青春有你2 | iQIYI
9 months ago 00:14:52 1
The language of the universe, the languages of humans: Dmitry Petrov at TEDxPerm
9 months ago 00:01:53 1
primadonna girl • lolita
9 months ago 00:01:55 1
The Easiest and Strongest Fishing Knot Ever | Best for Hook With 500% Guarantee
9 months ago 01:05:23 1
Muslimgauze – Mullah Said (1998) [FULL ALBUM]
9 months ago 00:01:13 1
Kirby & The Amazing Mirror – Game Boy Advance – Nintendo Switch Online + Expansion Pack
9 months ago 00:17:40 1
Russia’s third capital Kazan and Tatars’ biggest ethnic holiday
9 months ago 00:00:26 1
Range Rover Sport SVR L494 vs Bollard - #shorts
9 months ago 00:03:32 1
Hans Zimmer & Alan Walker – Time (Official Remix)
9 months ago 00:02:46 1
Yung Lean - friday the 13th (instrumental)
9 months ago 00:07:01 1
ASMR clicks with computer mice🎧#PCmouse #mouse sounds #asmr
9 months ago 00:00:05 1
Dawn Of The Final Day 24 Hours Remain
9 months ago 00:16:33 1
Experience the magic of a golden landscape with mesmerizing reflections: unconventional technique
9 months ago 00:17:09 1
CUTE EARRINGS MAKING AT HOME||BEADED EARRINGS WITH BRICK STITCH|| Useful & Easy
9 months ago 00:03:38 1
Joan Jett & The Blackhearts - I Love Rock N Roll (Official Video), Full HD (Remastered and Upscaled)
9 months ago 00:11:46 1
Conqueror’s Blade - Gameplay (PC/UHD)
9 months ago 00:05:40 1
Madonna Vogue - Evdokimov Fantasy Theatre - @eft_dubai
9 months ago 00:04:23 1
tyDi feat. Audrey Gallagher - World’s Apart (Official Music Video)
9 months ago 00:20:18 1
Crochet 101: Basic Crochet Stitches | Magic Circle tutorial