What prevents this with traditional 3D technology is since there is only one focal point, when you look away you lose the 3D illusion. With their technology, each pixel is 3D so you can look anywhere and still maintain the virtual illusion.
With sensors you can even interact with the world a la Minority Report style.
Check out the camera to shoot live action towards the end of the podcast. It’s like Disney’s Circle-Vision on steroids.