It’s pretty wild how frontier LLMs have crossed the chasm on inverse graphics. Young founders will start decompiling reality, building RL environments, and print money doing it. Incumbents won't be too happy unless they're fast to adapt. Case in point -- I gave AI a 3D scan of my parents old house, and it rebuilt the room in Blender. Then I turned off the gravity. Here’s how it works: 1. ~400 photos I took in 2019 go through RealityScan and become a photogrammetry mesh 2. GPT-6 Astra rebuilds it as a clean, editable Blender scene, using the scan as reference 3. Scan textures become procedural materials. No downloaded assets 4. Every object is isolated and editable, so the physics just works Turning messy scans into scenes modeled the way an artist would used to take days of skilled work. Huge implications for VFX, AR/VR and robotics.

If you haven't seen my video with @bilawalsidhu about God's Eye View, definitely check it out. Here's my 9th video in 14-days (trying to post 15 over 30-days to meet X's video kickstart requirements). For some reason, the backend shows I've only posted 5. 🤷‍♂️

I reconstructed the route Flávio Bolsonaro took to flee Brazil, 2 days after losing the presidential election and hours after a court ordered him to hand over his passports. 1. Took off from Iguazú heading toward Brazil, 6 km from the border, then turned away 2. The direct route to Miami crosses 2,416 km of Brazil 3. 2,098 recorded positions, zero inside Brazilian airspace 4. Closest pass: 69 km from Brazil, at 40,000 ft over Peru 5. 35-minute fuel stop in Guayaquil, Ecuador 6. Landed in Miami after ~7,140 km instead of 6,375 Brazil can't order a plane down if it never enters Brazil. Context: Flávio is the son of Jair Bolsonaro, who's serving 27 years for plotting a coup. He lost the runoff to Lula on Sunday. On Monday, Justice de Moraes gave him 24 hours to surrender his passports in a money-laundering probe. Tuesday night, the family crossed into Argentina by land and got on a private jet at Iguazú.

God's Eye View is becoming a time machine. Pretty wild that we can reconstruct real events like Fleet Week, then film them in a photorealistic digital twin of San Francisco with a cinematic camera rig - all by talking to my phone. Rendered in a browser on my macbook.

Probably the most overkill way to check if your bus is late. Live public transit moving through a 3D map of Boston, plus real-time traffic density. Built into God’s Eye View. All in your browser. Open source. MIT license.

It's mind bending walking around the same place simultaneously in two timelines Inside the frame it's winter, and outside the frame it's summer - until you step inside. Recorded this footage in the winter and localized it against a massive 3d scan of the same ranch in the summer. You can follow the camera from the outside, then step into the moment I recorded. We spend so much time looking at memories through 2d rectangles in our camera roll. It's a strange feeling to walk around one instead. Like navigating through space instead of scrolling through time. The geospatial memory palace continues to come to life!

Free viewpoint video with 4x iphones is genuinely nuts. This used to need a volumetric capture rig with dozens if not hundreds of cameras. Offline renders are just the start. Can't wait till we can playback dynamic 3d content like this in real time.

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.

Throwback to the “dinosaur input device” that was used to animate the stellar T-Rex dinosaur in the first Jurassic Park movie. Everything that has happened before will happen again, so now it’s a spatial 3D harness you can control with a Vision Pro and hand tracking.