The Quest 3 lets you scan a room and build up an internal 3D mesh that represents the world you are in. This can take from 20 seconds to minutes and requires the user walking around the area – and is not able to change dynamically to opening\/closing doors\/etc. <\/p>\n\n\n\n
The Depth API<\/a> provides live depth frames up to 5 meters in distance – but how to use that to build up the environment in real time?<\/p>\n\n\n\n Julian Triveri<\/a>‘s multiplayer mixed reality Quest 3 game\u00a0Lasertag<\/a> does just this. It takes the live frames and uses an open-source\u00a0Unity implementation<\/a>\u00a0of marching cubes<\/a>. Apple Vision Pro<\/a>\u00a0and\u00a0Pico 4 Ultra<\/a> already use this method – but have hardware accelerated depth sensors to help. Quest 3 developers need to do this computation themselves.<\/p>\n\n\n\n See the code\u00a0on GitHub<\/a>.<\/p>\n\n\n\n