Camera access for Quest developers is still on track for early 2025 and will “unlock a lot of capabilities in mixed reality,” according to Meta’s CTO.
During a recent AMA on Instagram, Andrew Bosworth, the head of Reality Labs, was queried about whether the Passthrough API revealed at Connect 2024 would launch in early 2025 as intended.
He replied, translated from English:
“Yes, we are really enthusiastic about this. We’ve had some developers with early access experimenting with it. We’ve observed that our announcements regarding this have led some competitors to rethink their positions on similar initiatives. That’s also a sign of progress, in my view. So, I’m genuinely thrilled about this. I believe we’re going to unlock a great deal of potential in mixed reality through this feature.”
What is the Passthrough API, and why does it matter?
At present, third-party mixed reality applications can only utilize abstract data concerning the surroundings. This encompasses a 3D mesh of the environment and blocks representing different furniture items.
The Passthrough API, introduced in September 2024, will provide these mixed reality applications access to the passthrough camera feed for the first time. This capability will allow applications to more effectively perceive, analyze, and interact with their surroundings and specific objects – a crucial enabler for advanced mixed reality.
“This will enable a plethora of innovative MR experiences. You have tracked objects, AI implementations, stunning overlays, scene comprehension, and so much more,” stated Meta’s Mark Rabkin during last year’s announcement.
It remains uncertain how extensive the camera access will be. Until recently, Meta has been cautious, concerned about public sentiment regarding privacy. Apple provides access to passthrough cameras in Vision Pro, yet only for internal, non-public applications.
What are your thoughts on the Passthrough API? Express your views in the comments below.
