AR app with rear camera face anchor

Trying to develop an app with face tracking using the rear camera of an iPad

or iPhone. All documentation available seems to refer only to front camera cases. Am I trying the impossible here?

Posted on Aug 28, 2022 06:59 AM

Reply
Question marked as Top-ranking reply

Posted on Aug 28, 2022 10:51 AM

While a dual camera back can capture depth, the rear cameras are not TrueDepth so no Face ID nor related support.


Apple Developer Documentation


Face detection runs a parallel scan using an IR point scan. It’s this point scan that is underneath Face ID.


Well, you could implement face detection support yourself, but that’s a larger (and riskier) ML project than you probably intended to start.


Improve Object Detection models in Create ML - Tech Talks - Videos - Apple Developer


I don’t think AR kit object detection will get you there, either:

Apple Developer Documentation


And the LIDAR scanner uses a very different hardware design and scan design:

https://www.eyerys.com/articles/how-apples-lidar-sensor-differs-one-its-truedepth-face-id



2 replies
Question marked as Top-ranking reply

Aug 28, 2022 10:51 AM in response to morpheuz7

While a dual camera back can capture depth, the rear cameras are not TrueDepth so no Face ID nor related support.


Apple Developer Documentation


Face detection runs a parallel scan using an IR point scan. It’s this point scan that is underneath Face ID.


Well, you could implement face detection support yourself, but that’s a larger (and riskier) ML project than you probably intended to start.


Improve Object Detection models in Create ML - Tech Talks - Videos - Apple Developer


I don’t think AR kit object detection will get you there, either:

Apple Developer Documentation


And the LIDAR scanner uses a very different hardware design and scan design:

https://www.eyerys.com/articles/how-apples-lidar-sensor-differs-one-its-truedepth-face-id



This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

AR app with rear camera face anchor

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.