Apple and its Lidar scanner

Astrid Baron - 09/12/2020

Apple and its Lidar scanner :

What is Apple's Lidar scanner really about? :

Apple has not finished surprising us. In constant technological evolution, the brand is back in force with new new features for the ipad pro and iphone 12. The latest models now feature an ultra-wide-angle camera, studio-quality microphones and a LiDAR scanner revolutionary. Although an old technology, the LiDAR (Light Detection And Ranging) is a small, matte black looking scanner next to the camera.   Lidar and apple But what is it for? The article by Sciencesetavenir sheds some light on the subject. "Used for many years in the fields of archaeological researchcaving etc.... LiDAR, also known simply as lidar, is used to measure the distance between a sensor and a target." The scanner uses a laser beam composed of multiple points of invisible light. Once the light beam has reached its target, it returns to the scanner? This allows the device to accurately measure distances. So one might ask: is this similar to Face ID? The Cnetfrance article addresses the subject. "Indeed, but with a longer range. The idea is the same: Apple's TrueDepth camera, which enables face identification, projects a series of infrared lasers, but can only work at close range. The lidar of the iPad Pro and the iPhone 12 Pro, works up to 5 metres". Several videos have been produced to demonstrate the capabilities of this depth and capture of a 3D part.

What are its features?

Cnetfrance explains that "Apple promises a up to six times faster focusing in conditions of low light for the camera. Lidar is also used to improve the effects of the night portrait mode."  Its long range (up to five metres) opens up new possibilities for developers who can create a digital reproduction of a room very quickly. In addition, by analysing the environment in 3D, Apple's photo algorithms can Detach the background from the foreground. An essential operation to apply the portrait mode blur - even under the most difficult conditions. This information could be used by third-party developers to develop new applications. The Geek Journal also informs us that "At Apple and its Lidar scanner, the range ofuse of such a sensor will be primarily dedicated to the augmented reality." Initially, this sensor is expected to improve the performance of ARKit, the augmented reality engine of the brand. The first area of application mentioned by Apple is to allow its "Measurements" application to calculate "more quickly the height of someone (...) and to measure objects more accurately and speed. While the use cases on a smartphone are not obvious, this technology is indispensable for augmented reality glasses. We will have the opportunity to zoom in again on Apple's secret AR glasses project.

How does lidar enhance augmented reality? :

Lidar, the Augmented Reality accelerator for Apple? A quick reminder about augmented reality: AR combines all the interactions between the real world and virtual elements such as 3D, 2D images and geolocation. As we said, the first use of LiDAR technology concerns augmented reality. The sensor provides more accurate AR experiences. faster and more realistic. A crucial point for augmented reality to work optimally is toe create sufficient depth and a perfectly reconstructed 3D environment. This is exactly what this scanner is useful for! Thus, applications offering, for example, to choose a piece of furniture remotely by simulating its representation in the middle of one's living room, should be more accurate than before. Entertainment applications will also benefit, such as of Snapchat which, at the Apple conference, unveiled a new filter, more advanced than the others, and reserved for the iPhone 12 Pro. 20minutes still points out that "Apple is obviously not the first smartphone manufacturer to integrate such a sensor on its phones. Huawei and Samsungto name but a few, have opted for Time of Flight sensors which behave in the same way as the LiDAR sensor to measure the distance of objects from the camera."But with more 10,000 augmented reality applications on the App StoreWe are only at the beginning of what Apple can offer. The iphonesoft blog. If 2021 is the year of virtual reality, it is likely that 2022 will be the year of augmented and mixed reality. ____________________________________________________________________________________

Would you like to know more about virtual or augmented reality? Get in touch now!

Subscribe to our newsletter!

Get the latest news about virtual and augmented reality, our new products...