augmented_auto.png
beach_friends.png
automotive+.jpg
augmented_auto.png

VR & AR


Augmented reality requires accurate depth data to complete the user experience  

SCROLL DOWN

VR & AR


Augmented reality requires accurate depth data to complete the user experience  

Depth sensing for AR & VR applications

The team at Pelican Imaging has developed revolutionary new array sensor technology that captures in 3D. Pelican's depth-sensing array solution provides highly accurate depth data in real time, both for images and video.

Mobile and augmented reality applications require 3D data to drive the next generation of products. Exciting new user experiences depend on giving devices the ability to "see" like our eyes do.

Next-generation VR and AR headsets demand high quality depth sensing to enhance the user experience and enable natural interaction with virtual objects. Requirements for real-time environment mapping, gesture control, and object tracking are driving the need for very accurate 3D capture.

Pelican's depth-sensing array solution provides multiple benefits for AR applications, including highly accurate near-field and far-field depth data captured in all lighting environments, real time processing, dynamic calibration, and minimal occlusion zones. The layout of the array is flexible and can be customized to meet specific depth resolution requirements.

Augmented reality glasses with integrated array of depth sensors 


AR & VR markets are expanding rapidly 

“VR growth begins now and will dominate much of the public discussion in the near term, but longer-term augmented reality represents a much larger technology evolution and opportunity. AR hardware will take longer to mature, but over time, it will grow to represent a much larger opportunity for hardware, software, and service companies.
— Tom Mainelli, IDC VP for Devices and AR/VR

Advantages of array camera technology

Advantages to Pelican's depth-sensing array solution: depth accuracy and quality whether used indoors or out, a small, configurable form factor for portable and wearable devices, low power for mobile devices, ability to recalibrate camera on the fly

Advantages to Pelican's depth-sensing array solution: depth accuracy and quality whether used indoors or out, a small, configurable form factor for portable and wearable devices, low power for mobile devices, ability to recalibrate camera on the fly

beach_friends.png

Mobile


According to IDC, by 2018, 85% of global image capture volume will come from mobile devices. 

SCROLL DOWN

Mobile


According to IDC, by 2018, 85% of global image capture volume will come from mobile devices. 

Depth sensing for mobile applications

Smartphones have transitioned into powerful computing devices. Users will realize the ability to capture 3D images and video from their mobile device, giving them unprecedented freedom to produce their own 3D content for a wide range of applications: 3D selfies, virtual and augmented reality, 3D printing, gaming, etc.

According to IDC, by 2018, 85% of the global image capture volume will come from mobile devices. Users increasingly want more features and functionality from the camera in their mobile phone, because that’s the ever-present camera in their pocket.

Not only is the Pelican sensor perfectly suited for mobile by virtue of its super-thin form factor (2.5-3mm), but because the sensor has no auto-focus mechanism and no moving parts, it’s capable of extremely fast shooting. When paired with the primary camera in a mobile device, the Pelican array can actually be used to decrease the shutter lag in the primary camera as well, while yielding beautiful, high-res, all-in-focus images.

This unique "array + main camera" approach allows mobile handset manufacturers to choose their own primary camera module (whether it’s 8MP, 13MP, or 20MP), and benefit from excellent image quality paired with the depth data from the scene. See examples above of an image captured with the Pelican array paired with an iPhone 6 - the result is a crisp, high resolution image with a highly accurate depth map.

Mobile device manufacturers can differentiate their products from simple stereo camera arrangements by being one of the first to offer customers a meaningful depth capture solution. For a closer look at how mobile handset makers can realize the benefits of the Pelican depth-sensing array, see the IDC report: How Computational Photography Can Drive Profits in the Mobile Device Market. 

Still images can be edited with ease. Because the image contains depth information, it’s extremely simple to refocus the photo, or select multiple objects of focus. Pelican’s software also enables users to capture quick distance measurements, adjust lighting, apply filters to all or part of the image, and easily replace backgrounds or combine photos. 

Mobile Devices Will Either Have 3D Sensors Or Suffer Flat Sales...
— TechCrunch, September 2015

automotive+.jpg

Automotive


Depth sensing for automotive applications enables an enhanced user experience and improved security features

SCROLL DOWN

Automotive


Depth sensing for automotive applications enables an enhanced user experience and improved security features

Depth sensing for automotive applications

Pelican’s 3D array solutions provide a depth point for every X-Y location.  This enables one HW platform to be used to achieve regulatory mandates and optional feature upgrades. 

This depth-sensing approach has multiple benefits: 

  • Reduces the need for ancillary sensors (Lidar, Sonic, Mass)
  • Single array camera maintains perfect calibration
  • Arrays of cameras can be re-calibrated dynamically in the field
  • Sensors can support visible and NIR

Camera Placement

A small camera footprint enables numerous camera locations:

  • A-frame pillar
  • Headliner
  • Interior mirror
  • Trunk Lid
  • Grill
  • Headlamps

Measuring Distances

  • Array camera: Each array camera provides near distance depth data (e.g. pedestrian or object detection, back up)
  • Stereo array cameras: Multiple array cameras provide far distance depth data (e.g active cruise control)
  • Arrays of individual cameras: Multi-baseline arrangement of individual cameras provide near and far distance depth data

Dynamic Calibration in the field 

Individual array cameras or clusters of individual cameras can locate the same objects to auto-calibrate/verify parallax data, in real time.

3D sensing is considered as one of the most evolving technologies in the overall sensor arena, owing to its usage and applications in several industry verticals such as consumer electronics, healthcare, industrial robotics, automotive, security and surveillance, and others. There is great demand in the market for 3D sensor products and the applications in which these products can be implemented.
— Markets & Markets research report