Qualcomm today announced a major expansion of Spectra, its effort to offer manufacturers a drop-in hardware and software solution for easily and affordably adding advanced camera technology to phones and other devices powered by Qualcomm Snapdragon chips.
The expanded Spectra suite includes three new hardware camera modules. The flagship module is an active depth-sensing camera that uses an infrared projector and camera to create a 3D map of its environment, much like LIDAR.
The other two new modules are a passive depth-sensing version using two standard cameras, and an iris-scanning front camera. Previous Spectra modules focused on photography, while the new modules enable and enhance additional phone functions, including biometric security, advanced AR, room-scale VR, and AI-powered object recognition. Spectra hardware modules are designed with Qualcomm’s guidance, but are made by third-party vendors. Each type of module is offered in one version from one vendor.
The Spectra suite also includes ready-to-go driver software tuned to each hardware module, and uses unique ISP technology built into the company’s Snapdragon chips. The three new camera modules rely on a new version of the ISP — to be found in future Snapdragon chips — that has been redesigned from the ground-up to be optimized for depth-sensing.
The active depth-sensing hardware and software is compatible with Google’s Tango AR platform, and should enable Tango phones that are smaller, cheaper, and have much better AR performance. When used for VR applications, the active depth-sensing can be used for position tracking that’s good enough to enable room-scale VR in phones.
This new version of Spectra also includes advanced new algorithms to reduce noise and improve low-light performance in both still photos and video, by intelligently analyzing multiple frames.
The new capabilities will be part of the next generation of Snapdragon chips, which haven’t been announced yet.