2019’s Mobile World Congress saw the exciting launch of Microsoft’s mixed reality headset HoloLens 2. As I noted in my blog on augmented reality (AR) developments at CES 2019, consumer take-up of AR wearables is becoming a more realistic proposition, but we’re still several years away from commercially viable AR devices at consumer price points. However, the adoption of AR wearables and devices within industry is happening now and continuing to grow. The Hololens 2 is one such AR device that is geared towards workers rather than consumers.
Looking at the device’s impressive new features and updates, HoloLens 2 takes some significant steps towards a brighter AR future with much improved display FoV (field of view) and brightness, user comfort, environment comprehension, and, most importantly, more natural HMI (Human Machine Interface) through NLP (Natural Language Processing), hand and eye tracking. All of these improvements are sitting on top of a developer-friendly Windows Core OS with a shiny new Arm-based compute platform (more on that later!). There is significant interest in developing for Windows on Arm devices, such as the HoloLens 2, which is driving new innovation in software and services similar to early smartphone eco-systems. With all of this in mind, let’s look at what this means…
Microsoft has been able to more than double the FoV in the HoloLens 2, representing a big step-up for HMDs (head mounted displays). According to a fairly detailed Microsoft blog post on the HoloLens 2, this has been achieved while maintaining the industry-leading holographic density of 47 pixels per degree per eye. The device also contains a new laser plus MEMS display sub-system to help achieve these performance advancements in a power-efficient manner.
The HoloLens 2 features a number of tracking additions and improvements. The addition of eye tracking is good to see, which is in line with industry trends. Moreover, improvements in hand and gesture tracking is due to the introduction of a much-improved Time of Flight (ToF) sensor and software enhancements. Other tracking and mapping improvements are as expected, but the inclusion of semantics – segmenting objects in the 3D map of the environment – is an interesting addition and showcase of how edge + cloud can offer significant benefits for the right use-case.
The HMI improvements on the HoloLens 2 are likely to make the device very beneficial to workers. Enabling eye tracking, hand tracking, gesture recognition and semantics to all work together provides a more natural, contextual way for workers to interact with virtual objects. This could mean that work tasks are completed more efficiently and to a higher standard.
With the introduction of eye tracking, comes the wearable AR device’s answer to fingerprint and face unlock on smartphones known as Iris scanning. This has been my long-time prediction for user ID on wearable AR, but Microsoft have delivered it much earlier than anticipated.
From an Arm perspective, we are most excited at the switch to a Qualcomm Snapdragon 850, which means the HoloLens has moved from an x86 processor to an Arm-based platform. The reason for this move… adopting the Snapdragon 850, which uses Arm Cortex technology, brings a number of benefits including performance and, most importantly, greater power efficiency. As you can see from the features and capabilities noted previously, increased compute performance will be a necessary requirement; however, the various compute-intensive tasks need to be carried out in a power efficient manner. As the features on wearable AR devices continue to evolve, the highly-integrated compute solutions based on Arm IP delivered by our innovative partners will continue to increase this much-needed efficiency.
In an article about the HoloLens 2 announcement in The Verge, Alex Kipman, a Technical Fellow at Microsoft and the person in charge of the whole HoloLens 2 project, was complimentary about Arm and explained the decision to move to the Arm-based Snapdragon SoC:
“Arm rules in battery-operated devices. The Arm decision became fairly easy. If you’re going to be on battery, [it’s] hard to find a product that’s not running Arm today.”
Away from HoloLens, Qualcomm has made no secret of its desire to work with smartphone-powered VR (Virtual Reality) and AR headset devices, particularly those that will rely on the 5G network. As reported in The Verge, Qualcomm will be creating an “XR-optimized” certification program for smartphones using its Snapdragon 855 processors, which means it could potentially work with any headset within this ecosystem.
The advancements in the HoloLens 2 show the fast-pace speed of development and innovation among xR wearables for industry. While the cost might be high – around the $3,500 mark – industry can point to the proven time and cost savings from using AR wearables, particularly in manufacturing and training. The proven return on investment and significant technology and user benefits make AR wearables, like the HoloLens 2, an attractive investment for businesses. From an Arm perspective, we’re excited to be a part of the HoloLens product development through the adoption of the Snapdragon 850 based on Arm Cortex technology. We look forward to future ground-breaking devices featuring Arm’s unrivalled performance and efficiency optimized products.
Why not learn more about our AR solutions below?
[CTAToken URL = "https://www.arm.com/solutions/mobile" target="_blank" text="Discover Arm's AR solutions" class ="green"]