Arm Community
Arm Community
  • Site
  • User
  • Site
  • Search
  • User
  • Groups
    • Arm Research
    • DesignStart
    • Education Hub
    • Graphics and Gaming
    • High Performance Computing
    • Innovation
    • Multimedia
    • Open Source Software and Platforms
    • Physical
    • Processors
    • Security
    • System
    • Software Tools
    • TrustZone for Armv8-M
    • 中文社区
  • Blog
    • Announcements
    • Artificial Intelligence
    • Automotive
    • Healthcare
    • HPC
    • Infrastructure
    • Innovation
    • Internet of Things
    • Machine Learning
    • Mobile
    • Smart Homes
    • Wearables
  • Forums
    • All developer forums
    • IP Product forums
    • Tool & Software forums
  • Support
    • Open a support case
    • Documentation
    • Downloads
    • Training
    • Arm Approved program
    • Arm Design Reviews
  • Community Help
  • More
  • Cancel
Processors
  • Developer Community
  • IP Products
  • Processors
  • Jump...
  • Cancel
Processors
Processors blog Taking a look inside the new HoloLens 2
  • Blogs
  • Leaderboard
  • Forums
  • Videos & Files
  • Mentions
  • Sub-Groups
  • Tags
  • Jump...
  • Cancel
  • New
More blogs in Processors
  • DesignStart blog

  • Machine Learning IP blog

  • Processors blog

  • TrustZone for Armv8-M blog

Tell us what you think
Tags
  • enterprise
  • Augmented Reality (AR)
  • Wearables
  • Cortex-A
  • Windows on Arm (WOA)
Actions
  • RSS
  • More
  • Cancel
Related blog posts
Related forum threads

Taking a look inside the new HoloLens 2

Ian Pilkington
Ian Pilkington
March 14, 2019

2019’s Mobile World Congress saw the exciting launch of Microsoft’s mixed reality headset HoloLens 2. As I noted in my blog on augmented reality (AR) developments at CES 2019, consumer take-up of AR wearables is becoming a more realistic proposition, but we’re still several years away from commercially viable AR devices at consumer price points. However, the adoption of AR wearables and devices within industry is happening now and continuing to grow. The Hololens 2 is one such AR device that is geared towards workers rather than consumers.

Looking at the device’s impressive new features and updates, HoloLens 2 takes some significant steps towards a brighter AR future with much improved display FoV (field of view) and brightness, user comfort, environment comprehension, and, most importantly, more natural HMI (Human Machine Interface) through NLP (Natural Language Processing), hand and eye tracking. All of these improvements are sitting on top of a developer-friendly Windows Core OS with a shiny new Arm-based compute platform (more on that later!). There is significant interest in developing for Windows on Arm devices, such as the HoloLens 2, which is driving new innovation in software and services similar to early smartphone eco-systems. With all of this in mind, let’s look at what this means…

HoloLens 2 in industry

Improved FOV

Microsoft has been able to more than double the FoV in the HoloLens 2, representing a big step-up for HMDs (head mounted displays). According to a fairly detailed Microsoft blog post on the HoloLens 2, this has been achieved while maintaining the industry-leading holographic density of 47 pixels per degree per eye. The device also contains a new laser plus MEMS display sub-system to help achieve these performance advancements in a power-efficient manner.

Tracking advancements

The HoloLens 2 features a number of tracking additions and improvements. The addition of eye tracking is good to see, which is in line with industry trends. Moreover, improvements in hand and gesture tracking is due to the introduction of a much-improved Time of Flight (ToF) sensor and software enhancements. Other tracking and mapping improvements are as expected, but the inclusion of semantics – segmenting objects in the 3D map of the environment – is an interesting addition and showcase of how edge + cloud can offer significant benefits for the right use-case.

Improving and aligning the HMI

The HMI improvements on the HoloLens 2 are likely to make the device very beneficial to workers. Enabling eye tracking, hand tracking, gesture recognition and semantics to all work together provides a more natural, contextual way for workers to interact with virtual objects. This could mean that work tasks are completed more efficiently and to a higher standard.

Security

With the introduction of eye tracking, comes the wearable AR device’s answer to fingerprint and face unlock on smartphones known as Iris scanning. This has been my long-time prediction for user ID on wearable AR, but Microsoft have delivered it much earlier than anticipated.

HoloLens 2 in industry

Moving to a Snapdragon SoC

From an Arm perspective, we are most excited at the switch to a Qualcomm Snapdragon 850, which means the HoloLens has moved from an x86 processor to an Arm-based platform. The reason for this move… adopting the Snapdragon 850, which uses Arm Cortex technology, brings a number of benefits including performance and, most importantly, greater power efficiency. As you can see from the features and capabilities noted previously, increased compute performance will be a necessary requirement; however, the various compute-intensive tasks need to be carried out in a power efficient manner. As the features on wearable AR devices continue to evolve, the highly-integrated compute solutions based on Arm IP delivered by our innovative partners will continue to increase this much-needed efficiency.

In an article about the HoloLens 2 announcement in The Verge, Alex Kipman, a Technical Fellow at Microsoft and the person in charge of the whole HoloLens 2 project, was complimentary about Arm and explained the decision to move to the Arm-based Snapdragon SoC:

“Arm rules in battery-operated devices. The Arm decision became fairly easy. If you’re going to be on battery, [it’s] hard to find a product that’s not running Arm today.”

Away from HoloLens, Qualcomm has made no secret of its desire to work with smartphone-powered VR (Virtual Reality) and AR headset devices, particularly those that will rely on the 5G network. As reported in The Verge, Qualcomm will be creating an “XR-optimized” certification program for smartphones using its Snapdragon 855 processors, which means it could potentially work with any headset within this ecosystem.

Exciting time for industry xR wearables

The advancements in the HoloLens 2 show the fast-pace speed of development and innovation among xR wearables for industry. While the cost might be high – around the $3,500 mark – industry can point to the proven time and cost savings from using AR wearables, particularly in manufacturing and training. The proven return on investment and significant technology and user benefits make AR wearables, like the HoloLens 2, an attractive investment for businesses. From an Arm perspective, we’re excited to be a part of the HoloLens product development through the adoption of the Snapdragon 850 based on Arm Cortex technology. We look forward to future ground-breaking devices featuring Arm’s unrivalled performance and efficiency optimized products.

Why not learn more about our AR solutions below?

Discover Arm's AR solutions

Anonymous
Processors blog
  • Learning from Tweeten: Porting Electron Apps to Native Arm64 for Windows on Arm

    Ben Clark
    Ben Clark
    This blog explores how Tweeten, a free popular Twitter app, was deployed on Windows on Arm devices through Electon on Native Arm64.
    • January 25, 2021
  • Learning from StaffPad: How to deploy apps with the Universal Windows Platform

    Ben Clark
    Ben Clark
    This blog explores how StaffPad, a music notation app, was deployed on Windows on Arm devices through the Universal Windows Platform.
    • January 18, 2021
  • Time to get excited about the growing Windows on Arm Ecosystem

    Rahoul Varma
    Rahoul Varma
    This blog highlights the latest developments with the growing Windows on Arm ecosystem.
    • November 30, 2020