Appleā€™s mixed reality headset project challenges explained


    Rendering by Antonia De Rosa. Edited by 9to5Mac.

    Since beginning its efforts in 2015, Appleā€™s work on a mixed reality headset has been hit with a range of challenges that have pushed back the potential launch date by years. Now a new report from The Information shares what the major roadblocks have been from inside sources.

    The Information was able to talk with 10 people close to Appleā€™s mixed reality headset project, most of whom worked on the team. Going all the way back to 2016, just one year after development started, the sources say Appleā€™s board was presented with a demo of very early prototypes to try and ā€œbuild support at Appleā€™s highest levels for bigger investments.ā€

    Former Vice President Al Gore, thenā€“Disney CEO Bob Iger and other Apple board members walked from room to room, trying out prototype augmented and virtual reality devices and software. One of the gadgets made a tiny digital rhinoceros appear on a table in the room. The creature then grew into a life-size version of itself, according to two people familiar with the meeting. In the same demo, the drab surroundings of the room transformed into a lush forest, showing how users could seamlessly transition from AR, in which they can still view the physical world around them, to the more immersive experience of VRā€”a combination known as mixed reality.

    Sources say some of the prototypes were ā€œcobbled togetherā€ and ran Microsoft Windows while others were modified HTC Vives or other existing headsets. However, one of them was so heavy it required a ā€œsmall craneā€ to hold it ā€œso the Apple board members could wear it without straining their necksā€

    While that doesnā€™t sound like an overly impressive experience, Appleā€™s board was convinced to support more development funding (another factor here was Appleā€™s concern about Facebookā€™s progress in the space).

    Going forward, the biggest challenges have been technical and one factor thatā€™s allegedly been at play is a CEO Tim Cook supporting the work, but not being a ā€œchampionā€ and highly involved in it.

    Technical challenges have been the biggest factor in the delays, as has been the case in the past for Appleā€™s most ambitious new products, such as the iPhone. But the Apple smartphone also had a singularly influential figure in Apple co-founder Steve Jobs to midwife it.

    While Appleā€™s current CEO, Tim Cook, supports the headset project, he hasnā€™t been as active in the effort as Jobs was with the iPhoneā€™s development, according to five people familiar with the project. For example, he rarely visits the group at its offices away from the main Apple campus, those people said. The lack of a honcho of Cookā€™s stature to champion the headset, code-named N301, has made it harder at times for it to compete with other products such as the Mac and iPhone for head count and engineering resources, the people said.

    Another challenge came from Jony Ive. When the headset team founder and leader Mike Rockwell was working on getting buy-in from Appleā€™s various teams to help with the development, his team was shut down on the idea of making it a VR headset. Iveā€™s team also pushed back on ā€œpractical usesā€ and doubted consumers would want to wear headsets for any considerable amount of time.

    Rockwell, Meier and Rothkopf soon encountered pushback from Iveā€™s team. The three men had initially wanted to build a VR headset, but Iveā€™s group had concerns about the technology, said three people who worked on the project. They believed VR alienated users from other people by cutting them off from the outside world, made users look unfashionable and lacked practical uses. Appleā€™s industrial designers were unconvinced that consumers would be willing to wear headsets for long periods of time, two of the people said.

    That ended up birthing the idea of a mixed reality headset:

    The men came up with a solution to address the concerns of Iveā€™s team. For example, they proposed adding cameras to the front of the headset so that people wearing the device could see their surroundings, said the three people. But the feature that ultimately sold the industrial designers on the project was a concept for an outward-facing screen on the headset. The screen could display video images of the eyes and facial expressions of the person wearing the headset to other people in the room.

    These features addressed the industrial design groupā€™s worries about VR-induced alienationā€”they allowed other people in a room to interact and collaborate with a person wearing a headset in a way not possible with other VR gear. For years, the existence of such a display, internally code-named T429, was known only to a small circle of people even within Rockwellā€™s group.

    The Informationā€™s report hints that a follow-up piece will cover a ā€œpivotal moment for the Apple headsetā€ that occurred in 2019. Thatā€™s likely when Jony Ive ā€œbalkedā€ at the idea of selling a headset that required a base station device to operate. Thatā€™s when the team pivoted to working on a less powerful, but more independent AR/VR device.

    The latest expectation is that Apple could announce its mixed reality headset in 2023. As far as price, weā€™ve heard reports that it could sell from above $2,000 to $3,000.

    FTC: We use income earning auto affiliate links. More.

    Roborock Q5+ robot vacuum


    Check out 9to5Mac on YouTube for more Apple news:



    Source link