Nat Versus the Volcano: Can an AI Investor Solve an Ancient Mystery from the Ashes of Vesuvius?Read more

Behind the Apple Design Decisions That Bogged Down Its Mixed-Reality Headset


In 2019, Apple had to make tough choices about the final design of its augmented and virtual reality headset. In this story—the second of two on the origins of the project—we reveal how those decisions have led to huge technical challenges and delays for Apple's biggest product gamble in years.

(L-R) Jonathan Ive, Johny Srouji, Dan Riccio and Tim Cook. Photos by Bloomberg; Apple. Art by Mike Sullivan
(L-R) Jonathan Ive, Johny Srouji, Dan Riccio and Tim Cook. Photos by Bloomberg; Apple. Art by Mike Sullivan
May 20, 2022 6:00 AM PDT

Apple’s executives had a critical design decision to make about the company’s riskiest product in years. It was 2019, and a growing team of Apple engineers had been working for more than three years on a headset that combined augmented and virtual reality capabilities. Now they had to figure out whether the mixed-reality headset would be a stand-alone device or would require a powerful base station to produce the dazzling digital imagery Apple envisioned for it.

Apple CEO Tim Cook and then–Chief Design Officer Jonathan Ive were among the executives who viewed VR demos on prototype headsets that simulated how the two approaches would differ, according to two people familiar with the demos. The headset that worked with a base station had superior graphics, including photorealistic avatars, while the stand-alone version depicted its avatars more like cartoon characters. Mike Rockwell, the Apple vice president in charge of the company’s AR/VR team, favored the headset with the base station, believing that Apple’s top brass wouldn’t accept the stand-alone version’s lower-quality visuals, according to the two people.

He was wrong. Ive had pushed for the stand-alone version of the headset since the early days of the project, according to a person familiar with it. Ultimately, Apple’s senior executives sided with Ive. Despite that, Rockwell still assured them he could make a great product. The choice has had lasting repercussions for the repeatedly delayed headset, which goes by the internal code-name of N301.

Access on the go
View stories on our mobile app and tune into our weekly podcast.
Join live video Q&A’s
Deep-dive into topics like startups and autonomous vehicles with our top reporters and other executives.
Enjoy a clutter-free experience
Read without any banner ads.
OpenAI's Greg Brockman (left) and Google's Demis Hassabis (right). Photos by Getty.
AI Agenda google ai
OpenAI Hustles to Beat Google to Launch ‘Multimodal’ LLM
As fall approaches, Google and OpenAI are locked in a good ol’ fashioned software race, aiming to launch the next generation of large-language models: multimodal.
From left, a Google TPU, Broadcom CEO Hock Tan and Google Cloud chief Thomas Kurian. Photos via Getty, Google and YouTube.
Exclusive google semiconductors
To Reduce AI Costs, Google Wants to Ditch Broadcom as Its TPU Server Chip Supplier
Google executives have extensively discussed dropping Broadcom as a supplier of artificial intelligence chips as early as 2027, according to a person with direct knowledge of the effort.
Flexport founder Ryan Petersen. Photos via Getty and Flexport.
e-commerce
Can Ryan Petersen Fix Flexport?
Ryan Petersen was getting antsy. This March, Petersen had handed over the CEO job at Flexport—the logistics company he’d founded a decade earlier, which had ballooned to an $8 billion valuation in 2022—to veteran Amazon executive Dave Clark.
Photo via Midjourney.
AI Agenda startups ai
The Rise of Startups That Help Other Startups Evaluate LLMs
All but a handful of artificial intelligence startups typically fall into one of two camps. The first group uses a single large-language model, typically OpenAI’s GPT-4, to power their applications.
Photos via Eiso Kant (left) and YouTube/VMWare Tanzu (right)
AI Agenda startups ai
How GitHub Copilot’s Co-Creator Raised $126 Million to Compete with His Former Employer
Recent interest in artificial intelligence has focused on large-language models that aim to do everything from writing Shakespearean poetry to solving math riddles.
Art by Mike Sullivan
entertainment media/telecom
Disney-Charter Deal Could Prompt More Cable TV-Streaming Bundles
Last week, Charter Communications, the No. 2 cable provider, and Walt Disney Co. cut a deal to include Disney streaming services, such as Disney+ and a new ESPN service still in the works, with Charter’s cable television packages.