Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri

Apple is working on new software tools that will allow both developers and customers to create augmented reality apps for its widely-rumored AR/VR headset, according to a paywalled report today from The Information's Wayne Ma.

Apple AR Icon
Interestingly, the report claims that customers will be able to create and release AR apps for the headset via Siri, even if they do not have the ability to code:

With the software tools, Apple hopes that even people who don't know computer code could tell the headset, via the Siri voice assistant, to build an AR app that could then be made available via Apple's App Store for others to download. The tool, for example, could allow users to build an app with virtual animals moving around a room and over or around real-life objects without the need to design the animal from scratch, program its animations and calculate its movement in a 3D space with obstacles.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the App Store alongside developers.

Apple already offers some AR creation tools like Reality Composer on the iPhone and iPad that could be expanded to the headset.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since.

Apple is also working on AR content for the headset, according to the report:

People familiar with Apple's content strategy for the headset say Apple executives are emphasizing health and wellness including proposals for AR apps that assist with meditation and exercise. One early AR demo allowed users to sit inside a Zen garden, the four people said.

Apple's headset is expected to be released later this year and will reportedly have an iOS-like interface with a grid of apps, advanced eye and hand tracking, and the ability to function as an external display for a Mac. The software tools for the headset could be revealed at Apple's annual developers conference WWDC in June, giving developers time to create AR and VR apps for the headset before it launches to customers later in the year.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

mgollaher92 Avatar
16 months ago
Yeah, lets have Siri develop apps when it can barely handle turning my lights on and off.
Score: 65 Votes (Like | Disagree)
HobeSoundDarryl Avatar
16 months ago

It's all fun and games until Siri runs into a compiler error.
"I don't know what you mean by compiler error. Here's what I found on the web for compiler error." ;)
Score: 19 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
16 months ago
The problem is Siri doesn't really like to listen to my commands. Apple really needs to work on fixing and improving Siri first. Will be seeing this error message alot.

Score: 15 Votes (Like | Disagree)
Akrapovic Avatar
16 months ago
This feels like someone heard a rumour and misunderstood it. Like when the iPhone 14 Pro camera cutout was said to have notification indicators in it, and it turned out it was the dynamic island. Or when the Watch S7 was meant to have a flat screen, and it turned out it was an early rumour for the AW Ultra.

This feels more like it'd be a mini sandbox style enviroment where can be like "Hey Siri, add a chair" and it'll drop in objects. Creating entire apps through voice is fantasy. We still can't even do that well with codeless drop n drag systems, never mind trying to explain an app to a voice assistant that struggles with timers.
Score: 14 Votes (Like | Disagree)
nwcs Avatar
16 months ago
That sounds fun for like 5 minutes. Like watching an old 1990s After Dark screen saver.
Score: 11 Votes (Like | Disagree)
4nNtt Avatar
16 months ago
I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat
Score: 9 Votes (Like | Disagree)

Popular Stories

iOS 18 Siri Integrated Feature

iOS 18 Rumored to Add These 10 New Features to Your iPhone

Wednesday April 24, 2024 2:05 pm PDT by
Apple is set to unveil iOS 18 during its WWDC keynote on June 10, so the software update is a little over six weeks away from being announced. Below, we recap rumored features and changes planned for the iPhone with iOS 18. iOS 18 will reportedly be the "biggest" update in the iPhone's history, with new ChatGPT-inspired generative AI features, a more customizable Home Screen, and much more....
Apple Silicon AI Optimized Feature Siri

Apple Releases Open Source AI Models That Run On-Device

Wednesday April 24, 2024 3:39 pm PDT by
Apple today released several open source large language models (LLMs) that are designed to run on-device rather than through cloud servers. Called OpenELM (Open-source Efficient Language Models), the LLMs are available on the Hugging Face Hub, a community for sharing AI code. As outlined in a white paper [PDF], there are eight total OpenELM models, four of which were pre-trained using the...
maxresdefault

Apple Announces 'Let Loose' Event on May 7 Amid Rumors of New iPads

Tuesday April 23, 2024 7:11 am PDT by
Apple has announced it will be holding a special event on Tuesday, May 7 at 7 a.m. Pacific Time (10 a.m. Eastern Time), with a live stream to be available on Apple.com and on YouTube as usual. The event invitation has a tagline of "Let Loose" and shows an artistic render of an Apple Pencil, suggesting that iPads will be a focus of the event. Subscribe to the MacRumors YouTube channel for more ...
apple id account

Apple ID Accounts Logging Out Users and Requiring Password Reset

Saturday April 27, 2024 12:41 am PDT by
There are widespread reports of Apple users being locked out of their Apple ID overnight for no apparent reason, requiring a password reset before they can log in again. Users say the sudden inexplicable Apple ID sign-out is occurring across multiple devices. When they attempt to sign in again they are locked out of their account and asked to reset their password in order to regain access. ...
macbook pro purple february

Best Buy Introduces Record Low Prices on Apple's M3 MacBook Pro for Members

Thursday April 25, 2024 7:41 am PDT by
Best Buy is discounting a collection of M3 MacBook Pro computers today, this time focusing on the 14-inch version of the laptop. Every deal in this sale requires you to have a My Best Buy Plus or Total membership, although non-members can still get solid second-best prices on these MacBook Pro models. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a...
macos sonoma feature purple green

Apple's Regular Mac Base RAM Boosts Ended When Tim Cook Took Over

Friday April 26, 2024 6:34 am PDT by
Apple used to regularly increase the base memory of its Macs up until 2011, the same year Tim Cook was appointed CEO, charts posted on Mastodon by David Schaub show. Earlier this year, Schaub generated two charts: One showing the base memory capacities of Apple's all-in-one Macs from 1984 onwards, and a second depicting Apple's consumer laptop base RAM from 1999 onwards. Both charts were...