Since as early as 2017, we've been seeing signs that Apple is working on possibly the next big thing in consumer tech – augmented reality (AR) glasses. Thanks to an increasing number of new Apple glasses leaks, rumors and even patents surfacing in recent months, we now know roughly what to expect from the upcoming wearable device.
Apple AR glasses: difference between AR and VR
You may have heard of VR (virtual reality) headsets, as they grew in popularity after 2012's launch of the Oculus Rift. They're usually large, bulky and expensive gaming-oriented devices that are designed to entirely block your eyes from seeing the real world. Because of that, they can be truly immersive for both gaming and professional tasks, such as pilot training. However, their bulk, immersion and reliance on a computer or a gaming console makes them unusable on the go, not to mention unfashionable.
However, AR (augmented reality) is different. AR glasses are see-through, as they use transparent lenses, and most simply add a digital overlay over your normal field of vision. For that to work, AR glasses can project a tiny screen on one or both of their lenses for the user to see. The design of AR glasses is also usually light and portable, similar to normal glasses, meaning they can be used outside.
Technically, Apple's AR glasses can cost less than a thousand dollars, but new and exciting first-gen products are rarely priced fairly. Let's take Google Glass as an example. Despite being quite an underwhelming AR device in regards to its usefulness and design, it cost $1,500 at its launch in early 2013.
Apple's AR glasses may be under $1,000 in a best-case scenario, as the cost to build them would likely be lower than the cost for building an iPhone. However, we can't rule out a higher price for the novelty and to make up for years of research and development. Like with Apple Watch, though, a more budget-friendly variant of the Apple AR headset could be released eventually.
Analyst Ming-Chi Kuo expects an Apple AR headset to be priced around $1,000. Alternatively, a late September 2021 report coming from Digitimes suggested a price of $2,000, which is certainly more plausible. Other reputable analysts and leakers such as Bloomberg's Mark Gurman have also hinted at a high price of around $2000.
Apple AR glasses latest leaks, updated July 19, 2022:
Apple's smart AR glasses have been in development since at least early 2017. Around that time, Apple CEO Tim Cook shared his excitement for AR during an interview, calling it "huge", but also suggesting that the technology might not be ready yet "for the mainstream".
Over the years, Apple was granted several patents related to what are likely the Apple AR glasses, along with possibly a separate VR-like headset. In 2020, various rumors suggested a possible Apple glasses launch in 2021 or 2022, but so far, they all turned false.
The latest report by Kuo (from June 7th) says that Apple's AR headset has been delayed for Q2 of 2023, with an announcement event to happen in January of the same year, along with pre-orders opening soon after. He also says that the wearable will be out by WWDC 2023 (before June). Again, this is all to be taken with a grain of salt, since the device has already been delayed several times, and further delays are just as likely.
Apple AR glasses design
And Apple glasses concept art.
Apple Glasses concept by Martin Hajek for iDrop News
As is to be expected from Apple, its smart glasses will be as sleek and stylish as the technology inside would allow for. In May of 2020, leaker Jon Prosser said during a podcast that the Apple glasses would resemble traditional glasses, which is plausible. Their design would steer away from resembling "heavy machinery on your face" and will be targeted at regular consumers.
Apple glasses concept, courtesy of EverythingApplePro
Allegedly, in 2020 Apple had both black and white Apple AR glasses prototypes that were seen by the leaker. He also mentioned that prescription lenses will be supported by Apple glasses, which suggests that their lenses might be interchangeable.
Apple AR headset concept by AntonioDeRosa
Apple AR glasses displays
Like most augmented reality glasses, Apple's will sport either one or two tiny projectors in each frame, which would cast an image onto the lenses. The image would appear to the observer as an overlay to their environment.
If the Apple glasses can project into both lenses by employing two projectors, one for each lens, certain apps could easily feature 3D effects.
Apple Glasses concept by Martin Hajek for iDrop News
Back in 2019, a CNET report suggested that the Apple glasses would project in 8K, meaning an impressive 7680 x 4320 pixel resolution for each eye.
Apple HMD (head-mounted display) patent image from 2019
Ming-Chi Kuo has suggested that Apple will use Sony Micro-OLED displays and optical modules for a "see-through AR experience," but will also be capable of providing a "a VR experience".
Apple AR glasses speakers and microphones
Apple's AR glasses will likely sport at least two speakers, one in each frame and close to the user's ears.
This isn't unlike other modern smart glasses, for example the Amazon Echo Frames. Despite not having a display, those have four tiny speakers, two in each frame, in addition to a microphone. While wearing them, the user can interact with the Amazon Alexa smart assistant and hear feedback from it.
A February 25th patent filed by Apple revealed that the Apple glasses might employ a large array of microphones covering it. The patent in question has the microphones detect sounds, even those that are beyond human hearing, and suggests that some sort of indicators will be used for "directing the user to the source of the sound”. Like most Apple glasses-related patents, it's uncertain whether this one will have anything to do with the final product, or was related to an idea for a feature that is already scrapped.
Apple glasses patent image possibly showing the planned arrangement of its microphones
Apple AR glasses software
Leaked name: realityOS (dubbed ‘rOS’ internally)
What will I be able to do with the Apple glasses?
In May of 2020, a leaker claimed that Apple's smart glasses will run on a new operating system or UI, codenamed "StarBoard". Back in late 2019, code that was discovered inside internal builds of iOS 13 did refer to codenames "StarBoard" and "STARTester". The latter was presumed to be an app which would detect whether Apple's AR glasses (also codenamed "T288") were being "worn" or "held." Along with that, the app was supposedly used to recreate what the wearer would see through the Apple glasses on an iPhone – likely for interface testing purposes.
Similarly to Amazon's Echo Frames smart glasses, Apple glasses users will be able to interact with a smart assistant (Siri in this case) by voice, ask it to call a contact, answer questions, make a note, play a podcast and so on.
Other Apple glasses features will likely include showing the wearer their iPhone notifications, displaying messages, map directions and other useful content. Like with Apple Watch, the Apple glasses would probably get their own app store, containing 3D AR games and other dedicated AR apps.
The Apple glasses will have 5G connectivity according to leaker Jon Prosser.
Apple AR glasses controls
Touch, voice, a ring, gloves? How will I interact with Apple glasses?
In mid-2019, an Apple application revealed that the company is working on magnetic sensing technology for detecting whether the user is wearing special gloves. In the patent, such gloves are shown to be used for interacting with the Apple glasses via gestures.
Image from an Apple patent showing the user interacting with AR glasses with a special glove and air gestures
Apple might also decide on a more discreet way of controlling the Apple glasses, like touch controls embedded in their frame or via a smart ring for touchless gesture controls.
Additionally, a future Apple Watch could be able to support air gestures, for interacting with Apple's AR glasses.
The latest rumors have also suggested using a digital crown (like the one on the Apple Watch) to navigate, or a pointing device worn on the user's finger. Those are all allegedly ways to navigate that were being tested by Apple, and we're yet to know for sure which input method the company would select for the final product.
Apple AR glasses camera
Will Apple's smart glasses have a camera? Or LiDAR?
Due to privacy reasons, it seems unlikely that Apple's smart AR glasses will have a built-in camera. One of the main criticisms towards Google's attempt at AR glasses (Google Glass) was that its built-in camera could be used to record people in public without their knowledge or consent. Because Google Glass had a built-in camera, wearing it was additionally banned in certain public areas, such as casinos and movie theaters.
Learning from this, most manufacturers of AR glasses don't include cameras anymore, nor would Apple, most likely.
However, analyst Ming-Chi Kuo expects an Apple AR headset to actually sport a whole 15 cameras, with eight of them used for AR video. As previously acknowledged, this could be a different device from the Apple VR glasses, that the Cupertino company is also working on. Apple Glass itself is still unlikely to have cameras and will focus just on AR, while the potential Apple VR headset is rumored to focus on both AR and VR.
Apple glasses LiDAR sensor concept, courtesy of EverythingApplePro
On the subject of cameras, Apple's LiDAR sensor, which we've seen on the iPad Pro and iPhone 12 Pro could make it into Apple's smart glasses. Taking in consideration that LiDAR isn't capable of capturing clear photos and videos of people like a standard camera, and will be useful for scanning the user's environment in order to enhance AR apps, Apple might be able to avoid potential privacy concerns despite including it.
Apple AR glasses battery and charging
Due to the size constraints of their design, Apple's glasses won't be able to employ large batteries, so the device will need to be energy efficient. A small battery cell would likely be integrated into each frame of the glasses.
Image from an Apple patent showing an AR headset charging in a docking station
Several Apple patent applications, which were published in March of 2020 suggested that Apple is considering its glasses to charge wirelessly on a dedicated dock. Judging by the most plausible patent, the glasses will contain magnets and coils that will connect with the dock, allowing for inductive charging.
FCC OKs Cingular\'s purchase of AT&T Wireless