Last month Patently Apple posted a report titled “Facebook is determined to stay ahead of Apple on HMDs and Win the Race on being first with Smartglasses to replace Smartphones.” With Facebook remaining at the forefront of the next-wave of computers in the form of smartglasses and HMDs, Apple wanted the news out about what their team was developing on this front. Nine days later we posted a new report titled “Apple’s Secretive Technology Development Group is working on both AR Glasses and an Advanced HMD with a Stunning Display.”
The report covered two key AR/VR Apple products in development. One of the products was dubbed the N421 project which focused on a lightweight pair of glasses using AR only that would allow Apple’s messages and Map apps to be seen in an augmented way. The project is likely a little more advanced than Alphabet’s recently acquired Focals from North because Apple will be offering more features as we’ll point to later.
Apple’s headset and glasses team led by Mike Rockwell had also been working on a headset that would revolutionize Head Mounted Display systems and offer breakthrough features far beyond Facebook’s Oculus line of headsets. The project was dubbed the N301 project. It was designed to be the best of both VR and AR to deliver an all-encompassing digital experience for gaming and consuming content.
It was designed to feature ultra-high-resolution screens that would make it almost impossible for a user to differentiate the virtual world from the real one. A cinematic speaker system would have made the experience even more realistic, according to those who had tested the prototypes.
Rockwell’s team planned to sell a stationary hub, which in prototype form resembled a small Mac, that would connect to the headset with a wireless signal. In other words Apple had developed a next-gen gaming console for VR gaming that would have crushed Microsoft’s Xbox X Series and Sony’s PS5.
At the time Jony Ive was still in the drivers seat regarding hardware and he gave the project a thumbs down. The question now becomes: with Jony Ive having retired, could Apple’s project N301 resurrect? Gaming fans around the world are fully familiar with the use of gaming consoles. So Jony Ive’s objection appeared to be an odd decision indeed.
Of course we were never told the price for this so-called gaming hub. If it rang in at the price of a Mac, say $1800 to $3500 range, then we’d understand the objection made by Ive. Though for the time being, we’re in the dark on that point and the N301 project is reportedly off the table.
Days later Patently Apple broke the news that Apple had filed for a patent related to modular smartglasses that would contain a great number of senses and feature built in the arms of the glasses frame. It was a model that would make slipping in prescription glasses a breeze. You could review our report titled “Apple Patent illustrates Future Smartglasses Offering a Modular Design allowing users to exchange parts for Different Functionality” here.
With Apple stealing the headset buzz from Facebook, it appears that they wanted the regain the upper hand over Apple and revealed a new headset design that was made for mobility and one that although in the form of sunglasses, could pack a visual punch only dreamed of in a glasses package before.
Below is a brief peek at Facebook’s next-gen Holographic Display in action for their future VR Glasses.
The design demonstrated in a proof-of-concept research device uses only thin, flat films as optics to achieve a display thickness of less than 9 mm while supporting a field of view comparable to today’s consumer VR products.
The work demonstrates the promise of better visual performance, as well: Laser illumination is used to deliver a much wider gamut of colors to VR displays, and progress is made toward scaling resolution to the limit of human vision. The next step is to advance the displays to offer color as noted below.
Facebook’s research team noted that today’s VR displays have three primary components: a source of light (e.g., LEDs), a display panel that brightens or dims the light to form an image (e.g., an LCD panel), and a viewing optic that focuses the image far enough away so that the viewer’s eyes can see it (e.g., a plastic lens).
As the first two components can readily be formed into thin and flat modules, most of the weight and volume go into the viewing optics. To significantly reduce the overall size and weight of VR displays, the Facebook team combined two techniques: holographic optics and polarization-based optical folding.
Most VR displays share a common viewing optic: a simple refractive lens composed of a thick, curved piece or glass or plastic. The Facebook team proposed replacing this bulky element with holographic optics. The result was a dramatic reduction in thickness and weight: The holographic optic bends light like a lens but looks like a thin, transparent sticker.
While it’s still in Facebook’s lab, I found it interesting that they wanted to share this information only after the news of what Apple’s Research team was up to.
Is Facebook wanting to stay hungry and ahead of Apple on this technological front? Yes, at the moment it appears that way. However, that could all change in the blink of an eye if Apple ever decided to unleash their N301 beast first.
Stay tuned as the race to deliver a powerful next-gen VR/AR Headset is only at the beginning stages.