Apple expressed at the WWDC conference that the positioning of Vision Pro is the first wearable spatial computing device, and it represents a groundbreaking milestone. Vision Pro will usher users into the era of spatial computing, with its underlying logic being a spatial computing platform. It enables users to freely switch between virtual and real environments, enjoying immersive entertainment, education, work, and social experiences.

Apple Vision Pro is a typical representative of entry-level spatial computing devices. The concept of spatial computing it proposes deconstructs and reconstructs space, providing people with the opportunity to enter a multidimensional spacetime. With the development of emerging technologies in spatial computing, this industry is expected to experience significant growth this year. According to market.us research data, the global spatial computing market is projected to grow from $124.6 billion in 2023 to $620.2 billion in 2032, with a compound annual growth rate of 18.2% during the forecast period.

（Source: maket.us，2024.02.22）

The three capabilities of Apple Vision Pro serving spatial computing are as follows

The concept of spatial computing

In a narrow sense, a spatial computing platform is a combination of virtual reality (VR), augmented reality (AR), mixed reality (MR), and more natural human-machine interaction interfaces, where machines perceive and process objects in both the real and virtual spaces. Spatial computing aims to better integrate the real physical space in which humans exist with the virtual space that computers possess, defining a new paradigm of human-machine interaction.

In a broad sense, a spatial computing platform is an information-environment coupling system that controls the spatiotemporal properties of the real environment through the coupling between the environment and information. The spatial computing platform can measure the spatiotemporal properties of the real world and transform them into information. It operates on the information level of the acquired spatiotemporal information and controls and modifies the spatiotemporal properties of objects in the real space according to computer instructions. The application framework of spatial computing is illustrated in the figure below. This type of computing not only retains the three-dimensional characteristics of objects but also emphasizes a human-centric design concept, thereby serving deep interaction between humans and the virtual world.

(Source: "Organizing the Aggregate: Languages for $patial Computing" by Jacob Beal et al.)

The disruptive and inevitable nature of spatial computing

· The Era of Computing Dimensionality Disruption

Upgrading dimensionality holds significant meaning for humanity. From one dimension to two dimensions (within the realm of planar computing), computers have fulfilled their mission of widespread accessibility. General users can effortlessly perform basic operations, while trained users can utilize various computer software for more advanced tasks such as drafting, modeling, and development.

Moving from two dimensions to three dimensions (from planar computing to spatial computing), this amplification effect becomes even more pronounced. Taking mechanical drafting using AutoCAD as an example, the final presentation depends on both the "creative idea itself" and the "ability to replicate the idea on paper using software." The replication aspect involves projecting a three-dimensional model onto a two-dimensional plane, which requires a higher learning and understanding cost and is constrained by the capabilities of the software. In a scenario where MR glasses are worn on a spatial computing platform for drafting, constructing three-dimensional models in a three-dimensional space, everything becomes intuitive and immersive. Users can focus more on the "creative idea" itself, and the software's capabilities and operational constraints are no longer limitations. The range of objects users can manipulate using computers will be further expanded, and the efficiency of interaction with computers will be enhanced.

· The Inevitability of the Era of Spatial Computing

The technology and experience of planar computing have reached their peak, and smartphone shipments have shown signs of decline. The turning point for spatial computing technology and experience has arrived, exemplified by the Apple Vision Pro.

Under this wave of spatial computing, Apple possesses the ability to anticipate and shape the future. After the introduction of Vision Pro, the disruptive nature of the device (screen substitution) becomes apparent, triggering a race among the industry chain, and ushering in an era of rapid growth. The so-called dominant giants are products of their time, having gained absolute advantages in the previous round of competition. However, they often become overly reliant on existing paths, adhering to conservative approaches in technology, industry chains, and business thinking, making them susceptible to "dimensionality reduction attacks" from emerging forces in the next generation.

· Business Implementation Extends Beyond MR Headsets

Spatial computing will find applications in various industries, including but not limited to gaming, education, healthcare, manufacturing, and retail. For example, in the education sector, spatial computing can provide more immersive and interactive learning experiences. In healthcare, it can assist doctors in simulating and planning complex surgeries. In manufacturing, it can enhance production efficiency through virtual simulations and remote assistance. In the retail industry, spatial computing can offer customers unique shopping experiences, such as trying on clothes through AR or previewing furniture placement in their homes.

Spatial computing is also expected to drive the development of multiple industries, including cloud computing, edge computing, artificial intelligence, connected vehicles, and virtual reality. For instance, in the field of autonomous driving, spatial computing plays a typical role in identifying the surrounding environment, moving objects, and pedestrians through sensor fusion and multimodal computing. By applying more powerful algorithms and chips, vehicles can tackle more complex terrains and driving scenarios. Spatial computing technology brings more efficient and intelligent solutions to various industries, further propelling the development of the digital age.

Representative products and companies in the spatial computing market

1. Microsoft HoloLens

Microsoft HoloLens is an intelligent headset product launched by Microsoft on Windows 10, serving as the primary device for Windows Holographic. It incorporates advanced sensors, a wide-angle high-definition 3D optical lens display, and surround sound, allowing users to interact with the user interface in augmented reality through eye gaze, voice, and gestures. Although HoloLens has not achieved widespread adoption, it has become an important symbol of modern spatial computing, demonstrating the potential and possibilities of spatial computing.

2. Meta Horizon OS

Meta Horizon OS is the MR operating system currently used by Meta Quest. It is developed based on AOSP (Android Open Source Project), and Meta has been working in this field for 10 years. The system features leading-edge technologies such as Inside-Out self-tracking, gesture tracking, full-color perspective, scene understanding, and spatial anchoring. It also includes a comprehensive set of software solutions, including eye/face tracking, avatars, and more. Meta has adjusted its hardware plans in line with Apple's strategy, shifting the focus of Quest devices from purely virtual reality to incorporating more augmented reality capabilities. Similar to Vision Pro, Meta, which was originally almost exclusively focused on full virtual reality, is increasingly turning its attention to mixed reality.

3. Google Glass

Google Glass was the first AR glasses launched by Google in 2012. It has similar functions to smartphones, allowing users to take photos, make video calls, determine directions, surf the internet, process text information, and receive emails through voice commands. With the introduction of Apple Vision Pro, Google had to accelerate its pace in the XR (extended reality) field. At last year's Galaxy Unpacked 2023 event, in addition to the highly anticipated new flagship Android phone, the Galaxy S23 series, Samsung officially announced its collaboration with Google to jointly develop XR devices and build an ecosystem for them.

4. Sony XR Headset and Controller

The official name, price, and other details of this product are yet to be confirmed (referred to as "Sony XR Headset" in the following text), and it is planned to be released within 2024. Sony announced a new XR headset targeting creators and the B2B market. It will provide a "clear viewing experience" and "intuitive 3D design interaction," and feature "video perspective" capabilities. Sony CEO Kenichiro Yoshida stated that this new headset is designed for professionals engaged in 3D work, allowing wearers to expand their creative space by overlaying virtual objects onto physical space.

The future of the spatial computing industry is full of endless possibilities and opportunities. With continuous technological innovation and expanding applications, spatial computing is expected to redefine our lifestyles and work patterns in the coming years, leading the new wave of digitization.