A Closer Look at Vision OS

Vision OS is a new software platform from Apple that introduces mixed reality experiences to developers and users. With the release of the developer tools yesterday, we had the chance to explore the platform and what it can offer. We installed a number of sample applications to see what was possible and get a feel for the type of applications Apple is envisioning. In this article, we will dive deeper into our experience using Vision OS in the Xcode simulator.

The Xcode Simulator

The Xcode simulator is a tool used for developing iPhone apps, and now it includes support for Vision OS. In the simulator, you can change the reality background and walk through the scene with controls at the bottom right. Here are some of the reality backgrounds that you can choose from:

• Kitchen view
• Kitchen view at night
• Living room view
• Living room view at night
• Museum view in day and night modes

Apple is also supporting game controllers for Vision OS. We plugged in a PlayStation 4 controller to move through the scene more naturally. However, the L2 and R2 buttons were the only ones that worked at the time of testing, so we hope they improve the controller support in future updates.

Sample Applications

The sample applications that we installed on Vision OS gave us a glimpse into the platform's capabilities.

Safari

In Safari, you can browse the internet in augmented reality or virtual reality. The idea behind this feature is to allow users to surf their favorite websites in 3D. You can watch 2D videos in 3D and go into full-screen mode for a more immersive experience. The onboard keyboard also pops up to allow typing, and there are gestures for zooming out, panning, and selecting tabs. It almost feels like performing natural gestures like something straight out of Minority Report.

Photos

With Photos, you can browse your images in mixed reality. Panoramic photos are particularly impressive as you can view them in 3D. A control panel icon is placed in every scene to adjust audio or access menu icons. Multiple windows can be placed anywhere in the scene to create a desktop-like feeling.

Happy Beam

Happy Beam is a simple mixed reality game where you shoot flying objects. It was an enjoyable experience with the right mix of challenge and difficulty.

Diorama

An app like Diorama provides a 3D model for users to manipulate in real-time. Users can change the diorama's composition and landscape, adding different land masses and scenes.

The Walmart Demo

Another sample app is the "Hello World" demo, where you can view objects in real-time and rotate them in 3D. There's a world globe, satellites in orbit, and other planetary objects.

First Look at Vision OS: Exploring the Possibilities of 3D Immersive Technology

The world of 3D immersive technology has always been a fascinating and rapidly growing field. Apple's recent announcement of their new operating system, Vision OS, has created excitement and anticipation about what this new technology has to offer. In this article, we will take a closer look at Vision OS and explore the possibilities that 3D immersive technology can bring.

Walking Around the System

One of the first things to note about Vision OS is that it is built using Swift UI. Developers can explore the source code to see how Apple built this operating system. Interestingly, as developers modify the code, they can see a real-time preview of their application. This feature can help make development faster and more efficient.

Reality Composer Pro

One of the newer applications within Vision OS is Reality Composer Pro. This application helps visualize 3D models, making it much easier for developers to work with and create realistic scenes. The Earth model in the app, for example, is composed of a sphere with an Earth material, a custom Shader, a cloud-pending speed, a sun angle, vectors, and UVS. Developers can also preview the telescope model before adding it to their scene.

Solar System Demo

The operating system offers a fully immersive view of the Solar System in 3D, allowing users to pan around and explore outer space. This feature can give users an immersive experience and make them feel like they are in space. The Milky Way galaxy and the Sun are some of the features that make this demo more interesting.

Vision OS and Multitasking

One of the exciting aspects of Vision OS is its ability to facilitate multitasking and managing multiple windows. Vision OS operates within a 3D space where users can position all their open applications and windows. This feature can be a boon for users who like multitasking, managing many random Windows at once. However, users should note that the app's current use cases and functionality may seem useless, but we are yet to see the full vision of what this technology can offer.

Developing for Vision OS

Developing a 3D immersive application for Vision OS is relatively straightforward. Developers can create a new project, name it, and give it a 3D model. Then, they can start modifying the model and preview their application in real-time. The SDK is available for download on Apple's website, and developers can start building their applications today.

The Future of Vision OS

While Vision OS is in its early stages, it has the potential to open up new landscapes for creative opportunities in the world of technology. Users can explore, play around, and come up with innovative applications that can reshape how we interact with technology. However, Apple's strict control over its app store and the ecosystem may be a concern for developers. As it stands, the app store will have a 30% tax and stringent restrictions that limit the type of applications developers can create.

As developers continue to explore Vision OS, they may discover new and creative ways to use the 3D immersive technology. The possibilities are endless and only limited by the users' imagination. Whether you want to create gaming-like experiences or build app-like experiences, Vision OS has options for developers. Let us know your thoughts on Vision OS and what you plan to do with the new technology.Vision os is still in its early stages, and the sample applications demonstrate how the platform could lead to more immersive and intuitive experiences, particularly in gaming, browsing, and viewing images. mixing real-world data and objects with virtual ones can create a new kind of computing environment. only time will tell what kind of impact vision os will have on the industry, but it certainly has potential.