• Toby Geeks Out!
  • Posts
  • Immersive Technology: A Look into the Future of AR, VR, and XR

Immersive Technology: A Look into the Future of AR, VR, and XR

Exploring the Future of Immersive Technology

In recent years, augmented reality (AR) and virtual reality (VR) have become increasingly popular topics in the tech industry. These technologies have revolutionized how we experience digital content, blurring the lines between the physical and digital worlds. Augmented reality overlays digital images onto the real world, enhancing our perception of reality, while virtual reality immerses us in a completely simulated environment.

Despite their many similarities, there are also key differences between AR and VR. AR is typically used to enhance the real world, while VR creates an entirely new world. AR is better suited for use cases where users must interact with the real world while accessing digital information. Conversely, VR is better suited for use cases where users need to be fully immersed in a simulated environment.

However, with technological advancements, we are now presented with mixed reality (XR), a combination of AR and VR in a single device. This technological innovation allows us to experience both AR and VR worlds in a more seamless and immersive way. By wearing an XR headset, we can walk through a virtual world while being aware of our physical surroundings.

This technology opens new possibilities for various industries, including education, entertainment, and healthcare. With the ability to view and interact with digital objects in the real world, XR technology has the potential to revolutionize the way we learn, play, and communicate with each other.

Apple’s Vision Pro

Apple recently announced the Vision Pro, a mixed reality (XR) device. Their first attempt is to create MR in the real world using spatial computing, using AR and VR capabilities in one device. Their goal is to blend digital content with your physical space seamlessly.

Apple created a spatial operating system called visionOS. It is built on the foundation of macOS, iOS, and iPad OS. It enables powerful spatial experiences. The Vision Pro lets you use your eyes, hands, and voice to navigate easily. Right now, there are only 11 apps you can see in the OS: Apple TV, Music, Mindfulness, Settings, Freeform, Safari, Photos, Notes, App Store, Mail, Messages, and Keynotes. But there is an icon called Compatible Apps. There is a chance that there are none or very few apps compatible with visionOS.

Interestingly, he did call the device ‘spatial computing.’ I don’t think I had heard that word anywhere when companies made reality devices. I always have known reality devices are usually for gaming and fitness but not for productivity. That would be an interesting era for spatial computing in the next 10 years.

With Vision Pro, you can use your favorite apps in new ways without being stuck to your desktop. With Vision Pro, you can arrange your apps anywhere and scale them to the perfect size, making your dream workspace real. You can browse the web in Safari, create to-do lists in Notes, chat in Messages, and switch between them with just a glance.

Without a TV, you can even watch a movie on a big screen from anywhere, like your couch or bed. Using the FaceTime video tile, you can easily work with others to chat and work on the same documents with your colleagues. You can also transform the space around you any way you want, for example, sitting on the beach, hanging out in the beautiful Rainforest of Amazonia, or sitting at the coffee shop in the Italy villa. However, I do not know what landscapes are available when it comes out to the visionOS, but that are just examples of where it can be possible.

Finally, you can connect with people nearby. Eyesight shows others when you're using apps or focused on something. So, if someone comes up to you while you're working or watching a movie, it lets you see them, and they can see your eyes.

The potential applications for Apple's Vision Pro are vast, and as technology continues to improve, we can expect to see even more innovative uses for MR in various industries.

The Vision Pro will not be out until early 2024, for a hefty price: $3,499.99. I am not sure when developers will start developing apps for visionOS. Still, when released, it may be limited to what is available on the spatial operating system for a short time.

Google’s Attempt to Create VR and AR Devices

This is not Apple's first attempt to create a VR/AR reality device. Other companies such as Google, Microsoft, and Meta have also developed VR/AR reality devices, some successful and others not. However, Apple has now entered the competition for the best reality device.

In 2013, Google released Google Glass, a pair of AR glasses that displayed digital information in the real world. Google Glass was marketed as a hands-free device that could take photos, make phone calls, and access the internet. However, the device faced challenges such as privacy concerns due to its camera and microphone, and its high price of $1,500 made it unaffordable for most people.

Despite its challenges, Google Glass paved the way for developing other AR products. AR technology has evolved significantly, and many companies are exploring its potential applications in various industries.

In 2014, Google released Google Cardboard, a low-cost VR viewer that could be used with a smartphone. Google Cardboard was designed to make VR more accessible and affordable for consumers. It was made out of cardboard and had lenses that could be used to view 3D content on a smartphone.

Google Cardboard successfully popularized VR among consumers and was used in various applications, from gaming to education. Google later released a more advanced VR headset called Daydream, designed to provide a more immersive VR experience.

Google's early attempts at AR and VR were mixed. While Google Glass was ultimately discontinued, Google Cardboard helped to popularize VR and make it more accessible to consumers. Today, AR and VR technology are used in various industries like healthcare, education, and entertainment.

If you're curious about reality devices, software, or hardware, there are three types of reality applications to consider: Virtual Reality, Augmented Reality, and Mixed Reality. Here's a brief explanation of each:

  • Mixed Reality (XR) combines VR and AR, where digital content seamlessly integrates into the real world and can interact with physical objects.

  • Virtual Reality (VR) creates a completely immersive digital environment, often requiring a headset or specialized equipment.

  • Augmented Reality (AR) overlays digital content onto the real world, typically viewed through a smartphone or tablet camera.

Mixed Reality

Mixed reality, also known as extended reality (XR), is a term used to describe different immersive technologies, including VR and AR. It covers everything from completely virtual environments (VR) to combining virtual and real elements (AR). XR recognizes that the distinction between VR and AR is becoming less clear, and technologies are blending to create mixed reality experiences. XR's goal is to make it easy for people to move between the physical and virtual worlds, allowing them to interact with both environments.

History

XR concept was first introduced in 1994 by Paul Milgram and Fumio Kishino, who defined it as the continuum between the real physical and virtual worlds. However, the technology did not become widely known until augmented reality (AR) and virtual reality (VR) technologies emerged in recent years.

Morton Heilig, one of the pioneers of virtual reality, created the Sensorama in 1962. The machine gave you a full experience with 3D pictures, sound, vibrating seats, and smells. Even though it wasn't exactly mixed reality, it helped create new technologies that would make you feel like you were there.

Benefits and Applications

Mixed reality lets users experience digital objects in the real world, making it a unique and immersive experience. The technology has been improving quickly, and companies like Microsoft and Meta are developing advanced MR headsets.

Mixed reality has many uses, from gaming and entertainment to education and training. For instance, XR can create immersive experiences that let users interact with virtual objects in the real world, like with Microsoft HoloLens. MR can also create virtual workspaces for teams to collaborate in real-time, no matter where they are, or visualize architectural designs.

XR can change how we interact with digital content, providing new and exciting possibilities for immersive experiences that blend the real and digital worlds. As technology evolves, we expect to see more innovative mixed-reality applications in various industries.

Devices that use Mixed Reality Today.

  1. Microsoft HoloLens 2 is a mixed-reality headset developed by Microsoft. It is designed to provide an immersive and interactive experience by overlaying digital content in the real world. The HoloLens 2 has sensors, cameras, and microphones that allow users to interact with digital objects in the real world. It is ideal for various use cases such as manufacturing, engineering & construction, healthcare, and education.

  1. Meta Quest is a mixed-reality headset developed by Meta (formerly Facebook). It is designed to allow users to interact with digital content in the real world, making it ideal for various use cases such as gaming, education, and productivity. One of the unique features of Meta Quest is its ability to track hand movements and gestures using device controllers, making interactions with digital objects more natural and intuitive. This feature sets it apart from other mixed-reality headsets.

Virtual Reality

History

Virtual reality (VR) was first introduced in the 1960s by Ivan Sutherland, who created a head-mounted display (HMD) system to display simple wireframe graphics. At the time, VR was mostly used for research because of its high cost and limited technology.

Jaron Lanier, a computer scientist and musician, founded the first company dedicated to developing VR technology, VPL Research, in the 1980s. Lanier and his team developed a range of VR devices, including HMDs and data gloves, that could interact with virtual environments.

VR technology began to gain widespread popularity in the 1990s, thanks to the development of more advanced HMDs and computer graphics. Companies like Sega and Nintendo experimented with VR in their gaming systems, and several VR arcade games were developed.

But, the technology remained limited due to the high hardware cost and the limited processing power of computers at the time. It wasn't until the early 2000s that VR started returning, thanks to the development of more advanced hardware and software.

In 2012, Oculus VR was founded by Palmer Luckey, a teenage inventor and VR enthusiast. Oculus VR developed the Oculus Rift, designed to offer a more immersive and affordable VR experience than previous systems. The Oculus Rift quickly gained a following among gamers and VR enthusiasts, and in 2014, the company was acquired by Facebook for $2 billion.

Benefits and Applications

VR creates a simulated digital environment that completely replaces the real world. Users typically wear a VR headset that displays a computer-generated virtual world. VR can also incorporate other sensory inputs, such as motion tracking, haptic feedback, and spatial audio, to enhance the sense of immersion. Users can interact with the virtual environment through hand controllers, gestures, or other input devices. VR is commonly used in gaming, simulations, training, and entertainment.

person wearing VR smartphone headset inside room

VR has many applications, from gaming and entertainment to education and training. In gaming, VR can create immersive experiences that allow users to explore new worlds and interact with virtual objects. VR can also be used in education to create virtual field trips, allowing students to explore historical sites or natural wonders. In training, VR can simulate dangerous situations or complex procedures, allowing professionals to practice in a safe environment. VR can also be used in therapy to help patients overcome phobias or to treat PTSD.

Today…

Today, VR has become more accessible and popular than ever, with the advent of more advanced VR headsets like the Oculus Rift and the HTC Vive and the development of more sophisticated computer graphics and processing power.

As technology continues to evolve, we can expect to see even more innovative applications of VR in various industries. The future of VR is bright, and it is exciting to see what new possibilities this technology will unlock in the years to come.

VR has the potential to revolutionize the way we interact with digital content, offering new and exciting possibilities for immersive experiences that transport us to different worlds and scenarios.

Augmented Reality

History

AR technology adds digital information to real-world objects using cameras and sensors. You can try AR on smartphones, tablets, smart glasses, or special headsets. AR lets you interact with virtual objects while being aware of your surroundings. AR is used in gaming, education, navigation, remote assistance, and marketing.

AR was first introduced in the 1960s by computer scientist Ivan Sutherland, who created a head-mounted display (HMD) system to overlay virtual images in the real world. However, AR remained a niche technology mostly used for research until the 1990s, when more advanced computer graphics and processing power became available.

In 1990, the term "augmented reality" was coined by a Boeing researcher, Tom Caudell, to describe a digital display system used in aircraft assembly. This marked the early recognition and exploration of blending digital information with the physical world.

In 1992, Louis Rosenberg developed the Virtual Fixtures system, which allowed military personnel to control remote robotic devices using AR. This technology was used for remote maintenance and repair of military equipment, and it helped to improve the safety and efficiency of military operations.

In 1998, Hirokazu Kato, a researcher from Japan, developed the ARToolKit, an open-source software library that enabled real-time tracking and recognition of physical markers for augmented reality applications. This made it easier for developers to create AR experiences.

In the early 2000s, AR began to be used for commercial purposes, such as marketing and advertising. One of the first commercial AR applications was the BMW Virtual Tour, which allowed users to explore the interior of a BMW car using AR. In 2008, the release of the first AR app for smartphones, called Wikitude, marked a major milestone in the development of AR technology. This app allowed users to point their smartphone camera at a location and see information about nearby points of interest.

Pokémon Go, an AR game released in 2016, became a global phenomenon, reaching over 800 million downloads within a year of its release.

person playing Pokemon Go during daytime

Apple introduced ARKit, a framework for developing augmented reality applications on iOS devices in 2017. ARKit made it easier for developers to create AR experiences and contributed to the proliferation of AR apps on Apple devices.

Benefits and Applications

Augmented Reality (AR) is a technology that superimposes digital information, such as images, videos, or text, onto the real environment. It enhances the user's perception of reality by adding a layer of computer-generated information, allowing them to interact with the digital content in the real world. AR can be experienced through a smartphone, tablet, or AR headset, making it more accessible and widely used than ever before.

AR can be used in gaming to create immersive experiences that blend the real world with digital elements, such as Pokemon Go. AR can create interactive learning experiences in education that allow students to engage with complex concepts more tangibly. For example, students can use AR to visualize human anatomy or historical events. In healthcare, AR can simulate surgical procedures, allowing medical professionals to practice before performing the procedure on a patient. AR can also help patients manage chronic conditions by reminding them to take medication or showing them how to perform exercises.

Today…

As technology continues to evolve, we can expect to see even more innovative applications of AR in various industries. The potential for AR to transform how we interact with the world around us is immense, and we are only beginning to scratch the surface of what is possible.

AR has the potential to make technology better by making it more fun and allowing people to mix the real and digital worlds. New devices like Apple's Vision Pro and better technology mean there will be even more cool AR things in the future.

In conclusion, the development of AR, VR, and XR technology has revolutionized how we experience digital content and has the potential to transform how we interact with the world around us. Each technology has unique benefits and applications, with AR better suited for enhancing the real world, VR for creating immersive digital environments, and XR combining the best of both worlds.

With the advent of new devices like Apple's Vision Pro and the continued evolution of technology, we can expect to see even more innovative AR, VR, and XR applications in various industries. These technologies offer exciting new possibilities for immersive experiences that blur the lines between the physical and digital worlds, and it is exciting to see how they will continue to shape the future of computing and improve our lives.

Imagine yourself in a mixed reality…

Join the conversation

or to participate.