Understanding Augmented and Virtual Reality

• Augmented Reality (AR) and Virtual Reality (VR) technologies were initially sources of inspiration for fiction writers and special effect teams.

Introduction to AR/VR

• The term "Augmented Reality" was first used by Thomas Caudell in efforts to apply VR to Boeing's manufacturing and engineering.
• "Augment" means adding something for substance, from Latin "augere," meaning "to increase."
• Morton Heilig is considered the "father of virtual reality" due to his research in the 50s and 60s.
• Ivan Sutherland invented VR with the first Head Mounted Display (HMD), resembling a portable television, but VR applications are finding practical uses in enterprise with potential to disrupt business processes.
• These technologies are impacting consumer tech and creating new opportunities in gaming, media, entertainment, training, education, defense, real estate, finance, health, retail, and employee/customer experience.

AR/VR Technologies

• Augmented Reality (AR) and Virtual Reality (VR) are different sides of the same concept with AR stimulating artificial objects in a real environment, while VR creates an artificial environment.
• Augmented Reality (AR) is a direct or indirect live view augmented by computer generated perceptual information including visual, auditory, haptic, somatosensory, and olfactory.
• Mixed Reality (MR) is an augmented reality subset that overlays 3D holograms into the real world.
• Virtual Reality (VR) uses computer tech to simulate an environment
• VR puts the user inside an experience, allowing them to interact with 3D worlds, rather than viewing a screen.
• Neuro Reality (NR) interfaces with the human brain, creating a sensory immersion and is in early stages of development.
• AR & VR both alter perception of the world differently: VR replaces current senses with new experiences, while AR adds to current reality.
• VR is more immersive, and AR offers more freedom and marketing options because it doesn't need a head-mounted display.

Key Components of AR/VR Systems:

• Key hardware of AR devices includes a processor, display, input devices, and sensors.
• Smartphones can fulfill AR hardware requirements.
• Microsoft HoloLens focuses on Mixed Reality (MR) as a head-mounted display.
• Google's "Google Glass 2.0" is used by enterprises with focus on workforce productivity.
• Special 3D augmented reality programs are used in AR applications, allowing virtual images to overlap real live images.
• Augmented reality software includes Auto Cad 3D, Cinema 4D.
• Users have to download an application in order to experience AR.
• A web cloud server is important in storing virtual image databases.
• Oculus VR is a major player in VR, making the Oculus Rift headsets.
• HTC Vive develops VR head-mounted displays and hand controllers.
• Companies developing VR headsets and peripherals include Sony, Samsung, Google, and Magic Leap.
• Neuralink is an early-stage brain-machine interface.

Working Principles of AR/VR

• Augmented Reality (AR) brings virtual objects into surrounding environments and is commonly sought.
• Augmented reality apps can be marker-based or location-based.
• Marker-based AR knows the object in view, location-based AR pinpoints the location of objects.
• Marker-based AR uses 2D barcodes, where software recognizes scanned patterns and overlays a digital image.
• This approach is also called recognition-based augmented reality
• Location-based AR uses GPS, digital compass, velocity meter, and accelerometer to provide location data.
• Inbuilt GPS software recognizes action of device, and app offers and superimposes relevant data onto the real scene.
• This approach is used in mapping directions or finding nearby services.
• Augmented reality can convert the environment into a digital interface
• Main categories are: 3D viewers and reality browsers
• 3D Viewers: Allow users to place life-size 3D models in their environment with or without the use of trackers and image tracking and depth sensing
• Reality Browsers: enriches the camera display, get relevant information regarding its history or approximate value of buildings etc
• One of the biggest applications of augmented reality gaming to date includes Pokémon Go, allowing users to catch Virtual Pokemon who are hidden throughout a map of the real world.
• Virtual Reality (VR) immerses users completely in a computer-generated environment, providing freedom of movement and sound.
• Special VR hand controllers enhance the experience.
• VR is achieved through headsets like Facebook's Oculus
• VR can create/enhance imaginary reality for gaming, entertainment, or create/enhance training by simulating real-life environments for people to practice beforehand
• Virtual Reality Modelling Language (VRML) is a coding language to create images for interaction
• AR and VR have inverse approaches with AR uses overlay to real world and VR offers digital recreation

Milgram's Reality-Virtuality Continuum:

• Real Environment, Augmented Reality (AR), Augmented Virtuality (AV), Virtual Environment
• Both the AR and VR enhance the user's experience and is used for entertainment and in the medical field
• AR can create remote surgeries etc and treat psychological conditions and PTSD
• AR enhances by overlaying virtual components onto the real world
• VR is usually delivered through headsets/controllers, while AR by mobile, laptops, smartphones
• AR and VR are often blended to create immersive experiences

Evolution of AR/VR:

• Interactions with interfaces used to be through intermediate devices like mouses and keyboards, then screens
• Screens manipulated through displays using physical or spoken words
• Augmented and virtual reality accelerates user interaction by improving fidelity of intention, increasing efficiency and driving innovation of devices.

AR/VR Applications in Sectors:

• AR and VR tech are finding their way into sectors with tech impacting consumer with device affordability
• In training/simulations: AR/VR helps in high end training in education, health and the aviation sector like using VR flight simulator tours
• In health: AR can enhance medical procedures, and VR can create form of therapy simulating icy environments from burns
• In retail: Marketing Managers are using AR for viewing retail shelf data etc while engineer teams deploy VR in real time
• In the media, Entertainment & games: AR/VR enhances a viewers experience
• In the defence sector: AR acts as "heads up display" for soldiers while VR is used to simulate combat
• In the Insurance sector: the growth of AR/VR will can new risks by using accident while playing games like Pokémon Go for individuals and businesses.
• Insurers improve effectiveness by the markets tech.
• AR & VR technologies are still nascent. 80% of the market by 2021 is projected to be accounted for by AR