VR Basics PDF

VR Basics What Is Virtual Reality? Virtual reality is the use of computer technology to create simulated environments. Virtual reality places the user inside a three-dimensional experience. Instead of viewing a screen in front of them, users are immersed in and...

VR Basics What Is Virtual Reality? Virtual reality is the use of computer technology to create simulated environments. Virtual reality places the user inside a three-dimensional experience. Instead of viewing a screen in front of them, users are immersed in and interact with 3D worlds. Simulation of human senses—all five of them—transforms a computer into a vehicle into new worlds. The only limitation to a superb VR experience is computing power and content availability. The Three Types of Virtual Reality All three types of VR, from non-immersive, semi-immersive, full immersive or a mixture of them, are also referred to as extended reality (XR). Three types of virtual reality experiences provide different levels of computer-generated simulation. The three main VR categories are the following: Non-Immersive Virtual Reality: This category is often overlooked as VR simply because it’s so common. Non-immersive VR technology features a computer- generated virtual environment where the user simultaneously remains aware and controlled by their physical environment. Video games are a prime example of non-immersive VR. Semi-Immersive Virtual Reality: This type of VR provides an experience partially based in a virtual environment. This type of VR makes sense for educational and training purposes with graphical computing and large projector systems, such as flight simulators for pilot trainees. Fully Immersive Virtual Reality: Right now, there are no completely immersive VR technologies, but advances are so swift that they may be right around the corner. This type of VR generates the most realistic simulation experience, from sight to sound to sometimes even olfactory sensations. Car racing games are an example of immersive virtual reality that gives the user the sensation of speed and driving skills. Developed for gaming and other entertainment purposes, VR use in other sectors is increasing. The virtual technology definition includes specific shared characteristics. Not only immersive, they are also computer-generated, believable as multidimensional experiences, and interactive. What’s the Difference Between Virtual Reality and Augmented Reality? Virtual reality (VR) is an all-enveloping artificial and fully immersive experience that obscures the natural world. Augmented reality (AR) enhances users’ real-world views with digital overlays that incorporate artificial objects. VR creates synthetic environments through sensory stimuli. Users’ actions impact, at least partially, what occurs in the computer-generated environment. Digital environments reflect real places and exist apart from current physical reality. 1 In AR, the real world is viewed directly or via a device such as a camera to create a visual and adds to that vision with computer-generated inputs such as still graphics, audio or video. AR is different from VR because it adds to the real-world experience rather than creating a new experience from scratch. Virtual Reality provides a completely Augmented Reality overlays immersive experience. Wherein the the computer-generated 3D user feels like a part of another content in the real world. world. Users have the ability to The user completely gets into the interact with Augmented new world and shut down from the technology and the real world. real world while experiencing VR. AR can be experienced by Users need VR devices like headsets Smartphones, Tablets, or AR & immersive sound, motion devices. controllers, etc, to experience VR. AR is a partially enclosed It’s called fully enclosed reality. reality. How Does Virtual Reality Technology Work? The VR process combines hardware and software to create immersive experiences that “fool” the eye and brain. Hardware supports sensory stimulation and simulation such as sounds, touch, smell or heat intensity, while software creates the rendered virtual environment. Eye and Brain Function and the 3D VR Experience 2 Immersive experience creation mimics how the eye and brain form visuals. Human eyes are about three inches apart and therefore form two slightly different views. The brain fuses those views to create a sense of depth or stereoscopic display. VR applications replicate that phenomenon with a pair of exact images from two different perspectives. Instead of a single image covering the entire screen, it shows two identical pictures made to offset the view for each eye. VR technology fools the viewer’s brain into perceiving a sense of depth and accept the illusion of a multi-dimensional image. What Technology Does Virtual Reality Use? VR technology commonly consists of headsets and accessories such as controllers and motion trackers. Driven by proprietary downloadable apps or web-based VR, the technology is accessible via a web browser. What Hardware Does Virtual Reality Use? Virtual reality hardware includes sensory accessories such as controllers, as well as headsets, hand trackers, treadmills and, for creators, 3D cameras. VR Headsets A VR headset is a head-mounted device, such as goggles. A VR headset is a visual screen or display. Headsets often include state-of-the-art sound, eye or head motion-tracking sensors or cameras. There are three main types of headsets: PC-Based VR Headsets: PC headsets tend to be the highest-priced devices because they offer the most immersive experiences. These headsets are usually cable- tethered from the headset and powered by external hardware. The dedicated display, built-in motion sensors and an external camera tracker offer high-quality sound and image and head tracking for greater realism. Standalone VR Headsets: All-in-one or standalone VR headsets are wireless, integrated pieces of hardware, such as tablets or phones. Wireless VR headsets are not always standalone. Some systems transmit information wirelessly from consoles or PCs in proximity, and others use wired packs carried in a pocket or clipped to clothing. Mobile Headsets: These shell devices use lenses that cover a smartphone. The lenses separate the screen to create a stereoscopic image that transforms a smartphone into a VR device. Mobile headsets are relatively inexpensive. Wires are not needed because the phone does the processing. Phones don’t offer the best visual experiences and are underpowered by game console- or PC-based VR. They provide no positional tracking. The generated environment displays from a single point, and it is not possible to look around objects in a scene. VR Accessories VR accessories are hardware products that facilitate VR technology. New devices are always in development to improve the immersive experience. Today’s accessories include 3 the 3D mouse, optical trackers, wired gloves, motion controllers, bodysuits, treadmills, and even smelling devices. These are some of the accessories used today in VR: 3D Mouse: A 3D mouse is a control and pointing device designed for movement in virtual 3D spaces. 3D mice employ several methods to control 3D movement and 2D pointing, including accelerometers, multi-axis sensors, IR sensors and lights. Optical Trackers: Visual devices monitors the user’s position. The most common method for VR systems is to use one or multiple fixed video cameras to follow the tracked object or person. Wired Gloves: This type of device, worn on the hands, is also known as cyber gloves or data gloves. Various sensor technologies capture physical movement data. Like an inertial or magnetic tracking device, a motion tracker attaches to capture the glove’s rotation and global position data. The glove software interprets movement. High-end versions provide haptic feedback or tactile stimulation, allowing a wired glove to be an output device. Motion Controllers: These accessories allow users to act in mixed reality. Controllers allow for fine-grained interaction with digital objects because they have a precise position in space. Omnidirectional Treadmills (ODTs): This accessory machine gives users the ability to move in any direction physically. ODTs allow users to move freely for a fully immersive experience in VR environments. Smelling Devices: Smell devices are one of the newer accessories in the VR world. Vaqso, a Tokyo-based company, offers a headset attachment that emits odors to convey the size and shape of a candy bar. The fan-equipped device holds several different smells that can change intensity based on the screen action. 4 What Software Does Virtual Reality Use? Developers use various software to build VR. They include VR software development kits, visualization software, content management, game engines, social platforms, and training simulators. VR Content Management Systems Software: Companies use this workplace tool to collect, store and analyze VR content in a centralized location. VR Game Engine Software: Developers use the tools to create a VR video game experience. VR Software Development Kit (SDK): SDKs offer a base to design, build and test VR experiences. VR Social Platforms Software: Users collaborate from remote locations in VR with these tools. VR Training Simulator Software: This software works for almost any industry for employee training in immersive environments. VR Visualization Software: Users experience aggregated data in a virtual environment. to fully understand what data means. Non-Headset VR Napster’s Trudgian points out another software technology that may someday disrupt headsets as a standard in VR: “Non-headset VR is coming, as demonstrated by the likes of Spatial, VRChat and RecRoom. “These apps allow users or players without headsets to connect to the same environment and interact with one another. Adding support for non-headset users serves virtual worlds well by adding a user base on universally accessible devices and platforms. In theory, if a virtual world is not reliant on headset-only users, it can expand in size tremendously; the amount of people who have access to a web browser or smartphone is far greater than that of any headset.” Importance of Audio in Virtual Reality VR strives to emulate reality, so audio is vital role to creating credible experiences. Audio and visuals work together to add presence and space to the environment. Audio cues are also crucial for guiding users through their digital experience. Convincing VR applications require more than graphics alone. Hearing and vision are also central to a person’s perception of space. People react more rapidly to audio cues than to visual indicators. To produce truly immersive virtual reality experiences, precise environmental noise and sounds as well as accurate spatial characteristics are required. How Virtual Reality Applications Are Used Today VR technology is associated with gaming, but it is used to support sales, facilitate learning, simulate travel, communicate, and more. Due to the pandemic, remote work, social interaction and virtual travel have increased VR use. Virtual Reality Use Case Examples 5 VR has impacted businesses ranging from medicine to tourism and is a cornerstone of many corporate digital transformation strategies. For example, according to a November 2020 Statista report estimates for business investments in the U.S. industrial maintenance and training are forecast to hit $4.1 billion in 2024. Futurist Baron says: “There will be significant opportunities for businesses to use VR both within their companies and with potential and existing customers.” Baron offers her insights into these top use cases: Training: One of the most obvious is the use of VR in employee training. While this currently requires the use of a headset, it can also be done onsite or at home. The ability to put an employee in other people’s shoes (whether those of a co-worker or customer) delivers a unique experience that isn’t feasible otherwise. As the technology improves, this will become a valuable tool in all corporate training, including situations that require complex decision-making. VR makes sense in education. Imagine an immersive experience in history or science, for example. As technology progresses and our attention spans decrease, we will continue to expect well-rounded experiences when learning anything new. Travel: Hotels can take you inside their property, so you know what to expect. VR can be beneficial for high-end travel (e.g., honeymoons or luxury resorts). For the user, they’d see (and feel) the location from their perspective instead of watching an online video or looking at 2D photos. Real Estate: Developers can move beyond 3D models to simulate life inside their new development. VR would work both for homes and commercial spaces. Also, co-working spaces can use VR to put the prospective tenant inside the space before you join. Healthcare: There are many uses for healthcare practitioners, researchers and patients. Imagine using VR to help patients with disorders such as anxiety or anorexia. It would be invaluable in medical school to help students learn how to deal with situations that may arise when they become doctors (empathy training, for example). VR is already in use for surgical training. Retail: Retailers can help potential consumers put themselves in situations where they can “try on” clothes or objects and get a sense of how they interact with an environment. For example, a bride-to-be could try a wedding dress and place it in an actual wedding environment. VR is different from AR, where you stay in your current reality. Military: VR is already a valuable tool in simulations for combat, confrontations and the like. It can replace expensive and sometimes dangerous real-life exercises. The ability to change scenarios makes it attractive for all branches of the military and the defense industry. Entertainment: The ability to provide immersive experiences will transform entertainment. Gaming and Hollywood will increasingly provide users and viewers with the ability to go from passive to active. Consumers will interact with stories in a highly personalized way (should they wish to). The ability to choose 6  your own POV in a game or movie will continue to provide new forms of engagement. Other use cases include: Architecture: VR can render different levels of detail that are important in early- stage design. Architects can create an immersive experience to visualize massing and spatial relationships. Other uses can show how light will affect the proposed space, based on window placement. Art: VR as a tool for fine art is a staple for artists who aim to push limits. Multimedia artists all over the world are already deeply involved in immersive experiential art forms. Laurie Anderson, a pioneer since the 1970s, was awarded the 74th Venice International Film Festival for her work, The Chalkroom. Aviation: Realistic cockpits with VR technology are used to train commercial pilots in training programs incorporating live instruction with virtual flight. Aerospace: Lockheed Martin builds its F-35 plane with virtual reality technology. In addition to design, engineers now use VR glasses to inspect planes. VR enables engineers to work with up to 96 percent accuracy at a 30 percent faster rate. Conference Rooms: Users equip themselves with a headset that simulates a meeting room, complete with colleagues and furniture. Motion tracking, combined with digital avatars, allows users to control their digital selves and employ gestures. Even those without headsets use webcam video feeds superimposed on the virtual conference room. Data Visualization: Engineering and scientific data visualization have profited for years from VR. New display technology has aroused interest in everything from weather models to molecular visualization. Dining: Project Nourished replicates eating by manipulating taste, smell, vision, sound, and touch. People experience the virtual as a gourmet meal. The process uses a VR headset, an aroma diffuser, a system that emulates chewing sounds, a rotating utensil and tasteless, 3D-printed food. The project aims to maximize the practical and therapeutic qualities of beverages, medicine and food while limiting natural resource use. Education: The use of traditional instruction mediums and textbooks is often ineffective for students with special needs. With the introduction of VR, students have become more responsive and engaged. At Charlton Park Academy in London, teachers use immersive technology to address their students’ unique needs better. Fashion: You can find Dior’s VR store on its French website. The brand offers shoppers a 3D, 360-degree e-commerce experience. Users virtually browse the store’s offerings, zoom in on preferred items and purchase them online. Gaming: Say “virtual reality,” and gaming is the application people think of first. According to the Entertainment Software Association figures reported in March 2020, 73 percent of the 169 million gamers in the U.S. reported owning a gamin console, while 29 percent said they had a VR capable system. 7  Manufacturing: Designers and engineers easily experiment with the build and look of vehicles before commissioning expensive prototypes with VR. Brands such as Jaguar and BMW use the technology for early design and engineering reviews. Virtual reality saves the car industry millions by reducing the number of prototypes built per vehicle line. Journalism: Immersive journalism allows the first-person experience of events or situations described in documentary films and news reports. The Weather Channel uses mixed reality to help communicate everything from wildfires to tornados to flooding. Law Enforcement: With the advent of VR goggles, virtual reality training has been a boon for law enforcement training. Incident training is realistic and helps prepare officers for everyday situations. Marketing and Advertising: Virtual reality for marketing allows organizations to bridge the gap between experience and action. VR changes the dynamic between consumers and brands since people seek VR experiences, such as those of Toms Shoes and The North Face. Museums: Through a mobile phone, projector, headset or web browser, visitors experience locations that would have been unreachable in the recent past. At the National Museum of Natural History in Paris, a permanent VR installation allows visitors to explore different animal species and their links. The exhibit simulates real experiences of interacting or observing animals in their natural habitats. Religion: There’s even an app to experience God. Believe VR and The Virtual Reality Church make it possible for people to worship in depth wherever they are. VR Church became extremely popular during pandemic shutdowns. Social media: VR allows people to make connections in a more meaningful way. VRChat gives the power of creation to its community with a wide selection of social VR experiences. Users can hang out, play and chat with spatialized 3D audio, multiplayer VR games, virtual space stations, and expressive lip-synced avatars. Sports: VR is a training aid in many sports such as cycling, skiing, golf and gymnastics. At least three college programs—Auburn University, Vanderbilt University and the University of Arkansas—and multiple NFL teams use virtual reality systems. Major Players in Virtual Reality and Latest Entries: Oculus, HTC, Sony and Valve VR is always improving due to technology refinements, and the latest “category killers” change rapidly. Top-of-the-pack players include ongoing favorites from Oculus, HTC, Sony and Valve. Top VR Headsets for 2021 Name Description Price Oculus Quest 2 Standalone VR $299 8 Oculus Rift S Tethered VR $559 HP Reverb G2 Highest-resolution RC VR headset $648 Valve Index High-powered, tethered VR $999 Sony PlayStation VR For PS4 gamers $419 HTC Vive Cosmos Whole-room VR $699 Top Mobile VR Headsets for 2021 Name Type Price A standalone device with advanced VR Oculus Quest 2 $299 gaming and experiences Enjoy more than 600 games and Samsung Gear VR $149 numerous 360-degree videos A Google Cardboard-compatible headset Mattel View-Master Deluxe that features a headphone connection $23 for better audio. Compatible with smartphones, from Merge VR $49 123mm to 158mm in size Cardboard device that combines DIY Nintendo Labo VR Kit $59 with gaming. An easy and affordable way to immerse Google Cardboard $9 – $39 yourself in mobile VR Benefits of Virtual Reality VR benefits many industries with its user engagement. VR is an excellent vehicle for training, conferencing, convenience, and communication. Here are some of the benefits of VR: Practical Training: VR is a safe way to simulate dangerous situations for training purposes. Firefighters, pilots, astronauts and police can learn in a controlled environment before going into the field. Immersive experience narrows timeframes so trainees can more quickly become professionals. Engagement and Connection: VR is an engaging and entertaining experience for its users. Convenient Conferences: Virtual meetings save time and money, yet help maintain a sense of collegiality. 9  “Tryout” Capability: Shoppers’s remorse may become a thing of the past with VR. You can use virtual reality to furnish your home, test-drive a car or try on wedding bands without leaving home. Challenges of Virtual Reality VR has some disadvantages despite its appealing sense of engagement, including technical issues, the potential for addiction, loss of human connection, and expense. It’s possible to mitigate some problems, but others are a fixed part of the VR experience. Here are some VR disadvantages: Addiction: Some people become addicted to the VR experience in gaming and social media applications. People can assume different identifies, which can be addictive and cause social, psychological and biological issues. Health Problems: Extensive use of VR can create a loss of spatial awareness, nausea, dizziness, disorientation and nausea, also known as simulator sickness. Screen Door Effect: When you use a headset, the display is within inches of your eyes. That means you see pixels or the spaces between them, no matter how excellent the display resolution may be. This mesh-like effect can irritate some users. Newer headsets have improved but not eliminated the issue. Loss of Human Connections: When you rely on virtual connections rather than real-life social interactions, trouble may result. Over-reliance on VR can lead to disassociation or depression. Training Doesn’t Translate in the Real World: People trained in virtual reality may do well in the app or platform but can’t perform to the necessary standard in real- world situations. Expense: While prices are coming down, VR systems are not affordable for everyone. The Future of VR in Business Businesses differentiate themselves through technological hybrids to interest consumers in innovations, mainly through VR and AR applications. Nowhere is this more evident than in shopping and retail. Virtual reality in retail is still in its infancy. According to a 2018 VR in Retail and Marketing report from ABI Research, VR technology in the retail and marketing sectors are on track to generate $1.8 billion by 2022. Virtual reality in retail helps vendors plan, design, research and engage customers. The technology offers companies a strong competitive advantage by keeping up to date with current patterns and trends, like 3D eCommerce. What are the 4 elements of Virtual Reality? 10 With a better understanding of how does virtual reality work it is also essential to know the4 primary elements of it: virtual world, immersion, sensory feedback, and interactivity. Virtual world VR uses computer technology to create a Virtual Environment that replicates the stimuli of the physical world and allows the user to interact with it on a real-time basis. This simulation enables them to feel that they are a part or are getting teleported to this virtual world. Immersion Immersion talks about making the experience closer to reality using immersive graphical content and sound. With the help of VR Headset and Spatial Audio users can fully immerse themselves in the virtual world while playing a game or watching a movie etc... Sensory feedback By replicating the principle of human perception VR gives a space wherein a user can move around or track their motion on the screen and change the positions with the help of VR equipment. Sometimes it's more than just Audio and Video, as VR also plays around with senses like the taste, smell, and forces to provide an immersive experience. Interactivity The real-time interaction on screen gives a sense of inclusion and immersion between the user and the VR system with the help of sensor-enabled technology. For example, a user can kill a monster, shoot, kick or pick something on the screen in the virtual world. Augmented reality According to the Swiss Society of Virtual and Augmented Reality (SSVAR), “Augmented reality (AR) overlays digitally created content onto the user’s real-world environment. AR experiences can range from informational text overlaid on objects or locations to interactive photorealistic virtual objects. AR differs from mixed reality in that AR objects 11 (e.g., graphics, sounds) are superimposed on, and not integrated into, the user’s environment.” To better understand the concept of augmented reality you just need to remember Pokémon GO. The game leads us to search for and capture "digital" creatures (not belonging to our physical world) that are added as layers (holograms) on top of the real world. Or take the Iron Man movies, for example, where the analogue world is enhanced with digital interfaces. Mixed reality “Mixed reality (MR) seamlessly blends a user’s real-world environment with digitally created content, where both environments coexist to create a hybrid experience. In MR, the virtual objects behave in all aspects as if they are present in the real world – e.g., they are occluded by physical objects, their lighting is consistent with the actual light sources in the environment, they sound as though they are in the same space as the user. As the user interacts with the real and virtual objects, the virtual objects will reflect the changes in the environment as would any real object in the same space.” -SSVAR, 2021 Sometimes MR could be confused with AR and vice-versa as both talk about a mix between the real and digital world. The key difference is that, in the MR environment, we are able to interact with digital devices – they are not just overlapped onto the real world, they become an integral part of the world where we are able to interact with them. In MR, both the physical and digital world are interconnected, represented only by a single reality. When defining VR, AR and MR, it’s important to remember where they fit in with the broader framework of extended reality (XR). XR is the umbrella which covers the three specific fields of AR, VR and MR. Field of view Field of view (FOV) is an important concept in XR, whether we’re speaking about VR, AR or MR. FOV is the concept that defines how we experience XR. It determines how much we can see and this has a great impact on how we feel and how we internalise the experience. In essence, FOV is the amount of the observable world that is seen at any given moment and it is measured in degrees. It matters not only in terms of quantity (the angle value it reaches) but also in its quality. This applies to the equipment we use in XR, be it 12 VR headsets or MR/AR glasses. It’s therefore important to be aware and check what the different types of XR hardware offer and make possible in this particular field. Degrees of freedom (DoF) There are two levels or degrees of freedom (DoF) that define the quality and the level of immersion of VR and AR experiences. These are called level 3 (3DoF) and level 6 (6DoF). These levels of freedom are given to us by the VR headsets, or more specifically by the whole system that supports the experience. So, when using a VR or AR headset we should look at the level of DoF it allows, because it will have a huge impact on the type of immersive experience we will have. 3 degrees of freedom (3DoF) Level 3 recognises three movements – the system tracks rotational motion around the x, y and z axes (also known as pitch, yaw and roll) but not translational. It does not detect the physical movement of the user, but only recognises head movements around the three axes. This means that the user will not be represented on the virtual world if they walk, jump or move to the side. 3DoF headset example: Oculus GO 6 degrees of freedom (6DoF) Level 6 recognises six movements – the system tracks both rotational and translational motion of a body in a 3D space. Basically, having 6DoF in a virtual experience means that the user can “rotate”: Moving between X and Y - pitch Moving between X and Z - yaw Moving between Z and Y - roll and the user can also “translate”: Moving up and down along the Y axis - heaving Moving forwards and backwards along the X axis - surging Moving left and right along the Z axis - swaying This means that the user’s movements will be reflected in the virtual world, not only if they move their head around, but also if they walk, jump or move to the side. 6DoF headset example: Microsoft HoloLens 2 13