Chapter 5 - AR.pdf

Outline Overview of AR AR, VR and MR Architecture of AR Systems Challenges of AR Applications of AR What is Augmented Reality? Its fundamental idea is to combine, mix or integrate the view of the real environment with virtual content that is presented through computer graphics,...

Outline Overview of AR AR, VR and MR Architecture of AR Systems Challenges of AR Applications of AR What is Augmented Reality? Its fundamental idea is to combine, mix or integrate the view of the real environment with virtual content that is presented through computer graphics, achieved by ensuring that the virtual content is aligned and registered with the real objects. yAllows users to overlay computer -generated content in the real world yTypically done in real-time and in semantic context with environmental elements. yThrough augmented vision, a user can digitally interact with and adjust information about their surrounding environment. AASTU,ECE, 2021 2 AR, VR and MR By the help of computer vision and power of processor development we have three types of reality; ƒVirtual reality (VR), ƒAugmented reality (AR) ƒMixed reality (MR) Extended reality (XR) is a universal term inclusive of all real-and-virtual combined environments and human -machine interactions generated by computer technology and wearables, such as virtual reality (VR), augmented reality (AR), and mixed reality (MR). AASTU,ECE, 2021 3 Virtual Reality (VR) ƒVR is fully immersive, which tricks your senses into thinking \RX·UHL different environment or world apart from the real world ƒIt is called a computer -simulated reality ƒUsing a head-mounted display (HMD) or headset, \RX·OOH[SHULHQFHDFRPSXWHU -generated world of imagery and sounds ƒComputer technologies using reality headsets to generate realistic sounds, images and other sensations that replicate a real environment or create an imaginary world. ƒYou can manipulate objects and move around using haptic controllers while tethered to a console or PC. AASTU,ECE, 2021 4 Virtual Reality (VR) … Advanced VR environment will engage all five senses(taste, sight, smell, touch, sound), but it is not always possible. 9 Provide freedom of movement ²users can move in a digital environment and hear sounds. 9 Special hand controllers can be used to enhance VR experiences. yExample of VR tools 9 HTC Vive , Oculus Rift, gaming console (PlayStation VR) -- connectedto computer 9 Google Cardboard ² stand alone and work in combinationwith smartphones AASTU,ECE, 2021 5 Augmented Reality yUsers can seeand interact with the real world while digital content is added to it 9 adds digital elements to a live view often by using the camera on a smartphone yDirect or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics or GPSdata Examples 9 Google Glass : digital content is displayed on a tiny screen in front of a XVHU·Veye. 9 Snapchatlenses 9 game Pokemon Go AASTU,ECE, 2021 6 Mixed Reality (MR) ƒSometimes referred to as hybrid reality ƒMerging of real and virtual worlds to produce new environments and visualizations where physical & digital objects co -exist & interact in real -time ƒplay a virtual video game, grab your real -world water bottle, and smack an imaginary character from the game with the bottle Mixed reality hardware LVVWLOOHPHUJLQJDQGKDV mainstream consumer market, most likely due to the price AASTU,ECE, 2021 7 Mixed Reality (MR) … yThe middle of AR and Augmented Virtuality (AV) y AR-adds virtual contents to the Real Environment y AV -adds real content to a predominantly virtual environment Provides the ability to have one foot (or hand) in the real world, & the other in an imaginary place, Breaking down basic concepts between real & imaginary AASTU,ECE, Paul Milgram's 2021 Reality-Virtuality (RV) Continuum 8 AR vs VR vs MR ‡Overlay digital content on top of the real -world AR ‡Fully digital ‡Fully immersive VR ‡require specialized VR headsets, noise-canceling headphones, cameras, and sometimes even motion capture technology. ‡Digital overlay that allows interactive virtual elements to integrate and interact with the real -world MR ‡Microsoft HoloLens and Magic Leap One : a bit expensive AASTU,ECE, 2021 9 Architecture of AR Systems The Infrastructure Tracker Unit Processor unit mixes was responsible for collecting data the virtual content from the real world, sending them to with the real content the Processing Unit and send the result to the Video Out module of the Visual Unit Visual Unit can be classified into two types of system Video see-through : HMD for video mix and display: closed view Optical see-through: HMD employ optical combiner : open view AASTU,ECE, 2021 10 AR Challenges HMDs (Head Mounted Displays) are currently the dominant display technology in the AR field. However, they lack in several aspects, such as ergonomics, high prices and relatively low mobility due to their sizes and connectivity features. Collision : difficulty to interact with multiple points in different depths causes collisions between interactive zones. Alternative approaches to developing ARS involve the use of monitors and tablets. Though Collison problems still are not solved AASTU,ECE, 2021 11 Applications of AR Systems ƒAR can be applied to many different disciplines such as X Education X Medical X Entertainment X Engineering Design X Manufacturing, X Maintenance, and Repair X Collaborative AR AASTU,ECE, 2021 12 Applications of AR: Education ƒIt allows flexibility and attractive by extend content into the world outside the classroom ƒAffordable learning materials : low cost ƒInteractive lessons: try to model ƒHigher engagement :activate, improve attention ƒHigher retention: use different senses ƒBoost intellectual curiosity : excited and innovative AASTU,ECE, 2021 13 Applications of AR: Education… Driving Simulators. Ship Simulators. Flight Simulators. Tank Simulators. AASTU,ECE, 2021 14 Applications of AR: Medicine Enhancing medicine and healthcare towards more safety and efficiency Practice Performing Surgery. Perform surgery on a remote patient. Teach new skills in a safe, and controlled environment. Ultrasound, CT (Computed Tomography) and/or MRI (Magnetic Resonance Imaging) scans provide the surgeon with the necessary view of the internal anatomy AR tools may also aid to detect the signs of depression and other mental illnesses by reading from facial expressions, voice tones, and physical gestures A 3D Virtual Reality Model of AASTU,ECE, 2021 Unborn Baby 15 Applications of AR: Medicine… ƒDescribing symptoms: accurate diagnosis ƒNursing care: successful finding of the vein (Accuvien) ƒSurgery: Three-dimensional reconstructions of organs (Agumedics ) ƒDiabetes Management : real-time tracking of blood sugar levels ƒNavigation: the nearest hospitals ϯƵůƚƌĂƐŽƵŶĚƐĐĂŶŝƐƌĞŐŝƐƚĞƌĞĚǁŝƚŚĂƉƌĞŐŶĂŶƚǁŽŵĂŶ͛ƐďŽĚLJ- Looking into the Inner part of the body AASTU,ECE, 2021 16 Applications of AR: Entertainment ƒAR can be used in music, movies, live shows, games ƒAR in games: for increasing physical activity ƒAR in music : providing complete information on the track or its performer ƒAR on TV: adding supplementary information ƒAR in eSports : online gaming ƒAR in the theater : accessibility (eg. Subtitles ) AASTU,ECE, 2021 17 Applications of AR: Entertainment a. Games using a virtual table and synthetic objects b. Advertisement in a Football game More vivid Move exciting More attractive AASTU,ECE, 2021 18 Applications of AR Engineering Design y3D prototyping of Engineering Design yDesign augmented with a computer-generated image of the current design built from the CAD files describing it Manufacturing, Maintenance, and Repair ƒ The image of the equipment would be augmented with annotations and information pertinent to the repair. 9 Makes much easier than consulting a lot of repair manuals ƒ Boing made an experimental system , where the technicians are guided by the augmented display that shows the routing of the cables on a generic frame used for all harnesses AASTU,ECE, 2021 19 Collaborative AR AR addresses two major issues with collaboration: seamless integration with existing tools and practices, and enhancing practice by supporting remote and co-located activities that would otherwise be impossible E.g. Collaborative AR systems using see-through displays include both those that use see-through handheld displays and see-through head-worn displays. AASTU,ECE, 2021 20 Additional Links: Johny (QJOLVK·V95 Schene: https:// www.youtube.com/watch?v=psWfx1i6BlY Short video describing VR, AR, & MR https:// www.youtube.com/watch?v=XLP4YTpUpBI A glimpse of Facebook's Metaverse: https:// www.youtube.com/watch?v=SAL2JZxpoGY AASTU,ECE, 2021 21