Multimedia Communication Slides - Introduction

Multimedia Communication (SW-416) INTRODUCTION 1 Multimedia Communication (SW-416) Course Learning Outcomes: Upon successful completion of this course, the student will be able to: CLOs Description Taxonomy PLO...

Multimedia Communication (SW-416) INTRODUCTION 1 Multimedia Communication (SW-416) Course Learning Outcomes: Upon successful completion of this course, the student will be able to: CLOs Description Taxonomy PLO level 1 Explain multimedia systems which C3 1 incorporate digital audio, graphics and video, pictures, integration of media, multimedia authoring, and delivery of multimedia. 2 Discover techniques for data C4 2 compression and transmission, audio and video compression, 3D modeling, and animation in multimedia. 2 Course Outline: Introduction to Multimedia ◦ Multimedia (MM) applications and requirements, Overview of MM systems, Characteristics, Challenges and Components of MM system, Overview of MM software tools, MM Authoring tools, their types and features, Organizing MM team. Text ◦ Typeface and Font, HyperText, and Font Editing and Design Tools. Images ◦ Bitmap and Vector graphics, Image file formats, Digitizing Real world Images, Image Processing software, Color models, and Using Light sources and perspective. 3 Course Outline: Video ◦ Analogue Video and its standards (PAL, SECAM, NTSC), Digital Video and its standards (AVI, MPEG, QUICKTIME, MOV). Animation ◦ Animation techniques, file formats and animation process, 3D drawing, modeling and surface rendering and its methods. Audio and Video Compression ◦ Audio and video compression (e.g., JPEG, MPEG, H.26X, etc.), scalable coding, perceptual audio encoders. Performance comparison of coding algorithms, Algorithms for image and video processing. 4 Recommended Books: Jeff Burger, “The Desktop Multimedia Bible”, Addison Wesley Publishing Company, Latest Edition. Vaughan, “Multimedia Making It work”, Osborne Mc Graw Hill, Latest Edition. Fred Halsall, "Multimedia Communications: Applications, Networks, Protocols, and Standards", Latest Edition. 5 MultimediaMulti - Media Multi: more than one Media: means for conveying information Media in the press: newspaper, radio and TV context - mass media Media in communications: cables, satellite, network – transmission media Media in computer storage: floppy, CD, DVD, HD, USB – storage media Media in HCI context: text, image, audio, video, CG – interaction media 6 Introduction to Multimedia Generally, multimedia is the presentation (usually by computer) of information through many forms of media. Media, such as pictures, sound effects, music, animation, video are organized and directed by a program to produce a specific experience for the user. Multimedia is the field concerned with the computer- controlled integration of text, graphics, drawings, still and moving images (video), animation, audio, and any other media where every type of information can be represented, stored, transmitted, and processed digitally. 7 Multimedia Categorization Linear: Active content progresses without any navigational control for the viewer. A cinema presentation or a live video feed can be considered linear multimedia because the viewer has no ability to speed up or slow down the presentation or skip to different segments. E.g. Live cricket or football matches. Nonlinear: Interactive multimedia combine the same technologies as linear ones, but with a twist. The viewer is hands-on controlling what is viewed. Multimedia ceases to be classified as linear when any interactive elements are introduced. ◦ The ability to skip to different chapters in a DVD, rewind or fast-forward in a video, move a character in a game, or navigate to different sections of a website. 8 Basic Elements of Multimedia Text (including hypertext) With multimedia technology, the reliance on textual information is complemented by sounds and pictures that enhance understanding and retention. In addition, hypertext enhances the meaning of the written word. Hypertext is where a word, or phrase in a section of text, can be referenced to another related topic when the user clicks on the word with his or her mouse; the computer then displays the linked reference. 9 Basic Elements of Multimedia Graphics (Pictures / Images) A digital representation of non-text information, such as a drawing, chart, or photograph. Images are an important component of any multimedia product. They are commonly used to represent visual controls, graphical buttons, statistical findings, photographs and so on. 10 Evolution of the Concept Pre-Industrial Age: Clay Woodblock Tablets Printing Industrial Age Newspaper: start of communication with media ◦ perhaps the first mass communication medium: uses text, graphics, and images. Basic Elements of Multimedia Animation Animation is created by moving and changing a sequence of pictures or objects on cue. It is achieved by changing an image slightly, one frame at a time, in a timed sequence to give the illusion of movement. 12 13 Basic Elements of Multimedia Animation Flip-Book Clay Animation Animation 14 Basic Elements of Multimedia Sound and Music files Sound files are a digital recording of an actual sound whether that sound be an event, such as a door closing, or music, such as a symphony playing. Recorded Audio - Audio Interchange File Format (AIFF) is an audio file format standard used for storing sound data for personal computers and other electronic audio devices most commonly used on Apple Mac systems. WAVE or WAV (Waveform Audio File Format), also named Audio for Windows, is a MS and IBM audio file format standard for storing an audio bit stream on PCs. Main format used for raw and typically uncompressed audio. In contrast, a digital music file (also known as a MIDI file, from Musical Instrument Digital Interface) is not an actual recording of a live sound. A MIDI file is a composed sequence of data that is interpreted by the computer's sound synthesizer and translated into actual sound. This file format lets users exchange music and data without regard to computer operating system platform. Today, there 15 Basic Elements of Multimedia Video files Digital video files (commonly called AVI or QuickTime files) store moving picture information in a format that can be played back on the computer screen. Photographic images are played back at speeds of 15 to 30 frames per second and provide the appearance of full motion. 16 Evolution of the Concept Radio - Guglielmo Marconi (Italy) TV - The innovative media in 20th century Changed the pubic communication all over the world Film without sound: ◦Thomas A. Edison invented the moving camera in 1887 ◦The art of motion pictures grew into full maturity in the "silent era" (1894 in film – 1929 in film). ◦The height of the silent era (from the early 1910s in film to the late 1920s) The Jazz Singer ◦ Jazz Singer (Music film), the first film with sound - 1927 Evolution of the Concept 1945: Memex (hypermedia system) from Vannevar Bush 1989: Tim Berners-Lee proposed the World Wide Web (WWW) 1990: Hypertext Markup language (HTML) was invented 1991: MPEG-1 was approved 1992: JPEG was approved 1992: WWW became publicly available 1994: Netscape (first browser) program was created Basic Elements of Multimedia Virtual Reality An artificial environment created with computer hardware and software and presented to the user in such a way that it appears and feels like a real environment. A computer-based technology for simulating visual, auditory, and other sensory aspects of complex environments. Virtual Reality Modeling Language (VRML) technology provides the user with the capability to browse and fly through three- dimensional space models on the Internet. Virtual reality systems require extremely expensive hardware and software and are confined mostly to research laboratories 19 Basic Elements of Multimedia Haptics Haptics is the science of applying touch sensation and control to interaction with computer applications. Haptics technology can be used to train people for tasks requiring hand-eye coordination, such as surgery and space ship maneuvers. Users can receive feedback from computer applications in the form of felt sensations in the hand or other parts of the body. An input/ouput device can be used to sense the body’s movements such as joy stick or data glove. 20 21 Usage of Multimedia Examples of use of multimedia: ◦ Advertisements ◦ Art and Entertainment ◦ Video teleconferencing ◦ Education (Distributed lectures for higher education) ◦ Medicine (Tele-medicine) ◦ Business (Co-operative work environment) ◦ Scientific Research ◦ Searching in large video and image databases (e.g. YouTube) 22 Advantages of Using Multimedia User-Friendly ◦ It doesn’t take much energy out of the user, in the sense that you can sit and watch the presentation, you can read the text and hear the audio. Multi Sensorial ◦ It uses a lot of the user’s senses while making use of multimedia, for example hearing, seeing and talking Integrated and Interactive ◦ All the different mediums are integrated through the digitization process(text, audio, video). ◦ Interactivity is heightened by the possibility of easy feedback. Flexible ◦ Being digital, this media can easily be changed to fit different situations and 23 audiences. Disadvantages of Using Multimedia Information overload ◦ Because it is so easy to use, it can contain too much information at once. Can be Expensive ◦ Multimedia makes use of a wide range of resources, which can cost you a large amount of money. Takes time to Compile ◦ Even though it is flexible, it takes time to put the original draft together. Too much makes it Unpractical ◦ Large files like video and audio has an effect of the time it takes for your presentation to load. Adding too much can mean that you have to use a larger computer to store the files. 24 Multimedia System A system capable of processing multimedia data and applications. A Multimedia System is characterized by the generation, storage, processing, manipulation and rendition of Multimedia information. 25 Characteristics of a Multimedia System In terms of computing, four fundamental multimedia attributes: Digitized: ◦ All media including audio/video are represented in digital format. Distributed: ◦ The information conveyed is remote, either pre-produced and stored or produced in real- time and distributed over networks. Integrated: ◦ The media are treated in a uniform way, presented in an orchestrated way, but are possible to manipulate independently. Interactive: The interface to the final presentation of media is usually interactive ◦ It is possible to affect the information received, and send your own information, in a non- trivial way beyond start, stop, fast forward. 26 Challenges for Multimedia Systems There are two form of problems: 1.Sequencing within the media - playing frames in correct order/time frame in video 2.Synchronization - inter-media scheduling (e.g. Video and Audio). ◦ Lip synchronization is clearly important for humans to watch playback of video and audio and even animation and audio. The key issues multimedia systems need to deal with are: How to represent and store temporal information? How to strictly maintain the temporal relationships on play back/retrieval? 27 Components of Multimedia Systems Capturing device: ◦ Video Camera, Video Recorder, Audio Microphone, Keyboards, Mouse, Graphic tablets, 3D input devices, Tactile sensors, VR devices, touch pen. Storage device: ◦ Hard disks, CD-ROMs, Jaz/Zip drives, DVD, etc Communication Networks ◦ Ethernet, Token Ring, FDDI, ATM, Intranets, Internets. Computer Systems ◦ Multimedia Desktop machines, Workstations, MPEG/VIDEO/DSP Hardware Display Devices 28 Multimedia Production Team A Multimedia team consists of people with various capabilities. Individual members of multimedia team can perform various tasks. To create a good multimedia project/presentation, diverse range of skills are required with detailed knowledge of computers, text, graphics arts, sound and video. Depending upon the scope and content of project, the team may employ mix of people, e.g. animators, composers, musicians, special effect engineers, researchers and others. Successful multimedia projects begin with selecting team players. 29 Multimedia Production Team Project Manager / Producer Multimedia Designer Subject Matter Expert Script Writer Audio And Video Specialist Programmer / Author Computer Graphic Artist WebMaster 30 Multimedia Production Team Project Manager / Producer: At the center of the action. This will likely include working with and managing a team of people who specialize in certain areas of media production. Responsible for overall development, implementation and day to day operations. Plays an important role in each of the three phases in the production process: preproduction, production and postproduction. Manages budges, time sheets, invoices, schedules. Must understand the strengths and limitations of hardware/software to make timely 31 Multimedia Production Team Multimedia Designer: The look and feel of a multimedia project should always be pleasing and aesthetic as well as engaging and inviting. Screens should present an appealing look of color, shape and elegance. The project should contain visual consistency. Navigation should be clear, icons should be meaningful and straight forward. The design should be sensitive to the needs of the general population using the project. Management of all this and more comprises the responsibilities of the multimedia designer. 32 Multimedia Production Team Multimedia Designer: Multimedia Designers work in a creative group that provides the clients with the multimedia content they need. The main responsibility of a Multimedia Designer is to design; that is, to produce sketches, scale models, plans, and drawings of the multimedia content to be developed. These plans and sketches will be checked by the creative director or by the producers for any inconsistencies or for production feasibility. Multimedia Designers are the ones in charge on the overall feel of the multimedia content. They can design the props, the set, and decide on the costumes that will best compliment the design. Responsible to make pleasant look and feel of multimedia project. They need to maintain the visual consistency and support the overall message of the program. 33 Multimedia Production Team Subject Matter Expert: This term is used to describe professionals with expertise in the field of application but usually without technical project knowledge. 34 Multimedia Production Team Script Writer: Multimedia writers do everything writers of Linear Media do. They create characters, action, point of views and they create interactivity. They write proposals, they script voice-overs and action sequences and narrations. They write text screens to deliver messages. Writers of text screens are often referred to as content writers. Create character, action, point of view and interactivity. Develop characters designed for an interactive environment Collect information, synthesize it and communicate it in concise manner Are different from writing a film or video script because multimedia stories can go in many different ways Must be familiar with interactive design and user interface issues Ability to work under tight deadlines in a team environment is essential 35 Multimedia Production Team Audio Specialist: The quality of audio elements can make or break a multimedia project. Audio Specialists are the wizards who make a multimedia project come alive, by designing and producing music, voice over narrations and sound effects. They are also responsible for recording, digitizing and editing sound. Adding sound effects and background music transitions. 36 Multimedia Production Team Video Specialist: The video specialist digitizes video along with adding and editing video effects and transitions. Shooting quality video, integrating scenes and action sequences and efficient delivery on CD, DVD or on web is also the responsibility of the video specialist. Must be skilled in managing all phases of production, from concept to final edit Must have strong background in video direction and editing Good understanding of interactive programming is required and how it will affect the video 37 Multimedia Production Team Computer Graphics Artist: Graphic design is a collaborative process between a client and a designer in conjunction with producers of form to convey a specific message to a targeted audience. The graphic artist develops the Graphic Elements of the program such as backgrounds, buttons, photo collages, 3D objects, logos and animation. 38 Multimedia Production Team Multimedia Programmer: A multimedia programmer or a software engineer integrates all the multimedia elements into of a project into a seamless whole using an authoring system or a programming language. Their function ranges from coding simple displays of multimedia elements to managing complex timings, transitions and record keeping Integrates all the MM elements of a project using programming language Promotes the ability to quickly learn and understand systems Must have working familiarity with digital media, digital video Must function well in team oriented environments 39 Multimedia Production Team Webmaster: Creates and maintain the web site. Integrates the multimedia elements into a web page and handles enquiries and feedback. A webmaster can keep tabs on everything related to a website. They monitor its performance with search engines, functionality, speed and design. Webmasters even keep track of content, campaigns and marketing efforts. 40