Multimedia Final Notes PDF

# Chapter 1: Multimedia **Definition:** Multimedia is any combination of text, art, sound, animation and video delivered through a computer or any other electronic devices. - Contemporary multimedia is the development, integration, and delivery of any combination of text, graphics, animation, sound...

# Chapter 1: Multimedia **Definition:** Multimedia is any combination of text, art, sound, animation and video delivered through a computer or any other electronic devices. - Contemporary multimedia is the development, integration, and delivery of any combination of text, graphics, animation, sound, or video through a digital processing device. - Interactive Digital Media is a computer-driven experience that facilitates an interaction between the device and a user. **Elements of Multimedia:** Text, sound, animation, graphic, and video **Forms of multimedia:** *(i) Non-interactive:* User has no control over the flow of information. *(ii) Interactive:* User participates in the flow of information. * **Basic Interactivity**: Includes menu and button options to access content. * **Adaptive and Intellimedia**: Adapts the information flow to the needs or interests of the users. * **Immersive**: Draws users into an alternate world. # History **Vannevar Bush:** - *Memex I*: Massive storage capacity. Automatic mathematical calculations and logical reasoning. - *Memex II*: Extended the original proposals of Memex I by considering new technical developments. **Alan Turing:** - *Turing Machine:* Carry out a specific set of instructions, or an "effective procedure" - *Universal:* Can accept a description of a single purpose machine and imitate it's behaviour. **Douglas Engelbart:** Proposed practical applications of computers beyond the normal mathematical and sorting functions. Developed innovations for human-computer interactivity in the NLS (Mouse, Email, Multiple screen areas for text editing) **Theodore Nelson:** - Coined terms hypertext and hypermedia. - Initiated Xanadu Project: A dynamic, expanding, hypertext library available for everyone. **Alan Kay:** Proposed a computer design that supported the ways people perceive, learn, and create: - *Dynabook*: Designed as a personal computer. - Introduced Graphical User Interface as an intuitive interface for the Dynabook. **Steve Jobs:** - *Macintosh computer:* Graphical desktop and Icons provide user interface. - First mass produced computer with built-in sound support. **Tim Berners-Lee:** Developed a decentralized information system of "nodes" linked together for easy access across a network. # Chapter 2: Multimedia Element: Text ## Tutorial 2: Multimedia Element: Text 1. What are the two main font technologies? Explain both. 2. What is hypertext? 3. What are the main text properties derived from the print industry? 4. What is one benefit and one limitation of OCR text input? 5. What is one benefit and one limitation of graphics text? 6. When should a person save a file created in word as an RTF file? 7. What are two advantages of XHTML? 8. What is the main distinction between ASCII and RTF text files? 9. What is the process of anti-aliasing? 10. Define the two principal uses of combining text and speech. ## Text *(1) Bitmapped fonts:* Dot-matrix layouts of letters - *Outline fonts:* Geometric designs for how a letter looks *(2) Hypertext:* Is a linked text. *(3) Typeface & font* - *Size* - *Weight* - *Leading* - *Kerning* - *Alignment* - *Color* - *Tracking* - OCR is very efficient; it allows quick conversion of printed or handwritten text into digital formats. - OCR has accuracy issues; it may struggle on low quality images. - Benefit: Solves problem of installed fonts - Limitation: It is not editable and non-searchable - RTF file is used for cross-platform compatibility. - XHTML improves page display on mobile and supports more powerful data manipulation. - The formatting of ASCII contains only plain text and RTF has rich text formatting. - Anti-aliasing creates a smooth edge by blending the color of the text with the color of the background. *(0) Speech recognition:* Software that converts human speech into editable text *(0) Speech synthesis:* Software analyzes text and reproduces it as spoken words. ## Guidelines: - Be selective - Be brief - Be consistent - Be careful - Be respectful # Chapter 3: Graphics **Graphic file formats:** - PICT, BMP, TIFF, JPEG, GIF, PNG **Image sources:** - *Paint Programs:* Specialized software for creating bitmapped - *Digital Cameras:* Number of pixels sampled by the camera is the camera's spatial resolution - *Scanner:* Capture 3D objects, existing or original art image - *Clip art:* Royalty free - *Screen grab:* Save image on monitor to a bitmapped file. **Advantages:** - Convey information more quickly than using text - Make complex information simple - Enhance online teaching and learning - Enhance communication with some disable groups **Challenges:** - Large file sizes - Slow downloads and processing - Possible inferior quality from original - File format compatibility - Use plug-ins that user cannot install - Images display may be different across various monitor. ## 2D vs 3D **2D:** - Simple to create and process - Smaller file size - Less processing power - Example: charts, diagram, illustrations **3D:** - Requires expertise - Large file sizes - More processing power - Example: Animation, video games and virtual reality. ## 3D Method and Steps: **Step 1: Modeling** - Process of specifying the shape of the 3D object **Four types of Modeling:** * **Polygon:** Object is defined as a pattern of straight-edged polygons * **Spline:** Uses curves to create objects. Similar to 2D vector * **Metaball:** Creates objects as a combination of elements called blobs. * **Formula:** Creates objects by using mathematical formulas **Step 2: Surface Definition:** Where textures are applied to the model's surface. **Step 3: Scene Composition:** Objects are arranged, backgrounds introduced, environmental effects added, and lighting established. **Step 4: Rendering:** Computer creates the scenes specified by the artist. # Chapter 4: Sound **Definition:** Sound is a form of mechanical energy. **Feature of sound:** - *Amplitude*: Perceived as volume - *Frequency*: Perceived as pitch - *Duration*: Length of time sound lasts. **Sample vs Synthesized** **Advantages:** | Sampled | Synthesized | |---|---| | 1) High Quality | 1) Exceptional editing control | | 2) Ease of creation | 2) Small file size | | 3) Ease of editing | | | 4) Consistent playback quality | | **Challenges:** | Sampled | Synthesized | |---|---| | 1) Large file size | 1) Musical expertise required | | 2) Editing limitation | 2) Playback quality is not consistent | | | 3) Not effective for natural sound and human voice | **File formats:** * **AIFF:** Apple computer - Uncompressed, high quality sound * **WAV:** Microsoft and IBM standards - Uncompressed, high quality sound * **AU:** Sun Microsystems - Internet transmission of lower quality sound files * **Real Audio:** Real Media - Streaming audio at low bandwidths. * **MP3:** (MPEG-1, audio layer 3) - Significant compression of high quality sound. * **WMA:** Windows Media Audio - Delivery lossy compression comparable to MP3 at lower bitrates. **Calculation:** *Stereo = sample rate (Hz) \* sample size (in bytes) \* sample time (in sec) \* 2* *Monophonic = sample rate (Hz) \* sample size (in bytes) \* sample time (in sec) \* 1* # Chapter 5: Animation ## Animation Basic: - Animation: rapidly displayed sequence of individual, still image - It is a series of graphics that create an illusion of motion - Made possible by 'persistence of vision' - Images formed on the retina persist for a short period of time after stimulus has disappeared. ## Early Animation devices: - *Thaumatrope:* With persistence of Vision; when spun the image appears as one creating an "optical illusion" - *Zoetrope:* Device that produces the illusion of motion by displaying several pictures in a cylinder container. ## The use of Animation: - To attract attention - To inform about the state of process - Demonstrations - Interactive Simulations ## Traditional Animations: - *Film based process:* Images are photographed and recorded as separate frames. - On long strip of transparent film. - Film passed in front of light source and animation appeared on screen. - *Film enhanced possibilities of animation:* - Multiple reels allowed longer animations - Projectors displayed images at reliable frame rates - Animators could add sound to the motion. - *Flipbook technique:* - Still images showing different stages of motion are created on each page. - Page are 'flipped' in rapid succession to view the motion - *Animation basics for flipbook technique:* - Quality of motion is based on rate of display - Speed is based on differences between images - Onion skinning: a technique used to draw new image based on the previous image. - Registration: physically aligns images with one another. ## Animation Software: - *Timeline:* Horizontal row of frames - *Frames:* Have multiple layers in columns - *Key frames:* Define major changes in a frame. - *Tweens:* Frames created automatically by software - *Onion skinning:* Assists in drawing changes from on frame to the next. - *Frame by frame animation:* Each frame is manually drawn to reflect motion sequence. - *Tween animation:* Computer generates in between frames based on two designated key frames. - *Provide tools to support animation process:* - Image-editing tools - Alignment tools and grids to control placement - Text tools - Basic Sound Control - Strategies to support interactivity # Chapter 6: Video ## The factors that effect video quality: - *Screen resolution:* Number of horizontal and vertical pixels used to present the video image. - *Frame rate:* Number of individual video frames displayed per second. - *Compression method:* Algorithm used to compress and decompress the video. ## Common video codec: * **MPEG:** - *MPEG-1:* (short video on CD) - *MPEG-4:* (video over the web) * **M-JPEG:** (less-compressed higher quality files without inter-frame loss) * **Real Video:** (propriety codec for streaming video on web) * **Flash Video:** (popular internet video standard.) * **QuickTime:** (cross-platform format) * **Windows Media Video:** (highly compressed streaming video format) * **SDTV:** (digital format that uses roughly same resolution as analog TV) * **HDTV:** (uses 16:9 aspect ratio and progressing scanning) * **AVCHD:** (a variant of MPEG-4 compression recording at 1080i, 1080p, or 720p) * **Motion JPEG 2000:** (produces smaller files at higher quality, uses intra-frame compression, visually lossless, lossy or mathematically lossless compression) ## The use of Video: - The embedding of video in multimedia applications is a powerful way to convey information which can incorporate a personal element which other media lack. - Promoting television shows, films, or other non-computer media that traditionally have used trailers in their advertising. - Giving user an impression of a speaker's personality. ## Advantages ... # Chapter 7: Methods of Integrate Media **Methods of integrate Media:** - **Programming:** Languages specify how the media is presented and user interactions carried out. - Requires command of the language. - Is time consuming. - **Authoring:** Applications specially designed to integrate and present media elements. - Developers can concentrate on design, interactivity, and functionality of the project. **Metaphors:** - **Authoring Metaphors:** Authoring applications are grouped around three metaphors: - *Card* - *Icon* - *Timeline* - Metaphors help orient developer to how the software organizes the media, sequences event, and presents final project. - **Card Metaphors:** Authoring systems wherein the elements are organized as pages of a book or a stack of cards. - Cards have two layers: - *Background layer* contains shared elements. - *Foreground layer* contains content specific to that card or slide. - Benefits of card layers: - Background content is created once which saves development time. - Common background layer provides consistent design. - File sizes are minimized by sharing background elements - **Icon Metaphors:** Authoring systems, wherein multimedia elements and interaction cues (events) are organized as objects in a structural framework or process. - Icons define media and forms of interactivity. - These icons can include menu choices, graphic images, sounds, and computations. - Icons are placed on a flowline to create the application structure. - Flowline is a graphical representation of the relationships between components of the application. **Team:** - **Project Manager:** Responsible for delivering the product with promised features, on time, and on budget. - Oversees the business aspects of the development process. - Must be organized, focused, and task oriented. - **Writers:** Also known as content writers - Create original text the project. - Provide written requirements of the project such as documentation, contracts, help screens **Techniques to deliver projects:** - **Remote delivery:** Store application and data on a server for access through a network. - **Local installation:** Application is installed and maintained on user's device.