MMC Reviewer (Midterms) PDF

Monomodal means having a single mode or property. Here are some examples: Texts: A text that has a single mode of interpretation is monomodal. For example, a poem or novel is monomodal. Paintings: are often monomodal, using the same medium and support, such as canvas and oi...

Monomodal means having a single mode or property. Here are some examples: Texts: A text that has a single mode of interpretation is monomodal. For example, a poem or novel is monomodal. Paintings: are often monomodal, using the same medium and support, such as canvas and oils. Communication: A monomodal view of communication is one that only uses language Segmental Focuses on individual sounds, or phonemes, like vowels and consonants. These sounds are the building blocks of syllables and are central to conveying word meanings. Suprasegmental Focuses on larger chunks of speech, like words or phrases, that extend over multiple segments. Suprasegmental features, also known as prosody, include intonation, stress, rhythm, pitch, and length. Lesson 1: THE MEANING OF MULTIMODAL COMMUNICATION AND ITS IMPORTANCE Multimodal Communication ○ Refers to the use of multiple modes or channels to convey information and meaning. Examples: Conversation (Verbal + Non-verbal) Presentations (Visual + Audio + Text) Advertising (Text + Visuals + Sound) Social Media Posts (Text + Images + Emojis Education (Multimedia Learning) such as textbooks, videos, diagrams, and spoken explanations How do we utilize multimodal communication? Digital Platforms - YouTube, Google meet, zoom, etc. Visual Communication - Images, posters, etc. Audio Communication - music, spoken words Accessibility Features - text-to-speech, closed captioning, text enlargement Tools and Softwares - Microsoft, chrome When and where do we use Multimodal Communication? Educational settings Business and Professional Environments Marketing and Advertising Healthcare and Medical Communication Entertainment and Media Customer Service Public Spaces Socail Media Platforms Accessible Communication Why do we need to be knowledgeable about Multimodal Communication? Multimodal communication is necessary because; It is relevant to researchers from a wide range of social science disciplines. Words alone are not enough to convey one's thoughts clearly. It makes the communication ]quicker and easier to comprehend. According to Swiss Linguist Ferdinand de Saussure Semiotics or meaning making system is the study of “the life of signs within a society”. Socially, what counts as mode is a matter for community and its social representational needs. What a community decides to regard and use as mode is mode.” (Kress, 2010, pg.87) The Importance of Multimodal Communication Enhanced Engagement Improved Comprehension Increased Accessibility Modern Relevance Practical Applications Education Business Healthcare Arts Entertainment Lesson 2: THE CHARACTERISTICS OF MULTIMODAL TEXT AND THE IMPORTANCE OF STUDYING MMT The role of Multimodal Text in an Era of Pandemic Multimodal text have emerged as a key tool in this transformation, combining visuals, language, audio, and interactive elements to bridge the gap between isolation and connection. Multimodal text Is oftern a digital text but can be a book, such as picture book, information text or graphic text Are communications that use more than one semiotic system, or mode to convey a message. Characteristics of Multimodal Text 1. Multiple Modes of Communication 2. Interactive Design 3. Complex Layering of Meaning 4. Digital or Physical Formats 5. Audience-Centered Mode vs. Medium Mode is the method or form of communication used to convey a message, such as text, image, audio, or gestures. Examples: YouTube video, music (aural), spoken language (linguistic), pictures (visual) all work together to communicate the message. Medium is a channel or platform through which the content is delivered, such as books, websites, apps, or videos. Media and Its Meaning Media is a plural word of medium which means a tool or channel used to store,transmit, and deliver information or data.  Examples: Television, books, magazines, radio, newspapers, internet Mass media vs. Local media Mass media refers to the news and information that reaches a large number of people. (Ex. public websites) Local media, serves the needs of the communities or urban areas in which they are located. (Ex. newspapers, regional television, radio stations) Basic functions of Mass Media Informative (ex. news) Educational (ex. Academic books) Entertaining (ex. sports, arts, showbiz) Advertising (ex. posters, videos) Modes of Multimodal Text Linguistic - refers to any sort of written and spoken text. ○ This includes word choice, grammar, vocabulary, and delivery. (Ex. captions, subtitles) Visual - refers to images or characters, such as marks, signs and symbols. ○ This includes aspects of visual design such as colours (emotion), layout, font (readability), front type and font size (emphasis), symbols/images (representation), charts (data representation) Gestural - is about movement and how we interpret it. ○ This includes facial expressions, gesture, posture, body movements) Spatial - refers to the organization of elements in a space. ○ This includes position, physical arrangement, proximity, etc. Aural - the audio mode which focuses on sound. ○ This includes voice, music, silence, background noise. Mediums in Multimodal Text Examples of medium in multimodal texts: Text: Articles, captions, instructions Images: Infographics, Photographs, Visual aids Video: Educational videos, commercials Interactive media: websites, e-learning platforms Important of Multimodal Text Multimodal text;  provides real-life skills that can help prepare students for careers. are also important aspect of education today. can assist in improving the student's engagement in activities. Crucial for development of critical thinking and literacy skills Lesson 3: EXPRESSING AND DEVELOPING IDEAS THROUGH MULTIMODAL TEXTS Multimodal communication used various modes (e.g. text, audio, images, video, and gestures) to convey messages. By combining these forms, individuals can express their thoughts and ideas more effectively and allow a deeper engagement and a more dynamic expression. Examples: Clarity and Engagement Inclusivity Nuanced Expression Cross-cultural Communication Learning how to create a multimodal text The following are the steps in creating an effective multimodal texts: Acknowledging your audiences Using the right modes Testing and refining Working with Multimodal texts in Education Traditional vs. Modern Literacy - Traditional literacy views reading and writing as distinct skills primarily focused on text-based comprehension, in contrast, modern literacy involves interpreting meaning from various elements (text, images, diagram, videos) that communicate ideas together. The Expert-Novice Relationship - Experts, often teachers have extensive background knowledge and naturally fill in gaps or interpret ambiguition in texts. In contrast, novices (students) face challenges due to their limited experience, often misinterpreting contents. Curriculum Documents - Although multimodal literacy is not always explicitly mandated, several curricula globally are beginning to integrate it. Text Talk in Education - Engagement between teacher and students Model for working with multimodal texts in Education ○ General Structure - it discusses how to analyze a text's organization, themes and progression. ○ Interaction between text resources - teachers are encouraged to highlight these interactions as novices might miss nuanced meanings or find inconsistent representatios.  Confusing ○ Figurative Language - (e.g. metaphors) ○ Values (Explicit and Implicit) - every text contains implicit or explicit values that reflect biases and assumptions. Gunther Kress' Semiotic Approach Semiotic Approach ○ it is a way of analyzing language and communication using different combinations of modalities like linguistic, visual, auditory, gestures, etc. ○ Highlights the importance of understanding the context in which communication takes place. ○ Communication is shaped by social context and cultural needs. ○ Examples: music videos, language in fandom slang, video games Social Semiotics ○ The study of the signs that people make in order to communicate and of the sign makers and their motivation. ○ Example is the popular game “Charade” Lesson 4: MODES & MEANING Modes Modes are defined as abstract ways of organizing meaning making it allows us to convey three main types of meanings: ○ Ideational Meaning ○ Interpersonal Meaning ○ Textual Meaning Affordances and Constraints of Modes In the context of multimodality, Affordances refers to the unique possibilities and limitations that each mode of communication offers for making meaning. Semiotic Modes are resources used systematically for meaning-making, such as language, gesture, colors etc.) ○ They focused on the affordances and constraints of different modes I. Visual Affordances Intermediate Impact Universal Understanding Memory Retention  Complex Data Representation Constraints Interpretation Variability Detail Limitation Accessibility Issues II. Aural Affordances Emotional Expression Attention-Grabbing Constraints Language Barriers Retention Issues III. Spatial Affordances Contextual Understanding Navigation Aid Constraints Accessibility Issues Resources Intensive IV. Gestural Affordances Non-Verbal Communication Cultural Universality Constraints Cultural differences Ambiguity Physical limitations V. Linguistic Affordances Precision Contextual nuance Constraints Language Barriers Misinterpretation Modal Ensembles Refer to the integration of multiple modes such as visual, aural, textual, and gestural working together to enhance meaning and create a multi-dimensional experience through their interplay.  Examples: ○ User manual or instructions ○ Advertising ○ Educational content ○ News reporting Combining modes to enhance meaning, illustrating that single modes often need others to convey a fuller message. ○ Text can clarify ○ Visuals can capture attention ○ Sound can evoke emotional responses The Role of Technology in Mode Selection How Technology Advancements Affect Modes - through the development of digital technology, there have been various changes in delivery communication. Examples: ○ The Teacher I only teaches verbally without any visual aids while the Teacher 2 teaches using the PowerPoint presentation. How technical resources for multimodal communication vary from different societies and periods - The places with more advanced technologies make it easier for people since it can save time and it becomes efficient for them. Examples: ○ Chatbots and AI, use of video chat platforms, and tracking conversations in a business meeting Social and Cultural Influence on Modes Societal Norms Shaped Modes of Communication ○ Cultural expectations influence how we interpret text, visuals, gestures, etc. ○ Example: Formal language in academic settings vs. Informal language in social media Evolution of Media and Shifting Norms ○ Media changes (e.g., print to digital) affect the norms around how modes are used. ○ Example: Emojis now carry specific meanings that may differ by culture. Contextual Interpretation of Modes ○ Multimodal communication depends on context for understanding. ○ Example: Body language varies in meaning across cultures. (e.g., eye contact) Culture as Shaper of Meaning  ○ Different cultures may assign unique meanings to symbols or gestures. ○ Example: Thumbs up as positive in some places, offensive in others. Modes and Ideologies Modes to Power Relations and Power Dynamic - Kress advocates a dynamic view “socially what counts as mode is a matter for a community and its social-representational needs. ○ Power Relations ○ Power Dynamic Role of Technology Examples of Certain Groups and Its Preferred Modes Political Groups ○ Preferred Mode: Emotional Language ○ Example: “Tax relief” and “Tax cuts for the rich/Tax cut” Subcultures and Identity Groups ○ Preferred Mode: Cultural practice, language and symbols ○ Example: Pride flag/parade, rainbow “Queer” Dominant Modes: Powerful groups control communication modes (e.g., writing, media) influencing how meaning is constructed and how we understand the world. ○ Example: Access Information In short, Kress shows that those in power decide which ways of communicating can define what is considered “true”, “normal”, or “acceptable”. Kress's Idea about Interpreter Freedom Kress explains that in multimodal texts audiences have the freedom to interpret the message in their own way. ○ Example: Music video ○ One person might interpret it as romantic, while another might see it as a story of empowerment. Balancing Freedom with Structure in Communication How structured settings limit freedom ○ When is freedom limited? In a classroom setting, clarity is more important than freedom of interpretation. Communication is controlled to make sure everyone understands the message the same way. Example:  ○ Social lesson ○ Job instructions ○ Balancing Flexibility and Control: Creative settings (like art or media) Structural settings (like classrooms or workshops) Lesson: FIVE MODES OF COMMUNICATION The Combination Between Modes in Multimodal Communication Example of Linguistic and Visual Modes - words paired with images reinforce each other. Example of Aural and Visual Modes - sounds or music combined with visuals can create moods or emotional responses in the audience. Example of Gestural and Linguistic Modes - Body languages, facial expressions, and gestures support spoken language adding layers of meaning to the words. Example of Spatial and Visual Modes - The spatial arrangement of elements can emphasize certain aspects of the visuals and guide viewers focus. Example of All Modes Combined - when all five modes are combined, they can create a fully immersive experience that engages audiences on multiple levels. The Influence of Multimodality Multimodality refers to the use of synthesized modes to realize meaning-making, that is the use of modes (e.g., linguistic, aural, etc.) to convey messages, receive knowledge and produce learning outcomes. Lutkewitte (2014) refers to multimodal composition as composition using multiple modes that work purposely to create meaning. Multiliteracies is a term highly related to multimodal teaching and literacy development, which is the ability of the students to comprehend different forms of texts and create meaningful products of the language learning process. What does a multimodal class look like? Students in multimodal classes work on assignments that draw on multiple modes that might include words, images, graphics, animation, sounds or video. Teachers in the context of multimodality Teachers’ readiness with technology and the internet is important in e-learning, multimodal pedagogy, and multiliteracies pedagogy because they are all connected to new forms of message delivery and meaning-making. ○ Examples of e-learning platforms: Zoom, Google meet, Google Docs, Google Classroom, etc. Effects of Multimodality in a Classroom Enhanced Learning Engagement Inclusive Learning Development of Critical Thinking Skills Interactive Learning Environments Lesson 6: MULTIMODAL TEXT Types of Multimodal Text Print-based Multimodal Text - this is a printed text that is combined with different modes. ○ Examples: comic books and graphic novels, picture storybooks, posters and leaflets, magazines and newspapers. ○ Purpose: To make content engaging and easy to understand by appealing to both visuals and text. Digital Multimodal Text - this is a virtual text that is combined with different modes. ○ Examples: Film, animations, e-posters, digital stories, podcasts Live Multimodal Text - this is a text that is performed live. ○ Examples: theatre, opera performances, and concerts, book premieres, poetry readings, and lectures. Transmedia Multimodal Text - this is a multimodal text inside a multimodal text. This tells a story or sends a message through a combination of different media platforms. ○ Examples: Film (Harry Potter), Games (Pokemon Go), News (Manila Bulletin) Lesson 7: SIGN LANGUAGES AND WHISTLED LANGUAGES Modality & Multimodality ○ In social semiotics, grammatical modality refers to how a sign or text claims to represent something as true or real, while multimodality refers to using multiple modes to convey meaning. Sign Languages - any means of communication through bodily movements, especially of the hands and arms, used when spoken communication is impossible or not desirable. Myths about Sign Languages Myth #1: Not “real” languages ○ Sign languages have their own grammar structure and components similar to spoken languages.  ○ American Sign Language (ASL) utilizes five parameters: handshape, location, movement, palm orientation, and non-manual markers Myth #2: Primarily Iconic ○ While some signs are iconic, most have an arbitrary relationship to their meanings. Myth #3: Universally Shared ○ No single sign language is used by all deaf people, many exist worldwide. ○ Sign languages emerge naturally within communities and may reflect local spoken languages. Myth #4: Sign Languages Cannot Convey the Same Meaning as Spoken Languages ○ Sign languages possess equal complexity as spoken language. ○ Fingerspelling is utilized for words that look like a sign equivalent. Whistled Languages In some environments, such as rain forests, or mountainous regions with dense vegetation, the local language is converted into a whistled form of communication. Structures and Features of Whistled Linguistic Basis ○ Pitch (frequency): Represents vowel and tonal aspects of speech. ○ Duration and Rhythm: Reflect syllabic and prosodic patterns. ○ Intensity: May represent stress or emphasis. Types of Whistled Languages Tonal - often stripped of articulation, leaving only suprasegmental features such as duration and tone. Non-Tonal - more articulatory features of the speech retained. The Interaction of Sound and Meaning in Whistled Languages Vowel: typically conveyed through changes in pitch. Consonants: represented by variations of pitch, transitions, or interruption in the whistle. Sign vs. Whistled Languages MODALITY  Sign languages ○ A visual language that relies on hand movements, facial expressions, body language, and spatial positioning. ○ Communicated through gestures seen by the recipient. ○ Primarily developed to enable communication for individuals who are deaf or hard hearing. ○ Typically used in interpersonal, face-to-face communication. Whistled Languages ○ An auditory language that uses variation in pitch and tone of whistling to articulate words and phrases. ○ Communicated through sound heard by the recipient. Used to announce news, give directions, warnings, and social messages. ○ Developed challenges posed by geographical barriers, such as steep mountains and rugged terrain. ○ Practiced in outdoor settings, especially by communities working in agriculture or similar profession. Cultural and Social Context Sign language - local sign languages integrate cultural norms, traditions, and idiomatic expressions, reflecting users’ cultural identity. Whistled language - these languages embody the community's cultural identity, passed down through generations as part of their heritage, often celebrated in festivals or rituals.