01_AI361_UPM_Week1 (1).pdf

Image Processing Week 1: Introduction Dr. Othman Soufan ([email protected]) Dr. Karim Said Barsim ([email protected]) UPM University Fall 2024 Course Overview Photography (Photo enhancement) Medical imaging...

Image Processing Week 1: Introduction Dr. Othman Soufan ([email protected]) Dr. Karim Said Barsim ([email protected]) UPM University Fall 2024 Course Overview Photography (Photo enhancement) Medical imaging Where do we find image Forensics/face processing? recognition Astronomy Drone images (agriculture) 3 [Digital] Image Processing This course has, in fact, a three-token title: ○ Image: dealing with pictorial data ○ Digital: in a digital form and on a digital computer ○ Processing: to achieve a specific goal or meet an ultimate objective Each token contributes to the refinement of the scope of the course. For instance, we will not be dealing with: ○ Audio or Textual data ○ Optical devices like lenses, mirrors, or prisms 4 [Digital] Image Processing Raw images may (and usually) contain many artifacts. They, thus, need to go through multiple treatments (aka processing) steps to extract high-level information. Our brains are inherently engaged in extensive visual processing activities: ○ Edge detection, ○ Color constancy, … etc Fig.: Examples of some well-known illusions that exploit the visual processing function of the brain [1, 2]. “Digital Image Processing” Rafael Gonalez and Richard Wood 5 https://en.wikipedia.org/wiki/Optical_illusion [Digital] Image Processing We will consider treating images merely on digital computers. This necessary includes: ○ Digital representation ○ Basic transformations: Scaling, Rotation, Flipping … etc But will include more sophisticated applications, e.g.,: ○ Denoising, Shading correction, Segmentation, Filtering,.. etc 7 Bird’s Eye on the Course Visual Representation Storage Fourier Transform Image 𝑓(𝑥, 𝑦) 𝑓(𝑥, 𝑦, 𝑡) Wavelet Transform Linear Algebra 𝑝 𝑧𝑘 ∼ 𝒩 𝜇, 𝜎 2 Statistical Probabilistic Treatment Treatment Deep Learning Numeric Representation Analytic Representation 9  What is image processing? 10 What is (digital) image processing? “Digital image processing encompasses processes whose inputs and outputs are images and, in addition, includes processes that extract attributes from images up to, and including, the recognition of individual objects.” “There is no general agreement among authors regarding where image processing stops and other related areas, such as image analysis and computer vision, start.” “One useful paradigm is to consider three types of computerized processes in this continuum: low-, mid-, and highlevel processes.” 11 What is (digital) image processing? Gouverneur, Benedict, et al. "Archeological treasures protection based on early forest wildfire multi-band imaging detection 12 system." Electro-Optical and Infrared Systems: Technology and Applications IX. Vol. 8541. SPIE, 2012. What is an image? 13 What is an image? 14 What is an image? A grid (matrix) of intensity values 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 20 0 255 255 255 255 255 255 255 255 255 255 75 75 75 255 255 255 255 255 255 255 255 75 95 95 75 255 255 255 255 255 255 255 255 96 127 145 175 255 255 255 255 255 255 255 255 127 145 175 175 175 255 255 255 255 255 255 255 127 145 200 200 175 175 95 255 255 255 255 255 127 145 200 200 175 175 95 47 255 255 255 255 127 145 145 175 127 127 95 47 255 255 255 255 74 127 127 127 95 95 95 47 255 255 255 255 255 74 74 74 74 74 74 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 (common to use one byte per value: 0 = black, 255 = white) 15 What is an image? 3D View 16 What is an image? 3D View 17 Excited! Let’s do some programming! Hello Madinah Image in Python https://github.com/soufanom/ai361- ip/blob/main/HelloMedina.py 19 Image Categorization Imaging more broadly and in medical applications 21 22 23 24 Infrared is being used for thermography based cancer detection (with weak performance) Normal photography is used for skin lesion assessments 25 Other Applications for Visible Range 26 27 28 Building a System for Image Processing 29 Important Areas within Visual Computing Important Areas within Visual Computing 31 Important Areas within Visual Computing 32 Important Areas within Visual Computing 33 Important Areas within Visual Computing 34 Important Areas within Visual Computing 35 Digital image processing is a wide field concerned with answering questions concerning about what are images and what do they say! 36 References - Digital Image Processing 4th ed. - R. Gonzalez, R. Woods - Image Processing and Computer Vision lecture slides by Prof. Joachim Weickert (https://www.mia.uni- saarland.de/Teaching/ipcv22.shtml) - Biomedical Computation lecture slides by Jacob Levman - Principles of Digital Image Processing: Fundamental Techniques - W. Burger, M. Burge - OpenAI. (2023). ChatGPT (August 3 Version) [Large language model]. https://chat.openai.com 37 Thanks! Let me answer your questions... [email protected] 38