Podcast
Questions and Answers
Which of the following is NOT a primary insect vision configuration?
Which of the following is NOT a primary insect vision configuration?
The concept of compound eyes allows for greater motion detection than traditional lenses.
The concept of compound eyes allows for greater motion detection than traditional lenses.
True
What are the two main types of biomimetic eyes?
What are the two main types of biomimetic eyes?
Compound eyes and camera-type eyes
In motion hyperacuity, the ability to detect slight movements is ______.
In motion hyperacuity, the ability to detect slight movements is ______.
Signup and view all the answers
Match the following biomimetic technologies with their functions:
Match the following biomimetic technologies with their functions:
Signup and view all the answers
In which situation are camera-type biomimetic eyes more usable?
In which situation are camera-type biomimetic eyes more usable?
Signup and view all the answers
All biomimetic sensors rely solely on photonic structures for functionality.
All biomimetic sensors rely solely on photonic structures for functionality.
Signup and view all the answers
How are biomimetic hair cells connected to hearing?
How are biomimetic hair cells connected to hearing?
Signup and view all the answers
What materials are used for 3D printing a biomimetic tympanic membrane?
What materials are used for 3D printing a biomimetic tympanic membrane?
Signup and view all the answers
High-frequency sounds localize near the apex of the cochlea.
High-frequency sounds localize near the apex of the cochlea.
Signup and view all the answers
What is the primary function of an artificial basilar membrane?
What is the primary function of an artificial basilar membrane?
Signup and view all the answers
The process described for creating a biomimetic tympanic membrane uses the fused deposition modeling technique which involves __________ materials.
The process described for creating a biomimetic tympanic membrane uses the fused deposition modeling technique which involves __________ materials.
Signup and view all the answers
Match the types of biomimetic artificial basilar membranes to their descriptions:
Match the types of biomimetic artificial basilar membranes to their descriptions:
Signup and view all the answers
Which of the following describes a characteristic of the basilar membrane?
Which of the following describes a characteristic of the basilar membrane?
Signup and view all the answers
Name one technology-based approach mentioned for creating an artificial basilar membrane.
Name one technology-based approach mentioned for creating an artificial basilar membrane.
Signup and view all the answers
The design of a biomimetic tympanic membrane does not require any support materials.
The design of a biomimetic tympanic membrane does not require any support materials.
Signup and view all the answers
Which of the following statements about depth of field (DOF) is correct?
Which of the following statements about depth of field (DOF) is correct?
Signup and view all the answers
The angular field of view is affected by object distance.
The angular field of view is affected by object distance.
Signup and view all the answers
What does Snell's law predict?
What does Snell's law predict?
Signup and view all the answers
The fraction of incident light intensity that is refracted is known as __________.
The fraction of incident light intensity that is refracted is known as __________.
Signup and view all the answers
Which type of aberration occurs due to imperfections in lenses and only considers one wavelength at a time?
Which type of aberration occurs due to imperfections in lenses and only considers one wavelength at a time?
Signup and view all the answers
Match the following terms with their definitions:
Match the following terms with their definitions:
Signup and view all the answers
Chromatic aberration appears as fringes of inappropriate color along edges in an image.
Chromatic aberration appears as fringes of inappropriate color along edges in an image.
Signup and view all the answers
What is the approximate field of view determined by?
What is the approximate field of view determined by?
Signup and view all the answers
Which motion processing model employs first and second derivatives to determine velocity?
Which motion processing model employs first and second derivatives to determine velocity?
Signup and view all the answers
The Hassenstein-Reinhardt model is a type of region-based motion processing model.
The Hassenstein-Reinhardt model is a type of region-based motion processing model.
Signup and view all the answers
Name one adaptive visual capability of the mantis shrimp.
Name one adaptive visual capability of the mantis shrimp.
Signup and view all the answers
The _____ allows for incredible motion detection capabilities, often described as motion hyperacuity.
The _____ allows for incredible motion detection capabilities, often described as motion hyperacuity.
Signup and view all the answers
Match the following visual models with their primary characteristics:
Match the following visual models with their primary characteristics:
Signup and view all the answers
What is a significant feature of fly eye sensors compared to CCD camera sensors?
What is a significant feature of fly eye sensors compared to CCD camera sensors?
Signup and view all the answers
Mantis shrimp can adjust their polarization contrast in real time.
Mantis shrimp can adjust their polarization contrast in real time.
Signup and view all the answers
What types of eye movement are possible for a mantis shrimp?
What types of eye movement are possible for a mantis shrimp?
Signup and view all the answers
What is the main function of the control circuit in a sensing array?
What is the main function of the control circuit in a sensing array?
Signup and view all the answers
A Bayer filter mosaic contains equal proportions of red, green, and blue filters.
A Bayer filter mosaic contains equal proportions of red, green, and blue filters.
Signup and view all the answers
Name one type of compound eye.
Name one type of compound eye.
Signup and view all the answers
The primary refractive power of the camera eye is due to the __________ interface.
The primary refractive power of the camera eye is due to the __________ interface.
Signup and view all the answers
Which type of eye is primarily found in nearly all mammals, including humans?
Which type of eye is primarily found in nearly all mammals, including humans?
Signup and view all the answers
Match the following types of eyes to their characteristics:
Match the following types of eyes to their characteristics:
Signup and view all the answers
The artificial vision system mimics the camera eye's components using multiple small apertures.
The artificial vision system mimics the camera eye's components using multiple small apertures.
Signup and view all the answers
What is the angular span calculated for Helmholtz’s schematic eye when the radius is 5.5 mm?
What is the angular span calculated for Helmholtz’s schematic eye when the radius is 5.5 mm?
Signup and view all the answers
What is the primary purpose of a camera's sensor array?
What is the primary purpose of a camera's sensor array?
Signup and view all the answers
Optical infinity refers to an object distance that is equal to the focal length.
Optical infinity refers to an object distance that is equal to the focal length.
Signup and view all the answers
What is the impact of aperture size on image clarity?
What is the impact of aperture size on image clarity?
Signup and view all the answers
The __________ frequency is half of the spatial sampling frequency to avoid aliasing.
The __________ frequency is half of the spatial sampling frequency to avoid aliasing.
Signup and view all the answers
Match the following optical terms with their definitions:
Match the following optical terms with their definitions:
Signup and view all the answers
Which condition leads to aliasing in images?
Which condition leads to aliasing in images?
Signup and view all the answers
The Gaussian lens equation is used to describe the spatial relationship between the object distance, image distance, and focal length.
The Gaussian lens equation is used to describe the spatial relationship between the object distance, image distance, and focal length.
Signup and view all the answers
What does the 'depth of field' refer to in optics?
What does the 'depth of field' refer to in optics?
Signup and view all the answers
Which of the following best describes the Modulation Transfer Function (MTF)?
Which of the following best describes the Modulation Transfer Function (MTF)?
Signup and view all the answers
Chromatic aberration does not result in color fringes along image edges.
Chromatic aberration does not result in color fringes along image edges.
Signup and view all the answers
What is the function of the Optical Transfer Function (OTF)?
What is the function of the Optical Transfer Function (OTF)?
Signup and view all the answers
The ______ defines how an infinitesimally small point of light is spread by an optical component.
The ______ defines how an infinitesimally small point of light is spread by an optical component.
Signup and view all the answers
Match the optical concepts with their definitions:
Match the optical concepts with their definitions:
Signup and view all the answers
Which factor influences the quantum efficiency of a CCD camera?
Which factor influences the quantum efficiency of a CCD camera?
Signup and view all the answers
CCDs can effectively generate free electrons from any wavelength of incoming photons.
CCDs can effectively generate free electrons from any wavelength of incoming photons.
Signup and view all the answers
What happens during 'blooming' in a CCD camera?
What happens during 'blooming' in a CCD camera?
Signup and view all the answers
What is the effect of longer focal length lenses on depth of field (DOF)?
What is the effect of longer focal length lenses on depth of field (DOF)?
Signup and view all the answers
The angular field of view is determined by object distance.
The angular field of view is determined by object distance.
Signup and view all the answers
What law predicts the angle of refraction when light enters an optical system?
What law predicts the angle of refraction when light enters an optical system?
Signup and view all the answers
The fraction of incident light intensity that is __________ is known as transmittance.
The fraction of incident light intensity that is __________ is known as transmittance.
Signup and view all the answers
Match the following types of aberrations with their characteristics:
Match the following types of aberrations with their characteristics:
Signup and view all the answers
In optics, reflectance refers to which of the following?
In optics, reflectance refers to which of the following?
Signup and view all the answers
Most optical aberrations are caused by the imperfections in lenses.
Most optical aberrations are caused by the imperfections in lenses.
Signup and view all the answers
What is the relationship between reflectance and transmittance in optics?
What is the relationship between reflectance and transmittance in optics?
Signup and view all the answers
What is the typical mean diameter of the optic disk in a human eye?
What is the typical mean diameter of the optic disk in a human eye?
Signup and view all the answers
The resolution limit of the human eye is 1 min of arc based on a 2 mm pupil and 550 nm wavelength.
The resolution limit of the human eye is 1 min of arc based on a 2 mm pupil and 550 nm wavelength.
Signup and view all the answers
What term describes the fixed part of a camera that is attached to a focal plane array (FPA)?
What term describes the fixed part of a camera that is attached to a focal plane array (FPA)?
Signup and view all the answers
The EC-Eye is an example of a __________ eye.
The EC-Eye is an example of a __________ eye.
Signup and view all the answers
What is the primary modular vision unit of the compound eye called?
What is the primary modular vision unit of the compound eye called?
Signup and view all the answers
Match the following components of a camera eye model to their descriptions:
Match the following components of a camera eye model to their descriptions:
Signup and view all the answers
Compound eyes provide a very narrow field of view.
Compound eyes provide a very narrow field of view.
Signup and view all the answers
What shape is the optic disk in a typical human eye?
What shape is the optic disk in a typical human eye?
Signup and view all the answers
What are the individual hexagonal-shaped lenses in a compound eye called?
What are the individual hexagonal-shaped lenses in a compound eye called?
Signup and view all the answers
The angle between adjacent ommatidia is referred to as the __________ angle.
The angle between adjacent ommatidia is referred to as the __________ angle.
Signup and view all the answers
What is the focal length of standard camera lenses typically described as?
What is the focal length of standard camera lenses typically described as?
Signup and view all the answers
The focal length in zoom lenses can change.
The focal length in zoom lenses can change.
Signup and view all the answers
Which of the following is a type of visual processing that occurs early in the vision system?
Which of the following is a type of visual processing that occurs early in the vision system?
Signup and view all the answers
Match each type of insect vision configuration with its description:
Match each type of insect vision configuration with its description:
Signup and view all the answers
What is the term used to describe the apparent motion of surfaces or objects in a scene?
What is the term used to describe the apparent motion of surfaces or objects in a scene?
Signup and view all the answers
The crystalline cone in a compound eye is made of opaque material.
The crystalline cone in a compound eye is made of opaque material.
Signup and view all the answers
Which material provides durability and flexibility for the biomimetic tympanic membrane?
Which material provides durability and flexibility for the biomimetic tympanic membrane?
Signup and view all the answers
The artificial basilar membrane does not mimic cochlear tonotopy.
The artificial basilar membrane does not mimic cochlear tonotopy.
Signup and view all the answers
What is the primary function of a biomimetic tympanic membrane?
What is the primary function of a biomimetic tympanic membrane?
Signup and view all the answers
The artificial basilar membrane is used as an acoustic transducer that mimics _________ of the basilar membrane.
The artificial basilar membrane is used as an acoustic transducer that mimics _________ of the basilar membrane.
Signup and view all the answers
Match the following biomimetic artificial basilar membranes with their technologies:
Match the following biomimetic artificial basilar membranes with their technologies:
Signup and view all the answers
What type of structure characterizes the basilar membrane?
What type of structure characterizes the basilar membrane?
Signup and view all the answers
Low-frequency sounds localize near the base of the cochlea.
Low-frequency sounds localize near the base of the cochlea.
Signup and view all the answers
Name one of the materials used in the 3D printing of a biomimetic tympanic membrane.
Name one of the materials used in the 3D printing of a biomimetic tympanic membrane.
Signup and view all the answers
Which motion processing model uses an array of band-pass filters to analyze incoming signals?
Which motion processing model uses an array of band-pass filters to analyze incoming signals?
Signup and view all the answers
The Hassenstein-Reinhardt model is a type of motion processing method that uses feature-based matching.
The Hassenstein-Reinhardt model is a type of motion processing method that uses feature-based matching.
Signup and view all the answers
Name one of the visual capabilities of the mantis shrimp.
Name one of the visual capabilities of the mantis shrimp.
Signup and view all the answers
Motion hyperacuity refers to the ability to detect slight movements with incredible __________.
Motion hyperacuity refers to the ability to detect slight movements with incredible __________.
Signup and view all the answers
Match the following motion processing models with their descriptions:
Match the following motion processing models with their descriptions:
Signup and view all the answers
What visual processing technique is primarily utilized by fly eye sensors?
What visual processing technique is primarily utilized by fly eye sensors?
Signup and view all the answers
Mantis shrimps can adjust their polarization contrast in real time by utilizing three axes of eye movement.
Mantis shrimps can adjust their polarization contrast in real time by utilizing three axes of eye movement.
Signup and view all the answers
Energy-based methods make use of __________ filters for motion detection.
Energy-based methods make use of __________ filters for motion detection.
Signup and view all the answers
Study Notes
Pázmány Péter Catholic University
- This is a university in Hungary
- Located in the Faculty of Information Technology and Bionics
Biomimetic and Bioinspired Sensors
- The lecture is about vision, hearing, and sensor technologies
- The date of the lecture is 2024.11.06.
- The lecturer is Dr. Sándor Földi
Contents of the lecture
- Optics
- Physiology of vision
- Classic camera
- Bioinspired vision sensor technologies
- Depth camera
- Physiology of hearing
- Bioinspired hearing sensor
Basic Optics
- An image is formed when light reflected off an object is focused on a surface
- In a camera, the sensor array is located at the image plane
- Sharpest image: achieved with converging lens or a system of lenses
- The Gaussian lens equation: 1/So + 1/Si = 1/f
- Focal length and optical parameters depend on wavelength
- Optical infinity: object distance resulting in an image plane close to focal length
- For designers: object distance (so) is greater than or equal to 100 times focal length (f)
- For visual acuity exams, so ≈ 338f
- Spatial sampling of the image:
- The center-to-center distance between sensor locations is the reciprocal of the spatial sampling frequency
- Spatial sampling is limited by the sampling theorem such that only spatial frequencies up to half the spatial sampling frequency are sampled and reconstructed without aliasing
- Aliasing is noticeable to humans in periodic patterns such as stripes in clothing
Basic Optics - Aperture Size
- No real world lens can focus light to an infinitesimally tiny point
- Effective aperture size = diameter, numerical aperture (microscopy), f-number (photography)
- Blur examples exist
Basic Optics - Depth of Field
- Depth of Field: Axial distance over which objects are in sharp focus
- Depth of Field (DOF) is smaller for larger apertures
- Longer focal length lenses have a smaller DOF for a given aperture
Basic Optics - Field of View
- Field of view (FOV): Span over which a scene is imaged
- FOV is determined only by the geometry of the system
- For an imaging sensor of size 'a' in a given direction, the angular FOV in that direction is 2arctan(a/2f)
Basic Optics - Reflection and Refraction
- When light enters an optical system, it encounters a boundary between two different indices of refraction
- Examples are: Air (n=1), Crown glass (n=1.5)
- Snell's law: sin θ1/n1 = sin θ2/n2
- Angle of reflection equals angle of incidence
- Reflectance (R) - fraction of light reflected (incident light intensity)
- Transmittance (T) - fraction of light refracted (incident light intensity)
- R + T = 1
Basic Optics - Aberrations
- Monochromatic aberrations are due to imperfections in lenses (spherical, comma, astigmatism, field curvature, defocus, barrel and pin-cushion distortion)
- Chromatic aberration is primarily due to material refractive index's dependence on wavelength. This results in fringes of inappropriate color along bright and dark regions of the image
Basic Optics - Fourier Optics
- A powerful and practical method for design considerations.
- Point Spread Function (PSF): Describes how a point of light is spread by a component
- Optical Transfer Function (OTF): Fourier transform of the PSF, in spatial frequency domain
- Modulation Transfer Function (MTF): Magnitude of OTF
- Contrast Transfer Function (CTF): Line pair (maximum frequency)
- Conversion between MTF and CTF is known
Recap - Vision
- In details: Lecture 2
Classic CCD Camera
- CCD: Charge Coupled Device
- Introduction: 1974 Bell Laboratory
- Popular since 1980
- Majority of cameras use CCDs
- Cheap semiconductor technology
- Discrete sensors = discretization, pixelization
- Incoming photons generate free electrons
- Photons with too little energy (infrared) do not generate electrons
- Photons with too much energy (ultraviolet) are absorbed before reaching the sensor layer
- Quantum efficiency (typically 70%)
- Free electrons trapped in potential holes (2-100,000)
- Blooming: overflow of too many electrons
Classic CCD Camera - Photoactive Region
- Photoactive region and a transmission region that are made of a shift-register
- Steps of sensing:
- Array is exposed to the image
- Control circuit transfers charge from each capacitor to its neighbor - like a shift register process.
- The last capacitor dumps charges to a charge amplifier which converts the charge to a voltage
- Repeat process to convert entire array content
Classic CCD Camera - Color Filter Array
- Bayer filter mosaic: color filter array (CFA) for arranging RGB color filters on a square grid of photosensors
- Filter pattern is half green, quarter red, and quarter blue
- Better color separation can be achieved with three-CCD devices and a dichroic beam splitter prism
Biomimetic Vision Sensor Approaches
- At least 10 known variants of animal eyes
- Two main groups: Noncompound and Compound eyes
- Refractive cornea eye (Camera eye)
- Compound Eye:
- Apposition eye
- Optical superposition eye
- Neural superposition eye
Camera Eye
- Nearly all mammals, including humans, have camera eyes.
- The primary refractive power due to the air/cornea optical interface.
- Additional refractive effect provided by an internal lens (e.g., crystalline lens for focus adjustment).
- Relatively large aperture → good light gathering and a small blur spot.
- Artificial vision systems based on camera eye use a single large-aperture lens mimicking the cornea and lens combined with the photoreceptors in retina.
Camera Eye of Humans
- Simplification of human eye: Helmholtz's schematic eye (reduced eye model)
- Single refractive surface (5.5 mm radius)
- Posterior nodal distance (16.7 mm)
- Angular span (16.7 mm × tan(1°)=291.5 μm/deg)
Camera Eye-Typical Human Eye
- Optic disk has mean diameter of 1800 µm
- Optic disk subtends arc roughly 6.2°
- Not truly spherical
- Resolution limit ~1 min of arc for certain conditions
- Camera eye model for camera and vision sensors
- Focal plane array (FPA) usually rigidly attached to sensor frame
- Focal length fixed (zoom lenses are exceptions).
Biomimetic Camera Eye Example: EC-Eye
- Describes electrochemical eye (EC-Eye)
- Features an eye-like structure with lens, vitreous humor, retina, etc.
Recap - Ear Structure
- Describes auditory canal, malleus, incus, stapes, tympanic membrane, oval window, round window, cochlea, spiral ligament, spiral organ of Corti, scala vestibuli, scala tympani, scala media, and stria vascularis.
Recap - Organ of Corti
- Shows structure of outer and inner hair cells, tectorial membrane, basilar fiber, spiral ganglion, cochlear nerve, and reticular lamina.
Artificial Hair Cells
- Shows diagrams for artificial hair cells, including cantilever support sensor structures
Biomimetic Sound Detection
- Human hearing frequency range: 20 Hz to 20 kHz
- Sound pressure range: 20 µPa to 20 Pa
- Artificial hair cell mimics sound conversion into an electrical signal by inner hair cell, amplification by outer hair cell, MEMS technology, self-sensing, and self-actuated cantilever.
- Feedback control loop for process
Biomimetic Tympanic Membrane
- Tympanic membrane (TM) consists of three parts: Malleus, Pars Tensa, and Pars Flaccida
- TM curved conical shape does not behave as a typical diaphragm
- Pressure forces transmitted centrally to TM during movement
Biomimetic Tympanic Membrane Techniques
- Fused deposition modeling technique
- Two materials for 3D printing: Thermo-plastic elastomer and polivinyl alcohol
Biomimetic Artificial Basilar Membrane
- Pseudo resonant structure
- Different width, stiffness, mass, damping, and duct dimensions along its length
- High-frequency sounds localize near base, low frequencies near apex
- Acoustic transducer that mimics cochlear tonotopy (passive mechanical freq selectivity)
- Different MEMS technology-based approaches
Biomimetic Artificial Basilar Membrane - Types
- Trapezoidal membrane type
- Beam array type
Biomimetic Artificial Basilar Membrane - Materials
- Flexible piezoelectric zirconite titanite (PZT)
- Flexible Piezoelectric polyvinylidene diflouride (PVDF)
Biomimetic Artificial Basilar Membrane - Triboelectric
- Triboelectric-based
- Uses a method involving several stages of components.
Summary - Questions
- 4 important basic concepts of optics in biomimetic vision sensors
- Two main types of biomimetic eyes, differences and usages
- Concept of compound eyes, primary insect vision and reaching motion hyperacuity
- Connection between biomimetic hair cells and hearing
- Introduction of a biomimetic basilar membrane sensor
References
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Related Documents
Description
Test your knowledge on biomimetic technologies related to vision and hearing. This quiz covers various concepts like compound eyes, biomimetic tympanic membranes, and artificial basilar membranes. Challenge yourself and see how well you understand these advanced technologies and their functions.