Biomimetic and Bioinspired Sensors (Lecture 5) PDF

BIOMIMETIC AND BIOINSPIRED SENSORS Lecture 5 2024. 10. 09. Dr. Sándor Földi Sensor technologies and biological sensing  CONTENTS 1. Concepts of biomimetics 2. Examples of biomimetic sensors 3. Biomimetic and Bioinspired sens...

BIOMIMETIC AND BIOINSPIRED SENSORS Lecture 5 2024. 10. 09. Dr. Sándor Földi Sensor technologies and biological sensing  CONTENTS 1. Concepts of biomimetics 2. Examples of biomimetic sensors 3. Biomimetic and Bioinspired sensor technologies and their applications a. Snake’s infrared thermography b. Bat’s echolocation c. Acustical defence d. Dolphin’s sonar e. Hair cells f. Whiskers 3  SENSORS IN NATURE 4  DEVELOPMENT BY EVOLUTION Millions of years Advantageous and optimal solutions survive Optimized for the task Optimized in size and structure Diversity 5  BIOMIMETICS Emulation of the models, systems and elements of nature for the purpose of solving complex human/engineering problems Natural selection → good adaptation Macro or nano scales Examples for engineering problems nature has solved: Self-healing Hydrophobicity Self-assembly Utilization of solar energy Tolerance and resistance of environmental effects 6  BIOMIMETICS – HISTORY One of the earliest examples of biomimicry: Leonardo da Vinci’s plans on human flight Observation of the anatomy and flight of birds 7 Reference: https://www.leonardodavinci.net/flyingmachine.jsp#prettyPhoto  BIOMIMETICS – INSPIRATION Flying Implants Artificial Intelligence Synthetic life, gene technologies The Game of Life, Genetic Algorithms Structures (e.g.: bees’ honeycomb) Biologically inspired mechanisms (e.g.: controlled adhesion) Materials (e.g.: spider web – strong fibers) Biosensors 8  BIOMIMETICS – BASIC CONCEPT, DESIGN CONCEPT QUESTIONS Having an Search similar Observe engineering problems in nature’s problem nature solution Copy/Mimic, Understand optimization, and model simplification Reference: Baniqued, P. D. E., Dungao, J. R., Manguerra, M. V., Baldovino, R. G., Abad, A. C., & Bugtai, N. T. (2018, February). Biomimetics in the design of a robotic exoskeleton for upper limb therapy. In AIP Conference 9 Proceedings (Vol. 1933, No. 1, p. 040006). AIP Publishing LLC  BIOMIMETIC METHODOLOGY FRAMEWORK – EXAMPLE – EXOSKELETON DESIGN Reference: Baniqued, P. D. E., Dungao, J. R., Manguerra, M. V., Baldovino, R. G., Abad, A. C., & Bugtai, N. T. (2018, February). Biomimetics in the design of a robotic exoskeleton for upper limb therapy. In AIP Conference 10 Proceedings (Vol. 1933, No. 1, p. 040006). AIP Publishing LLC  CHALLENGES AND PROSPECTS 11 Reference: Xue, J., Zou, Y., Deng, Y., & Li, Z. (2022). Bioinspired sensor system for health care and human‐machine interaction. EcoMat, 4(5), e12209.  SNAKE – INFRARED THERMOGRAPHY IR detector enables the snake (pit vipers and boids) to: percieve a two dimensional image of the heat distribution form a thermal image of their prey or predators, helping to hunt or survive IR detector works in complete darkness 12  INFRARED THERMOGRAPHY – ANATOMICAL STRUCTURE Pit organs: Set of cavities In pit viper: it is located on each side of the snake’s head near the eyes In rattlesnake: the IR detection is done by some special loreal pit organs located between the eye and nostril on either side of the viper’s face, with a thin membrane suspended between these chambers acting as an IR antenna The snakes can detect temperature difference in the range of mK 13 Reference: Iniewski, Krzysztof, ed. Biological and Medical Sensor Technologies. CRC Press, 2017.  INFRARED THERMOGRAPHY – ANATOMICAL STRUCTURE Behind the heat-sensing membrane, an air-filled chamber provides air contact on either side of the membrane. Pit organ: mitochondria-enriched, highly vascular heavily innervated with numerous heat-sensitive receptors formed from terminal masses of the trigeminal nerve fibers (terminal nerve masses, or TNMs) The fibers convey IR signals from the pit organ to the optic tectum of the brain High water concentration tissue → highly absorptive in the mid-IR region of the EM spectrum 14 Reference: Ding, Yucheng, et al. "Uncooled self-powered hemispherical biomimetic pit organ for mid-to long-infrared imaging." Science Advances 8.35 (2022)  INFRARED THERMOGRAPHY – PHYSIOLOGY Two major regions of IR transmission: 1700–2900 cm−1 (3.4–6.0 μm) 700–1200 cm−1 (8.3–14 μm) Photochemical transduction utilizing the transient receptor potential „Wasabi receptor” (TRPA1): Heat activated channel For rattlesnake: inactive at room temperature, but active above 28.0 ± 2.5 °C Reference: Gracheva, Elena O., et al. "Molecular basis of infrared detection by snakes." Nature 464.7291 (2010): 1006-1011. Reference: Sichert, Andreas B., Paul Friedel, and J. Leo van Hemmen. "Snake’s perspective on heat: reconstruction of input using an imperfect detection system." Physical review letters 97.6 (2006): 068105 15  INFRARED THERMOGRAPHY – HEMISPHERICAL BIOMIMETIC PIT ORGAN Germanium has high light transmittance in the wavelength range of 7 to 14 μm and is opaque to visible light. 625-pixel hemispherical IR image sensor with a minimum pitch of 550 μm. Because of the accuracy limit of manual assembly, it is difficult to further increase pixel density. 16 Reference: Ding, Yucheng, et al. "Uncooled self-powered hemispherical biomimetic pit organ for mid-to long-infrared imaging." Science Advances 8.35 (2022)  INFRARED THERMOGRAPHY – HEMISPHERICAL BIOMIMETIC PIT ORGAN It is naturally a self-powered device with no energy consumption. Theoretically, each nanowire in this PIT device can work as an individual pixel without any concern about the signal strength. Captured images of human hand. Captured images of letter-shaped resistors with a semiconductor chilling plate (~0°C) as the background. Insets provide the optical photos of imaging target. 17 Reference: Ding, Yucheng, et al. "Uncooled self-powered hemispherical biomimetic pit organ for mid-to long-infrared imaging." Science Advances 8.35 (2022)  INFRARED THERMOGRAPHY Modern temperature measurement systems: contact (thermocouples, resistance temperature detectors and thermistors) and noncontact (IR) type Discovery of IR measurement: Sir Frederick William Hershel Noncontact IR thermography application areas: Biophysics Communication Remote sensing Medical imaging Security Astrophysics Engineering Thermal IR detectors convert incoming radiation into heat, raising the temperature of the thermal detector This temperature change converted to electrical signal IR detector types: Thermal detectors Photon detectors Pyroelectric detectors 18  INFRARED THERMOGRAPHY Thermal IR detectors: Bolometer, in which resistance varies with received radiation. Thermopile consists of multiple thermocouples in series whose voltage output varies with the received radiation. Bolometer Thermopile References: https://commons.wikimedia.org/wiki/File:1024_Pyrometer-8445.jpg; https://en.wikipedia.org/wiki/File:Differential_Temperature_Thermopile.png; https://en.wikipedia.org/wiki/File:FluxTeq_PHFS01_Heat_Flux_Sensor.jpg; https://commons.wikimedia.org/wiki/File:Caltech-Submillimeter- Observatory_(straightened).jpg; https://en.wikipedia.org/wiki/File:Bolometer_conceptual_schematic.svg 19  INFRARED THERMOGRAPHY Photon type detectors: Photoconductive: shows increased conductivity with received radiation (photoresistors) Photovoltaic: converts received radiation into electric current Photoconductive Photovoltaic References: https://commons.wikimedia.org/wiki/File:LDR_1480405_6_7_HDR_Enhancer_1.jpg; https://en.wikipedia.org/wiki/File:Fixed_Tilt_Solar_panel_at_Canterbury_Municipal_Building_Canterbury_New_Hampshire.jpg; https://en.wikipedia.org/wiki/File:ZomeworksTrackerHead5816.jpg 20  INFRARED THERMOGRAPHY Pyroelectric detectors: Surface charge varies in response to the recieved radiation Common example: Passive Infrared Sensors 21 References: https://en.wikipedia.org/wiki/File:Pyrosensor.jpg; https://en.wikipedia.org/wiki/File:Light_switch_with_passive_infrared_sensor.jpg  INFRARED THERMOGRAPHY Engineering applications: Remote temperature measurement. Temperature measurement in harsh environments. Temperature profiling of electrical and mechanical devices in power generation and transmission. Temperature profiling and safety in nuclear power plants. Thermal monitoring of boilers and chimneys. Thermal investigations and hot-spot detection in electronic printed circuit boards. Inspection and quality assessment in car manufacturing. Fire detection in waste recycling applications. Quality control on refrigeration systems and refrigerators. In defense of the recent outbreaks of the COVID virus many airports and medical facilities employed IR noncontact detectors to screen infected people. 22  INFRARED THERMOGRAPHY – APPLICATIONS 23 Reference: Iniewski, Krzysztof, ed. Biological and Medical Sensor Technologies. CRC Press, 2017.  MEDICAL THERMOGRAPHY We have covered IR thermal cameras Using IR cameras for diagnostics Moisture, airflow and surrounding temperature are important, therefore thermography experiments required controlled environments The temperature change during the experiment must stay within a few degrees For experiments the room temperature and acclimation time are important factors, which has established standards 24  MEDICAL THERMOGRAPHY – BREAST CANCER Below example shows a patient with breast cancer, whose mammography report was negative 25 Reference: Lahiri, B. B., Bagavathiappan, S., Jayakumar, T., & Philip, J. (2012). Medical applications of infrared thermography: a review. Infrared Physics & Technology, 55(4), 221-235.  MEDICAL THERMOGRAPHY – DIABETES Can diagnose diabetic neuropathy and vascular disorders 26 Reference: Lahiri, B. B., Bagavathiappan, S., Jayakumar, T., & Philip, J. (2012). Medical applications of infrared thermography: a review. Infrared Physics & Technology, 55(4), 221-235.  INFRARED THERMOGRAPHY – FLIR CAMERA It is a non-contact device that detects infrared energy (heat) and converts it into a visual image. A FLIR thermal camera can detect tiny differences in heat—as small as 0.01°C— and display them as shades of grey or with different color palettes. A thermal camera is made up of a lens, a thermal sensor, processing electronics, and a mechanical housing. The lens focuses infrared energy onto the sensor. Low resolution (fewer pixels) compared to usual visible cameras of the same size. 27  BAT’S ECHOLOCATION Ultrasonic sound emission Bat’s brain and auditory system: Compare the outgoing sounds with the returning echoes Produce detailed image of the surrounding Emits echolocation sounds in pulses The pulses vary in properties depending on: Species Hunting strategies Mechanism of information processing Bat uses timing, frequency content, duration, and intensity of the echo pulses in an adaptive way to catch the prey that is also moving. 28  BAT’S ECHOLOCATION 29 Reference: Iniewski, Krzysztof, ed. Biological and Medical Sensor Technologies. CRC Press, 2017.  BAT’S ECHOLOCATION – TYPES Frequency modulated (FM) or constant frequency (CF) signals for orientation and foraging CF component: ~27kHz; duration 20–200 ms FM component: sweeps down from 24 to 12 kHz with a prominent second harmonic from 40 to 22 kHz Narrowband CF signals: localization of the targets and determination of the target velocity and direction FM signals: form a multidimensional acoustic image to identify targets 30  BAT’S ECHOLOCATION – TYPES FM bat: Uses shorter duration broadband signals Lives mostly in open forest Has no Doppler shift compensation (DSC) Can differentiate delay time less than 60 μs Has better target localization CF/FM bat: Uses mixed signal with longer CF part with short narrowband FM part Lives mostly at dense places, caves, etc. Has DSC to compensate own wing flattering and increase resolution accounting for insects’ wing flattering Does not have advanced delay time processing Has higher sensitivity and frequency selectivity, adaptive motion control 31 Reference: Iniewski, Krzysztof, ed. Biological and Medical Sensor Technologies. CRC Press, 2017.  BAT’S ECHOLOCATION – NEUROBIOLOGY 32 Reference: Iniewski, Krzysztof, ed. Biological and Medical Sensor Technologies. CRC Press, 2017.  BAT’S ECHOLOCATION – PHYSICS 𝑃𝐺𝐴𝜎 −2𝛽𝑅 𝑆≈ 2 4 𝑒 16𝜋 𝑅 Range equation P is the acoustic power transmitted by the bat S is the signal power received by the bat G is the gain of the transmitter relative to an isotropic beam A is the received antenna area, that is, the size of the bat’s ears R is the range of the prey σ is the acoustic cross section (echo area) of the target β is the atmospheric attenuation factor which depends on frequency (β = 0.16 m-1 at 30 kHz, β = 0.69 m−1 at 100 kHz) σ depends on the shape of the insect 33  BAT’S ECHOLOCATION – PHYSICS Typical ratio: S/P≈10-12 Small reflected signal power → Physiological adaptations to the ear and the brain Filters with very narrow band of frequencies near the transmitted frequency Head-related transfer function: Localizing sound source in space Interaural intensity differences Spectral cues d