AI Ethics.pdf

Introduction to AI Ethics Deep Learning course Seminar (AA 2022/2023) Gabriele Graffieti Algorithm Engineer @ Ambarella Head of AI Research @ AI for People...

Introduction to AI Ethics Deep Learning course Seminar (AA 2022/2023) Gabriele Graffieti Algorithm Engineer @ Ambarella Head of AI Research @ AI for People May 12, 2023 Gabriele Graffieti Introduction to AI Ethics May 12, 2023 1 / 65 AI for People Our mission is to learn, pose questions and take initiative on how AI technology can be used for the social good. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 2 / 65 AI for People Our Goals Shaping AI technology around human and societal needs Technological development should always put the interest of the people first narrowing the gap between civil society and technical experts Gabriele Graffieti Introduction to AI Ethics May 12, 2023 3 / 65 AI for People Gabriele Graffieti Introduction to AI Ethics May 12, 2023 4 / 65 AI for People Gabriele Graffieti Introduction to AI Ethics May 12, 2023 5 / 65 AI for People Join us! We are an open organization, we always welcome new interested people! We have periodic meetings open to everyone (∼ once a month) Best way to join us: join our Slack channel! Send an email to us (check the website) Reach us on social networks (we are on Twitter, Linkedin, Instagram, Facebook). If you are interested in our initiatives, sign to our monthly newsletter! Gabriele Graffieti Introduction to AI Ethics May 12, 2023 6 / 65  What is AI ethics Section 1 What is AI ethics Gabriele Graffieti Introduction to AI Ethics May 12, 2023 7 / 65  What is AI ethics Ethics What is Ethics Nobody really knows! The discipline concerned with what is morally good and bad and morally right and wrong. Its subject consists of the fundamental issues of practical decision making, and its major concerns include the nature of ultimate value and the standards by which human actions can be judged right or wrong. What is AI ethics AI ethics is a set of guidelines that advise on the design and outcomes of artificial intelligence. The definition of a set of moral values that AI must comply with, and the development a set of regulation, guidelines, and constraints that AI development must follow. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 8 / 65  What is AI ethics What is not AI ethics Gabriele Graffieti Introduction to AI Ethics May 12, 2023 9 / 65  What is AI ethics Let’s check a ML project together Problem Our healthcare system process thousands of patients every day. Every patient is different, with their own medical history and different response to drugs, surgery, treatments. Patient may recover quickly without needing extra care, while other patients may require extra cures or re-hospitalization. Healthcare resources are unfortunately limited. Requirements An AI system that analyzes medical history of a person and predicts if that person will require additional medical care in the future. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 10 / 65  What is AI ethics Let’s do another one Problem Our company receives thousands of CVs daily The openings are many and different from each other (programmer, marketing, administrative, sales,... ) Just skim through the CVs requires a lot of time and effort Good candidates can be erroneously discarded in this preliminary phase Requirements An AI system that analyze the CV and take only the best candidates Gabriele Graffieti Introduction to AI Ethics May 12, 2023 11 / 65  What is AI ethics A possible solution Solution Use the CVs of the current employees as ground truth data We want to select candidates similar to the people we already have in our company Our great engineers designed and developed the system with sota models and techniques Results The selected people are very good candidates The system performs better than our HRs in selecting good candidates All the ML metrics shows stunning performance Questions: Are you happy? Do you approve the system? Do you gave a raise to the engineers? Gabriele Graffieti Introduction to AI Ethics May 12, 2023 12 / 65  What is AI ethics Congrats! Gabriele Graffieti Introduction to AI Ethics May 12, 2023 13 / 65  What is AI ethics Congrats! Gabriele Graffieti Introduction to AI Ethics May 12, 2023 14 / 65  What is AI ethics Well, we can try to fix this right? Not so easy kiddo! This problem is not easily detectable in the first place! The people selected are in fact good candidates! The prediction of re-hospitalization is very accurate! The system still performs better than humans All the ML metrics shows absolutely stunning performance! But if we remove all the gender/race info from the data? The AI system can infer them! ▶ From the prevalent male-female colleges / address or geographic info ▶ From sports/activity (cheerleader) / disorders more common in one race ▶ From part of associations (female chess team,... ) / level of care received Gabriele Graffieti Introduction to AI Ethics May 12, 2023 15 / 65  The main enemy: bias in the data Section 2 The main enemy: bias in the data Gabriele Graffieti Introduction to AI Ethics May 12, 2023 16 / 65  The main enemy: bias in the data What is Bias Definiton the action of supporting or opposing a particular person or thing in an unfair way, because of allowing personal opinions to influence your judgment. Bias is not always unwanted Used to perceive possible dangers by almost all animals Pareidolia Basis of Bayesian Statistics (degree of belief) Gabriele Graffieti Introduction to AI Ethics May 12, 2023 17 / 65  The main enemy: bias in the data Example of Biases in Everyday Life Beauty bias Halo/Horns effect Conformity bias Status quo bias Authority bias Idiosyncratic bias... Gabriele Graffieti Introduction to AI Ethics May 12, 2023 18 / 65  The main enemy: bias in the data Bias in AI Gabriele Graffieti Introduction to AI Ethics May 12, 2023 19 / 65  The main enemy: bias in the data Are you sure about your data? Have you even checked the labels when you downloaded a dataset? Do you know how the data is labeled? Do you know who labeled the data? Do you trust who collected and labeled the data you use? Gabriele Graffieti Introduction to AI Ethics May 12, 2023 20 / 65  The main enemy: bias in the data Are you sure about your data? Gabriele Graffieti Introduction to AI Ethics May 12, 2023 21 / 65  The main enemy: bias in the data Culture What about how different cultures see the same data? Emotion recognition and expression may vary a lot between different cultures A face that is labeled as angry by a western person may be labeled as surprised by an Asian person Style of writing, gestures, voice tone may vary between different cultures How can we trust the labeling? Gabriele Graffieti Introduction to AI Ethics May 12, 2023 22 / 65  The main enemy: bias in the data High risk AI applications Not a problem if we build course’s projects or even thesis, but... Diagnosis applications Control of critical infrastructure Law enforcement Scoring Hiring... Gabriele Graffieti Introduction to AI Ethics May 12, 2023 23 / 65  The main enemy: bias in the data But we can play the devil’s advocate Humans are not perfect Juror decision are affected by sport results ▶ In the US, the best day to have a trial is Monday after a victory of the local football team... ▶...and the worst day to have a trial is Monday after a defeat of the local football team Juror decision is highly biased toward race and wealth of the defendant Human decision making is highly affected by mood, personal concerns, stress, level of sleep, affinity with the assessed person, stereotypes,... There is not a universal way to take decisions → different cultures = different decision making processes. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 24 / 65  The main enemy: bias in the data But... What about human-AI collaboration? Seems the perfect solution... ▶ What if AI is right 99.999% of the time? ▶ Should the human check every time? ▶ There are cognitive biases whereby after some time the human unconsciously trust AI and they no longer be able to spot AI errors. ▶ What if AI is right but the human overcome the decision? ▶ And what if AI is wrong but is so powerful that can convince the human? Gabriele Graffieti Introduction to AI Ethics May 12, 2023 25 / 65  The main enemy: bias in the data Gabriele Graffieti Introduction to AI Ethics May 12, 2023 26 / 65  The main enemy: bias in the data Gabriele Graffieti Introduction to AI Ethics May 12, 2023 27 / 65  The main enemy: bias in the data https://futurism.com/top-google-result-edward-hopper-ai-generated-fake Gabriele Graffieti Introduction to AI Ethics May 12, 2023 28 / 65  The main enemy: bias in the data Questions? Discussion? Gabriele Graffieti Introduction to AI Ethics May 12, 2023 29 / 65  Ethics on a Broader Perspective Section 3 Ethics on a Broader Perspective Gabriele Graffieti Introduction to AI Ethics May 12, 2023 30 / 65  Ethics on a Broader Perspective Who Owns AI? AI needs (a big) infrastructure The algorithm is just a small part of the product. Computational capabilities (computational power and memory) are fundamental. Only the biggest companies have the workforce to maintain a solid infrastructure. → Substantial advantage over smaller companies or academia. AI needs (a lot of) data Data is essential to reproduce results. Data is often more important than algorithm (who owns data?) Big tech companies have the possibility to acquire a huge amount of data daily. → Substantial advantage over smaller companies or academia. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 31 / 65  Ethics on a Broader Perspective The Myth of AI Democratization I AI big companies claim to be democratic Sharing their research (e.g. arXiv). Sharing their code (e.g. github). Sharing their frameworks (e.g. Tensorflow). Sharing their infrastructure (?) (e.g. colab). Technology democratization [...] at an increasing scale, consumers have greater access to use and purchase technologically sophisticated products, as well as to participate meaningfully in the development of these products. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 32 / 65  Ethics on a Broader Perspective White House meeting on the threat of AI - May 5, 2023 Gabriele Graffieti Introduction to AI Ethics May 12, 2023 33 / 65  Ethics on a Broader Perspective The Myth of AI Democratization II AI is currently owned by few companies They have access to a huge amount of data. They attract top AI scientists (huge salaries, freedom). They have the power to transform research ideas into products. Why AI democracy is important Avoid monopolies. Democratization means that everyone gets the opportunities and benefits of artificial intelligence. Openness in AI development is proved to be beneficial to the development of better technologies. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 34 / 65  Ethics on a Broader Perspective https://www.semianalysis.com/p/google-we-have-no-moat Gabriele Graffieti Introduction to AI Ethics May 12, 2023 35 / 65  Ethics on a Broader Perspective AI Singularity I Exponential progress equal singularity We live in a historical moment when the acceleration of progress is becoming more and more visible. AI is becoming more ”intelligent” than human in many tasks. We could potentially substitute humans or delegate activities to AI starting today! OpenAI is trying to raise $100B in coming years to achieving the development of AGI. In recent time a sort of hysteria arises Google Engineer Claims AI Chatbot Is Sentient Pause Giant AI Experiments: An Open Letter The Godfather of AI Leaves Google and Warns of Danger Ahead Gabriele Graffieti Introduction to AI Ethics May 12, 2023 36 / 65  Ethics on a Broader Perspective Privacy & Ownership Gabriele Graffieti Introduction to AI Ethics May 12, 2023 37 / 65  Ethics on a Broader Perspective Privacy & Ownership What about code? What kind of license applies to ChatGPT generated code is still not clear. Legally, the implications of using chatGPT generated code in commercial product are still unknown. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 38 / 65  Ethics on a Broader Perspective Climate Change The carbon footprint of training a model In 2019 a paper calculated a carbon footprint of 280,000kg of CO2 for a single training of a 213M parameters NLP architecture. GPT4 number of parameters is still unknown, but some sources put it as high as 100T (1014 ). A more accurate (and maybe way downward) estimation is 500-1,000B. To put that in perspective, a single training of GPT4 emit at least 560M kg of CO2 (without taking into account much larger datasets). In order to stop climate change, a person must emit at max 600kg of CO2 per year. One training of GPT4 (way downward estimation + without accounting for data storage, web servers, etc.) consume as much as ∼1M people in a year. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 39 / 65  Ethics on a Broader Perspective Climate Change Gabriele Graffieti Introduction to AI Ethics May 12, 2023 40 / 65  High Risk AI Applications Section 4 High Risk AI Applications Gabriele Graffieti Introduction to AI Ethics May 12, 2023 41 / 65  High Risk AI Applications Media Generation, a (mid)journey Gabriele Graffieti Introduction to AI Ethics May 12, 2023 42 / 65  High Risk AI Applications Media Generation, a (mid)journey Gabriele Graffieti Introduction to AI Ethics May 12, 2023 43 / 65  High Risk AI Applications Media Generation, a (mid)journey Gabriele Graffieti Introduction to AI Ethics May 12, 2023 44 / 65  High Risk AI Applications Media Generation, a (mid)journey Gabriele Graffieti Introduction to AI Ethics May 12, 2023 45 / 65  High Risk AI Applications Media Generation, a (mid)journey Gabriele Graffieti Introduction to AI Ethics May 12, 2023 46 / 65  High Risk AI Applications Media Generation, a (mid)journey Gabriele Graffieti Introduction to AI Ethics May 12, 2023 47 / 65  High Risk AI Applications Deepfakes Gabriele Graffieti Introduction to AI Ethics May 12, 2023 48 / 65  High Risk AI Applications Deepfakes Gabriele Graffieti Introduction to AI Ethics May 12, 2023 49 / 65  High Risk AI Applications Military Gabriele Graffieti Introduction to AI Ethics May 12, 2023 50 / 65  High Risk AI Applications Education Students work on tests and homework on the platform as part of the school curriculum. While they study, the AI measures muscle points on their faces via the camera on their computer or tablet, and identifies emotions including happiness, sadness, anger, surprise and fear. Facial expression recognition AI can identify emotions with human-level accuracy. The system also monitors how long students take to answer questions; records their marks and performance history; generates reports on their strengths, weaknesses and motivation levels; and forecasts their grades. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 51 / 65  High Risk AI Applications Scoring https://gptzero.me Gabriele Graffieti Introduction to AI Ethics May 12, 2023 52 / 65  High Risk AI Applications Scoring Gabriele Graffieti Introduction to AI Ethics May 12, 2023 53 / 65  How to build ethical machines Section 5 How to build ethical machines Gabriele Graffieti Introduction to AI Ethics May 12, 2023 54 / 65  How to build ethical machines Risk Management & Safety II Why fair AI is so difficult to obtain? Industrial history: ▶ Software development: not economically valuable Just roll out v. 1.1 or a security patch → Actually perceived as valuable. Cyber rather than physical. ▶ Compare with infrastructure or industrial products engineering: Product recalls and failures. Very physical. Hype and startuppy culture: ▶ Software development: minimise time to market, “easy money”/smart potato, clients’ care. ▶ Infrastructure and industrial products: entrenched industry, public tenders, educate the client. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 55 / 65  How to build ethical machines Three layers of AI (and technology) Safety First Layer: Alignment ▶ Do what I mean given this environment. ▶ Technology works in intended use-cases. ▶ E.g. bias and fairness. Second Layer: Robustness ▶ Keep doing what I mean in unforeseen environment. ▶ Technology is safe even in unintended use-cases. ▶ E.g. ethics in decisions and adversarial attacks. Third Layer: Corrigibility ▶ Enable me to detect and correct your mistakes. ▶ Imperfect technology can be detected and improved over time. ▶ E.g. white box models. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 56 / 65  How to build ethical machines How to Insert Ethics in AI The most ethical approach? Ethics by design: ▶ Can be paternalistic as it constrains the choices of agents. ▶ i.e. speed bumps (permanent and leaves no real choice, especially in emergency). Pro-ethical design: ▶ It does not preclude a course of action, but it requires the agents to make up their mind about it (still forces to make a choice, but less of a paternalistic nudge). ▶ i.e. a speed camera (leave freedom to choose to pay a ticket, especially in emergency Gabriele Graffieti Introduction to AI Ethics May 12, 2023 57 / 65  How to build ethical machines Some Countermeasures I Use explainable models An artificial intelligence model can be white box by design. ▶ E.g. symbolic reasoning systems. We can theoretically know the output of the system for every possible input. We can inspect the system in order to find biases and weaknesses. A white box model is easier to fix. Explainability a priori. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 58 / 65  How to build ethical machines Some Countermeasures II Explain black box models Attention models. Test the model with different data until the reasons of the input-output mapping is inferred. ▶ E.g. cover portions of images until the most important patch is found. ▶ E.g. change the data in a loan request until the bank’s AI system accept/reject it. Explainability a posteriori. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 59 / 65  How to build ethical machines Some Countermeasures III Image from “Visualizing and Understanding Convolutional Networks”, Zeiler et al. Gabriele Graffieti Introduction to AI Ethics May 12, 2023 60 / 65  How to build ethical machines Some Countermeasures IV Image from “Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead”, Cynthia Rudin Gabriele Graffieti Introduction to AI Ethics May 12, 2023 61 / 65  How to build ethical machines To sum up Ethics in AI is still an open issue Generally it was not taught to AI scholars In the last few years ethics was overshadowed by the incredible results of AI systems Only now AI is so pervasive that can greatly affect people’s life. But is becoming an high considerable property of present and future AI systems Many companies have started hiring ethicists in their AI teams The EU is planning to propose a regulation of AI and its applications Many top conferences requires to discuss the ethics of any submission Gabriele Graffieti Introduction to AI Ethics May 12, 2023 62 / 65  How to build ethical machines Some advice Always think about the possible (ethical) problems of your AI system Spend a lot of time to think about data, how it was acquired, how it was labeled, the level of generalization,... Try to maintain a collaboration with AI ethicists, AI philosophers, people who care and know about ethics Do not fall for easy and fast enthusiasm: the possible bad outcomes are often hidden and difficult to spot. Be an advocate for ethical AI systems How AI take decisions is often totally different from how humans take the same decision! Gabriele Graffieti Introduction to AI Ethics May 12, 2023 63 / 65  How to build ethical machines Question time Gabriele Graffieti Introduction to AI Ethics May 12, 2023 64 / 65  Introduction to AI Ethics Deep Learning course Seminar (AA 2022/2023) Gabriele Graffieti Algorithm Engineer @ Ambarella Head of AI Research @ AI for People May 12, 2023 Gabriele Graffieti Introduction to AI Ethics May 12, 2023 65 / 65