ETI CH1.pdf

Emerging Trends in CO and IT (22618) Unit-1 Artificial Intelligence Content 1.1 Introduction of AI o Concept o Scope of AI o Components of AI o Types of AI o Application of AI 1.2 Concept of machine learning and deep learning. 1.1 Introduction...

Emerging Trends in CO and IT (22618) Unit-1 Artificial Intelligence Content 1.1 Introduction of AI o Concept o Scope of AI o Components of AI o Types of AI o Application of AI 1.2 Concept of machine learning and deep learning. 1.1 Introduction of AI A branch of Computer Science named Artificial Intelligence (AI)pursues creating the computers / machines as intelligent as human beings. John McCarthy the father of Artificial Intelligence described AI as, “The science and engineering of making intelligent machines, especially intelligent computer programs”. Artificial Intelligence (AI) is a branch of Science which deals with helping machines find solutions to complex problems in a more human-like fashion. Artificial is defined in different approaches by various researchers during its evolution, such as “Artificial Intelligence is the study of how to make computers do things which at the moment, people do better.” There are other possible definitions “like AI is a collection of hard problems which can be solved by humans and other living things, but for which we don’t have good algorithms for solving.” e. g., understanding spoken natural language, medical diagnosis, circuit design, learning, self-adaptation, reasoning, chess playing, proving math theories, etc.  Data: Data is defined as symbols that represent properties of objects events and their environment.  Information: Information is a message that contains relevant meaning, implication, or input for decision and/or action.  Knowledge: It is the (1) cognition or recognition (know-what), (2) capacity to act(know-how), and(3)understanding (know-why)that resides or is contained within the mind or in the brain. Maharashtra State Board of Technical Education 1 Emerging Trends in CO and IT (22618)  Intelligence: It requires ability to sense the environment, to make decisions, and to control action. 1.1.1 Concept: Artificial Intelligence is one of the emerging technologies that try to simulate human reasoning in AI systems The art and science of bringing learning, adaptation and self- organization to the machine is the art of Artificial Intelligence. Artificial Intelligence is the ability of a computer program to learn and think.Artificial intelligence (AI) is an area of computer science that emphasizes the creation of intelligent machines that work and reacts like humans. AI is built on these three important concepts Machine learning: When you command your smartphone to call someone, or when you chat with a customer service chatbot, you are interacting with software that runs on AI. But this type of software actually is limited to what it has been programmed to do. However, we expect to soon have systems that can learn new tasks without humans having to guide them. The idea is to give them a large amount of examples for any given chore, and they should be able to process each one and learn how to do it by the end of the activity. Deep learning: The machine learning example I provided above is limited by the fact that humans still need to direct the AI’s development. In deep learning, the goal is for the software to use what it has learned in one area to solve problems in other areas. For example, a program that has learned how to distinguish images in a photograph might be able to use this learning to seek out patterns in complex graphs. Neural networks: These consist of computer programs that mimic the way the human brain processes information. They specialize in clustering information and recognizing complex patterns, giving computers the ability to use more sophisticated processes to analyze data. 1.1.2 Scope of AI: The ultimate goal of artificial intelligence is to create computer programs that can solve problems and achieve goals like humans would. There is scope in developing machines in robotics, computer vision, language detection machine, game playing, expert systems, speech recognition machine and much more. The following factors characterize a career in artificial intelligence:  Automation  Robotics  The use of sophisticated computer software Individuals considering pursuing a career in this field require specific education based on the foundations of math, technology, logic and engineering perspectives. Apart from these, good communication skills (written and verbal) are imperative to convey how AI services and tools will help when employed within industry settings. AI Approach: The difference between machine and human intelligence is that the human think / act rationally compare to machine. Historically, all four approaches to AI have been followed, each by different people with different methods. Maharashtra State Board of Technical Education 2 Emerging Trends in CO and IT (22618) Fig 1.1 AI Approaches Think Well: Develop formal models of knowledge representation, reasoning, learning, memory, problem solving thatcan be rendered in algorithms. There is often an emphasis on a systems that are provably correct, and guarantee finding an optimal solution. Act Well: For a given set of inputs, generate an appropriate output that is not necessarily correct but gets the job done.  A heuristic (heuristic rule, heuristic method) is a rule of thumb, strategy, trick, simplification, or any other kind of device which drastically limits search for solutions in large problem spaces.  Heuristics do not guarantee optimal solutions; in fact, they do not guarantee any solution at all:  all that can be said for a useful heuristic is that it offers solutions which are good enough most of the time Think like humans: Cognitive science approach. Focus not just on behavior and I/O but also look at reasoning process. The Computational model should reflect “how” results were obtained. Provide a new language forexpressing cognitive theories and new mechanisms for evaluating them. GPS (General Problem Solver): Goal not just to produce humanlike behavior (like ELIZA), but to produce a sequence of steps of the reasoning process that was similar to the steps followed by a person in solving the same task. Act like humans: Behaviorist approach-Not interested in how you get results, just the similarity to what human results are. Example: ELIZA: A program that simulated a psychotherapist interacting with a patient and successfully passed the Turing Test. It was coded at MIT during 1964-1966 by Joel Weizenbaum. First script was DOCTOR. The script was a simple collection of syntactic patterns not unlike regular expressions. Each pattern had an associated reply which might Maharashtra State Board of Technical Education 3 Emerging Trends in CO and IT (22618) include bits of the input (after simple transformations (my →your) Weizenbaum was shocked at reactions: Psychiatrists thought it had potential. People unequivocally anthropomorphized. 1.1.3 Components of AI The core components and constituents of AI are derived from the concept of logic, cognition and computation; and the compound components, built-up through core components are knowledge, reasoning, search, natural language processing, vision etc. Level Core Compound Coarse components Logic Induction Knowledge Knowledge based Proposition Reasoning systems Tautology Control Model Logic Search Heuristic Search Theorem Proving Cognition Temporal Learning Belief Multi Agent system Adaptation Desire Co-operation Self-organization Intention Co-ordination AI Programming Functional Memory Vision Perception Utterance Natural Language Speech Processing The core entities are inseparable constituents of AI in that these concepts are fused at atomic level. The concepts derived from logic are propositional logic, tautology, predicate calculus, model and temporal logic. The concepts of cognitive science are of two types: one is functional which includes learning, adaptation and self-organization, and the other is memory and perception which are physical entities. The physical entities generate some functions to make the compound components The compound components are made of some combination of the logic and cognition stream. These are knowledge, reasoning and control generated from constituents of logic such as predicate calculus, induction and tautology and some from cognition (such as learning and adaptation). Similarly, belief, desire and intention are models of mental states that are predominantly based on cognitive components but less on logic. Vision, utterance (vocal) and expression (written) are combined effect of memory and perceiving organs or body sensors such as ear, eyes and vocal. The gross level contains the constituents at the third level which are knowledge-based systems (KBS), heuristic search, automatic theorem proving, multi- agent systems, Al languages such as PROLOG and LISP, Natural language processing (NLP). Speech processing and vision are based mainly on the principle of pattern recognition. AI Dimension: The philosophy of Al in three-dimensional representations consists in logic, cognition and computation in the x-direction, knowledge, reasoning and interface in the y- direction. The x-y plane is the foundation of AI. The z-direction consists of correlated systems of physical origin such as language, vision and perception as shown in Figure.1.1 Maharashtra State Board of Technical Education 4 Emerging Trends in CO and IT (22618) Fig. 1.2 Three dimensional model of AI The First Dimension (Core) The theory of logic, cognition and computation constitutes the fusion factors for the formation of one of the foundations on coordinate x-axis. Philosophy from its very inception of origin covered all the facts, directions and dimensions of human thinking output. Aristotle's theory of syllogism, Descartes and Kant's critic of pure reasoning and contribution of many other philosophers made knowledge-based on logic. It were Charles Babbage and Boole who demonstrated the power of computation logic. Although the modern philosophers such as Bertrand Russell correlated logic with mathematics but it was Turing who developed the theory of computation for mechanization. In the 1960s, Marvin Minsky pushed the logical formalism to integrate reasoning with knowledge. Cognition: Computers has became so popular in a short span of time due to the simple reason that they adapted and projected the information processing paradigm (IPP) of human beings: sensing organs as input, mechanical movement organs as output and the central nervous system (CNS) in brain as control and computing devices, short-term and long-term memory were not distinguished by computer scientists but, as a whole, it was in conjunction, termed memory. In further deepening level, the interaction of stimuli with the stored information to produce new information requires the process of learning, adaptation and self-organization. These functionalities in the information processing at a certain level of abstraction of brain activities demonstrate a state of mind which exhibits certain specific behaviour to qualify as intelligence. Computational models were developed and incorporated in machines which mimicked the functionalities of human origin. The creation of such traits of human beings in the computing devices and processes originated the concept of intelligence in machine as virtual mechanism. These virtual machines were termed in due course of time artificial intelligent machines. Maharashtra State Board of Technical Education 5 Emerging Trends in CO and IT (22618) Computation The theory of computation developed by Turing-finite state automation—was a turning point in mathematical model to logical computational. Chomsky's linguistic computational theory generated a model for syntactic analysis through a regular grammar. The Second Dimension The second dimension contains knowledge, reasoning and interface which are the components of knowledge-based system (KBS). Knowledge can be logical, it may be processed as information which is subject to further computation. This means that any item on the y-axis is correlated with any item on the x-axis to make the foundation of any item on the z-axis. Knowledge and reasoning are difficult to prioritize, which occurs first: whether knowledge is formed first and then reasoning is performed or as reasoning is present, knowledge is formed. Interface is a means of communication between one domain to another. Here, it connotes a different concept then the user's interface. The formation of a permeable membrane or transparent solid structure between two domains of different permittivity is termed interface. For example, in the industrial domain, the robot is an interface. A robot exhibits all traits of human intelligence in its course of action to perform mechanical work. In the KBS, the user's interface is an example of the interface between computing machine and the user. Similarly, a program is an interface between the machine and the user. The interface may be between human and human, i.e. experts in one domain to experts in another domain. Human-to- machine is program and machine-to-machine is hardware. These interfaces are in the context of computation and AI methodology. The Third Dimension The third dimension leads to the orbital or peripheral entities, which are built on the foundation of x-y plane and revolve around these for development. The entities include an information system. NLP, for example, is formed on the basis of the linguistic computation theory of Chomsky and concepts of interface and knowledge on y-direction. Similarly, vision has its basis on some computational model such as clustering, pattern recognition computing models and image processing algorithms on the x-direction and knowledge of the domain on the y-direction. The third dimension is basically the application domain. Here, if the entities are near the origin, more and more concepts are required from the x-y plane. For example, consider information and automation, these are far away from entities on z-direction, but contain some of the concepts of cognition and computation model respectively on x-direction and concepts of knowledge (data), reasoning and interface on the y-direction. In general, any quantity in any dimension is correlated with some entities on the other dimension. The implementation of the logical formalism was accelerated by the rapid growth in electronic technology, in general and multiprocessing parallelism in particular. Maharashtra State Board of Technical Education 6 Emerging Trends in CO and IT (22618) 1.1.4 Types of AI Artificial Intelligence can be divided in various types, there are mainly two types of main categorization which are based on capabilities and based on functionally of AI. Following is flow diagram which explain the types of AI. Fig 1.3 Types of AI AI type-1: Based on Capabilities 1. Weak AI or Narrow AI:  Narrow AI is a type of AI which is able to perform a dedicated task with intelligence. The most common and currently available AI is Narrow AI in the world of Artificial Intelligence.  Narrow AI cannot perform beyond its field or limitations, as it is only trained for one specific task. Hence it is also termed as weak AI. Narrow AI can fail in unpredictable ways if it goes beyond its limits.  Apple Siriis a good example of Narrow AI, but it operates with a limited pre-defined range of functions.  IBM's Watson supercomputer also comes under Narrow AI, as it uses an Expert system approach combined with Machine learning and natural language processing.  Some Examples of Narrow AI are playing chess, purchasing suggestions on e- commerce site, self-driving cars, speech recognition, and image recognition. 2. General AI:  General AI is a type of intelligence which could perform any intellectual task with efficiency like a human.  The idea behind the general AI to make such a system which could be smarter and think like a human by its own.  Currently, there is no such system exist which could come under general AI and can perform any task as perfect as a human.  The worldwide researchers are now focused on developing machines with General AI.  As systems with general AI are still under research, and it will take lots of efforts and time to develop such systems. Maharashtra State Board of Technical Education 7 Emerging Trends in CO and IT (22618) 3. Super AI:  Super AI is a level of Intelligence of Systems at which machines could surpass human intelligence, and can perform any task better than human with cognitive properties. It is an outcome of general AI.  Some key characteristics of strong AI include capability include the ability to think, to reason, solve the puzzle, make judgments, plan, learn, and communicate by its own.  Super AI is still a hypothetical concept of Artificial Intelligence. Development of such systems in real is still world changing task. Artificial Intelligence type-2: Based on functionality 1. Reactive Machines  Purely reactive machines are the most basic types of Artificial Intelligence.  Such AI systems do not store memories or past experiences for future actions.  These machines only focus on current scenarios and react on it as per possible best action.  IBM's Deep Blue system is an example of reactive machines.  Google's AlphaGo is also an example of reactive machines. 2. Limited Memory  Limited memory machines can store past experiences or some data for a short period of time.  These machines can use stored data for a limited time period only.  Self-driving cars are one of the best examples of Limited Memory systems. These cars can store recent speed of nearby cars, the distance of other cars, speed limit, and other information to navigate the road. 3. Theory of Mind  Theory of Mind AI should understand the human emotions, people, beliefs, and be able to interact socially like humans.  This type of AI machines are still not developed, but researchers are making lots of efforts and improvement for developing such AI machines. 4. Self-Awareness  Self-awareness AI is the future of Artificial Intelligence. These machines will be super intelligent, and will have their own consciousness, sentiments, and self-awareness.  These machines will be smarter than human mind.  Self-Awareness AI does not exist in reality still and it is a hypothetical concept. 1.1.5 Application of AI AI has been dominant in various fields such as −  Gaming: AI plays crucial role in strategic games such as chess, poker, tic-tac-toe, etc., where machine can think of large number of possible positions based on heuristic knowledge. Maharashtra State Board of Technical Education 8 Emerging Trends in CO and IT (22618)  Natural Language Processing: It is possible to interact with the computer that understands natural language spoken by humans.  Expert Systems: There are some applications which integrate machine, software, and special information to impart reasoning and advising. They provide explanation and advice to the users.  Vision Systems: These systems understand, interpret, and comprehend visual input on the computer. For example, o A spying aeroplane takes photographs, which are used to figure out spatial information or map of the areas. o Doctors use clinical expert system to diagnose the patient. o Police use computer software that can recognize the face of criminal with the stored portrait made by forensic artist.  Speech Recognition: Some intelligent systems are capable of hearing and comprehending the language in terms of sentences and their meanings while a human talks to it. It can handle different accents, slang words, noise in the background, change in human’s noise due to cold, etc.  Handwriting Recognition: The handwriting recognition software reads the text written on paper by a pen or on screen by a stylus. It can recognize the shapes of the letters and convert it into editable text.  Intelligent Robots: Robots are able to perform the tasks given by a human. They have sensors to detect physical data from the real world such as light, heat, temperature, movement, sound, bump, and pressure. They have efficient processors, multiple sensors and huge memory, to exhibit intelligence. In addition, they are capable of learning from their mistakes and they can adapt to the new environment. 1.2 Concept of machine learning and deep learning 1.2.1 Machine Learning:  Machine learning is a branch of science that deals with programming the systems in such a way that they automatically learn and improve with experience. Here, learning means recognizing and understanding the input data and making wise decisions based on the supplied data.  It is very difficult to cater to all the decisions based on all possible inputs. To tackle this problem, algorithms are developed. These algorithms build knowledge from specific data and past experience with the principles of statistics, probability theory, logic, combinatorial optimization, search, reinforcement learning, and control theory. The developed algorithms form the basis of various applications such as:  Vision processing  Language processing  Forecasting (e.g., stock market trends)  Pattern recognition  Games  Data mining  Expert systems Maharashtra State Board of Technical Education 9 Emerging Trends in CO and IT (22618)  Robotics Machine learning is a vast area and it is quite beyond the scope of this tutorial to cover all its features. There are several ways to implement machine learning techniques, however the most commonly used ones are supervised and unsupervised learning. Supervised Learning: Supervised learning deals with learning a function from available training data. A supervised learning algorithm analyzes the training data and produces an inferred function, which can be used for mapping new examples. Common examples of supervised learning include:  classifying e-mails as spam,  labeling webpages based on their content, and  voice recognition. There are many supervised learning algorithms such as neural networks, Support Vector Machines (SVMs), and Naive Bayes classifiers. Mahout implements Naive Bayes classifier. Unsupervised Learning: Unsupervised learning makes sense of unlabeled data without having any predefined dataset for its training. Unsupervised learning is an extremely powerful tool for analyzing available data and look for patterns and trends. It is most commonly used for clustering similar input into logical groups. Common approaches to unsupervised learning include:  k-means  self-organizing maps, and  hierarchical clustering 1.2.2 Deep Learning Deep learning is a subfield of machine learning where concerned algorithms are inspired by the structure and function of the brain called artificial neural networks. All the value today of deep learning is through supervised learning or learning from labelled data and algorithms. Each algorithm in deep learning goes through the same process. It includes a hierarchy of nonlinear transformation of input that can be used to generate a statistical model as output. Consider the following steps that define the Machine Learning process  Identifies relevant data sets and prepares them for analysis.  Chooses the type of algorithm to use  Builds an analytical model based on the algorithm used.  Trains the model on test data sets, revising it as needed.  Runs the model to generate test scores. Deep learning has evolved hand-in-hand with the digital era, which has brought about an explosion of data in all forms and from every region of the world. This data, known simply as big data, is drawn from sources like social media, internet search engines, e-commerce platforms, and online cinemas, among others. This enormous amount of data is readily accessible and can be shared through fintech applications like cloud computing. Maharashtra State Board of Technical Education 10 Emerging Trends in CO and IT (22618) However, the data, which normally is unstructured, is so vast that it could take decades for humans to comprehend it and extract relevant information. Companies realize the incredible potential that can result from unraveling this wealth of information and are increasingly adapting to AI systems for automated support. Applications of Machine Learning and Deep Learning  Computer vision which is used for facial recognition and attendance mark through fingerprints or vehicle identification through number plate.  Information Retrieval from search engines like text search for image search.  Automated email marketing with specified target identification.  Medical diagnosis of cancer tumors or anomaly identification of any chronic disease.  Natural language processing for applications like photo tagging. The best example to explain this scenario is used in Facebook.  Online Advertising. References:  https://www.tutorialspoint.com/artificial_intelligence/artificial_intelligence_overview. htm  https://www.javatpoint.com/introduction-to-artificial-intelligence  https://www.tutorialspoint.com/tensorflow/tensorflow_machine_learning_deep_learni ng.htm Sample Multiple Choice Questions 1. __________________is a branch of Science which deals with helping machines find solutions to complex problems in a more human-like fashion a. Artificial Intelligence b. Internet of Things c. Embedded System d. Cyber Security 2. In ______________ the goal is for the software to use what it has learned in one area to solve problems in other areas. a. Machine learning b. Deep learning c. Neural networks d. None of these 3. Computer programs that mimic the way the human brain processes information is called as a. Machine learning b. Deep learning c. Neural networks d. None of these Maharashtra State Board of Technical Education 11 Emerging Trends in CO and IT (22618) 4. The core components and constituents of AI are derived from a. concept of logic b. cognition c. computation d. All of above 5. Chomsky's linguistic computational theory generated a model for syntactic analysis through a. regular grammar b. regular expression c. regular word d. none of these` 6. These machines only focus on current scenarios and react on it as per possible best action a. Reactive Machines b. Limited Memory c. Theory of Mind d. Self-Awareness Maharashtra State Board of Technical Education 12