Week 2 - CPUs.pdf

ACSIT Computer Systems Fundamentals INFO1250 Conestoga College  ACSIT What are the major components CPU Memory Motherboard Expansion boards Case Power supply Fans 9/12/2023 INFO1250 2 ...

ACSIT Computer Systems Fundamentals INFO1250 Conestoga College  ACSIT What are the major components CPU Memory Motherboard Expansion boards Case Power supply Fans 9/12/2023 INFO1250 2  ACSIT Week 7 – CPUs 3  ACSIT What is CPU Central Processing Unit The heart of the whole system Does that actual work Everything else is supporting players 9/12/2023 INFO1250 4  ACSIT What is CPU Basic operations Control Fetch, decode, execute Execute Mathematics Add, subtract, multiply, divide Integer, floating point Count, decrement Address translation Translate relative addresses to real addresses 9/12/2023 INFO1250 5  ACSIT What is CPU 9/12/2023 INFO1250 6  ACSIT Early CPUs 9/12/2023 INFO1250 7  ACSIT Current CPUs 9/12/2023 INFO1250 8  ACSIT Current CPUs 9/12/2023 INFO1250 9  ACSIT Basic Classifications CISC Complex Instruction Set Computer Intel i series/ AMD Ryzen series Most common RISC Reduced Instruction Set Computer IBM Power series/ Broadcom /Apple M series 9/12/2023 INFO1250 10  ACSIT Marketing Usage based Workstation Server Mainstream Enthusiast Budget 9/12/2023 INFO1250 11  ACSIT Marketing 9/12/2023 INFO1250 12  ACSIT Identify and describe common Intel and AMD processor socket types 13  ACSIT Intel vs AMD 14  ACSIT Intel vs AMD 15  ACSIT Intel vs AMD 16  ACSIT Northbridge 17  ACSIT Northbridge A northbridge or host bridge One of the two chips in the core logic chipset architecture on a PC motherboard, the other being the southbridge. Connected directly to the CPU via the front-side bus (FSB) responsible for tasks that require the highest performance such as Memory access. Thus also known as Memory Controller Hub On the same die as CPUs in most modern chips 18  ACSIT Current CPUs 9/12/2023 INFO1250 19  ACSIT Northbridge PCI-E 20  ACSIT Northbridge 21  ACSIT Clock A clock cycle is the time it takes for the CLK wire to charge. – A cycle is one complete up-and-down segment of the sine wave. – Every command requires at least two clock cycles. 22  ACSIT Clock Speed Clock speed is the maximum number of clock cycles the CPU can handle in a given time period. Clock speed is measured in hertz – One cycle per second = 1 hertz (Hz) 1 million cycles per second = 1 megahertz (MHz) 1 billion cycles per second = 1 gigahertz (GHz) – Intel 8088 ran at 4.77 MHz – Modern CPUs run at 3+ GHz 23  ACSIT Clock Speed Where is the clock speed? SYST8000 24  ACSIT System Crystal System crystal governs CPU running speed Modern CPUs tell the motherboard the clock speed it needs, and the clock chip automatically adjusts. SYST8000 One of many types of system crystals 20  ACSIT System Crystal (continued) Crystal can clock a CPU with a rated speed higher than the crystal, but the CPU will operate at the slower speed of the crystal. – A 1 GHz crystal can clock a 2 GHz CPU, but the CPU will operate only as fast as the crystal clock—1 GHz. – Underclocking means running a CPU slower than its rated clock speed—it does not take advantage of all the power of the CPU. – Overclocking means to run a CPU faster than its maximum clock speed—it can overheat the CPU. 26  ACSIT Back to the External Data Bus Diagram of an Intel 8088 showing the external data bus and clock wires 27  ACSIT Memory A program is stored on the hard drive. Hard drives can’t give the CPU data at a fast enough speed, so something that stores the program and gives it to the CPU rapidly is needed. Devices that hold ones and zeros that the CPU accesses are called memory. Each line of memory has an address – Used to locate the data 28  ACSIT Memory and RAM Random access memory (RAM) is organized like a spreadsheet, with each row holding eight bits (one byte). – A bit is a one or a zero RAM transfers and stores data to and from the CPU in byte-sized chunks Number of bytes of RAM varies from PC to PC, with today's PCs holding billions of bytes of RAM 29  ACSIT 9/13/2023 INFO1250 30  ACSIT Hierarchy Example The number of levels in the memory hierarchy and the performance at each level has increased over time. The type of memory or storage components also change historically. For example, the memory hierarchy of an Intel Haswell Mobile processor circa 2013 is: Processor registers – the fastest possible access (usually 1 CPU cycle). A few thousand bytes in size Cache Level 0 (L0) Micro operations cache – 6 KiB in size Level 1 (L1) Instruction cache – 128 KiB in size Level 1 (L1) Data cache – 128 KiB in size. Best access speed is around 700 GiB/second Level 2 (L2) Instruction and data (shared) – 1 MiB in size. Best access speed is around 200 GiB/second Level 3 (L3) Shared cache – 6 MiB in size. Best access speed is around 100 GB/second Level 4 (L4) Shared cache – 128 MiB in size. Best access speed is around 40 GB/second Main memory (Primary storage) – Gigabytes in size. Best access speed is around 10 GB/second. In the case of a NUMA machine, access times may not be uniform Disk storage (Secondary storage) – Terabytes in size. As of 2017, best access speed is from a consumer solid state drive is about 2000 MB/second Nearline storage (Tertiary storage) – Up to exabytes in size. As of 2013, best access speed is about 160 MB/second Offline storage 2023-09-13 wikipedia 31  ACSIT RAM as a Spreadsheet RAM as a spreadsheet 32  ACSIT DRAM Computers use dynamic RAM (DRAM) for main memory – Dynamic rather than static Circuits need constant electrical charge and to be refreshed to maintain data. 33  ACSIT Address Bus CPU and RAM need a method to communicate, so they use the EDB. The CPU needs a helper chip—the memory controller chip (MCC) to facilitate the flow of data from RAM to the CPU. 27 Extending the EDB The MCC grabs a byte of RAM.  ACSIT Address Bus (continued) The address bus is a separate set of wires from the external data bus. – Enables the CPU to control the MCC – CPU tells the MCC which line of code it wants from RAM 35  ACSIT Address Bus (continued) The number of wires in the address bus determines the maximum amount of RAM the CPU can handle. – An 8088 had 20 wires, which provided 220 (1,048,576) combinations. Address space of 1,048,576 bytes or one megabyte (1 MB) 36  ACSIT Bits and Bytes Any individual 1 or 0 = a bit 4 bits = a nibble 8 bits = a byte 16 bits = a word 32 bits = a double word 64 bits = a paragraph or quad word Bits are represented as b (e.g., Kb) Bytes are represented as B (e.g., KB) 37  ACSIT Addressing Rows of RAM To determine the location in RAM – First byte of RAM represented by twenty zeros (00000000000000000000) – Last RAM row represented by twenty ones (11111111111111111111) 38  ACSIT Modern CPUs Developers – Intel has dominated the industry with its CPUs and motherboard support chips. Modern Intel processors include Core, Pentium, Celeron, Atom, and Xeon brands. – AMD has kept competition in the CPU market. While Intel holds the most market share, AMD provides quality CPUs at competitive prices. 39  ACSIT Modern CPUs Early Intel and AMD CPUs were identical; but they are no longer interchangeable. 40  ACSIT Model Names Intel and AMD differentiate product lines by using different product names, based on the target market. Current Intel and AMD Product Lines and Names Market Intel AMD Mainstream and enthusiast desktop Core i7/i5/i3 A-Series, FX Budget desktop Pentium, Celeron Sempron, Athlon Server Xeon Opteron 41  ACSIT Both companies use code names to keep track of different variations within models. – CPUs labeled as the same model may have CPUs inside that are very different from earlier versions of that model. 42  ACSIT 43  ACSIT Mobile devices need to consume as little electricity as possible. Less electricity consumption extends the battery charge and creates less heat. Both manufactures have created both mobile and desktop versions of their CPUs. 44  ACSIT Desktop Versus Mobile Saving energy by making the CPU run more slowly when demand is light is called throttling. 45  ACSIT Technology Ways CPUs have been improved – Clock multipliers – 64-bit processing – Virtualization support – Parallel execution – Multicore processing – Integrated memory controller (IMC) – Integrated graphics processing unit (GPU) – Security 46  ACSIT Clock Multipliers All modern CPUs run at some multiple of the system clock speed. In early computers, the CPU ran at the same speed as the bus. – Designers discovered that the CPU could run faster than other chips on the motherboard. – Technicians had to set jumpers or dual in-line package (DIP) switches on older motherboards to configure the multiplier. – Now the motherboard is automatically configured through a function called CPUID (CPU identifier). 47  ACSIT DIP switches on a motherboard 48  ACSIT 49  ACSIT EDB and address-bus size increased in size. New technologies such as multimedia extensions (MMX) and Streaming SIMD Extensions (SSE) were added; – Caused shift to 64-bit technology Most new CPUs support 64-bit processing – Can run a compatible 64-bit operating system, such as Windows 10, or Linux, and 64-bit applications. 50  ACSIT 64-Bit Processing CPUs also still support 32-bit processing for 32- bit operating systems, and 32-bit applications. Primary benefit to moving to 64-bit – Supports more than 4 GB of memory – up to 16 EB (Exabyte) 51  ACSIT Cache A cache reduces wait states by using built-in, very high- speed RAM called static RAM (SRAM). – SRAM preloads as many instructions as possible. – The cache on the CPU was called the L1 cache because it was used first by the CPU. – The cache on the motherboard was called the L2 cache, and used second by the CPU. Later added to CPU package – Most newer CPUs include three caches. 52  ACSIT The address bus and external data bus (connecting the CPU, MCC, and RAM) were lumped into a single term called the frontside bus. The connection between the CPU and the L2 cache became known as the backside bus. 53  ACSIT CPU-Z displaying the cache SRAM cache information for a Core i7 processor 5437  ACSIT Frontside and backside buses 55  ACSIT Almost all current microprocessors have an integrated memory controller (IMC) – Moved from the motherboard chip into the CPU to optimize the flow of information into and out from the CPU – Causes different CPUs to require different types and capacities of RAM 56  ACSIT Integrated Graphics Processing Unit Integrated graphics processing unit (IGPU), Integrated graphics, shared graphics solutions, integrated graphics processors (IGP) or unified memory architecture (UMA) utilize a portion of a computer's system RAM rather than dedicated graphics memory. IGPs can be integrated onto the motherboard as part of the (northbridge) chipset, or on the same die with the CPU (like AMD APU or Intel HD Graphics). 50  ACSIT Integrated Graphics Processing Unit Video processing portion of computer tasks are handled by the graphics processing unit (GPU) – Can handle certain tasks much more efficiently than the standard CPU Enhances computer’s overall performance while reducing energy use, size, and cost – Ideal for mobile devices 58  ACSIT Enhancing CPU Performance CPU’s can only be so fast – As of 2014, the Guinness World Record for the highest CPU clock rate is an overclocked, 8.723 GHz AMD Piledriver-based FX-8370 chip. It surpassed the previous record achieved in 2011, an 8.429 GHz AMD FX-8150 Bulldozer-based chip Heat becomes an issue as speed increases 59  ACSIT Enhancing CPU Performance Multi-Core Virtualization (vCPU) Parallel Execution Multithreading Pipelining 60  ACSIT Multi-Core A multi-core processor is a computer processor integrated circuit with two or more separate processing units, called cores, each of which reads and executes program instructions, as if the computer had several processors. 61  ACSIT Multi-Core (continued) Just announced, June 2020, the 64-bit Arm server chips includes a 128 core CPU Intel has a Xeon CPU with 56 cores AMD has an EPYC CPU with 48 cores 62  ACSIT Multi-Core (continued) Multi-Core and cache setup CountingPine at English Wikipedia 63  ACSIT Virtualization (vCPU) Single Core 64  ACSIT Virtualization (continued) Each CPU can run 5-10 virtual CPU’s (vCPU) 65  ACSIT Virtualization (continued) Each CPU have Core Core multiple cores – CPU’s within the Core Core CPU 66  ACSIT Virtualization (continued) Each CPU have vCPU vCPU 1 Core vCPU vCPU vCPU vCPU vCPU 1 Core vCPU vCPU vCPU multiple cores vCPU vCPU vCPU vCPU vCPU vCPU Each core can have vCPU vCPU 1 Core vCPU vCPU vCPU vCPU 1Core vCPU vCPU 5-10 vCPU’s vCPU vCPU vCPU vCPU vCPU vCPU vCPU vCPU 67  ACSIT Parallel Execution Parallel computing is a type of computation where many calculations or the execution of processes are carried out simultaneously. Large problems can often be divided into smaller ones, which can then be solved at the same time. Wikipedia 68  ACSIT Parallel Execution (continued) Non-parallel execution – 4*6*2*8 4 6 Process 24 2 Process 48 8 Process 384 69  ACSIT Parallel Execution (continued) Parallel execution – 4*6*2*8 4 6 Process 24 16 Process 384 2 8 Process 16 70  ACSIT Parallel Execution (continued) Parallel execution – 4*6*2*(7+1) 4 6 Process 24 2 Process 48 8 Process 384 7 1 Process 8 SYST8000 71  ACSIT Multithreading In computer architecture, multithreading is the ability of a central processing unit (CPU) (or a single core in a multi-core processor) to provide multiple threads of execution concurrently, supported by the operating system. wikipedia 72  ACSIT A multiprocessing system has more than two processors whereas Multithreading is a program execution technique that allows a single process to have multiple code segments Multiprocessing improves the reliability of the system while in the multithreading process, each thread runs parallel to each other. Multiprocessing helps you to increase computing power whereas multithreading helps you create computing threads of a single process 73  ACSIT...01100110 01101001 01110010 01110011 01110100 01110010 01100101 01110011…...01110011 01100101 01100011 01101110 01100100 74  ACSIT In computing, a pipeline, also known as a data pipeline, is a set of data processing elements connected in series, where the output of one element is the input of the next one. The elements of a pipeline are often executed in parallel or in time-sliced fashion. Wikipedia 75  ACSIT Pipelining (continued) Types of Pipeline – It is divided into 2 categories: Arithmetic Pipeline Instruction Pipeline 76  ACSIT Pipelining (continued) Arithmetic Pipeline – Arithmetic pipelines are usually found in most of the computers. They are used for floating point operations, multiplication of fixed point numbers etc. 77  ACSIT Pipelining (continued) Instruction Pipeline – In this a stream of instructions can be executed by overlapping fetch, decode and execute phases of an instruction cycle. This type of technique is used to increase the throughput of the computer system. 78  ACSIT Pipelining (continued) 0 1 2 3 4 5 6 7 8 9 Without Pipeling Waiting Instructions Stage 1: Fetch Pipeline Stage 2: Decode Stage 3: Execute Stage 4: Write-Back Completed Instructions 79  ACSIT Pipelining (continued) 0 1 2 3 4 5 6 7 8 9 With Pipeling Waiting Instructions Stage 1: Fetch Pipeline Stage 2: Decode Stage 3: Execute Stage 4: Write-Back Completed Instructions 80  ACSIT Pipelining (continued) 0 1 2 3 4 5 6 7 8 9 With Pipeling bubble Waiting Instructions Stage 1: Fetch Pipeline Stage 2: Decode Stage 3: Execute Stage 4: Write-Back Completed Instructions 81  ACSIT Security NX bit technology in all modern processors – Enables CPU to protect certain sections of memory – Stops malicious attacks from getting to essential operating system files – Known by different terms Microsoft – Data execution prevention (DEP) Intel – XD bit (eXecute Disable) AMD – Enhanced Virus Protection ARM – XN (eXecute Never) CompTIA – Disable execute bit 82  ACSIT Security (continued) DEP in Windows 83