HCIA-Storage V5.0 Training Material PDF

Storage Technology Trends  Foreword ⚫ Data carries information during the transmission on networks. What is the relationship between information and data? What is the function of data storage? This course describes the definitions of information and data in the co...

Storage Technology Trends  Foreword ⚫ Data carries information during the transmission on networks. What is the relationship between information and data? What is the function of data storage? This course describes the definitions of information and data in the computer field, their relationship, as well as the concept, development history, and development trend of data storage. 2 Huawei Confidential  Objectives On completion of this course, you will be able to understand:  Definitions of information and data  Concept of data storage  Development history of data storage  Development trend of data storage products 3 Huawei Confidential  Contents 1. Data and Information 2. Data Storage 3. Development of Storage Technologies 4. Development Trend of Storage Products 4 Huawei Confidential What is Data ⚫ SNIA (Storage Networking Industry Association) defines data as the digital representation of anything in any form. Format in which data is stored Email 0101001010100010000011 1100011100010001110001 1100000111101010100101 Digital music 0101001010100101001010 1001010101001010100010 1010010101001010101010 Digital video 0101010101010010100010 0101001010101010100101 Ebook 0101001010101010100101 0101010010100101001000 1010101001001010010010 5 Huawei Confidential Data Types Semi- Structured structured Unstructured data data data 6 Huawei Confidential Data Processing Cycle ⚫ Data processing is the reorganization or reordering of data by humans or machines to increase their specific value. A data processing cycle includes three basic steps: input, processing, and output. Input Processing Output 7 Huawei Confidential What is Information ⚫ Information is processed, structured, or rendered in a given context to make it Processing Information meaningful and useful. ⚫ Information is processed data, including data with context, relevance, and Data purpose. It also involves the manipulation of raw data. Data Redundancy 8 Huawei Confidential Data vs. Information ⚫ After being processed, data can be converted into information. ⚫ In order to be stored and transmitted in IT systems, information needs to be processed as data. Item Data Information Raw and meaningless, with no Feature Valuable and logical specific purpose Essence Original materials Processed data Dependence Data never depends on information Information depends on data Meteorological data or satellite Example Weather forecasts image data 9 Huawei Confidential Information Lifecycle Management ⚫ Information lifecycle management (ILM) refers to a set of management theories and methods from the stage in which the information is generated and initially stored to the stage where the information is obsoletely deleted. Data value Data Data Data Data Data Data creation protection access migration archiving destruction 10 Huawei Confidential  Contents 1. Data and Information 2. Data Storage 3. Development of Storage Technologies 4. Development Trend of Storage Products 11 Huawei Confidential What is Data Storage Storage in a narrow sense Storage in a broad sense 12 Huawei Confidential Data Storage System ⚫ Disaster recovery (DR) solutions ⚫ Backup solutions ⚫ Storage management software Solutions ⚫ Snapshot and mirroring software ⚫ Backup software ⚫ Multipathing software Storage software ⚫ Storage devices ⚫ Connection elements  Disk array  HBA cards  Tape library  Switches Storage hardware  Virtual tape  Cables library  …  … 13 Huawei Confidential Physical Structure of Storage Hosts Network switching devices NAS gateway Storage application software Front-end boards of controllers Cache Storage System Back-end boards of Storage management controllers software Connectors Disks 14 Huawei Confidential Data Storage Types Internal DAS SAN Storage FAS NAS Storage External Storage Object Storage 15 Huawei Confidential Evolution of Data Management Technologies Scale-out Dedicated storage device storage device Tape and single disk Big data management Card and paper Traditional tape database File system system management management Manual management 16 Huawei Confidential Data Storage Application Database servers Users Application servers Email servers Offline Online storage Nearline storage storage File servers Employees Classification based on data access frequencies Data Data Data generation processing management 17 Huawei Confidential  Contents 1. Data and Information 2. Data Storage 3. Development of Storage Technologies ◼ Storage Architecture ▫ Storage Media ▫ Interface Protocols 4. Development Trend of Storage Products 18 Huawei Confidential History of Storage Architecture Development 2000s 1990s Scale-out storage Storage Cloud storage 1980s network External storage 1950s Traditional storage 19 Huawei Confidential From Disks to Disk Arrays Disks in a server Early external storage Storage arrays Server Server Server CPU CPU CPU RAM RAM RAM Disks Disks Disks JBOD Controllers 20 Huawei Confidential From Separation to Convergence SAN NAS Clients Unified Storage Server Server Ethernet File system Server SAN LAN File NAS SAN system Storage Storage File system Storage 21 Huawei Confidential Scale-out Storage ⚫ Physical resources are organized using software to form a high-performance Front-end logical storage pool, ensuring reliability service network Management and providing multiple storage services. network ⚫ Generally, scale-out storage scatters data to multiple independent storage servers in a scalable system structure. It uses those storage servers to share... storage loads and uses location servers to locate storage information. Node Node Node Node Back-end storage network 22 Huawei Confidential Storage Virtualization ⚫ Storage virtualization consolidates the Clients or servers storage devices into logical resources, thereby providing comprehensive and unified storage services. Management ⚫ Unified functions are provided Logical resources regardless of different storage forms and device types. Virtualization Physical resources 23 Huawei Confidential Cloud Storage ⚫ The cloud storage system combines multiple storage devices, applications, and services. It uses highly virtualized multi-tenant infrastructure to provide scalable storage resources for enterprises. Those storage resources can be dynamically configured based on organization requirements. Legacy New applications applications Protocol and interface Converged Elastic Block storage service File storage service Object storage service Open Storage device and storage node Universal hardware platforms 24 Huawei Confidential  Contents 1. Data and Information 2. Data Storage 3. Development of Storage Technologies ▫ Storage Architecture ◼ Storage Media ▫ Interface Protocols 4. Development Trend of Storage Products 25 Huawei Confidential History of HDDs ⚫ Larger capacity with the smaller size. 1950s–1960s 1960s–1970s 1970s–1980s 1980s-1990s 1990s- Giant disk 14-inch disk 8-inch disk Portable Microdrive IBM 350 RAMAC IBM 3340 Disks started to 5.25-inch 1.8-inch IBM 1301 enter the civil 3.5-inch Hitachi: 1-inch market. 2.5-inch Toshiba: 0.85- inch... 26 Huawei Confidential History of SSDs ⚫ Solid-state drives (SSDs) were invented almost as early as HDDs, but were not popular at that time due to its high price and the rapid development of HDDs at the end of the 20th century. ⚫ With the requirement for high access speed, SSDs are booming. Bell Labs 1976 SanDisk 1999 Samsung 2010… Floating gate Dataram sold launched flash BiTMICRO released laptops Lower costs transistor Bulk Core. SSDs. launched flash using SSDs. Greater capacity 2 MB capacity 20 MB capacity SSDs. 32 GB capacity 18 GB capacity 1967 1991 2006 27 Huawei Confidential Development of Flash Memory Single-level cell Triple-level cell Quad-level cell (SLC): fast (TLC): mature (QLC): larger and read/write and mainstream cheaper, applicable long service life technology to warm data Multi-level cell 3D TLC: improves SCM: with the access the storage density speed slightly slower than (MLC): moderate through multi- memory, but much faster read/write speed than NAND media and service life layer overlaying 28 Huawei Confidential Storage Class Memory (SCM) ⚫ Storage class memory (SCM) is non-volatile memory, which is slightly slower than memory but much faster than NAND in terms of the access speed. ⚫ There are various types of SCM media under development, but the mainstream SCM media are PCRAM, ReRAM, MRAM, and NRAM. Current Storage Technology SCM DRAM NAND Flash PCRAM ReRAM MRAM NRAM Non-volatility No Yes Yes Yes Yes Yes Read latency 10–60 ns 25 μs 48 ns < 10 ns < 10 ns < 30 ns Write latency 10–60 ns 200 μs 40–150 ns ~ 10 ns 12.5 ns 50 ns Erasable times > 1015 104 108 105 > 1015 > 1014 Addressing unit Byte Page Byte Byte Byte Byte 29 Huawei Confidential  Contents 1. Data and Information 2. Data Storage 3. Development of Storage Technologies ▫ Storage Architecture ▫ Storage Media ◼ Interface Protocols 4. Development Trend of Storage Products 30 Huawei Confidential Interface Protocols ⚫ Disk interfaces connect disks to hosts. ⚫ Interface protocols refer to the communication modes and requirements that interfaces for exchanging information must comply with. Parallel interface Serial interface 31 Huawei Confidential History of Interface Protocols 100G NVMe-oF 400G Ethernet NVMe-oF 1.0 (FC-NVMe) Ethernet Host interface (RDMA) NVMe-oF 1.1 (TCP) 64G FC 2G FC iSCSI 4G FC 8G FC 16G FC 32G FC The first-gen FC protocol was 2004 2008 2012 2016 2017 2018 2020… released in 1994. SATA 1.0 Disk interface SATA 3.0 4G FC SAS 1.0 SAS 2.0 SAS 3.0 SAS 4.0 SATA 2.0 NVMe 1.0 NVMe 1.2 NVMe 1.3 NVMe 1.4 32 Huawei Confidential NVMe and NVMe-oF ⚫ NVMe, Non-Volatile Memory Express  Improves the performance CPU CPU  Reduces the latency PCIe PCIe ⚫ NVMe-oF, NVMe over Fabrics SAS Controller  Potential: low latency and high SAS Expander bandwidth  Purpose: accelerates the data transmission among the storage NVMe back-end SAS back-end physical path physical path network 33 Huawei Confidential  Contents 1. Data and Information 2. Data Storage 3. Development of Storage Technologies 4. Development Trend of Storage Products 34 Huawei Confidential History of Storage Products Cloud Media HDD SSD Architecture Trend Centralized Scale-out All-flash Intelligence Management Manual O&M Intelligent O&M 35 Huawei Confidential The Intelligence Era is Coming Steam Age Electricity Age Information Age Intelligence Age Industry Cloud Service extension computing AI Network coordination Agriculture + Data + Intelligence Internet IoT Intelligent production Service Big data Customization 36 Huawei Confidential Challenges to Data Storage Time-consuming RAID 24/7 µs-level Always-on Real-time, high-speed reconstruction services for all processing of production Service things connected transactions in the 5G era interruption due to multiple points of failure Finance High disk Reliable Fast failure rate Gov & Public Large enterprise Low data deduplication and compression ratios Large Efficient Carrier Transportation Unstable latency EB-level TCO reduction Energy & Electricity Data monetized as Edge-center-cloud under high assets and intelligent synergy, minimizing Inefficient convergence of concurrency storage tiering, the per-bit data cost block, file, and object turning cold data to and maximizing the services warm data to mine value data value 37 Huawei Confidential Characteristics of Storage in the Intelligence Era Storage in the intelligence era Intelligent data lifecycle management Storage for AI AI in storage Data convergence Zero data migration Data collaboration Convergence of Simplified protocol stack and data- SAN and NAS storage convergence Intelligent storage tiering of hot, Compute-storage collaboration, on- warm, and, cold data demand capacity expansion Multi-service convergence Dedicated hardware and (block, file, and object) scale-out storage Hardware + Algorithm + Architecture = Efficient storage Robust reliability Large capacity High performance Device-level of 99.99999% PB-level to EB-level ms-level to µs-level System-level of 99.999% Efficient deduplication & Intelligent distributed cache compression Solution-level reliability + Cost-effective media, warm and High-speed protocols Cloud-level DR cold data storage and algorithms Minimum cost and maximum value for per-bit data 38 Huawei Confidential Data Storage Trend Scale-out storage Database Cloud applications Blockchain computing Storage in AI Mainframe the system Hyper- Big data intelligenc Private software Traditional and hardware external converged e era infrastructure 5G solutions with storage (HCI) General- fully coupled purpose compute, storage, Brain-like computing DNA Graph and network Tensor computing resources, VM Container computing computing computing applicable only to x86 large CXL HCCS organizations RoCE/NVMe FC IP SAS IB Quantum dot PCM MRAM HDD SSD Biomolecule Optical storage 39 Huawei Confidential Optical Storage Technology Blu-ray storage Gold nanostructured glass Long service High 100 GB+ per Low power Long-term 10 TB per life reliability disk consumption stable storage disk 50 years >>> 600 years 40 Huawei Confidential DNA Data Storage ⚫ A small number of synthetic DNA molecules can store a large amount of data, and can freeze, dry, transport, and store data for thousands of years. ⚫ Advantages of using DNA as storage media:  Small size  High density  Strong stability ⚫ Bottlenecks and limitations:  High costs of DNA molecular synthesis  Slow data read and search 41 Huawei Confidential Atomic Storage ⚫ In 1959, physicist Richard Feynman suggested that it was possible to use atoms to store information if they could be arranged the way we wanted. ⚫ Because an atom is so small, the capacity of atomic storage will be much larger than that of existing storage media in the same size. ⚫ With the development of science and technology, arranging the atoms the way we want has become a reality. ⚫ Bottlenecks and limitations:  Strict requirements on the operating environment 42 Huawei Confidential Quantum Storage ⚫ Now, information in electronic devices is stored and moved through the flow of electrons. ⚫ If electrons are replaced by photons, the movement of information within a computer may occur at the speed of light. ⚫ Although the storage efficiency and service life are improved, the quantum storage is still difficult to be widely applied at present. ⚫ Quantum storage cannot meet the following requirements:  High storage efficiency  Low noise  Long service life  Operating at room temperature 43 Huawei Confidential Storage Network Trend AS-IS TO-BE FC SAN and IP SAN Converged AI Fabric network High network costs: The FC private network has low latency but high Reduced network costs: Open Ethernet carries high-performance, low- costs. The IP SAN has low costs but high latency and poor performance. latency, and low-cost storage networks. High O&M costs: IP SAN and FC SAN require dedicated O&M personnel Reduced O&M costs: No dedicated O&M skills are required, and unified separately, and do not support cloud-and-network synergy. network management is supported for data centers. LAN Flexibility Eth Flexibility No packet loss NIC NIC Low latency FC SAN FC SAN IP SAN IP SAN 10G Eth IP FC 16G FC SAN iNIC iNIC SAN SAN 10G IP SAN Low cost Low latency Ethernet 44 Huawei Confidential History of Huawei Storage Products 2021 2019 2017 First high-end OceanProtect 2015 Huawei OceanStor all-scenario storage 2013 2nd-gen high- Dorado, fastest data 2011 accelerated by AI end storage all-flash storage protection 2008 1st-gen high- chips 2006 Launched self- solution end storage 2002 Launched 2 - nd developed Interop Best Released SmartMatrix Dived into self- gen FC storage. HSSDs, pioneer architecture Best-in-class of of Show storage developed Founded in the all-flash the year Award technical IP SAN Huawei industry research Symantec Co., Ltd. Start out Grow Lead Released self- Launched developed Scale-out Huawei FC storage virtual storage clustered Launched T OceanStor V3 2003 NAS storage series New-gen 2007 unified storage First SAN&NAS Leader in Gartner Industry's first hybrid 2009 converged Magic Quadrant flash full-series Huawei 2012 storage for the first time storage 2014 NVMe all-flash OceanStor 2016 storage Pacific series OceanStor 2018 6.x 2020 2022 45 Huawei Confidential  Quiz 1. (Choose multiple options) Which of the following are data types? A. Structured data B. Semi-structured data C. Unstructured data D. Massive amounts of data 2. (Choose multiple options) Which of the following statements about storage are correct? A. Storage refers to disks. B. A storage system consists of storage hardware, software, and solutions. C. Storage types include block storage, file storage, and object storage. D. File storage is used to store data of data applications. 46 Huawei Confidential  Quiz 3. (Choose multiple options) Which of the following are characteristics of cloud storage? A. Convergence B. Open C. Elasticity D. Scale-up 4. (Choose multiple options) Which of the following are the objectives of integrating AI into storage? A. Simple B. Efficient C. High power consumption D. Easy to use 47 Huawei Confidential  Summary Data and Information Data Storage Storage Architecture Trend of Storage Technologies Storage Technologies Storage Media Storage Products Interface Protocols 48 Huawei Confidential  Recommendations ⚫ Huawei official websites  Enterprise business: https://e.huawei.com/en/  Technical support: https://support.huawei.com/enterprise/en/index.html  Online learning: https://www.huawei.com/en/learning ⚫ Popular tools  HedEx Lite  Network Document Tool Center  Information Query Assistant 49 Huawei Confidential Thank you. 把数字世界带入每个人、每个家庭、 每个组织，构建万物互联的智能世界。 Bring digital to every person, home, and organization for a fully connected, intelligent world. Copyright© 2022 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.  Intelligent Data Storage System 1 Huawei Confidential  Foreword ⚫ This course describes the components of the storage system, including the controller enclosure, disk enclosure, disks, and interface modules, the expansion methods of the storage system, and the working principles of the storage media and the components. 2 Huawei Confidential  Objectives Upon completion of this course, you will understand:  Storage product forms  Functions and components of controller enclosures and disk enclosures  Working principles of HDDs and SSDs  Concepts of scale-up and scale-out, and related cables and interface modules 3 Huawei Confidential  Contents 1. Intelligent Data Storage System 2. Intelligent Data Storage Components 3. Storage System Expansion Methods 4 Huawei Confidential Storage in the Intelligent Era ⚫ As we move rapidly toward an intelligent world, data is being generated at an unprecedented rate. ⚫ More companies have realized that the key to achieving smartization is data infrastructure, with storage at its core. ⚫ An intelligent world calls for intelligent storage.  Storage for AI ◼ Support companies to adopt intelligent technologies to accomplish AI training and application.  AI in Storage ◼ Integrate AI technologies into the full-lifecycle management to improve storage management, performance, efficiency, and stability. 5 Huawei Confidential Intelligent Data Storage Architecture Storage Database Big data Edge Intelligent data reduction AI-based prediction Intelligent data reduction Intelligent data storage CPU and GPU intelligent reduction algorithm Deep Intelligent CPU/GPU Intelligent Intelligent Intelligent compression global acceleration tiering prefetch prediction Intelligent data storage prediction Intelligent prefetch, data tiering, hotspot identification, Intelligent scheduling data caching and other technologies for optimal media Intelligence Container Heterogeneous computing power Near-data computing combination + Intelligent scheduling DR SC SS Dynamic management of heterogeneous computing Hardware CPU NPU GPU resources, near-data computing scheduling, and quick A M D start of containers Memory Fabric Network chip Network chip Memory Fabric: building a memory-centric and high- All IP performance network Supporting high-performance networks with nanosecond- level latency Memory SSD Memory pooling and tiering media media All IP: ultimate cost reduction based on SSD media In-depth disk-controller collaboration, and SLC, QLC, and OLC evolution DRAM SCM SLC/QLC QLC/OLC Building a simplified network with all IP ns μs 50 μs 200 μs 6 Huawei Confidential  Contents 2. Intelligent Data Storage Components ◼ Controller enclosure ▫ Disk enclosure ▫ Expansion module ▫ Disk ▫ Interface module 7 Huawei Confidential Storage Product Form 2 U, disk and 4 U, disk and Integrated bay controller integration controller separation Note: Huawei OceanStor Dorado V6 is used as the example. 8 Huawei Confidential Controller Enclosure ⚫ The controller enclosure uses a modular design and consists of a system subrack, controllers (with built-in fan modules), BBUs, power modules, management modules, and interface modules. Management Power module module Interface module System subrack Controller 9 Huawei Confidential Front View of a Controller Enclosure Icon Description Enclosure ID indicator Enclosure location indicator 1. Blinking blue: The controller enclosure is being located. 2 U controller enclosure (disk and controller integration) 2. Off: The controller enclosure is not located. Enclosure alarm indicator 1. Steady amber: An alarm is reported by the controller enclosure. 2. Off: The controller enclosure is working properly. Power indicator/Power button 4 U controller enclosure (disk and controller separation) Note: Huawei OceanStor Dorado V6 is used as the example. 10 Huawei Confidential Rear View of a Controller Enclosure 1 2 3 4 5 No. Description 1 Management port 2 Maintenance port 6 7 3 Serial port 4 Interface module 5 Power-BBU module 6 SAS expansion port 7 Interface module 8 Management module 9 Power module 8 9 11 Huawei Confidential Controller ⚫ A controller is the core component of a storage system. It processes storage services, receives configuration management commands, saves configuration data, connects to disks, and saves critical data to coffer disks. Controller enclosure FE FE Controller Controller Cache Cache CPU CPU BE BE Disk enclosure Cache data 12 Huawei Confidential BBU and Fan Module BBU latch Fan latch Fan module Running/Alarm Running/Alarm indicator of the BBU indicator of the fan BBU Front view 13 Huawei Confidential Coffer Disk 2.5-inch coffer disk Palm-sized NVMe coffer SSD Alarm/Location indicator Alarm/Location indicator Running indicator Running indicator Latch Latch Handle Handle Disk Disk Label Label Note: Huawei OceanStor Dorado V6 is used as the example. 14 Huawei Confidential Power Module ⚫ The AC power module supplies power to the controller enclosure, allowing the enclosure to operate normally at maximum power. Running/ Alarm Handle indicator Latch Power socket Note: Huawei OceanStor Dorado V6 is used as the example. 15 Huawei Confidential  Contents 2. Intelligent Data Storage Components ▫ Controller enclosure ▪ Disk enclosure ▫ Expansion module ▫ Disk ▫ Interface module 16 Huawei Confidential Disk Enclosure ⚫ The disk enclosure uses a modular design and consists of a system subrack, expansion modules, power modules, and disks. Power module Expansion module System subrack Disk drive module 17 Huawei Confidential Front View of a Disk Enclosure Icon Description ID indicator of the disk enclosure Location indicator of the disk enclosure 2 U 25-slot smart SAS disk enclosure 1. Blinking blue: The disk enclosure is being located. 2. Off: The disk enclosure is not located. Alarm indicator of the disk enclosure 1. Steady yellow: An alarm is reported by the disk enclosure. 2. Off: The disk enclosure is working properly. 2 U 36-slot smart NVMe disk enclosure Power indicator of the disk enclosure 1. Steady green: The disk enclosure is powered on. 2. Off: The disk enclosure is powered off. Power indicator/Power button Note: This slide shows the front views of a 2 U SAS 1. The disk enclosure is powered on and off with the controller enclosure. The power button on the disk disk enclosure and a 2 U smart NVMe disk enclosure is invalid and cannot be used to power enclosure of Huawei OceanStor Dorado V6. on or off the disk enclosure separately. 18 Huawei Confidential Rear View of a Disk Enclosure 4 No. Description 1 Serial port 2 Mini SAS HD expansion port 3 ID display 4 Expansion module 1 2 3 5 5 Power module 2 U smart SAS disk enclosure 6 Onboard expansion port 7 Onboard management port 8 Power module Note: This slide shows the rear views of the 2 U smart SAS and 6 7 8 smart NVMe disk enclosures of Huawei OceanStor Dorado V6. 2 U smart NVMe disk enclosure 19 Huawei Confidential  Contents 2. Intelligent Data Storage Components ▫ Controller enclosure ▫ Disk enclosure ▪ Expansion module ▫ Disk ▫ Interface module 20 Huawei Confidential Expansion Module Expansion module of a 2 U SAS disk enclosure Connects to a controller enclosure through expansion ports Expansion module of a 2 U smart NVMe disk enclosure Connects to a controller enclosure through expansion ports 21 Huawei Confidential CE Switch Rear view 48 x 10GE electrical ports 4 x 60 Gbit/s optical ports Console Front view USB port FAN1 FAN2 PWR1 PWR2 Two Ethernet management ports (combo) Note: Huawei CE6800 series switches are used as an example. 22 Huawei Confidential Fibre Channel Switch Management ports (serial port and Ethernet port) USB port 24 Fibre Channel ports Power socket Three link aggregation groups Note: Huawei SNS2124 is used as an example. 23 Huawei Confidential Device Cables 1. Serial cable 2. Mini SAS HD 3. Mini SAS HD electrical cable optical cable 4. 100G 6. MPO-4*DLC 7. Optical fiber QSFP28 cable 5. 25G SFP28 cable optical fiber 24 Huawei Confidential  Contents 2. Intelligent Data Storage Components ▫ Controller enclosure ▫ Disk enclosure ▫ Expansion module ▪ Disk ▪ HDD ▪ SSD ▫ Interface module 25 Huawei Confidential Disk Type IDE SCSI SATA 1.8-inch SAS Interface 2.5-inch FC type 3.5-inch Dimensions NVMe 5.25-inch... Enterprise-class Application... scenario Desktop-class... What are the types of disks? HDD Structure SSD... 26 Huawei Confidential HDD Structure ⚫ An HDD consists of platters, an actuator arm, read/write heads, a spindle, a port, and control circuits. Platter Actuator arm Spindle Control circuit Port Read/write head 27 Huawei Confidential HDD Working Principles Basic operation The platter is driven by a motor. Platter Landing zone Spindle Magnetic data R/W Head The distance between the The head flies head and the disk is small. over the platter. 28 Huawei Confidential Data Organization on a Disk Sector Track Head Cylinder Actuator arm Platter Motor Motor 29 Huawei Confidential Disk Capacity and Cache ⚫ Disk capacity  Disk capacity = Number of cylinders x Number of heads x Number of sectors x 512 bytes. The unit is MB or GB. The disk capacity is determined by the capacity of a single platter and the number of platters. ⚫ Cache  Because the processing speed of a CPU is much faster than that of a disk, the CPU must wait until the disk completes a read/write operation before issuing a new command. To solve this problem, a cache is added to the disk to improve the read/write speed. 30 Huawei Confidential Factors Relevant to Disk Performance Primary factor that determines the Rotation speed throughput in the case of sequential I/Os Primary factor that affects the random I/O Seek speed performance Single platter Indirect factor for disk performance capacity The least important factor for disk Port speed performance 31 Huawei Confidential Average Access Time ⚫ The average access time is determined by:  Average seek time  Average latency time Seek time Latency Wait time Disc Data Block Seek Tracks 32 Huawei Confidential Data Transfer Rate ⚫ The date transfer rate is determined by:  Internal transfer rate  External transfer rate/Interface transfer rate Disk Disc Seek Tracks External Internal 33 Huawei Confidential Disk IOPS and Transmission Bandwidth ⚫ IOPS  Input/Output operations per second (IOPS) is a key indicator to measure disk performance.  IOPS is calculated by the seek time, rotation latency, and data transmission time. ⚫ Transmission bandwidth (throughput)  Indicates the amount of data that is successfully transmitted in a unit time, that is, the speed at which data streams are transmitted. For example, if it takes 10s to write 10,000 files of 1 KB size, the transmission bandwidth is only 1 MB/s; if it takes 0.1s to write a 10 MB file, the transmission bandwidth is 100 MB/s. 34 Huawei Confidential Parallel and Serial Transmission ⚫ For example, the methods for transmitting numbers 1 to 8 are as follows: Parallel transmission Serial transmission 1 2 3 8 7 6 5 4 3 2 1 Transmit 4 Receive Transmit Receive end 5 end end end 6 7 8 Multiple lines are connected between two ends, Only one line is connected between two ends. Eight and one number is transmitted on each line. numbers are sent on this line in sequence. The receive end has all numbers after eight transmissions. 35 Huawei Confidential HDD Port Technology ⚫ A disk must provide a simple port for users to access its data. Generally, disks provide the following physical ports: IDE port Used for the ATA instruction system SATA port Disk ports Parallel SCSI port Used for the SCSI Serial SCSI (SAS) port instruction system Fibre Channel port 36 Huawei Confidential IDE Disk Port ⚫ The integrated drive electronics (IDE) port is also called the parallel ATA port.  ATA stands for Advanced Technology Attachment.  The ATA disk is also called the IDE disk.  The ATA port uses the parallel ATA technology. 37 Huawei Confidential SATA Port ⚫ SATA is short for serial ATA.  SATA ports use serial transmission and provide a higher rate than IDE ports.  SATA uses a point-to-point architecture and supports hot swap. SATA Version Line Code Transfer Rate Throughput 1.0 8b/10b 1.5 Gbit/s 150 MB/s 2.0 8b/10b 3 Gbit/s 300 MB/s Power 3.0 8b/10b 6 Gbit/s 600 MB/s SATA port 38 Huawei Confidential SCSI Port ⚫ SCSI is short for Small Computer System Interface. 39 Huawei Confidential SAS Port ⚫ SAS is short for Serial Attached SCSI.  SAS is a point-to-point, full-duplex, and dual-port interface.  SAS is backward compatible with SATA.  Rate: 600 Mbit/s per channel  SAS features high performance, high reliability, and powerful scalability. 40 Huawei Confidential Fibre Channel Port ⚫ Fibre Channel disks use the Fibre Channel arbitrated loop (FC-AL).  FC-AL is a dual-port serial storage interface based on the SCSI protocol.  FC-AL supports full-duplex mode.  Fibre Channel provides a universal hardware transmission platform for upper-layer protocols (SCSI and IP). It is a serial data transmission interface that features high speed, high reliability, low latency, and high throughput. 40-pin Male FC-SCA II Connector 41 Huawei Confidential  Contents 2. Intelligent Data Storage Components ▫ Controller enclosure ▫ Disk enclosure ▫ Expansion module ▪ Disk ▫ HDD ▪ SSD ▫ Interface module 42 Huawei Confidential SSD Overview ⚫ Compared to HDDs, SSDs have absolute advantages in terms of performance, reliability, power consumption, and portability. SSDs have been widely used in various industries. ⚫ SSD characteristics:  Uses NAND flash to save data, providing a faster speed than HDDs.  Has no mechanical structure inside, so it consumes less power, dissipates less heat, and generates less noise.  Its service life is determined by the number of program/erase (P/E) cycles. 43 Huawei Confidential SSD Architecture ⚫ An SSD consists of a control unit and a storage unit (mainly flash memory chips).  Control unit: SSD controller, host interface, and DRAM  Storage unit: NAND flash RAM Flash Flash SSD Controller... Pkg Pkg Processor Host Host NAND Flash Flash interface flash Pkg Pkg... Interconnect logic Buffer interface manager 44 Huawei Confidential NAND Flash ⚫ Internal storage units in NAND flash include: Page 0 Page 0 Page 1 Page 1 LUNs, planes, blocks, pages, and cells......  Page P Page P Block 0 Block 1 ⚫ Operations on the NAND flash include erase, Page 0 Page 0 program, and read. Logical Unit 0 Page 1 Page 1...... ⚫ NAND flash is a non-volatile medium. A block Page P Page P Block 2 Block 3 must be erased before new data is written to it....... A program/erase (P/E) cycle is the process of Page 0 Page 0 Page 1 Page 1 erasing a block and then writing it again....... Page P Page P Block B Block B+1 Page Register Page Register Plane Plane Address 0 Address 1 45 Huawei Confidential SLC, MLC, TLC, and QLC 111 1111 1110 11 110 1101 1100 1 101 1011 10 100 1010 1001 1000 011 0111 01 010 0110 0101 0 001 0100 00 000 0011 0010 0001 0000 SLC-1bit MLC-2bit TLC-3bit QLC-4bit SLC MLC TLC QLC 1. Supports 50,000 to 100,000 1. Supports about 3,000 P/E cycles. 1. Provides higher data density and 1. The capacity is further P/E cycles, providing the 2. The speed is slower than that of supports only several hundred to improved by 33%. best reliability. SLC. 1,000 P/E cycles. 2. The performance and life 2. The storage capacity is 3. The storage capacity is relatively 2. The reliability and performance cycle are further reduced. small. large. are low. 3. The cost is the highest. 4. The price is relatively low. 3. Generally used in personal devices due to the cost advantage, but cannot meet the requirements of enterprise products. 46 Huawei Confidential Flash Chip Data Relationship Plane Die 1478 blocks 2 planes Cell Page Block 146688 cells 768 pages..................... Page is the minimum read/write unit, and block is the minimum program/erase unit. 47 Huawei Confidential Address Mapping Management Logical block address (LBA) No. 26, XX Road, Binjiang District, Hangzhou City, Zhejiang Province, People's Republic of China Physical block address (PBA) 120º 12' east longitude, 30º 16' north latitude HDD: The relationship between LBA and PBA is fixed. ⚫ Overwrite The Flash Translation Layer (FTL) is responsible SSD: The relationship between LBA and PBA is not fixed. for the conversion ⚫ Non-overwrite: A block must be erased before new data is between the LBA and PBA. written to it. New data and old data are at different locations. 48 Huawei Confidential FTL Sector 0 Sector 3 Main controller Sector 2 FTL mapping table: saved in the Sector 1 internal SRAM/DRAM, external Sector 2 DRAM, or NAND flash. Sector 4 Sector 3 Sector 5 Sector 0 Sector 1 OS sector (512 FTL mapping Data is stored in the bytes). File systems operation. The main NAND physical read/write data in the controller maps the addresses based on unit of 512 bytes. addresses based on the mapping table. the mapping table. 49 Huawei Confidential Data Write Process on an SSD (1) ⚫ The following uses eight channels as an example to demonstrate how the host writes data to the SSD. Channel 0 block Channel 1 block Channel 2 block Channel 3 block Writes 4 KB of data Writes 16 KB of data 4 KB SSD controller Channel 4 block Channel 5 block Channel 6 block Channel 7 block 50 Huawei Confidential Data Write Process on an SSD (2) ⚫ When the SSD is full, old data must be deleted to release space for new data. When a user deletes and writes data, data in some blocks becomes invalid or aged. Channel 0 block Channel 1 block Channel 2 block Channel 3 block SSD controller Channel 4 block Channel 5 block Channel 6 block Channel 7 block 51 Huawei Confidential Data Read Process on an SSD Reads 4 KB Channel 0 block Channel 1 block Channel 2 block Channel 3 block of data Reads 32 KB of data 4 KB SSD controller Channel 4 block Channel 5 block Channel 6 block Channel 7 block 52 Huawei Confidential SSD Performance Advantages SSD Performance Advantages Power consumption under 100,000 read IOPS I/O I/O IP/FC SAN Seek time Mechanical latency 2 SSDs 250 HDDs Power (W) 4000 About 400-fold 2000 VS HDD storage system SSD storage system SSD FC HDD 53 Huawei Confidential Use of SSDs in Storage Systems ⚫ Class A applications: high-concurrency applications featuring random reads and writes, such as databases ⚫ Class B applications: large files, images, and streaming media featuring sequential reads and writes ⚫ Class C applications: data backup or rarely used applications Access frequency A SSD media FC/SAS disk SATA/NL-SAS/Tape B C Data distribution 54 Huawei Confidential SCM Card ⚫ Storage class memory (SCM) is a new class of non-volatile memory. It is slightly slower than memory but much faster than NAND in terms of the access speed. ⚫ An SCM card is a cache acceleration card of the SCM media type. To use SmartCache for OceanStor Dorado V6 all-flash storage (6.1.0 and later versions), install an SCM card on the controller enclosure. 55 Huawei Confidential  Contents 2. Intelligent Data Storage Components ▫ Controller enclosure ▫ Disk enclosure ▫ Expansion module ▫ Disk ◼ Interface module 56 Huawei Confidential Front-End: GE Interface Modules GE electrical 10GE electrical 40GE interface 100GE interface interface module interface module module module 57 Huawei Confidential Front-End: RoCE Interface Modules 25 Gbit/s RoCE interface module 100 Gbit/s RoCE interface module 58 Huawei Confidential Front-End: SmartIO Interface Modules 59 Huawei Confidential Back-End: 100 Gbit/s RDMA Interface Module and 12 Gbit/s SAS Expansion Module 100 Gbit/s RDMA interface module 12 Gbit/s SAS expansion module 60 Huawei Confidential Scale-out: 100 Gbit/s RDMA Interface Module and 25 Gbit/s RDMA Interface Module 25 Gbit/s RDMA interface module 100 Gbit/s RDMA interface module 61 Huawei Confidential  Contents 1. Intelligent Data Storage System 2. Intelligent Data Storage Components 3. Storage System Expansion Methods 62 Huawei Confidential Scale-up and Scale-out ⚫ Developments in enterprise IT systems and service expansion have caused data to skyrocket. The initial configuration of storage systems cannot meet the demands, and now capacity expansion is a top concern for system administrators. There are two capacity expansion methods: scale-up and scale-out. The following uses Huawei storage products as an example to describe the two methods. Storage Storage Devices (enclosure and disk) controller controller Storage Storage controller controller Scale-out Switch fabric Storage Scale-up controller Storage controller Scale-up Scale-out 63 Huawei Confidential SAS Disk Enclosure Scale-up Networking Principles Adding a 2 U SAS disk enclosure to an existing loop Controller enclosure 2 U SAS disk enclosure 0 2 U SAS disk enclosure 1 64 Huawei Confidential Smart Disk Enclosure Scale-up Networking Principles Adding a 2 U smart disk enclosure to an existing loop Controller enclosure Smart disk enclosure 0 Smart disk enclosure 1 65 Huawei Confidential Scale-out Direct-Connection Networking Connecting to the management network Controller enclosure 0 (existing) Connecting to the management network Controller enclosure 1 (new) Four-controller direct connection The above figure shows the scale-out networking of Huawei OceanStor Dorado 5000 V6 and 6000 V6. 66 Huawei Confidential Scale-out Switched Networking ⚫ The networking can be switching networking or switch-free networking. ⚫ The management networks involve external and internal management networks. ⚫ The internal management network and internal data network share the same physical network. For details, see the orange and blue cables in the figure. QoS is used, minimizing the impact on the management channel and data channel. ⚫ The external management network only needs to enable the management network of two controllers in the first controller enclosure to connect to the user's management network. There is no need to connect controllers in other controller enclosures to the user's management network. ⚫ The ETH management network ports in the rear of a CE6850 switch are used to connect to the user's network. 67 Huawei Confidential Local Write Process 1 2 SAN 1 LUN 2 PCIe switched network 4 Engine 0 Engine 1 Engine 2 Engine 3 3 5 68 Huawei Confidential Non-local Write Process 1 4 SAN 1 4 LUN 2 PCIe switched network 3 6 5 Engine 0 7 Engine 1 Engine 2 Engine 3 69 Huawei Confidential Local Read Process 1 2 SAN 1 LUN 2 PCIe switched network 5 8 Engine 0 Engine 1 Engine 2 Engine 3 3 4 6 7 70 Huawei Confidential Non-local Read Process 1 4 SAN 1 4 2 PCIe switched network LUN 3 7 Engine 0 10 Engine 1 Engine 2 Engine 3 5 6 8 9 71 Huawei Confidential  Quiz 1. (Multiple-answer question) What are the types of SSDs? A. SLC B. MLC C. TLC D. QLC 2. (Multiple-answer question) Which of the following can be used to measure the performance of an HDD? A. Disk capacity B. Rotation speed C. Data transfer rate D. Average access time 72 Huawei Confidential  Summary Intelligent data Controller storage system Controller enclosure Coffer disk Disk BBU enclosure Expansion module Intelligent storage Expansion Intelligent data components module Device cables storage system HDD Disk SSD Interface module Storage system Scale-up expansion methods Scale-out 73 Huawei Confidential  Recommendations ⚫ Huawei official websites  Enterprise business: https://e.huawei.com/en/  Technical support: https://support.huawei.com/enterprise/  Online learning: https://www.huawei.com/en/learning ⚫ Popular tools  HedEx Lite  Network Document Tool Center  Information Query Assistant 74 Huawei Confidential Thank you. 把数字世界带入每个人、每个家庭、 每个组织，构建万物互联的智能世界。 Bring digital to every person, home, and organization for a fully connected, intelligent world. Copyright© 2022 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice. RAID Technologies  Foreword ⚫ This course introduces technologies of traditional RAID and RAID 2.0+. The evolution of RAID technologies aims at data protection and performance improvement. 2 Huawei Confidential  Objectives After completing this course, you will be able to understand:  Common RAID levels  Different levels of data protection provided by different RAID levels  Working principles of RAID 2.0+  Dynamic RAID and RAID-TP 3 Huawei Confidential  Contents 1. Traditional RAID 2. RAID 2.0+ 3. Other RAID Technologies 4 Huawei Confidential Background ⚫ Problems in traditional computer systems must be addressed. Instructions processed per second CPU > 1 million Disks become the system performance bottleneck. RAM > 100,000 Limited disk slots cannot provide sufficient capacity. Data is stored on individual disks, so data reliability is low. < 300 Disk 5 Huawei Confidential What Is RAID? ⚫ Redundant Array of Independent Disks (RAID) combines multiple physical disks into one logical disk in different ways, improving read/write performance and data security. ⚫ Implementations: hardware RAID and software RAID. How large is a logical disk? Logical disk Physical Physical Physical Physical disk disk disk disk 6 Huawei Confidential Data Organization Forms ⚫ Disk striping: Space in each disk is divided into multiple strips of a specific size. Written data is also divided into blocks based on the strip size. ⚫ Strip: A strip consists of one or more consecutive sectors in a disk, and multiple strips form a stripe. ⚫ Stripe: A stripe consists of strips of the same location or ID on multiple disks in the same array. Disk 1 Disk 2 Disk 3 D6 D7 D8 Stripe 2 Depth of a stripe D3 D4 D5 Stripe 1 D0 D1 D2 Stripe 0 Data strips in Data strips in Data strips in a disk a disk a disk 7 Huawei Confidential Data Protection Techniques ⚫ Mirroring: Data copies are stored on another redundant disk. ⚫ Exclusive or (XOR)  XOR is widely used in digital electronics and computer science.  XOR is a logical operation that outputs true only when inputs differ (one is true, the other is false). ◼ 0 ⊕ 0 = 0, 0 ⊕ 1 = 1, 1 ⊕ 0= 1, 1 ⊕ 1 = 0 Physical disk 1 Physical disk 2 Parity disk 1 1 0 0 1 1 0 0 0 XOR for redundant backup 8 Huawei Confidential Common RAID Levels and Classification Criteria ⚫ RAID levels use different combinations of data organization forms and data protection techniques. Consists of striping with double RAID 6 distributed parity. Consists of striping, but no mirroring or parity. RAID 0 Common RAID levels RAID 10 RAID 0 is implemented after RAID Consists of data mirroring, 1 is implemented. without parity or striping. RAID 1 RAID 50 RAID 0 is implemented after RAID 5 Consists of striping with is implemented. dedicated parity. RAID 3 Consists of striping with RAID 5 distributed parity. 9 Huawei Confidential How Does RAID 0 Work? Write data to D 2, Read data from D 2, D 3... D 3... Write data to D 1. Read data from D 1. D0 Write data to D 0. Read data from D 0. D5 D 0, D 1, D 2, D 3, D 4, D 5 D4 D3 Physical disk 1 Physical disk 2 D2 D6 D4 D5 Stripe 2 D1 D2 D3 Stripe 1 D0 D0 D1 Stripe 0 Logical disk Data strips in a disk Data strips in a disk Stripping without error check Just a Bunch Of Disks (JBOD) 10 Huawei Confidential How Does RAID 1 Work? Write data to and read data from D 2. Write data to and read data from D 1. Write data to and read data from D 0. D2 D 0, D 1, and D 2 pass through a