Middle East College COMP 30031 Enterprise Data Centre and WAN Connectivity Unit 1.pdf

COMP 30031 Enterprise Data Centre and WAN Connectivity 14 July 2020 Disclaimer The PowerPoint presentations of the Module COMP 30031 Enterprise Data Centre and WAN Connectivity are created merely to guide me during the delivery of this module in my class. The content included in the slides are only...

COMP 30031 Enterprise Data Centre and WAN Connectivity 14 July 2020 Disclaimer The PowerPoint presentations of the Module COMP 30031 Enterprise Data Centre and WAN Connectivity are created merely to guide me during the delivery of this module in my class. The content included in the slides are only indicative to remind me the sequence which I will be following during the delivery. The content presented in the slides is free from any plagiarism and copyright violations and wherever needed appropriate referencing/citations have been provided. In addition to the content in this PowerPoint presentations, I will also be verbally delivering other important content in the class as well as also writing on the board, some information related to the topic being covered wherever necessary. The student is therefore advised to refer to the text books, reference books and any supplementary materials recommended in the Module Information Guide (MIG) or in the PowerPoint presentations for complete understanding of the topic. 2 Unit 1: Fundamentals of Design Plan Data Centre Design Project considerations Project scope Budget Build Budget and Run Budget Criteria Using Rack Location Units System Availability Profiles Insurance and Local Building Codes Determining the Viability of the Project Project plan Process structural Layout Support systems: Space requirements HVAC and air flow Power requirements Networking Logical and physical security system monitoring Remote System Management planning for an expansion Data Centre Design Project considerations The core values that must be considered in the DC design project: Simplicity Flexibility Scalability Modularity Keep your sanity Overview of Data Centre Elements of Data Center infrastructure: Power Site raised floor the environmental controls network infrastructure Command Center A data center is a permanent fixture. Hence, servers and storage system components are considered as contents and not part of it Project Scope Determines the data center design Depends on the company’s requirements and budget Examples: Adding storage devices and servers to Data Centre Separate building construction in new location and adding all necessary utilities project specifications Budget How much budget is available? Is the budget appropriate for the project scope Is the budget sufficient to satisfy the company’s needs? How much is in general the budget to create the center? How to distribute the funds? Can this distribution be changed? What are the factors included in running costs: maintenance, services, maintenance, … What are the redundancy requirements: services, power, UPS, HVAC. What might be the future changes: power, upgrades, system additions,… Budget classification Building Budget For building and installing the data centre Running Budget For yearly operating costs repair, maintenance, connectivity, ISP network storage and network equipment, service and support agreements on computers, Electricity cost Criteria Location (or site) region/building Depends on many factors. practical and affordable Can be near or far to corporate offices Can be on multiple locations Essential criteria Power Physical capacity. Bandwidth Cooling Criteria Secondary Criteria Plumbing, lighting and other fixtures Doors, windows, walls, loading dock and offices Additional hardware such as card readers , security cameras, door knobs, cabinet equipment, etc. Pallet jacks and other equipment Command Center Using Rack Location Units (RLUs) Helps to determine the essential criteria: power, cooling, etc RLUs are calculated based on the operating requirements of each rack in the DC In case of varied equipment, varied RLU definitions are required Ex: RLU-A racks for storage racks and RLU-B for server racks (Rack Location Units – Dataspace 2020) System Availability Profiles Project scope includes the availability requirements of the different data center equipment Determines the mission critical devices (or group of devices) and the less mission critical ones. Availability level is different from one task to another Redundancy requirements: Power redundancies Network redundancies Device redundancies Cooling redundancies Example of Availability Profile (Snevely 2002) Insurance and Local Building Codes should be considered in all design process aspects All design team and all building contractors are involved. Approval on final plans must be acquired from building authorities and insurers and Aware on the constraints is important Continuous communication with building authorities and insurers can save time Determining the Viability of the Project Constraints to be considered: Adequateness of the budget Floor adequateness to ceiling height grounding, seismic restraints, cable routing, Are employees qualified? Is the location expensive? Is the region inadequate or too far? Appropriateness of the space Adequateness of the power Cooling capacity Adequateness of ISP services Are fire regulations, Local building codes and insurance too restrictive? Is it exposed to weather or seismic problems? Are fire accidents frequent? Designing a Data Center Design Process Data Center Support Systems Data Center Structural Layout System Monitoring Physical and Logical Security Remote Systems Management Planning for Possible Expansion Reference Design “In general, a reference design is a system blueprint, list of attributes including system level performance specifications, and (ideally) includes a detailed list of materials or components that comprise the system. “(Schneider, 2021) It can serve as a baseline design and then adapted to meet specific user constraints or preferences Can be for the complete DC or part of it such as IT room or cooling plant. Built from recommended best practices Benefits of Reference Design Keep the planning phase easy and simple Save the time for creating the designs Reducing the risk, improve the reliability of the DC and offer predictable performance Elements of a Data Center Reference Design Graphical descriptions Written support documents Example: (schneider, 2021) Limits of a Reference Design Engineering services are essential in order to approve the design by local authorities Must be compliant with local codes and adaptable for the given site Some reference design may not include safety or security systems Design Drawings Detailed plans are essential in design stages Use of Computer Aided Design (CAD) to create clear plans. Such blueprints allow architectural, mechanical, electrical and IT updates. Has many advantages: evaluation and planning for the future External contractors: Electrical engineers HVAC designers Structural engineers Interior designers Architectural firms To coordinate between different contractors, a project management firm can be required. Designing for Data Center Capacities Balance between Data center capacities and Equipment capacities Some limitations: District Budget Power Connectivity Cooling Weight Space Site Insurance and building code In case of great limitations, project scope can be changed In practice: RLUs Rack Location Units (RLUs), flexible and scalable system that helps to determine the data center capacities Efficient use of rack resources Helps to determine the device requirement limits. Data center devices are installed in racks. Power, bandwidth, cooling and other services must be provided to this location. Services provided to RLUs are a unit of measure. Data Center Structural Layout Structural considerations Building height Building near a river Building in a very high floor Aisles width structural load rating of raised floors and ramps Raised Floor Provides flexibility in : flexibility in air conditioning, electricity and network cabling In general, it is constructed with two-foot square tiles. The space under is called plenum Plenum is used to feed conditioned air from HVAC , mount electrical outlets that feed the racks and route cables. Floor Height depends also on air conditioner design,… Typical height is 61 cm (24 inches). Minimum 46 cm and maximum 152 cm. Floor Tiles: typical size is 24 inch*24 inch (61 cm *61 cm). Don’t use carpeted tiles. Support Grid creates open structure below the floor Must consider all the possible weight that can be placed on it. Placement of Wireways and Cable Trays Air Flow and Pressure Calculation depends on : initial air temperature Initial air pressure Cooling amount per rack solid and perforated tiles arrangement Pressure Leak Detection Required to ensure the efficiency of HVAC system and to ensure that air flow goes through perforated tiles. Replacing perforated tiles with solid tiles should be part of the standard procedure when a machine is removed or relocated. Aisles and corridors Must provide flexible passage and rack replacement Depends also on air flow requirements and RLUs Equipment rows need to run parallel to air handlers Data Center Support Systems Services provided by Data Center are: Power to the racks Cooling Network connectivity Redundancy Space and Weight These systems are interdependent HVAC and Air Flow Requirements HVAC units must be placed with consideration to shape and size of the room and connection availability. HVAC system layout must provide best air flow to the areas that need. Air pressure under the floor must be higher than in the floor above. Environmental control Need for cooling Cooling must be delivered where needed Data centers need precise cooling. Controls must be adaptable to changes Data centers need frequent air exchange Temperature Requirements In general, an ambient temperature range in the data center of 70 to 74 F (21 to 23 C) is optimal for system reliability and operator comfort. to maintain safe associated relative humidity levels. to give the greatest buffer against problems and activities that can change the temperature profile. Failure of any part of the HVAC or support systems Installations, deinstallations, or reconfigurations of hardware Removal of floor tiles for subfloor work, such as cabling Doors left open Relative Humidity Relative humidity (RH) is the amount of moisture in a given sample of air at a given temperature in relation to the maximum amount of moisture that the sample could contain at the same temperature. When temperatures increases, RH decreases In case of sub-floor air distribution, ambient RH is in general less than sub-floor RH. Ambient levels between 45% and 50% RH are optimal for system reliability. Minimum 20% and maximum 80%. To avoid: Corrosion. Electrostatic Discharge (ESD). Operating time buffer Monitoring Temperature and RH Levels Monitoring System collects the historical data of room conditions, diagnosing and correcting problems. Sensors must be placed in critical heat areas. Alarm capabilities using SNMP Must be periodically examined and evaluated Placement of HVAC Units Depends on heat load and RLUs Must be determined with the help of HVAN engineers Simulation is done using specific software. Example: “Flovent”. Pipes used to expel the heat through water must be well studied to avoid water become near electricity Humidification Systems Can be inside HVAC systems or in separate equipment To maintain psychometric rates in specific ranges. Monitors the room conditions and adapt to changes Advantages: Moisture will not be condensed like with HVAC. No corrosion. Disadvantages: More costs Air Distribution The air flow cycle follows this pattern: Cooled air is passed by HVAC units through performed tiles to the raised floor Conditioned air goes through racks and IT equipment Hot air raises to the ceiling Hot air where goes again into HVAC units to be cooled again Tile Placement and Air Flow Types and number of tiles depend on the site characteristics and equipment layout Important guidelines: Design of Power Distribution System Aims to provide consistent and adequate power to IT devices. Electrical distribution panels must be provided with enough redundancy and minimize unscheduled outages It includes: main power feed the transformers, power distribution panels with circuit breakers, wiring, grounding system, power outlets, and any power generators, power supplies, Assessing Power Requirements is expressed by KVA (Kilo Volt Amps) or in watts (V*A=W) For DC (Direct Current) Needed for Data center and other building offices Use RLUs to determine the amount that is required RLUs can include servers, storage and network equipment Power will be needed for other systems such as: HVAC units, fire system, lights,… A good practice is to add 70% for cooling system to total equipment power. Add also 3% to 5% for potential increase in power requirements The power consumption depends on the climate and system Diversity in utility feeds Power redundancy must be prepared according to availability profiles To ensure constant uptime, utility feeds other than the power grids must be provided. Costs must be justified by the cost of downtime Get first history of power outages from the power supplier. Uninterruptible Power Supply(UPS) Very important for the availability of Data centers UPS must be able to feed 100% the data center hardware during the required time to start getting power from backup generators or any other alternative power feed. To deal with fault overload conditions, 150% of power load must be carried. Must work continuously for filtering, conditioning and regulating the power. With battery backups, UPS provides power for minimum of 15 mn during power failures. (UPS Power Critical Power System Services | Storage Battery Systems 2020) Backup Power Generators Adding backup power generators depends on the availability plans and risk exposure determination. Must be able to feed all computer and support system equipment. It is a must in case the power outages can exceed 20mn. must consider code compliance, location, diesel supplier contracts,.. (Miller 2020) Sharing Breakers Circuit breakers are types of switches that protect electrical devices in case of short circuit or overload. When sharing breakers between two machines, accurate calculations on normal and peak power loads must be done. Maintenance Bypass Design of the system must allow the bypassing and isolation of some system points for maintenance. Installation and Placement Power distribution must be close to computer devices and compatible with them. Heavy machines must have separate power source than other data center equipment. Grounding and Bonding Path to 0 potential Provides safety to personal from shocks and equipment from failures. Power source of DC equipment must be connected to earth ground electrode sub-system Low resistance in these subsystems is ensured through a network of rods, mats, plates and grids. Proper grounding aims also to control the noise Grounding rods are connected with Bondings Bounding of different groundings must respect a code. Grounding system must be well bounded for more efficiency of circuit breakers Signal Reference Grid(SRG) Aims to decrease the noise (high frequency impedance) Provides multiple path to earth Input Power Quality Power conditioning technology must be used to avoid issues such as: High frequency Low power Noise High ground current Voltage sags and surges Distortion Wiring and Cabling Wiring and cabling must be put in place according to national codes Obsolete cables must be removed Command Center Helps to control access to critical system and console. Plays an important role in disaster recovery Provides monitoring to physical access to the Data center as well as logical access https://r-ddataproducts.com/command-consoles-technical-furniture/ References Snevely, R. (2001). Enterprise Data Center Design and Methodology. San Antonio Road , Palo Alto: Sun Microsystems. page, M. (2021). Colocation – DataSpace. Retrieved 23 October 2021, from https://www.dataspace.ru/en/services/colocation/arenda-stoek Schneider. (2013). Better Data Centers through Reference Designs. Retrieved from https://www.schneideruniversities.com/catalog/view/course/id/57/title/B etter%20Data%20Centers%20Through%20Reference%20Designs schneider. (2021). Reference Design 84. Retrieved from https://download.schneider-electric.com/files?p_Doc_Ref=RD84DSR2_EN