SuperServer SYS-220HE-FTNRD-NEBS - Server Supermicro - Free user manual and instructions

USER MANUAL SuperServer SYS-220HE-FTNRD-NEBS Supermicro

Front view of a server rack with drive bays, ventilation fans, and I/O port (no visible text or labels)

Front view of a server rack with multiple drive bays and ports (no visible text or labels)

USER'S MANUAL

Revision 1.0

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A or Class B digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in industrial environment for Class A device or in residential environment for Class B device. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.0

Release Date: July 25, 2022

VC

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2022 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of this carrier grade (NEBS) server. Installation and maintenance should be performed by experienced technicians only.

Please refer to the SYS-220HE-FTNR-NEBS/220HE-FTNRD-NEBS server specifications page on our website for updates on supported memory, processors, and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
- Product drivers and utilities: https://www.supermicro.com/wdl/driver
- Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at:

[e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Secure Data Deletion

A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/Log9_Secure_Data_Deletion_Utility/

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Contacting Supermicro....9

Chapter 1 Introduction

1.1 Overview....10
1.2 System Features ....11

Front View....11

Control Panel....13

Bezel....14

Rear View....14

1.3 System Architecture ....15

Main Components....15

System Block Diagram....17

1.4 Motherboard Layout....18

Quick Reference Table....19

Chapter 2 Server Installation

2.1 Overview....20
2.2 Unpacking the System....20
2.3 Preparing for Setup....20

Choosing a Setup Location....20
Rack Precautions....21
Server Precautions....21
Rack Mounting Considerations....22

Ambient Operating Temperature....22
Airflow 22
Mechanical Loading....22
Circuit Overloading....22
Reliable Ground....22

2.4 Installing the Rails....24

Identifying the Rails ....24
Releasing the Inner Rail....25
Installing the Inner Rails ....26
Installing the Outer Rails onto the Rack....27

2.5 Installing the Chassis into a Rack....28

Removing the Chassis from the Rack....29

2.6 Connecting Power and Ground in a NEBS environment....30

DC Power Source, Power Connection, and Grounding....30

Chassis Ground Stud connections for AC and DC systems ....31

Chapter 3 Maintenance and Component Installation

3.1 Removing Power 32

3.2 Accessing the System....33

Removing the Top Cover....33

3.3 Static-Sensitive Devices....34

Precautions 34

3.4 Processor and Heatsink Installation....35

The Processor Carrier Assembly 36

The Processor Heatsink Module (PHM) 38

Preparing the CPU Socket for Installation....39

Installing the PHM into the CPU Socket....40

Removing the PHM from the CPU Socket 42

Removing the Processor Carrier Assembly from the PHM 43

Removing the Processor from the Processor Carrier Assembly 44

3.5 Memory....45

Memory Support....45

Memory Installation Sequence....45

General Memory Population Requirements....45

Supported memory 46

DDR4 Memory Population Guidelines ....47

DIMM Installation 48

DIMM Removal 48

3.6 Motherboard Battery....49

3.7 Chassis Components ....50

Bezel 50

Bezel Extension....52

Replacing the Bezel Air Filter....53

3.8 Storage Drives....54

Checking the Temperature of an NVMe Drive....54

Installing Drives....54

Hot-Swap for NVMe Drives....57

Installing M.2 Solid State Drives....58

Installing M.2 Drives ....58

3.9 System Cooling....59

Fans 59

Air Shrouds 60

3.10 Expansion Cards....61

Riser Cards 61

Installing Expansion Cards....63

3.11 Power Supply 64

3.12 BMC 65

Chapter 4 Motherboard Connections

4.1 Power Connections ....66

4.2 Headers and Connectors....67

Control Panel....70

Front Control Panel LEDs....70

4.3 Input/Output Ports ....74

Front I/O Ports....74

4.4 Jumpers....75

4.5 LED Indicators....76

4.6 Storage Ports ....77

Chapter 5 Software

5.1 Microsoft Windows OS Installation....78

5.2 Driver Installation....80

5.3 SuperDoctor® 5....81

5.4 BMC....82

BMC ADMIN User Password 82

Chapter 6 Optional Components

6.1 Storage Protocols Supported 83

6.2 Power Supply Modules 83

6.3 TPM Security Module....84

6.4 Intel Virtual RAID on CPU (VROC)......85

Requirements and Restrictions....85

Supported SSDs and Operating Systems 85

Additional Information 86

Hardware Key 86

Configuring NVMe RAID Manually....87

Status Indications....92

Hot-Swap Drives 92

Hot-unplug 92

Hot-plug 92

Related Information Links 92

Chapter 7 Troubleshooting and Support

7.1 Information Resources....93

Website 93

Direct Links for the SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS System ....93

Direct Links for General Support and Information 93

7.2 Baseboard Management Controller (BMC)....94

7.3 Troubleshooting Procedures .....95

No Power 95

No Video 96

System Boot Failure 96

Memory Errors 96

Losing the System's Setup Configuration....96

When the System Becomes Unstable 96

7.4 BIOS Error Beep (POST) Codes .....98

Additional BIOS POST Codes 98

7.5 Crash Dump Using BMC....99

7.6 UEFI BIOS Recovery 100

Overview ....100

Recovering the UEFI BIOS Image....100

Recovering the Main BIOS Block with a USB Device....100

7.7 CMOS Clear....105

7.8 BMC Reset....105

7.9 Where to Get Replacement Components....106

7.10 Reporting an Issue....106

Technical Support Procedures....106

Returning Merchandise for Service....106

Vendor Support Filing System 107

7.11 Feedback....107
7.12 Contacting Supermicro....108

Appendix A Standardized Warning Statements for AC Systems

Appendix B Standardized Warning Statements for DC Systems

DC Power Disconnection....147

Hazardous Voltage or Energy Present on DC Power Terminals 149

Appendix C System Specifications

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Sales Inquiries)

[e-mail] (Gov. Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

[e-mail] (Webmaster)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail] (Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides a brief outline of the functions and features of the SuperServer® SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS. It is based on the X12DHM-6 motherboard and the CSE-HE211-R000NFP chassis. There are two models that vary by power supply:

• SYS-220HE-FTNR-NEBS AC power supply
• SYS-220HE-FTNRD-NEBS DC power supply

The following provides an overview of the specifications and capabilities.

System Overview
Motherboard	X12DHM-6
Chassis	CSE-HE211-R000NFP
Processor Support	Dual 3rd Generation Intel® Xeon® Scalable processors. Supported CPUsP4X-ICX6338T-SRKXF: ICX 6338T 2P 24C/48T 2.1G 36M 11.2GT 165W 4189 M1.
Memory	32 DIMM slots for 3DS ECC DDR4-3200 RDIMM. For the latest NEBS validated memory, see the Memory section in Chapter 3.
Drive Support	Six 2.5" hot-swap NVMe/SATA hybrid drive baysTwo M.2 PCIe 3.0 x4 NVMe/SATA hybrid slots (with support for M-Key 2280 and 22110)
Expansion Slots	Three PCIe 4.0 x16 DW FHFL (10.5" L) and two PCIe 4.0 x8 FHHL or six PCIe 4.0 x8 FHFL (10.5" L) and two PCIe 4.0 x8 FHHL.Two AIOM (Advanced I/O Module) PCIe 4.0 x16 slots
I/O Ports	One RJ45 Dedicated BMC LAN portTwo USB 3.0 port(s) (2 Front)One VGA port(s)
System Cooling	Six 6cm heavy duty fans with optimal fan speed control
Power	SYS-220HE-FTNR-NEBS: 2000W Redundant AC Power Supplies with PMBusSYS-220HE-FTNRD-NEBS: 1300W Redundant DC -48V Power Supplies with PMBus
Form Factor	2U Rackmount 3.5 x 17.2 x 22.6in. / 89 x 437 x 574mm (HxWxD)
NEBS Compliance	GR-1089-CORE, Issue 7 and GR-63-CORE, Issue 5.

Notes: A Quick Reference Guide can be found on the product page of the Supermicro website.

The following safety models associated with the SYS-220HE-FTNR-NEBS and SYS-220HE-FTNRD-NEBS have been certified as compliant with UL or CSA: HE211-13D, HE211-R13DX12, HE211-20, HE211-R20X12, HE211-12, HE211-R12X12.

1.2 System Features

The following views of the system display the main features. Refer to Appendix C for additional specifications.

Front View

Control Panel BMC LAN Port Power Supply (PWS1) Power Supply (PWS2) USB Ports VGA Port A1 A2 CPU1 CPU2

Figure 1-1. Front View (SYS-220HE-FTNR-NEBS)
Note: see the following page for details on the features shown above.

Control Panel BMC LAN Port Power Supply (PWS1) Power Supply (PWS2) USB Ports VGA Port A1 A2 4 3 5 6 7 8 CPU1 CPU2

Figure 1-2. Front View (SYS-220HE-FTNRD-NEBS)
Note: see the following page for details on the features shown above.

System Features: Front
Feature Description
Power Supplies	Two (redundant) power supply modules, PWS1, and PWS2 on the leftSYS-220HE-FTNR-NEBS: 2000W AC Power Supplies with PMBusSYS-220HE-FTNRD-NEBS: 1300W DC Power Supplies with PMBus
USB Two USB 3.0	ports
BMC LAN Port One	RJ45 dedicated BMC LAN port
VGA Port One Video port
Control Panel One	control panel (see Control Panel for details)
[8W63]	AIOM/OCP NIC 3.0 Slot
[CS84]	AIOM/OCP NIC 3.0 Slot
[42x8]	1 - PCIe 4.0 x16 or (optional) x8 FH, 10.5" L2 - Optional: PCIe 4.0 x8 FH, 10.5" L (slot 2 is disabled if slot 1 is configured as a PCIe 4.0 x16)3 - PCIe 4.0 x16 or (optional) x8 FH, 10.5" L4 - Optional: PCIe 4.0 x8 FH, 10.5" L (slot 4 is disabled if slot 3 is configured as a PCIe 4.0 x16)
	5 - PCIe 4.0 x16 or (optional) x8 FH, 10.5" L6 - Optional: PCIe 4.0 x8 FH, 10.5" L (slot 6 is disabled if slot 5 is configured as a PCIe 4.0 x16)7 - PCIe 4.0 x8 FHHL8 - PCIe 4.0 x8 FHHL

Power Supply Indicators
Power Supply Condition Green LED	Amber LED
No Power to Power Supply OFF OFF
Power Supply critical events causing a shutdown/ failure/ OCP/ OVP/ Fan Fail/ OTP/ UVP	OFF Amber LED
Power Supply Warning Events Where the power supply continues to operate; High temperature; Over voltage; under voltage, etc.	OFF 1Hz Blink Amber
AC or DC present only 12VSB ON (PS OFF)	1Hz Blink Green OFF
Output ON and OK Green OFF
One of the power cords unplugged and in redundant mode	OFF Amber

Control Panel

Power UID Button/LED BMC Reset Power LED HDD NIC (LAN2) LED NIC (LAN1) LED Power Fail LED Information LED

Figure 1-2. Control Panel

Control Panel Features
Feature Description
Power button	The main power switch applies or removes primary power from the power supply to the server but maintains standby power.
UID button/LED BMC button	The unit identification (UID) button turns on or off the blue light function of the Information LED and a blue LED on the rear of the chassis.This button can also be used to reset the BMC. See Chapter 3.
Power LED	Indicates power is being supplied to the system power supply units. This LED is illuminated when the system is operating normally.
HDD Indicates activity on the storage drives when flashing.
NIC (LAN1) LED	Indicates network activity on LAN1 when flashing.
NIC (LAN2) LED	Indicates network activity on LAN2 when flashing.
Power Fail LED	Indicates a power supply module has failed.
Information LED	Alerts operator to several states, as noted in the table below.

Information LED
Status Description
Continuously ON and red	An overheat condition has occurred. (This may be caused by cable congestion.)
Blinking red (1Hz) Fan failure, check for an inoperative fan.
Blinking red (0.25Hz)	Power failure, check for a non-operational power supply.
Solid blue	UID has been activated locally to locate the server in a rack environment.
Blinking blue	UID has been activated using the BMC to locate the server in a rack environment.

Bezel

Close-up of a black server rack with ventilation grilles and a red button (no visible text or symbols)

Figure 1-3. Front View with Bezel
Rear View

Front view of a server rack with five labeled ports (0–5), showing front panel and internal drive bays (no text or symbols beyond labels)

Figure 1-4. System: Rear View

System Features: Rear

Feature Description

System Fans Six 6cm heavy duty fans with optimal fan speed control

Logical Storage Drive Numbers
Item Description
0 _ 3	2.5" hot-swap 2.5" NVMe Gen4/SATA3 drive bays (NVMe from CPU1)
4 _ 5	2.5" hot-swap 2.5" NVMe Gen4/SATA3 drive bays (NVMe from CPU2)

1.3 System Architecture

This section covers the locations of the system's main components, a system block diagram, and a motherboard layout with the connectors and jumpers called out.

Main Components

Six Internal Fans Storage Backplane Dual 3rd Gen Intel® Xeon® Scalable Processors up to 270W Heatsinks DIMM Slots

Figure 1-5. Main Component Locations

System Features: Top
Feature Description
Heatsinks Two Heatsinks on two CPUs.
Storage Backplane	Disk-on-Module port allows for flashcards to be mounted directly on the motherboard.
DIMM Slots 32 DIMM	slots
Processors Dual 3rd Gen Intel® Xeon® Scalable Processors up to 270W
System Fans Six internal systems fans
Memory Slots 32 DIMM	slots DDR4

System Block Diagram

The block diagram below shows the connections and relationships between the subsystems and major components of the overall system.

graph TD
    subgraph BMC AST2600
        A["DSR MEMORY"] --> B["BMC AST2600"]
        C["DSR MEMORY"] --> D["Processor 1 SocketID 00"]
        E["DSR MEMORY"] --> F["Processor 2 SocketID 01"]
        G["DSR MEMORY"] --> H["CPLD CPU"]
    end

    subgraph I/O
        I["DSR MEMORY"] --> J["CPU 1"]
        I --> K["CPU 2"]
        I --> L["CPU 3"]
    end

    subgraph I/O
        M["DSR MEMORY"] --> N["CPU 4"]
        O["CPU 5"]
        P["CPU 6"]
    end

    subgraph I/O
        Q["DSR MEMORY"] --> R["CPU 7"]
        S["CPU 8"]
        T["CPU 9"]
    end

    subgraph I/O
        U["DSR MEMORY"] --> V["CPU 10"]
        W["CPU 11"]
        X["CPU 12"]
    end

    subgraph I/O
        Y["DSR MEMORY"] --> Z["CPU 13"]
        AA["CPU 14"]
        AB["CPU 15"]
    end

    subgraph I/O
        AC["DSR MEMORY"] --> AD["CPU 16"]
        AE["CPU 17"]
        AF["CPU 18"]
    end

    subgraph I/O
        AG["DSR MEMORY"] --> AH["CPU 19"]
        AI["CPU 20"]
        AJ["CPU 21"]
        AK["CPU 22"]
    end

    subgraph I/O
        AL["DSR MEMORY"] --> AM["CPU 30"]
        AN["CPU 31"]
        AO["CPU 32"]
    end

    subgraph I/O
        AP["DSR MEMORY"] --> AQ["CPU 33"]
        AR["CPU 34"]
        AS["CPU 35"]
    end

    subgraph I/O
        AT["DSR MEMORY"] --> AU["CPU 36"]
        AV["CPU 37"]
        AW["CPU 38"]
    end

    subgraph I/O
        AX["DSR MEMORY"] --> AY["CPU 39"]
        AZ["CPU 40"]
        BA["CPU 41"]
    end

    subgraph I/O
        AR["DSR MEMORY"] --> AS["CPU 42"]
        AT["DSR MEMORY"] --> AU["CPU 43"]
        AV["DSR MEMORY"] --> AW["CPU 44"]
    end

    subgraph I/O
        AXA["DSR MEMORY"] --> AZA["CPU 45"]
        BAIX["DSR MEMORY"] --> BBAX["CPU 46"]
    end

    subgraph I/O
        AXB["DSR MEMORY"] --> AZB["CPU 47"]
        BAIXB["DSR MEMORY"] --> BBAXB["CPU 48"]
    end

    subgraph I/O
        AXC["DSR MEMORY"] --> AZC["CPU 49"]
        BAIXC["DSR MEMORY"] --> BBAXC["CPU 50"]
    end

    subgraph I/O
        AXD["DSR MEMORY"] --> AZD["CPU 51"]
        BAIXD["DSR MEMORY"] --> BBAXD["CPU 52"]
    end

    subgraph I/O
        AXE["DSR MEMORY"] --> AZE["CPU 53"]
        BAIXE["DSR MEMORY"] --> BBAXE["CPU 54"]
    end

    subgraph I/O
        AXF["DSR MEMORY"] --> AZF["CPU 55"]
        BAIXF["DSR MEMORY"] --> BBAXF["CPU 56"]
    end

    subgraph I/O
        AXG["DSR MEMORY"] --> AZG["CPU 57"]
        BAIXG["DSR MEMORY"] --> BBAXG["CPU 58"]
    end

    subgraph I/O
        AXH["DSR MEMORY"] --> AZH["CPU 59"]
        BAIXH["DSR MEMORY"] --> BBAXH["CPU 60"]
    end

    subgraph I/O
        AXI["DSR MEMORY"] --> AZI["CPU 61"]
        BAIXI["DSR MEMORY"] --> BBAXI["CPU 62"]
    end

    subgraph I/O
        AXJ["DSR MEMORY"] --> AZJ["CPU 63"]
        BAIXJ["DSR MEMORY"] --> BBAXJ["CPU 64"]
    end

    subgraph I/O
        AXK["DSR MEMORY"] --> AZK["CPU 65"]
        BAIXK["DSR MEMORY"] --> BBAXK["CPU 66"]
    end

    subgraph I/O
        AXL["DSR MEMORY"] --> AZL["CPU 67"]
        BAIXL["DSR MEMORY"] --> BBAXL["CPU 68"]
    end

    subgraph I/O
        AXM["DSR MEMORY"] --> AZM["CPU 69"]
        BAIXM["DSR MEMORY"] --> BBAXM["CPU 70"]
    end

    subgraph I/O
        AXN["DSR MEMORY"] --> AZN["CPU 71"]
        BAIXN["DSR MEMORY"] --> BBAXN["CPU 72"]
    end

    subgraph I/O
        AXO["DSR MEMORY"] --> AZO["CPU 73"]
        BAIXO["DSR MEMORY"] --> BBAXO["CPU 74"]
    end

    subgraph I/O
        AXP["DSR MEMORY"] --> AZP["CPU 75"]
        BAIXP["DSR MEMORY"] --> BBAXP["CPU 76"]
    end

    subgraph I/O
        AXQ["DSR MEMORY"] --> AZQ["CPU 77"]
        BAIXQ["DSR MEMORY"] --> BBAXQ["CPU 78"]
    end

    subgraph I/O
        AXQA["DSR MEMORY"] --> AZQA["CPU 79"]
        BAIXAQ["DSR MEMORY"] --> BBAXAQ["CPU 80"]
    end

    subgraph I/O
        AXQB["DSR MEMORY"] --> AZQB["CPU 81"]
        BAIXAQB["DSR MEMORY"] --> BBAXAQB["CPU 82"]
    end

    subgraph I/O
        AXQC["DSR MEMORY"] --> AZQC["CPU 83"]
        BAIXQC["DSR MEMORY"] --> BBAXQCB["POR WMx x8 PORT"]

    end

    BMC AST2600 --> BMC AST2600_1 & BMC AST2600_PCON
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_CONN
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_PCON
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_PCON
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_PCON
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_PCON
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_PCon
    BMC AST2600_PCON --> BMC AST2600_SIMAS_LP_PCon

Figure 1-6. System Block Diagram

1.4 Motherboard Layout

Below is a layout of the X12DHM-6 motherboard with a jumper, connector, and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information, and jumper settings, refer to Chapter 4 or the Motherboard Manual.

graph TD
    subgraph Computer Architecture
        A["CPU1"] --> B["CPU2"]
        B --> C["CPU3"]
        C --> D["CPU4"]
        D --> E["CPU5"]
        E --> F["CPU6"]
        F --> G["CPU7"]
        G --> H["Computer Components"]
    end

    subgraph Memory Layers
        I["LED1"] --> J["LED2"]
        K["JPM1"] --> L["JFP1"]
        M["JPM2"] --> N["JFP2"]
        O["JPM3"] --> P["JPM4"]
        Q["JPM4"] --> R["JPM5"]
        S["JPM5"] --> T["JPM6"]
        U["JPM6"] --> V["JPM7"]
        W["JPM7"] --> X["JPM8"]
    end

    subgraph External Components
        Y["LED1"] --> Z["LED2"]
        AA["LED2"] --> AB["LED1"]
        AC["LED1"] --> AD["LED2"]
        AE["JPM1"] --> AF["JPM2"]
        AG["JPM2"] --> AH["JPM3"]
        AI["JPM3"] --> AJ["JPM4"]
        AK["JPM4"] --> AL["JPM5"]
        AM["JPM5"] --> AN["JPM6"]
        AO["JPM6"] --> AP["JPM7"]
        AQ["JPM7"] --> AR["JPM8"]
    end

    subgraph Control Layers
        AS["Power Supply"] --> AT["External Components"]
    end

    subgraph External Components
        AU["External Components"] --> AV["Control Layers"]
    end

    style Computer Architecture fill:#f9f,stroke:#333
    style External Components fill:#bbf,stroke:#333

Figure 1-7. Motherboard Layout

Quick Reference Table

Jumper Description Default Setting

JBT1 CMOS clear Open (Normal)
Connector Description
BT1 Onboard CMOS battery
FAN1 ~ FAN8 6-pin system cooling fan headers
FAN9 ~ FAN10 4-pin CPU cooling fan headers
JAIOM1	The Supermicro® Advanced I/O Module (AIOM) slot
JF3_JIPMB1	6-pin BMC external I^2C header (for an BMC card)
JFP1	Front control panel header
JFP2	Front VGA header
JGPW1~5	8-pin power connector
JIO1	Low-profile slimSAS 8x I/O connector
JL1	Chassis intrusion header
JNVI2C1	NVMe SMBus ( I^2C ) headers used for PCIe hot-plug SMBus clock and data connections
JNVVPP1	CPU VPP bus header for backplane NVMe riser card device
JPCIE1, JPCIE4 CPU PCIe 4.0 x16 slots
JPCIE2A1, JPCIE2B1,JPCIE3A1, JPCIE3B1,JPCIE5A1, JPCIE5B1	CPU PCIe 4.0 x8 slots
JPRG1	Complex Programmable Logical Device (CPLD) header
JPWR1, JPWR4 6-pin power connector
JRSI2C1	SMBus header for riser card
JS1	I-SATA 0~7 connector
JTPM1	Trusted Platform Module/Port 80 Connector
JUID1	Multi-purpose UID switch and reset switch
JUSB3	USB 3.0 header (supports two USB 3.0 ports)
JVRM1	VRM SMB clock to BMC
M.2-H1/M.2-H2	M.2 PCIe 3.0 x2 or SATA 3.0 hybrid slots (Supports M-Key 2280 and 22110) supported by PCH
P1_NVME0/P1_NVME1/P2_NVME0/P2_NVME1	NVMe PCIe 4.0 x4 ports (Note: When installing an NVMe device on a motherboard, please be sure to connect JNVME0 first for your system to work properly.)
PSU1~2	Power supply unit connectors
VROC (JRK1)	Intel VROC RAID key header for NVMe SSD

LED Description Status

LEDM1 BMC Heartbeat LED Blinking Green: BMC Normal

LED1 Unit Identifier (UID) LED Solid Blue: Unit Identified

LED2 System Power LED LED On: Onboard Power On

Chapter 2

Server Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory, etc., refer to Chapter 3 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Unpacking the System

Inspect the box in which the system was shipped, and note if it was damaged in any way. If any equipment appears damaged, file a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the server. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise, and electromagnetic fields are generated. It will also require a grounded AC or DC power outlet nearby. Be sure to read the precautions and considerations noted or in Appendix A or Appendix B respectively.

2.3 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise, and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).

- This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

The ports of this equipment are suitable for connection to intra-building or unexposed wiring or cabling only. The intra-building port(s) of the equipment or subassembly must not be metallically connected to interfaces that connect to the outside plant wiring. These interfaces are designed for use as intra-building interfaces only (Type 2 or Type 4 ports as described in GR-1089-CORE, issue 6) and require isolation from the exposed outside plan cabling. The addition of primary protectors is not sufficient protection in order to connect these interfaces metallically to outside plant wiring.

Warning: The intra-building port(s) (10Gb DAC SFP and 100Gb DAC QSFP ports) of the equipment or subassembly must use shielded intra-building cabling/wiring that is grounded at both ends.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time - extending two or more simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Appendix A or Appendix B.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your way up.
• The AC power input ports are intended for installation in NEBS environments where rapid changes in line voltage may occur. A Surge Protective Device (SPD) should be used instead of an Uninterruptible Power Supply (UPS).
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the servers closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.
• Slide rail mounted equipment is not to be used as a shelf or a workspace.

Slide rail mounted equipment is not to be used as a shelf or a workspace.

Warning: Do not pick up the server with the front handles. They are designed to pull the system from a rack only.

2.4 Installing the Rails

This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided. You should also refer to the installation instructions that came with the rack unit you are using. Note: This rail will fit a rack between 26.8" and 36.4" deep.

Identifying the Rails

The chassis package includes two rail assemblies. Each assembly consists of three sections: An inner rail that secures directly to the chassis, an outer rail that secures to the rack, and a middle rail which extends from the outer rail. These assemblies are specifically designed for the left and right side of the chassis and labeled.

Outer Rail Middle Rail

Figure 2-1. Identifying the Outer Rail, Middle Rail and Inner Rail (Left Rail Assembly Shown)

Note: Both front chassis rails and the rack rails have a locking tab, which serves two functions. First, it locks the server into place when installed and pushed fully into the rack (its normal operating position. In addition, these tabs lock the server in place when fully extended from the rack. This prevents the server from coming completely out of the rack when pulled out for servicing.

Releasing the Inner Rail

Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing.

To mount the rail onto the chassis, first release the inner rail from the outer rails.

1. Pull the inner rail out of the outer rail until it is fully extended as illustrated below.
2. Press the locking tab down to release the inner rail.
3. Pull the inner rail all the way out.

Rail Assembly (Shown with Rails Retracted) Outer Rail Middle Rail Push the lever down, and pull the inner all the way out of the middle rail.

Figure 2-2. Extending and Releasing the Inner Rail

Installing the Inner Rails

Begin the rack mounting procedure by installing the inner rails to the chassis.

1. Identify the left and right inner rails. They are labeled.
2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
3. Slide the inner rail forward toward the front of the chassis and under the hooks until the quick release bracket snaps into place, securing the rail to the chassis.
4. Optionally, you can further secure the inner rail to the chassis with a screw.

Front Rear

Figure 2-3. Installing the Rails

Warning: Do not pick up the server with the front handles. They are designed to pull the system from a rack only.

Installing the Outer Rails onto the Rack

Installing the Outer Rails

1. Press upward on the locking tab at the rear end of the middle rail.
2. Push the middle rail back into the outer rail.
3. Hang the hooks on the front of the outer rail onto the square holes on the front of the rack. If desired, use screws to secure the outer rails to the rack.
4. Pull out the rear of the outer rail, adjusting the length until it just fits within the posts of the rack.
5. Hang the hooks of the rear section of the outer rail onto the square holes on the rear of the rack. Take care that the proper holes are used so the rails are level. If desired, use screws to secure the rear of the outer rail to the rear of the rack.
6. Repeat for the other outer rail.

Technical illustration of a metal beam with structural supports and directional arrows indicating assembly (no text or symbols present)

Figure 2-4. Installing the Outer Rails to the Rack

Note: The figure above is for illustrative purposes only. Always install servers at the bottom of the rack first.

Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

2.5 Installing the Chassis into a Rack

Once rails are attached to the chassis and the rack, you can install the server.

Installing the Chassis into a Rack

1. Extend the outer rails as illustrated above.
2. Align the inner rails of the chassis with the outer rails on the rack.

3. Optional screws may be used to hold the front of the chassis to the rack.

4. Slide the inner rails into the outer rails, keeping the pressure even on both sides. When the chassis has been pushed completely into the rack, it should click into the locked position.

Push Hold down

Figure 2-5. Installing the Server into the Rack

Note: The figure is for illustrative purposes only. Always install servers to the bottom of a rack first.

Removing the Chassis from the Rack

Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack. Use a lift.

1. If necessary, loosen the thumbscrews on the front of the chassis that hold it in the rack.
2. Pull the chassis forward out the front of the rack until it stops.
3. Press the release latches on each of the inner rails downward simultaneously and continue to pull the chassis forward and out of the rack.

Isometric line drawing of a server rack cabinet with an open rack unit (no text or symbols)

Figure 2-6. Removing the Chassis from the Rack

2.6 Connecting Power and Ground in a NEBS environment

DC Power Source, Power Connection, and Grounding

Note: This product should be installed only in a Restricted Access Location, that is, a dedicated equipment room, service closet, etc. A Restricted Access Location is an area intended for qualified and trained personnel only and is access controlled.

A reliable ground to the DC power supply must be maintained at all times. The server must be grounded with the chassis ground studs, which ensures the equipment is not energized through cable connections when both Power Suppliers are removed. Simultaneous connections to both the chassis ground stud and the DC Power Supply ground is permissible.

The DC power source shall be in the same building as the server, to minimize the possibility of transient energy to the main inputs of the server.

+ Return Safety Ground - 48Vdc

Figure 2-7. DC Input Power Cable Connector

The DC Power Supply has three connections/conductors:

• -48Vdc, negative terminal (Battery).
• Safety Ground, indicated by “Earth GND Symbol”. (Optional because Chassis GND stud is connected)
  • +Return, positive terminal (Battery Return, BR).

Supermicro provides a cable for connection to the DC power supply. You should use the provided cable or an equivalent cable with the following specifications:

• Positronic CBD connector.
  • Conductor Wire size: 8WG.
• Safety Ground insulation color: Green/Yellow.
  • Use copper conductors only.

Note: If using the Supermicro provided DC power cables, the connector and contacts do not need to be treated with anti-oxidants prior to connection to the Power Supply in the server. Otherwise, the cable wires should be prepared to a bright finish, and coated with an appropriate anti-oxidant prior to crimping or connections to the battery, battery return, and Earth Ground per GR1089 R9-19 [84].

Note: The SYS-220HE-FTNRD-NEBS server is DC-I and can be grounded in both CBN and IBN networks. It is suitable for installation in Network Telecommunication Facilities and in locations where the NEC applies. Connection of the +Return (BR) supports both North America, Isolated GP (single point connection to CBN) and Europe, Integrated GP (Multiple point connection to CBN) configurations.

DC power source must meet TNV-2 requirements as defined by UL 60950-1 and IEC 60950-1.

Chassis Ground Stud connections for AC and DC systems

Both the AC and DC server products will include a chassis ground terminal as part of the chassis. This terminal is identified with the IEC 60417 #5019 Protective Earth Symbol. This equipment is designed to connect to the Common Bonding Network (CBN) of the facility in which it is installed.

Technical line drawing of an electronic device chassis with internal components and mounting holes (no text or symbols)

Figure 2-8. Chassis Ground Studs (Earth Ground)

The Chassis ground connection should use a single 8AWG conductor with a cable insulation color of Green/Yellow. Multiple conductors are not allowed per attachment point. A standard ring terminal is recommended for the connection to the GND stud.

The connection to the Chassis Ground stud must establish metal to metal contact. Paint and other non-conductive coatings shall be removed on the surfaces between the mounting hardware. The surfaces shall be cleaned and an anti-oxidant shall be applied before being joined.

Prior to making crimp connections, coat all bare conductors with an appropriate anti-oxidant compound. Bring the ground terminal and connecting hardware to a bright finish and coat with an anti-oxidant before making a connection.

Do not mix copper and aluminum conductors (or other dissimilar metals) in the same terminal. Use lugs rated for copper if using copper conductors, and aluminum rated lugs if using aluminum conductors.

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components requires that power first be removed from the system. Please follow the procedures given in each section.

3.1 Removing Power

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non-hot-swap components or when replacing a non-redundant power supply.

1. Use the operating system to power down the system.
2. After the system has completely shut-down, disconnect the AC or DC power cord(s) from the power strip or outlet. (If your system has more than one power supply, remove the AC or DC power cords from all power supply modules.)
3. Disconnect the power cord(s) from the power supply module(s).

3.2 Accessing the System

The CSE-HE211-R000NFP chassis features a removable top cover, which allows easy access to the inside of the chassis.

Removing the Top Cover

1. Press the release button and slide the cover toward the rear.

2. Lift the top cover-up.

Check that all ventilation openings on the top cover and the top of the chassis are clear and unobstructed.

Caution: Except for short periods of time, do not operate the server without the cover in place. The chassis cover must be in place to allow for proper airflow and to prevent overheating.

Release Button

Figure 3-1. Removing the Chassis Cover

3.3 Static-Sensitive Devices

Electrostatic Discharge (ESD) can damage electronic components. To avoid damaging your motherboard, it is important to handle it very carefully. The following measures are generally sufficient to protect the system PCBs from ESD.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing any PCB (printed circuit board) from its antistatic bag.
• Handle PCBs by their edges only; do not touch its components, peripheral chips, memory modules, or gold contacts.
• When handling chips or modules, avoid touching their pins.
• Put the PCBs back into their antistatic bags when not in use.
• Use only the correct type of onboard CMOS battery. Do not install the onboard battery upside down to avoid a possible explosion.

3.4 Processor and Heatsink Installation

The processor (CPU) must first be attached to the processor carrier to form the processor carrier assembly. This assembly gets attached to the heatsink to form the processor heatsink module (PHM), which is then installed into the CPU socket. Before installing, be sure to perform the steps below:

• Please carefully follow the instructions given on ESD precautions.
  • After shutting down the system, unplug the AC or DC power cords from all power supplies.
• Check that the plastic protective cover is on the CPU socket and that none of the socket pins are bent. If they are, contact your retailer.
• When handling the processor, avoid touching or placing direct pressure on the LGA lands (gold contacts). Improper installation or socket misalignment can cause serious damage to the processor or the socket and may require manufacturer repairs.
• Thermal grease is pre-applied on new heatsinks. No additional thermal grease is needed.
• All graphics in this manual are for illustration only. Your components may look different.

Supported processors: P4X-ICX6338T-SRKXF: ICX 6338T 2P 24C/48T 2.1G 36M 11.2GT 165W 4189 M1

The Processor Carrier Assembly

The processor carrier assembly is comprised of the processor and the processor carrier.

To create the processor carrier assembly, please follow the steps below:

Note: Before installation, be sure to review the Static-Sensitive Devices section earlier in this chapter.

1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below. These triangles indicate the location of pin 1.

2. Turn the processor over (with the gold pins up). Locate the CPU keys on the processor and the four latches on the carrier as shown below.

(with Processor Seated inside the Carrier)

1. Locate the lever on the carrier and press it down as shown below.

Lever

1. Using pin 1 as a guide, carefully align the CPU keys on the processor (A & B) with those on the carrier (a & b) as shown below.

CPU Key (on the processor) CPU Key (on the carrier) Latch B 1 A 2 a Latch CPU Key (on the processor) CPU Key (on the carrier)

1. Once aligned, carefully place one end of the processor under latch 1 on the carrier, and then press the other end down until it snaps into latch 2.

2. After the processor is placed inside the carrier, examine the four sides of the processor, making sure that the processor is properly seated on the carrier.

Processor Carrier Assembly (Top Side View) Processor Carrier Assembly

The Processor Heatsink Module (PHM)

After creating the processor carrier assembly, follow the instructions below to mount the heatsink onto the carrier assembly to form the processor heatsink module (PHM).

Note: If this is a new heatsink, the thermal grease has been pre-applied. Otherwise, apply the proper amount of thermal grease to the underside of the heatsink.

1. Turn the heatsink over with the thermal grease facing up. Pay attention to the two triangle cutouts (A, B) located at the diagonal corners of the heatsink as shown in the drawing below.

2. Hold the processor carrier assembly upside-down to locate the triangles on the processor and the carrier, which indicate pin 1.

3. Turn the processor carrier assembly over so that the gold pins are facing up. Locate the two-pin 1 locations ("A on the processor and "a" on the processor carrier assembly).

4. Align "a" on the processor carrier assembly with the triangular cutout "A" on the heatsink along with "b", "c", "d" on the processor assembly with "B", "C", "D" on the heatsink.

5. Once properly aligned, place the heatsink on the processor carrier assembly with all corners matched up, making sure that the four clips are properly securing the heatsink.

Processor Carrier Assembly Pin1 a b c D A B C Heatsink

Preparing the CPU Socket for Installation

The CPU socket comes with a plastic protective cover, which needs to be removed before installing the Processor Heatsink Module (PHM). Do this by gently squeezing the grip tabs then pulling the cover off.

CPU Socket with Plastic Protective Cover Grip Tab

Installing the PHM into the CPU Socket

After assembling the Processor Heatsink Module (PHM), you are ready to install it into the CPU socket.

1. Locate four threaded fasteners (a, b, c, d) on the CPU socket.

CPU Socket Threaded Fastener (a, b, c, d: Threaded Fasteners) CPU Socket Pin1

1. Locate four peek nuts (A, B. C. D) and four rotating wires (1, 2, 3, 4) on the heatsink as shown below.

Heatsink A, B, C, D: Peek Nut 1, 2, 3, 4: Rotating Wire a, b, c, d: Threaded Fastener Rotating Wire 4 Rotating Wire 3 Rotating Wire 1 Peek Nut CPU Socket d a Threaded Fastener Rotating Wire Peek Nut (Unlatched) (latched)

1. Check the rotating wires (1, 2, 3, 4) to make sure that they are in the unlatched position as shown.

Unlatched State Rotating Wire Side View Top View Peek Nut

1. Align peek nut "A" (next to the triangular pin 1 on the heatsink) with threaded fastener "a" on the CPU socket. Then align peek nuts "B", "C", "D" on the heatsink with threaded fasteners "b", "c", "d" on the CPU socket, making sure that all peek nuts and threaded fasteners are properly aligned.

2. Once aligned, gently place the heatsink on the CPU socket, making sure that each peek nut is properly attached to its corresponding threaded fastener.

A, B, C, D: Peek Nut on the Heatsink B D A C b c d a, b, c, d: Threaded Fastener on the CPU socket

1. Press all four rotating wires outward and make sure that the heatsink is securely latched into the CPU socket.

Rotating Wire Rotating Wire Latched State Top View

1. With a T30-bit screwdriver, tighten all peek nuts in the sequence of "A", "B", "C", and "D" with even pressure. To avoid damaging the processor or socket, do not use a force greater than 12 lbf-in when tightening the screws.

2. Examine all corners of the heatsink to ensure that the PHM is firmly attached to the CPU socket.

Technical diagram showing two mechanical components with labeled parts A, B, C, D and red arrows indicating motion or force directions.

Removing the PHM from the CPU Socket

Before removing the PHM from the motherboard, first shut down the system and unplug the AC or DC power cord from all power supplies.

1. Use a T30-bit screwdriver to loosen the four peek nuts on the heatsink in the sequence of A, B, C, and D.

B C D A Peek Nut C

1. Once the peek nuts have been loosened from the CPU socket, press the rotating wires inward to unlatch the PHM from the socket, as shown below.

Technical illustration of a dual-chamber industrial cooling unit with red arrows indicating heating or cooling process (no text or symbols present)

Unlatched State Rotating Wire Side View Peek Nut

1. Gently lift the PHM upward to remove it from the CPU socket.

Technical diagram of an electronic component with mounting base and internal structure, showing red directional arrows indicating assembly or movement (no text or symbols present)

Removing the Processor Carrier Assembly from the PHM

To remove the processor carrier assembly from the PHM, please follow the steps below:

1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown below.

Processor Carrier Assembly Pin1 Pin1 a b c D A Heatsink B C

1. When all plastic clips have been detached from the heatsink, remove the processor carrier assembly from the heatsink.

Technical diagram of an electronic component with red arrows indicating assembly or force direction (no text or symbols present)

Removing the Processor from the Processor Carrier Assembly

Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below.

1. Unlock the lever from its locked position and push it upwards to disengage the processor from the processor carrier, as shown below right.

Processor Carrier Assembly Lever

1. Once the processor has been loosened from the carrier, carefully remove the processor from the carrier.

Note: Please handle the processor with care to avoid damaging it or its pins.

Isometric technical diagram of a computer motherboard with a highlighted component and red arrow indicating upward motion (no text or symbols)

3.5 Memory

Memory Support

The X12DHM-6 has 32 DIMM slots to support up to 8TB of 3DS LRDIMM/LRDIMM/3DS RDIMM/RDIMM DDR4 (288-pin) ECC memory with speeds of 3200/2933/2666 MHz and up to 8TB of Intel Optane PMem 200 Series with speeds of up to 3200 MHz.

Memory Installation Sequence

Memory for this motherboard is populated using the "Fill First" method. The DIMM slots with blue release tabs are considered the first DIMM of their channel, and those with white release tabs are the second of the channel. When installing memory modules, be sure to populate the memory slots with the blue release tabs first and then populate those with the white release tabs.

General Memory Population Requirements

1. Be sure to use the memory modules of the same type and speed on the motherboard. Mixing of memory modules of different types and speeds is not allowed.
2. Using unbalanced memory topology such as populating two DIMMs in one channel while populating one DIMM in another channel will result in the reduced memory performance.
3. Populating memory slots with a pair of DIMM modules of the same type and size will result in interleaved memory, which will improve memory performance.

Supported memory

• MEM-DR432L-HL03-ER32: Hynix 32GB DDR4-3200 ECC RDIMM
• MEM-DR464L-HL02-ER32: Hynix 64GB DDR4-3200 ECC RDIMM
• MEM-DR432L-CL05-ER32: Micron 32GB DDR4-3200 ECC RDIMM
• MEM-DR464L-CL03-ER32: Micron 64GB DDR4-3200 ECC RDIMM
• MEM-DR432L-SL02-ER32: Samsung 32GB DDR4-3200 ECC RDIMM
• MEM-DR416L-CL06-ER32: Micron 16GB DDR4-3200 ECC RDIMM
• MEM-DR464L-SL01-ER32: Samsung 64GB DDR4-3200 ECC RDIMM
• MEM-DR416L-SL02-ER32: Samsung 16GB DDR4-3200 ECC RDIMM

DDR4 Memory Population Guidelines

The following memory population table was created based on guidelines provided by Intel to support Supermicro motherboards.

Memory Population for DDR4-only Configurations, 32 DIMM Slots
CPUs/DIMMs Memory Population Sequence
1 CPU & 1 DIMM	A1
1 CPU & 2 DIMMs*	A1, E1
1 CPU & 4 DIMMs*	A1, C1, E1, G1
1 CPU & 6 DIMM	A1, B1, C1, E1, F1, G1
1 CPU & 8 DIMMs*	A1, B1, C1, D1, E1, F1, G1, H1
1 CPU & 12 DIMMs	A1, A2, B1, C1, C2, D1, E1, E2, F1, G1, G2, H1
1 CPU & 16 DIMMs*	A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2
2 CPUs & 2 DIMMs*	CPU1: A1CPU2: A1
2 CPUs & 4 DIMMs*	CPU1: A1, E1CPU2: A1, E1
2 CPUs & 6 DIMMs	CPU1: A1, C1, E1, G1CPU2: A1, E1
2 CPUs & 8 DIMMs*	CPU1: A1, C1, E1, G1CPU2: A1, C1, E1, G1
2 CPUs & 10 DIMMs	CPU1: A1, B1, C1, E1, F1, G1CPU2: A1, C1, E1, G1
2 CPUs & 12 DIMMs*	CPU1: A1, B1, C1, E1, F1, G1CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 14 DIMMs	CPU1: A1, B1, C1, D1, E1, F1, G1, H1CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 16 DIMMs*	CPU1: A1, B1, C1, D1, E1, F1, G1, H1CPU2: A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 18 DIMMs	CPU1: A1, A2, B1, C1, C2, D1, E1, E2, F1, G1, G2, H1CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 20 DIMMs	CPU1: A1, A2, B1, C1, C2, D1, E1, E2, F1, G1, G2, H1CPU2: A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 22 DIMMs	CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 24 DIMMs*	CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2CPU2: A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 32 DIMMs*	CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2CPU2: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2

* recommended for optimal performance
- Must have at least one DIMM per CPU.

DIMM Installation

1. Insert the desired number of DIMMs into the slots based on the recommended DIMM population tables shown above.
2. Push the release tabs on both ends of the DIMM slot outwards to unlock it.

1. Align the key of the DIMM module with the receptive point on the memory slot.

Key

1. Align the notches on both ends of the module with the receptive points on the ends of the slot.

Notches

1. Push both ends of the module straight down into the slot until the module snaps into place.

Push both ends straight down into the memory slot.

Illustration of two hands holding a mechanical component with arrows indicating motion (no text or symbols)

1. Press the release tabs to the lock positions to secure the DIMM module into the slot.

DIMM Removal

Press both release tabs on the ends of the DIMM module to unlock it. Once the DIMM module is loose, remove it from the memory slot.

Warning! To avoid causing any damage to the DIMM module or the DIMM socket, do not use excessive force when pressing the release tabs on the ends of the DIMM socket. Handle DIMMs with care. Be aware and follow the ESD instructions given at the beginning of this chapter.

3.6 Motherboard Battery

The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard.

Replacing the Battery

Begin by removing power from the system.

1. Push aside the small clamp that covers the edge of the battery. When the battery is released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+) side facing up. Then push the other side down until the clamp snaps over it.

Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

LITHIUM BATTERY BATTERY HOLDER

Figure 3-2. Installing the Onboard Battery

Warning: There is a danger of explosion if the onboard battery is installed upside down (which reverses its polarities). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).

3.7 Chassis Components

This section provides instructions on installing and replacing system components. To assure compatibility, only use components that match the specifications or part numbers given.

Bezel

The SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS includes a front bezel with an air filter. The bezel can be removed and the air filter replaced. It is recommended that you keep a maintenance log and frequently replace the filter. The filter's condition will affect the airflow throughout the whole system. See the next section for the procedure to replace the filter.

Release lever Mounting Pins

Figure 3-3. Front Bezel

Removing the Bezel

1. Use the key to unlock the bezel.
2. Press the red release lever to retract the bezel pins.
3. Push the bezel to the left then with both hands carefully angle it out and away from the chassis.

Replacing the Bezel

1. Insert the two pins on the left of the bezel into the left-side mounting pin holes on the chassis (see following illustration).
2. Push and hold the release lever while pushing the right side of the bezel into the pins on the right side of the chassis, then release the lever to secure the bezel.
3. Lock the bezel if desired.

Hole for Bezel Pin 1 Hole for Bezel Pin 2 Hole for Bezel Pin 2 Hole for Bezel Pin

Figure 3-4. Bezel Mounting Pins

Bezel Extension

An extension for the bezel may be used when the I/O connections are located at the front of the server. This extension is used to keep the hold the I/O cables where they can be routed out through the side of the extension.

Installing the Bezel Extension

1. First remove the bezel as described in the previous section.
2. Align the extension with the front of the chassis and push the left side in with the retractable pins in their respective holes.
3. With the extension angled in, depress the vertical latch with the blue arrow tabs and push the right side of the extension in until it latches into place.
4. After routing any I/O cabling through the extension, replace the bezel on the front of the extension in the same way it attached to the chassis (described in previous section).

Removing the Bezel Extension

1. First remove the bezel as described in the previous section.
2. Depress the depress the vertical latch with the blue arrow tabs and pull the right side and then the left side of the extension out and away from the chassis.

Technical line drawing of a server rack with internal components and housing (no text or symbols)

Figure 3-5. Installing the Bezel Extension

Replacing the Bezel Air Filter

Per NEBS requirements, the air filter must be replaced periodically. A clogged air filter reduces cooling capability and may incur overheating problems. Filter life for a typical data-center environment is six months. Dirtier environments may require service more often. The BMC provides a warning message 30 days before your change date; the default of six months can be changed by the user using the BMC.

Note: Filters are single-use. Do not clean and reuse. Replace them with Supermicro air filters only. Supermicro filters are marked "UL Classified" and are designed to meet UL 900-2004 standards.

Replacing the Bezel Filter

1. To remove the old filter, push up and hold the small release lever, slide the filter to the left and pull it out.
2. Replace with a new filter. Lift the release lever, push the new filter into position, then slide it to the right so that the filter frame catches under the tabs on the bezel. Then release the lever.

Lift Release Lever STEP 1 STEP 2 Release the Lever STEP 3

Figure 3-6. Replacing the Bezel Air Filter

3.8 Storage Drives

The system supports six hot-swap NVMe/SATA hybrid drive bays and two M.2 SATA3 slots. For compatible storage drives, see the X12DHM-6 motherboard page.

The drives are mounted in toolless drive carriers that simplify their removal from the chassis. These carriers also help promote proper airflow.

Note: Enterprise-level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro website product pages at https://www.supermicro.com/products/nfo/Ultra.cfm.

Checking the Temperature of an NVMe Drive

There are two ways to check using BMC.

Checking a Drive

• BMC > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives.
• BMC > Server Health > Sensor Reading > NVME_SSD – Shows the single highest temperature among all the NVMe drives.

Installing Drives

The front of the system has six hard drive bays that support NVMe and SATA3 hard drives.

Front view of a server rack with multiple drive bays and orange indicator lights (no visible text or labels)

Figure 3-7. Logical Drive Numbers

Removing a Hot-Swap Drive Carrier from the Chassis

1. Press the release button on the drive carrier, which will extend the drive carrier handle.
2. Use the drive carrier handle to pull the drive out of the chassis.

30 Align Both Mounting Holes 30-50-42-471-X

Figure 3-8. Removing a Drive Carrier

Installing a Hard Drive into a Drive Carrier

1. Insert a drive into the carrier with the PCB side facing down and the connector end toward the rear of the carrier.
2. Align the drive in the carrier so that the screw holes of both lineup. Note that there are holes in the carrier marked "SATA" to aid incorrect installation.
3. Secure the drive to the carrier with four screws.
4. Insert the drive carrier into its bay, keeping the carrier oriented so that the hard drive is on the top of the carrier and the release button is on the right side. When the carrier reaches the rear of the bay, the release handle will retract.
5. Push the handle in until it clicks into its locked position.

Note: Your operating system must have RAID support to enable the hot-plug capability of the hard drives.

Note: Enterprise-level hard disk drives are recommended for use in Supermicro chassis and servers.

MILKON VACERATION Align Both Mounting Holes 0-10

Figure 3-9. Removing the Dummy Drive from a Carrier

Hot-Swap for NVMe Drives

Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using BMC.

Note: If you are using VROC, see the VROC appendix in this manual instead.

Ejecting a Drive

1. BMC > Server Health > NVMe SSD
2. Select Device, Group, and Slot, and click Eject. After ejecting, the drive Status LED indicator turns green.
3. Remove the drive.

Note that Device and Group are categorized by the CPLD design architecture. The SYS-220HE-FTNRD-NEBS server has one Device and one Group.

A Slot is the slot number on which the NVMe drives are mounted.

Overview Physical View Logical View Controller Physical View ✓ Bits ✓ Unstone ✓ Except ✓ Insert Start LED Status Supported Actions Disk Inful Capacity Link Speed Connected Logical Drive Connected Controller 0.3 SAMSUNG METZ-028/0649-0003 N/A 8.3 GTto- N/A N/A MyAir Devices1 0.1 SAMSUNG METZ-028/0649-0003 N/A 8.3 GTto- N/A N/A MyAir Devices1

Figure 3-10. BMC Screenshot

Replacing the Drive

1. Insert the replacement drive.
2. BMC > System > Storage Monitor > Physical View
3. Select Device, Group, and slot and click Insert. The drive Status LED indicator flashes red, then turns off. The Activity LED turns blue.

Installing M.2 Solid State Drives

The X12DHM-6 has two M.2 slots for two PCIe 3.0 NVMe/SATA M.2 drives in the 2280 and 22110 form factors. The M.2 slots allow for a variety of card sizes with increased functionality and storage efficiency.

Installing M.2 Drives

1. Remove power from the system and then remove the top cover as described in Sections 3.1 and 3.2.
2. Begin by removing the riser brackets from the chassis.
3. Insert the M.2 sideways into the connector so that it lays flat, then secure it to the bracket with the plastic clip.
4. Repeat as necessary for more M.2 drives.
5. With the drives installed and secured to the bracket, replace the bracket back into the chassis as before.
6. Finish by replacing the cover and restoring power to the system.

3.9 System Cooling

Fans

Six 6-cm heavy-duty fans provide cooling for the system. Fans are hot-swapped and can be replaced without powering down the system. The electrical connections are automatically made when a fan is inserted into its slot.

Make sure the chassis cover is only off for a short time and makes a good seal when replaced for the cooling air to circulate properly through the system.

Changing a System Fan

1. Determine which fan is failing using BMC if possible. If not, remove the chassis cover while the power is on and examine the fans to determine which one has failed.
2. Pull the system partially out from the rack.
3. With the top cover partially pushed back, depress the release buttons on the front section of the top cover to swing it open on its hinges.
4. Squeeze the fan tabs of the failed fan and lift the fan housing up and out of the chassis.
5. To install a fan, push it into the proper location until it clicks.
6. Finish by fully closing the cover and pushing the system back into the rack.

Technical diagram of a server rack with numbered components, showing front panel and rear panel assembly.

Figure 3-11. Installing a Fan (positions indicated)

Air Shrouds

Air shrouds concentrate airflow to maximize fan efficiency.

Air Shroud for Memory (CPU1/2)

Four 2U air shrouds cool the DIMM slots controlled by CPUs 1 and 2 (see figure below).

1. Remove the system from the rack and remove the cover as described previously.
2. Remove riser card brackets and riser card supporting bar.
3. Place each air shroud over eight DIMM slots at a time for both CPU1 and CPU2-controlled DIMM slots, as illustrated below.
4. Re-assemble riser card supporting bar and riser card brackets.
5. Close the cover and push the system back into the rack.

Isometric technical line drawing of a server rack with multiple internal components (no text or labels)

Figure 3-12. Installing Air Shrouds for CPU1/2 DIMMs

3.10 Expansion Cards

The SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS includes three riser cards to support the use of expansion (add-on) cards. The system also has flexible networking options with two AIOM networking slot (OCP NIC 3.0 compatible).

CPU1 CPU2

Figure 3-13. Expansion Card Chassis Slots

Riser Cards

This system include riser cards that provide PCIe capabilities.

PCIe Slots per Riser Card
Riser Card Part Number Slot Description (all PCIe 4.0)
Left-facing riser card	RSC-H2-68G4		x16 or 2 x8 FH, 10.5"L (CPU2)
Middle-facing riser card	RSC-H-66G4L	16	or 2 x8 FH, 10.5"L (CPU2)
Right-facing riser card	RSC-H2-6888G4 (default)	16	or 2 x8 FH, 10.5" (CPU1) + 2 x8 FHHL (CPU1)

Full-height = 4.2", Low-profile = 2.5", Full-length = 10.5", Half-length = 6.6"

The SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS includes three riser cards (two cards of RSC-H2-68G4 and one card of RSC-H2-6888G4) to support the use of expansion (add-on) cards. The riser cards have already been pre-installed into the motherboard. Below are the riser cards and their respective PCIe slots and cable connections details.

JPCIE2A1 JPCIE1A1 JPCIE1B1

Figure 3-14. RSC-H2-68G4 Riser Card

Cables for PCIe Slots
	PCIe Slot 1/3	PCIe Slot 2/4	JPCIE1A1 JPCIE1B1	JPCIE2A1
Config. 1	PCIe 4.0 x16	N/A	Straight Connector	Right Angle Connector	N/A
Config. 2	PCIe 4.0 x8	PCIe 4.0 x8	Straight Connector	N/A	Right Angle Connector

JPCIE2A JPCIE1A1 JPCIE1B

Figure 3-15 RSC-H2-6888G4 Riser Card

Cables for PCIe Slots
	PCIe Slot 5	PCIe Slot 6	JPCIE1A1 JPCIE1B1	JPCIE2A1
Config. 1	PCIe 4.0 x16	N/A	Straight Connector	Right Angle Connector	N/A
Config. 2	PCIe 4.0 x8	PCIe 4.0 x8	Straight Connector	N/A	Right Angle Connector

The SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS includes three riser cards to support the use of expansion (add-on) cards.

Before following the procedure below to install expansion cards, first turn off and remove power from the system as described in section 3.1 then remove the top cover.

Installing Expansion Cards

1. Remove the top cover and pull up the riser card brackets.

- For the right side (looking from the node front), open the clip of each slot on the right.

1. Remove the blank PCI shield from the chassis.

2. Slide the expansion card shield into the open shield slot while plugging the expansion card into the riser card.

Technical line drawing of a server rack with internal components and mounting brackets (no text or symbols)

Figure 3-16. Installing Riser Cards

3.11 Power Supply

The system includes two hot-plug power supply modules: the SYS-220HE-FTNR-NEBS with AC (2000W) and the SYS-220HE-FTNRD-NEBS with DC (1300W) power supplies. These modules will automatically sense the AC power supply and operate at an input voltage between 100V to 240V and DC power supply operates at an input voltage -48Vdc. Note that different input voltages will result in different maximum power output levels.

In the event of a power module failure, the other power module will continue to power the system on its own. Failed power supply modules can be replaced without powering down the system. Replacement modules can be ordered directly from Supermicro.

An amber light on the power supply is illuminated when the power is switched off. A green light indicates that the power supply is operating.

Replacing the Power Supply

1. Unplug the AC or DC power cord from the failed power supply module.
2. Push and hold the release tab on the back of the power supply.
3. Grasp the handle of the power supply and pull it out of its bay.
4. Push the new power supply module into the power bay until it clicks into the locked position.
5. Plug the AC or DC power cord back into the power supply module.

2 Release Tab PRE-NOODP-IN PRE-NOODP-IN

Figure 3-17. Installing a Power Supply Module

Note: The AC and DC systems follow the same procedure to replace the power supply.

3.12 BMC

The BMC can be reset using the button on the front control panel or on the chassis rear.

• Reset—Press and hold the button. After six seconds, the LED blinks at 2 Hz. The BMC resets and the reset duration is \~250 ms. Then the BMC starts to boot.
• Restore factory default configuration—Hold the button for twelve seconds. The LED blinks at 4 Hz while defaults are configured.
• Firmware update—the UID LED blinks at 10Hz during a firmware update.

BMC Reset Options
Event LED (Green)
Reset Blinks at 2 Hz
Restore Defaults	Blinks at 4 Hz
Update Blinks at 10 Hz

Chapter 4

Motherboard Connections

This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1. More detail can be found in the Motherboard Manual Please review the Safety Precautions in Appendix A before installing or removing components.

4.1 Power Connections

Power Supply Connectors

Two power supply connectors are located at PSU1 and PSU2. You must also connect the 8-pin 12V DC power connectors (JGPW1/JGPW2/JGPW3/JGPW4/JGPW5) to the power supply to provide adequate power to your system.

8-Pin Power Connectors

JGPW1/JGPW2/JGPW3/JGPW4/JGPW5 are 8-pin 12V DC power inputs for the system and it must be connected to the power supply. Refer to the table below for pin definitions..

8-pin PowerPin Definitions

Pin# Definition

1 - 4 Ground

5 - 8 P12V (12V Power)

Required Connection

Other Power Connectors

JPWR1/JPWR4 are 6-pin 12V DC power inputs for the CPU and it must be connected to the power supply.

Note: To provide adequate power supply to the motherboard, be sure to connect the power supply units, the 8-pin and 6-pin power connectors to the power supply. Failure to do so may void the manufacturer warranty on your power supply and motherboard.

Universal Serial Bus (USB) Ports and Headers

A USB header is located at JUSB3 on the motherboard. This USB header supports two USB 3.0 connections.

4.2 Headers and Connectors

Fan Headers

There are eight 6-pin fan headers (FAN1 \~ FAN8) and two 4-pin fan headers (FAN9 \~ FAN10) on the motherboard. All these fan headers are backwards compatible with the traditional 3-pin fans. However, fan speed control is available by Thermal Management via the BMC interface. Refer to the table below for pin definitions.

6-pin Fan HeaderPin Definitions
Pin#	Definition
1	Ground
2	3A/+12V
3	Tachometer
4	PWM_Control
5	3A/12V
6	Ground

4-pin Fan HeaderPin Definitions
Pin#	Definition
1	Ground
2	2.5A/+12V
3	Tachometer
4	PWM_Control

TPM/Port 80 Header

A Trusted Platform Module (JTPM1)/ Port 80 header is located at JTPM1 to provide TPM support and Port 80 connection. Use this header to enhance system performance and data security. Refer to the table below for pin definitions. Please go to the following link for more information on the TPM: http://www.supermicro.com/manuals/other/TPM.pdf.

Trusted Platform Module Header Pin Definitions
Pin# Definition Pin# Definition
1 +3.3V 2 SPI_CS#
3 RESET# 4 SPI_MISO
5 SPI_CLK 6 GND
7 SPI_MOSI 8 NC
9 +3.3V Stdby 10 SPI_IRQ#

Chassis Intrusion

A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable from the chassis to inform you when the chassis is opened. Refer to the table below for pin definitions.

6-pin BMC External I²C Header

A System Management Bus header for BMC 2.0 is located at JF3_JIPMB1. Connect the appropriate cable here to use the IPMB I²C connection on your system. Refer to the table below for pin definitions.

NVMe SMBus Headers

NVMe SMBus (I²C) header (JNVI2C1), used for PCIe SMBus clock and data connections, provides hot-plug support via a dedicated SMBus interface. This feature is only available for a Supermicro complete system with an SMCI-proprietary NVMe add-on card and a proper cable installed. See the table below for pin definitions.

Unit Identifier (UID) Switch and UID LED Indicator

A UID switch jumper (JUIDB1) and a UID LED (LED1) are located on the motherboard. The front UID LED is located on pins 7 & 8 of the front panel control header (JFP1). When you press the rear UID switch, both front and rear UID LEDs will be turned on. Press the UID switch again to turn off the LED indicators. The UID indicators provide easy identification of a system that may be in need of service.

Note: UID can also be triggered via BMC on the motherboard. For more information on BMC, please refer to the BMC User's Guide posted on our website at http://www.supermicro.com.

VROC RAID Key Header

A VROC RAID Key header is located at JRK1 on the motherboard. Install a VROC RAID Key on JRK1 for NVMe RAID support as shown in the illustration below. Please refer to the layout below for the location of JRK1.

Intel VROC KeyPin Definitions
Pin#	Definition
1	Ground
2	3.3V Standby
3	Ground
4	PCH RAID Key

Isometric diagram of a connector with a green arrow indicating direction, no text or symbols present

Note: The graphics contained in this user's manual are for illustration only. The components installed in your system may or may not look exactly the same as the graphics shown in the manual.

VRM SMBus Header

JVRM1 is a voltage regulator module (VRM) SMBus header. Use this header to program the CPU and memory VRM controllers.

SMBus Header for Riser Card

The SMBus Header for the riser card is located at JRSI2C1 on the motherboard. Please refer to the layout below for the location of JRSI2C1.

CPU VPP Bus Header for Backplane NVMe Riser Card Device

The CPU VPP Bus header for the riser card is located at JNVVPP1 on the motherboard. Please refer to the layout below for the location of JNVVPP1.

Control Panel

The front control panel header (JFP1) contains header pins for various buttons and indicators that are normally located on a control panel at the front of the chassis. These connectors are designed specifically for use with Supermicro chassis. See the figure below for the descriptions of the front control panel buttons and LED indicators.

Front Control Panel LEDs

Front Control Panel (JFP1)LED Indicators
Event Power (LED1) HDD (LED2) LAN (LED3/4) UID			(LED5) Information (LED5) Power Fail (LED6)
Power On Solid On
HDD Activity Blinking
NIC Activity Blinking
Overheat Solid On
Fan Fail Blinking @ Hz
Power Fail					Blinking @1/4Hz	Solid On
Local UID On				Solid On
Remote UID On				Blinking 1Hz
Checking	BMC/BIOS Blinking @4HZ
Recovering/Updating	BMC Blinking @4HZ BMC 2 Blinks @4Hz, 1 Pause @2Hz (on-on-off-off)			BIOS/BMC Blinking @10Hz
Flash Not Detected or Golden Image Check Failed	BMC/BIOS Blinking @1HZ
CPLD Recovery Mode				Blinking @10Hz (MB UID LED)	Blinking @10Hz (FP Red LED)

Power On & BMC/BIOS Status LED Button

The Power On and BMC/BIOS Status LED button is located on pins 1 and 2 of JFP1. Momentarily contacting both pins will power on/off the system or display BMC/BIOS status. Refer to the tables below for more information.

Power Button & BIOS/BMC Status LED Indicator Pin Definitions (JFP1)

Pin# Definition

1 Signal

2 Ground

Power ButtonLED States
Status Event
Green: solid on	System power on
BMC/BIOS blinking green @ 4Hz	BMC/BIOS checking
BIOS blinking green @ 4Hz	BIOS recovery/update in progress
BMC blinking red x2 (2 blinks red) @ 4Hz, 1 pause @ 2Hz (on-on-off-off)	BMC recovery/update in progress
BMC/BIOS blinking green @ 1Hz	Flash not detected or golden image checking failure

Reset Button

The Reset Button connection is located on pins 3 and 4 of JFP1. Momentarily contacting both pins will reset the system. Refer to the table below for pin definitions.

Reset ButtonPin Definitions (JF1)

Pin# Definition

3 Reset

4 Ground

Power Fail LED

The Power Fail LED connection is located on pins 5 and 6 of JFP1. When this LED turns solid red, it indicates a power failure. Refer to the table below for pin definitions.

Power Fail LEDPin Definitions (JF1)
Pin#	Definition
5 3.3V
6 PWR	Fail for LED6 (Solid red on: PWR failure)

Information LED (OH/Fan Fail/PWR Fail/UID LED)

The Information LED (OH/Fan Fail/PWR Fail/UID LED) connection is located on pins 7 and 8 of JFP1. The LED on pin 7 is active when the UID button (JUIDB1) on the rear I/O panel is pressed. The LED on pin 8 provides warnings of overheat, power failure, or fan failure. Refer to the tables below for more information.

Information LED-Blue+ (OH/Fan Fail/PWR Fail LED for LED5/blue UID LED)LED States
Status Description
Solid red (on)	An overheat condition has occurred.
Blinking red (1Hz)	Fan failure: check for an inoperative fan.
Blinking red (0.25Hz)	Power failure: check for a non-operational power supply
Blinking red (10Hz) (FP red LED)	CPLD recovery mode error(s)
Solid blue	Local UID is activated. Use this function to locate a unit in a rack mount environment that might be in need of service.
Blinking blue (1Hz)	Remote UID is on. Use this function to identify a unit from a remote location that might be in need of service.
BIOS/BMC blinking blue (10Hz) BIOS/BMC: recovery and/or update in progress
Red Info LED blinking (10Hz) and MB UID LED blue blinking (10Hz)	CPLD: recovery and/or update in progress

The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11 and 12 of JFP1, and LAN port 2 is on pins 9 and 10. Refer to the tables below for pin definitions.

LAN1/LAN2 LEDPin Definitions (JFP1)
Pin#	Definition	Pin#	Definitin
9 NIC	2 Activity	LED 10 NIC	2 Link	LED
11 NIC	1 Activity	LED 12 NIC	1 Link	LED

LAN1/LAN2 LEDLED States

Color State

NIC 2: Blinking green LAN 2: Active

NIC 1: Blinking green LAN 1: Active

ID\_UID Switch/HDD LED

The UID Switch/HDD LED connection is located on pins 13 and 14 of JFP1. The UID switch is used for a chassis that supports a front UID switch. The front UID switch functions in the same way as the rear UID switch; both are for input only and cannot be used for output.

When this LED is blinking green, it indicates HDD is active. Attach a cable to pins 13 and 14 to show ID_UID status and hard drive activity. Refer to the tables below for pin definitions.

ID_UID/HDD LEDPin Definitions (JF1)

Pins Definition

13 ID_UID/3.3V Stdby

14 HDD Activity

ID_UID/HDD LEDLED State
Color State
Blinking Green HDD	Active

FP Power LED

The Front Panel Power LED connection is located on pins 15 and 16 of JFP1. Refer to the table below for pin definitions.

FP Power LEDPin Definitions (JFP1)
Pins Definition
15 3.3 V
16 FP	PWR LED

NMI Button

The non-maskable interrupt (NMI) button header is located on pins 19 and 20 of JFP1. Refer to the table below for pin definitions.

NMI ButtonPin Definitions (JFP1)

Pins Definition

19 NMI

20 Ground

4.3 Input/Output Ports

Front I/O Ports

See the figure below for the locations and descriptions of the I/O ports on the front of the motherboard.

Diagram showing labeled ports and connectors: two Ethernet ports with blue I/O pins, one connected to a 2.5V D-substrate via a green port.

Front I/O Ports

# Description

1 BMC_LAN Port

2 UB 0 (3.0)

3 UB 1 (3.0)

4 VGA Port

VGA Connections

The VGA header is located at JFP2 on the motherboard. These VGA connections provide analog interface support between the computer and the video displays. Refer to the layout below for the locations of VGA connections.

4.4 Jumpers

Explanation of Jumpers

To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board. See the diagram below for an example of jumping pins 1 and 2. Refer to the motherboard layout page for jumper locations.

Note: On two-pin jumpers, "Closed" means the jumper is on, and "Open" means the jumper is off the pins.

Connector Pins Jumper Setting 3 2 1 3 2 1

CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system and unplug the power cord(s).
2. Remove the cover of the chassis to access the motherboard.
3. Remove the onboard battery from the motherboard.
4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
5. Remove the screwdriver (or shorting device), and reinstall the battery to the proper location
6. Replace the cover, reconnect the power cord(s), and power on the system.

Note: Clearing CMOS will also clear all passwords.

4.5 LED Indicators

BMC Heartbeat LED

A BMC Heartbeat LED is located at LEDM1 on the motherboard. When LEDM1 is blinking, the BMC is functioning normally. Refer to the table below for more information.

BMC Heartbeat LED Indicator
LED Color Definition
Green:Blinking	BMC Normal

Onboard Power LED

The onboard Power LED is located at LED2 on the motherboard. When this LED is on, the system power is on. Be sure to turn off the system power and unplug the power cord before removing or installing components. Refer to the table below for more information.

Onboard Power LED Indicator
LED Color Definition
Off	System PowerOff (power cable not connected)
Green	System PowerOn

Unit ID LED

A unit identifier LED indicator is located at LED1 on the motherboard. This UID indicator provides easy identification of a system unit that may need service.

UID LED
LED Color Definition
Blue: On Unit	Identified

4.6 Storage Ports

I-SATA 3.0 Ports

The X12DHM-6 has an I-SATA 3.0 header (JS1) with support for eight I-SATA ports (I-SATA0\~7) on the motherboard. These SATA ports are supported by the Intel C621A chipset. Please refer to the layout below for the location of JS1.

M.2 Slots

The X12DHM-6 motherboard has two PCIe 3.0 hybrid and NVMe or SATA M.2 slots (M.2-H1, M.2-H2). M.2 allows for a variety of card sizes, increased functionality, and spatial efficiency. The M.2 slot on the motherboard supports PCIe 3.0 x2 or SATA 3.0 devices in the 2280 and 22110 form factors.

NVMe Connectors

Four NVMe connectors (P1_NVME0, P1_NVME1, P2_NVME0, P2_NVME1) provide onboard NVMe connections. Use these NVMe connectors to attach high-speed PCIe storage devices.

Note: When installing an NVMe device on a motherboard, please be sure to connect the first NVMe port first (P1_NVME0/P2_NVME0) for your system to work properly.

Chapter 5

Software

After the hardware has been installed, you can install the Operating System (OS), configure RAID settings, and install the drivers.

5.1 Microsoft Windows OS Installation

If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals.

Installing the OS

1. Create a method to access the MS Windows installation ISO file. This might be a USB flash or media drive, or the IPMI KVM console.
2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
3. Boot from a bootable device with Windows OS installation. You can see a bootable device list by pressing F11 during the system startup.

Please select boot device: ATEN Virtual CDROM YSOJ → IPMI virtual drive (Legacy) ASUS SDRW-08D2S-U F601 → USB DVD device (Legacy) USB FLASH DRIVE PMAP → USB flash drive with OS installation (Legacy) IBA 40-10G Slot 1900 v1060 → PXE boot (Legacy) UEFI: ATEN Virtual CDROM YSOJ → IPMI virtual drive (UEFI) UEFI: ASUS SDRW-08D2S-U F601 → USB DVD device (UEFI) UEFI: Built-in EFI Shell Enter Setup ↑ and ↓ to move selection ENTER to select boot device ESC to boot using defaults

Figure 5-1. Select Boot Device

1. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on "Load driver" link at the bottom left corner.

Where do you want to install Windows? Name Total size Free space Type Refresh Delete Format New Load driver Extend We couldn't find any drives. To get a storage driver, click Load driver. Next

Figure 5-2. Load Driver Link

To load the driver, browse the USB flash drive for the proper driver files.

• For RAID, choose the SATA/sSATA RAID driver indicated then choose the storage drive on which you want to install it.

• For non-RAID, choose the SATA/sSATA AHCI driver indicated then choose the storage drive on which you want to install it.

• Once all devices are specified, continue with the installation.

• After the Windows OS installation has been completed, the system will automatically reboot multiple times.

5.2 Driver Installation

The Supermicro website contains drivers and utilities for your system at https://www.supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver.

After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash or media drive. (You may also use a utility to extract the ISO file if preferred.)

Another option is to go to the Supermicro website at http://www.supermicro.com/products/. Find the product page for your motherboard, and "Download the Latest Drivers and Utilities". Insert the flash drive or disk, and the screenshot shown below should appear.

SUPERMICRO X12DHM-6 Motherboard Drivers & Tools (Win2019) Intel® C621A Chipset X12DHM-6 SUPERMICRO Computer Inc. Intel Chipset INF files Microsoft .Net Framework 4.8 (Optional) ASPEED Graphics Driver Intel Virtual RAID on CPU Intel PRO Network Connections Drivers SUPERMICRO SuperDoctor 5 Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information, please visit SUPERMICRO's web site.

Figure 5-3. Driver and Tool Installation Screen

Note: Click the icons showing handwriting on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you must reboot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire content.

5.3 SuperDoctor® 5

The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server) IPMI, you can remotely control power ON/OFF and reset chassis intrusion for multiple systems. SuperDoctor 5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

SuperDoctor® Manual and Resources

SuperDoctor 5 Health Info Certificate error: localhost:HHa/SuperDoctor Loading Select Language: English (AEMIN) Layout Motherboard: C7B360-CB-ML Voltage Status Close Inference Temperature CPU Time Screw Temp Processing Temp Hard Disk | install Instruments SUPRITICAL-INVER (2019C43) Memory Ask the anything

Figure 5-4. SuperDoctor 5 Interface Display Screen (Health Information)

5.4 BMC

The motherboard provides remote access, monitoring and management through the baseboard management controller (BMC) and other management controllers distributed among different system modules. There are several BIOS setting that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources.

BMC ADMIN User Password

For security, each system is assigned a unique default BMC password for the ADMIN user. This can be found on a sticker on the chassis and a sticker on the motherboard. The sticker also displays the BMC MAC address. If necessary, the password can be reset using the Supermicro IPMICFG tool.

BMC AC1F6BC PWD SUOKJ

Figure 5-5. BMC Password Label

The sticker can be found on the pull-out service tag at the front of the chassis. See Chapter 1 for label location.

Chapter 6

Optional Components

This chapter describes alternate configurations and optional system components.

Optional Parts

Storage drive options

Power options

Cable Management Arm

TPM security module

Intel VROC RAID Key

6.1 Storage Protocols Supported

The storage drive bays can support SATA and NVMe drives in any combination.

SATA – The default configuration supports up to twelve SATA drives.

NVMe – The default configuration supports up to six NVMe drives.

6.2 Power Supply Modules

Power Supply Module Options
Watts Part	Number 80Plus Level
1300	PWS-1K30F-1R (default DC PWS)	-
2000 PWS-2	K08F-1R (default) Titanium

6.3 TPM Security Module

SPI capable TPM 2.0 (or 1.2) with Infineon 9670 controller, horizontal form factor

The JTPM1 header is used to connect a Trusted Platform Module (TPM). A TPM is a security device that supports encryption and authentication in hard drives. It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system.

Details and installation procedures are at:

http://www.supermicro.com/manuals/other/TPM.pdf.

• AOM-TPM-9670V
• AOM-TPM-9671V

6.4 Intel Virtual RAID on CPU (VROC)

Intel® Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex.

• A single processor supports up to 12 NVMe SSDs and up to 6 RAID arrays.
• A dual processor system supports up to 24 NVMe SSDs and 12 RAID arrays.

Stripe sizes are 4K, 8K, 16K, 32K, 64K, 128K.

Requirements and Restrictions

• Intel VROC is only available when the system is configured for UEFI boot mode.
• To enable the mdadm command and support for RSTe, install the patch from

- Linux: https://downloadcenter.intel.com/download/28158/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Linux-

- Windows: https://downloadcenter.intel.com/download/28108/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Windows-

• To enable Intel VROC, a hardware key must be inserted on the motherboard, and the appropriate processor's Virtual Management Devices must be enabled in the BIOS setup.
• It is possible to enable Intel VROC without a hardware key installed, but only RAID0 will be enabled.
• Intel VROC is not compatible with secure boot. This feature must be disabled.
• When creating bootable OS RAID1 devices, you must have both devices on the same CPU, and a VMD on that CPU.
• Spanning drives when creating RAID devices is not recommended due to performance issues, even though it is supported.

Supported SSDs and Operating Systems

To see the latest support information: https://www.intel.com/content/www/us/en/support/articles/000030310/memory-and-storage/ssd-software.html

Additional Information

Additional information is available on the product page for the Supermicro add-on card and the linked manuals.

www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm

Hardware Key

The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly. The key must be plugged into the Supermicro motherboard (connector JRK1). The key options are:

Intel® VROC Keys
VROC Package Description Part Number Intel MM Number
Standard	RAID 0, 1, 10Supports 3rd party SSDs	AOC-VROCSTNMOD 95	1605
Premium	RAID 0, 1, 5, 10Supports 3rd party SSDs	AOC-VROCPREMOD 95	1606
Intel SSD only	RAID 0, 1, 5, 10Supports Intel SSDs only	AOC-VROCINTMOD 95	822

VROC Key Header, JRK1

Figure 6-1. Intel VROC RAID Key and Motherboard Connector JRK1

Configuring NVMe RAID Manually

RAID for NVMe SSDs is enabled by default when Intel VROC Raid Key is populated. It may be managed manually through the UEFI BIOS.

1. Reboot the server and press the [DEL] key to access the BIOS options.

2. Switch to Advanced > Chipset Configuration > North Bridge > IIO Configuration > Intel® VMD Technology.

Aptio Setup - AMI Advanced Intel® VMD Technology NVMe Mode Switch [Auto] ► Intel® VMD for Volume Management Device on CPU1 ► Intel® VMD for Volume Management Device on CPU2 NVMe Mode Switch Manual VMD Auto Select NVMe Mode, default Auto mode - enable VMD when VROC key presence

Figure 6-2. BIOS, Selecting VMD Mode

You can select a mode. The default is Auto. The VMD switch enables VMD mode for all NVMe ports despite the presence of the VROC key. The Manual switch allows the user to choose devices on which to enable VMD.

The onboard M.2 NVMe from PCH is located in the CPU1 section.

The screenshot below shows example choices in Manual mode.

Optio Setup - AMI Advanced VMD Config for PCH ports Enable/Disable VMD [Enable] M.2-P1 VMD [Disable] M.2-P2 VMD [Disable] VMD Config for IOU 0 Enable/Disable VMD [Enable] RSC-D2-668G4 SLOT1 VMD [Disable] RSC-D2-668G4 SLOT2 VMD [Disable] Hot Plug Capable [Disable] VMD Config for IOU 1 Enable/Disable VMD [Enable] RSC-D2-668G4 SLOT3 VMD [Disable] Hot Plug Capable [Disable] VMD Config for IOU 3 Enable/Disable VMD [Enable] Hot Plug Capable [Disable] VMD Config for IOU 4 Enable/Disable VMD [Enable] CPU1 NVMe1 VMD [Disable] CPU1 NVMe2 VMD [Disable] CPU1 NVMe3 VMD [Disable] Enable/Disable VMD +:-: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.21.1279 Copyright (C) 2021 AMI Enable/Disable VMD in this Stack.

Figure 6-3. BIOS, Manual Mode (Example—your server may look different.)

1. Select the desired PStack# to Enable or Disable the corresponding Intel VMD controller

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack2 Intel® VMD for Volume Management Device [Disable] Intel® VMD for Volume Management Device for PStack0 Disable Enable Enable/Disable Intel® Volume Management Device Technology In this Stack.

Figure 6-4. BIOS, Enabling VMD for Pstack0

1. Select the desired PCIe slot to Enable or Disable Intel VMD functionality according to the current hardware configuration being used. Hot Plug Capability can also be Enabled or Disabled.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Enable] CPU1 SLOT1 PCI-E 3.0 X8 VMD [Disable] Hot Plug Capable [Disable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack2 Intel® VMD for Volume Manage CPU1 SLOT1 PCI-E 3.0 X8 VMD Disable Enable Enable/Disable Intel® Volume Management Device Technology on specific root port

Figure 6-5. BIOS, Enabling VMD Functionality per Slot

1. Repeat steps 3 and 4 for each PStack# on each CPU to be enabled or disabled. In this example, we enabled CPU1 Slot1 (Figure 6-11) and CPU2 Slot5 (Figure 6-12) (four U.2 form factor SSDs), as well as CPU1 M.2 C-1 and CPU1 M2. C-2 (two M.2 form factor SSDs)

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Enable] CPU1 SLOT1 PCI-E 3.0 X8 VMD [Enable] Hot Plug Capable [Enable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Enable] CPU1 M.2 C-2 PCI-E 3.0 X4 VMD [Enable] CPU1 M.2 C-1 PCI-E 3.0 X4 VMD [Enable] CPU1 SLOT3 PCI-E 3.0 X8 VMD [Disable] Hot Plug Capable [Enable] VMD Config for PStack2 Intel® VMD for Volume Management Device [Disable] Enable/Disable Intel® Volume Management Device Technology in this Stack.

Figure 6-6. BIOS, Enabling CPU1 Example

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Enable] CPU2 SLOT5 PCI-E 3.0 X16 VMD [Enable] Hot Plug Capable [Enable] VMD Config for PStack2 Intel® VMD for Volume Management Device [Disable] Enable/Disable Hot Plug for PCIe Root Ports 2A-2D The Select Reserve

Figure 6-7. BIOS, Enabling CPU2 Example

1. Press [F4] to save the configuration and reboot the system and press [DEL] to enter BIOS.

Note: Disabling the VMD controller without first deleting the associated existing RAID volume can lead to unexpected behavior. This action is strongly not recommended.

Note: The effects of physically changing or swapping a CPU on the VMD controller enablement have not yet been thoroughly tested or documented.

1. Switch to Advanced > Intel(R) Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume.
2. Set Name.

3. Set RAID Level.

4. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller.

MSCI Setup Utility - Copyright (C) 2018 American MegaFinds, Inc. Advanced Create disk usage Name: MSCI Level1 MSCI Level2 Create disk usage over VAS Controller [1] Select Disk INTEL SUPPERCHARTI INTELFTS1500P49E [4] INTEL SUPPERCHARTI INTELFTS1500P49E [4] INTEL SUPPERCHARTI INTELFTS1500P49E [1] InTEL SUPPERCHARTI INTELFTS1500P49E [1] Strip Line: [120KB] Capacity Output: 367.43 Create Volume +1 Select Screen +2 Select Trim Refer Select +3 Change Out. +4 General Help +5 Previous Issues +6 Options Default +7 Lack & Full +8 Exit Version 6.19.1208, Copyright 10/12/2018 American MegaFinds, Inc.

Figure 6-8. Created Volume without enabling RAID spanned over VMD controller

Auto Setup Utility - Copyright ©2008 American requirements, Inc. Advanced Create AVID Volume Name: Capacity Level: Volume: (Min30/Max) Enable AVID volume over UMD Controller DC Select Zone: INTEL: SUPEREXCHINT1 DRUMPETS25A0GPHS INTEL: SUPEREXCHINT1 DRUMPETS25A0GPHS INTEL: SUPEREXCHINT1 DRUMPETS25A0GPHS INTEL: SUPEREXCHINT1 DRUMPETS25A0GPHS DC Select Zone: Capacity (MB): 120000 4510.00 Create Volume X - To Select Zone + : Select Screen T4: Select Type Wider: Select +/-: Change Rate, F1: General help F2: Previous Values F3: Selected Defaults F4: Save & Fail F5: Add

Figure 6-9. Created Volume with enabling RAID spanned over VMD controller

1. Select specific disks for RAID with an [X].

• RAID0: Select at least two [2 - 24] disks
• RAID1: Select only two disks
• RAID5: Select at least three [3 - 24] disks
• RAID10: Select only four disks

1. Select Stripe Size (Default 64KB).

2. Select Create Volume.

3. If another RAID is needed, start again at step 9.

4. Press [F4] to save and reboot.

Status Indications

An LED indicator on the drive carrier shows the RAID status of the drive.

Drive Carrier Status LED Indicator
Status State (red)
Normal function OFF
Locating 4 Hz blink
Fault Solid ON
Rebuilding 1 Hz Blink

IBPI SFF 8489 Defined Status LED States

Hot-Swap Drives

Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other manufacturers. Under vSphere ESXi, several steps are necessary to avoid potential stability issues. See the information at the link [1] below.

Hot-unplug

1. Prevent devices from being re-detected during rescan:

esxcli storage core claiming autoclaim --enabled=false

1. Unmount the VMFS volumes on the device. Check [2] for details.
2. Detach the device. Check [3] for details.
3. Physically remove the device.

Hot-plug

• Physically install the device.

ESXi will automatically discover NVMe SSDs, but a manual scan may be required in some cases.

Related Information Links

[1] https://kb.vmware.com/s/article/2151404
[2] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-1B56EF97-F60E-4F21-82A7-8F2A7294604D.html
[3] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-F2E75F67-740B-4406-9F0C-A2D99A698F2A.html

Chapter 7

Troubleshooting and Support

7.1 Information Resources

Website

A great deal of information is available on the Supermicro website, supermicro.com.

SUPERMICRO TECHNOLOGY & OUR PLANET Supermicro Resource-Saving Systems: Reduce Cost and Environmental Impact

Figure 7-1. Supermicro Website

• Specifications for servers and other hardware are available by clicking the menu icon, then selecting the Products option.
• The Support option offers downloads (manuals, BIOS/BMC, drivers, etc.), FAQs, RMA, warranty, and other service extensions.

Direct Links for the SYS-220HE-FTNR-NEBS/SYS-220HE-FTNRD-NEBS System

SYS-220HE-FTNR-NEBS and SYS-220HE-FTNRD-NEBS specifications page

X12DHM-6 motherboard page for links to the Quick Reference Guide, User Manual, validated storage drives, etc.

Direct Links for General Support and Information

Frequently Asked Questions

Add-on card descriptions

TPM User Guide

General Memory Configuration Guide: X12

SuperDoctor5 Large Deployment Guide

Direct Links (continued)

For validated memory, see our Product Resources page

Product Matrices page for links to tables summarizing specs for systems, motherboards, power supplies, riser cards, add-on cards, etc.

Security Center for recent security notices

Supermicro Phone and Addresses

7.2 Baseboard Management Controller (BMC)

The system supports the Baseboard Management Controller (BMC). BMC is used to provide remote access, monitoring, and management. There are several BIOS settings that are related to BMC.

For general documentation and information on BMC, please visit our website at: https://www.supermicro.com/en/solutions/management-software/bmc-resources.

System Storage UID Control Flickrware Update Sensor Readings System Firmware Version 9.19.04 BETA Firmware Build Time 04/18/2020 Redfish Version 1.8.9 BIC's Version BIC's Build Time CPLD Version F6:03:05 BMC Mac Address AC:1F:88:30:22:0G LAN 1 Mac Address AC:1F:88:CA:22:BA LAN 2 Mac Address AC:1F:88:CA:22:BB LAN 1 Mac Address DC:C4:7A:DE:5E:7E LAN 2 Mac Address DC:C4:7A:DB:5E:7F LAN 1 Mac Address AC:1F:88:CF:37:FA LAN 2 Mac Address AC:1F:88:CF:37:FB Host Server Host Name Server IP Address 172.31.96.213 IPv6 Address 1 red0.0.0.er IT/bolf bldt 3x63 IPv6 Address 2 IPv6 Address 3 IPv6 Address 4 IPv6 Address 5 IPv6 Address 6 Power Consumption Min Peak Average Usage Max Peak X.Time(min), Y:Power Consumption (Watt) Remote Console Preview LabVik plugin HTML5 reload image

Figure 7-2. BMC Sample

7.3 Troubleshooting Procedures

Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures or Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non-hot-swap hardware components.

No Power

1. As you try to power up the system, note any beep codes. Refer to the next section for details on beep codes.

2. Check that the power LED on the motherboard is ON.

PWRLED

Figure 7-3. Location of the MB Power LED

1. Make sure that the power connector is connected to your power supply.
2. Make sure that no short circuits exist between the motherboard and chassis.
3. Disconnect all cables from the motherboard, including those for the keyboard and mouse.
4. Remove all add-on cards.
5. Install a CPU, a heatsink, connect the internal speaker (if applicable), and the power LED to the motherboard. Make sure that the heatsink is fully seated.
6. Use the correct type of onboard CMOS battery as recommended by the manufacturer. Check to verify that it still supplies approximately 3VDC. If it does not, replace it with a new one. Warning: To avoid possible explosion, do not install the battery upside down.
7. Verify that all jumpers are set to their default positions.
8. Check that the power supplies' input voltage operates at 100-120V or 180-240V.
9. Turn the power switch ON and OFF to test the system.

No Video

1. If the power is ON but you have no video, remove all the add-on cards and cables.
2. As you try to power up the system, note any beep codes. Refer to the next section for details on beep codes.

System Boot Failure

If the system does not display POST (Power-On-Self-Test) or does not respond after the power is turned ON, check the following:

Turn ON the system with only one DIMM module installed. If the system boots, check for bad DIMM modules or slots by following the Memory Errors Troubleshooting procedure below.

Memory Errors

1. Make sure that the DIMM modules are properly and fully installed.
2. Confirm that you are using the correct memory. Also, it is recommended that you use the same memory type and speed for all DIMMs in the system. See Section 3.5 for memory details.
3. Check for bad DIMM modules or slots by swapping modules between slots and noting the results.
4. Check the power supply voltage 115V/230V switch.

Losing the System's Setup Configuration

1. Always replace power supplies with the exact same model that came with the system. A poor quality power supply may cause the system to lose the CMOS setup configuration.
2. The battery on your motherboard may be old. Check to verify that it still supplies approximately 3VDC. If it does not, replace it with a new one.
3. If the above steps do not fix the setup configuration problem, contact your vendor for repairs.

When the System Becomes Unstable

If the system becomes unstable during or after OS installation, check the following:

1. CPU/BIOS support: Make sure that your CPU is supported and that you have the latest BIOS installed in your system.

2. Memory support: Make sure that the memory modules are supported by testing the modules using memtest86 or a similar utility.
   Note: Refer to the product page on our website at http://www.supermicro.com for memory and CPU support and updates.

3. HDD support: Make sure that all hard disk drives (HDDs) work properly. Replace the bad HDDs with good ones.
4. System cooling: Check the system cooling to make sure that all heatsink fans and CPU/system fans, etc., work properly. Check the hardware monitoring settings in the BMC to make sure that the CPU and system temperatures are within the normal range. Also, check the front panel Overheat LED and make sure that it is not on.
5. Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Please refer to our website for more information on the minimum power requirements.
6. Proper software support: Make sure that the correct drivers are used.

If the system becomes unstable before or during OS installation, check the following:

1. Source of installation: Make sure that the devices used for installation are working properly, including boot devices such as CD.
2. Cable connection: Check to make sure that all cables are connected and working properly.
3. Using the minimum configuration for troubleshooting: Remove all unnecessary components (starting with add-on cards first), and use the minimum configuration (but with a CPU and a memory module installed) to identify the trouble areas. Refer to the steps listed in Section A above for proper troubleshooting procedures.
4. Identifying bad components by isolating them: If necessary, remove a component in question from the chassis, and test it in isolation to make sure that it works properly. Replace a bad component with a good one.
5. Check and change one component at a time instead of changing several items at the same time. This will help isolate and identify the problem.
6. To find out if a component is good, swap this component with a new one to see if the system will work properly. If so, then the old component is bad. You can also install the component in question in another system. If the new system works, the component is good and the old system has problems.

7.4 BIOS Error Beep (POST) Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

These fatal errors are usually communicated through a series of audible beeps. The table below lists some common errors and their corresponding beep codes encountered by users.

BIOS Error Beep (POST) Codes
Beep Code Error	Message Description
1 short Refresh Circuits have been reset (Ready to power up)
5 short, 1 long Memory error No memory detected in the system
5 long, 2 short Display memory read/write error Video adapter missing or with faulty memory
1 long continuous System OH System overheat condition

Additional BIOS POST Codes

The AMI BIOS supplies additional checkpoint codes, which are documented online at http://www.supermicro.com/support/manuals/ ("AMI BIOS POST Codes User's Guide").

When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20).

For information on AMI updates, please refer to http://www.ami.com/products/.

7.5 Crash Dump Using BMC

In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using BMC.

Check the BMC Error Log

1. Access the BMC web interface.
2. Click the Server Health tab, then Event Log to verify an IERR error.

Host Identification Server: 172 031 040 125 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Event Log For more special event log settings, please click here This page displays events from the system's event log. You can choose a category from the pull-down box to filter the events and also sort them by clicking on a column header. Clear Event Log Save Select an event log category: All Events Event ID : Time Stamp : Sensor Name : Sensor Type : Description : 1 2017/10/19 15:38:37 Processor IERR - Assertion 2 2017/10/19 15:59:20 Processor IERR - Assertion

Figure 7-4. BMC Event Log

In the event of an IERR, the BMC executes a crash dump. You must download the crash dump and save it.

7.6 UEFI BIOS Recovery

Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you do update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.

Overview

The Unified Extensible Firmware Interface (UEFI) provides a software-based interface between the operating system and the platform firmware in the pre-boot environment. The UEFI specification supports an architecture-independent mechanism that will allow the UEFI OS loader stored in an add-on card to boot the system. The UEFI offers clean, hands-off management to a computer during system boot.

Recovering the UEFI BIOS Image

A UEFI BIOS flash chip consists of a recovery BIOS block and a main BIOS block (a main BIOS image). The recovery block contains critical BIOS codes, including memory detection and recovery codes for the user to flash a healthy BIOS image if the original main BIOS image is corrupted. When the system power is turned on, the recovery block codes execute first. Once this process is complete, the main BIOS code will continue with system initialization and the remaining POST (Power-On Self-Test) routines.

Note 1: Follow the BIOS recovery instructions below for BIOS recovery when the main BIOS block crashes.

Note 2: When the BIOS recovery block crashes, you will need to follow the procedures to make a Returned Merchandise Authorization (RMA) request. Also, you may use the Supermicro Update Manager (SUM) Out-of-Band (https://www.supermicro.com.tw/products/nfo/SMS_SUM.cfm) to reflash the BIOS.

Recovering the Main BIOS Block with a USB Device

This feature allows the user to recover the main BIOS image using a USB-attached device without additional utilities used. A USB flash device such as a USB Flash Drive, or a USB CD/DVD ROM/RW device can be used for this purpose. However, a USB Hard Disk drive cannot be used for BIOS recovery at this time.

The file system supported by the recovery block is FAT (including FAT12, FAT16, and FAT32) which is installed on a bootable or non-bootable USB-attached device. However, the BIOS might need several minutes to locate the SUPER.ROM file if the media size becomes too large due to the huge volumes of folders and files stored in the device.

To perform UEFI BIOS recovery using a USB-attached device, follow the instructions below.

1. Using a different machine, copy the "Super.ROM" binary image file into the Root "\" directory of a USB device or a writable CD/DVD.
   Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
   Note 2: Before recovering the main BIOS image, confirm that the "Super.ROM" binary image file you download is the same version or a close version meant for your motherboard.
2. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and reset the system when the following screen appears.
3. After locating the healthy BIOS binary image, the system will enter the BIOS Recovery menu as shown below.

SUPERIMC BMC IP:10.132.161.13 PEI--Could Not Find Recovery Image... 07

Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below.

Optio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Recovery Security Boot Save & Exit Please select blocks you want to update: Boot Video: [Download] Boot Block update [Enabled] ▶ Proceed with flash update Set this option to reset NVRAM to default values +: Select Screen T4: Select item Enter Select +/- Change Opt. P1: General Help P2: Previous Values P3: Optimized Defaults P4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

1. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update" and press the key. You will see the BIOS recovery progress as shown in the screen below.

Note: Do not interrupt the BIOS flashing process until it has been completed.

1. After the BIOS recovery process is complete, press any key to reboot the system.

2. Using a different system, extract the BIOS package into a USB flash drive.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING! System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Program new data Write new boot block... 178 +: Select Screen F1: Select Item Enter: Select +/-: Change Opt.. F3: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.12% Copyright (C) 2017 American Megatrends, Inc.

1. Press continuously during system boot to enter the BIOS Setup utility. From the top of the toolbar, select Boot to enter the submenu. From the submenu list, select Boot Option

Aptia Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING! System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once: firmware update is completed press any key to reboot the system —— Flash update —— Flash update completed. Press any key to reset the system ++: Select Screen I1: Select Item Enter: Select +/-t Change Out. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (C) 2017 American Regatrends, Inc.

1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press to save the settings and exit the BIOS Setup utility.

1. When the UEFI Shell prompt appears, type fs# to change the device directory path. Go to the directory that contains the BIOS package you extracted earlier from Step 6. Enter flash.nsh BIOSname.### at the prompt to start the BIOS update process.

Boot Configuration Boot mode select [DGAL] LEGACY to EFI support [Disabled] FIXED BOOT ORDER Priorities Boot Option #1 [UEFI #0:UEFI Del...] Boot Option #2 [CO/DVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CO/DVD] Boot Option #5 [USB Key:BanDisk] Boot Option #6 [USB Floccyl] Boot Option #7 [USB Lm] Boot Option #8 [Network:IMA GE SI...] Boot Option #9 [KEY Hard Disk] Boot Option #10 [UEFI CD/DVD] Boot Option #11 [UEFI USB Hard Disk] Boot Option #12 [UEFI USB CO/DVD] Boot Option #13 [UEFI USB Key:UEFI...] Boot Option #14 [UEFI USB Floccyl] Boot Option #15 [UEFI USB Lm] Boot Option #16 [UEFI Network] Boot Option #17 [Hard Disk] ▶ Add New Boot Option Sets the system boot order +: Select Screen TA: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESE: Exit version 2.19.12wk. Copyright (C) 2017 American Megatrends, Inc.

Note: Do not interrupt this process until the BIOS flashing is complete.

1. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC or DC power cable from the power supply, clear CMOS, and

plug the AC or DC power cable in the power supply again to power on the system.

1. Press continuously to enter the BIOS Setup utility.

2. Press to load the default settings.

3. After loading the default settings, press to save the settings and exit the BIOS Setup utility.

7.7 CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system completely.

2. Remove the cover of the chassis to access the motherboard.

3. Remove the onboard battery from the motherboard.

4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.

5. Remove the screwdriver or shorting device.

JBT1 contact pads

1. Replace the cover, reconnect the power cords, and power on the system.

Notes: Clearing CMOS will also clear all passwords.

Do not use the PW_ON connector to clear CMOS.

7.8 BMC Reset

The BMC can be reset using the UID button.

• Reset – Press and hold the button. After six seconds, the LED blinks at 2Hz. The BMC resets and the reset duration is \~250 ms. Then the BMC starts to boot.
• Restore factory default configuration – Hold the button for twelve seconds. The LED blinks at 4Hz while defaults are configured. Note: All BMC settings including username and password will be removed except the FRU and network settings.

Firmware update – When the BMC firmware is being updated, the UID LED blinks at 10Hz.

BMC Reset Options
Event UID LED	BMC Heartbeat LED
Reset Blue, Blinks at 2Hz Green, solid
Restore Defaults	Blue, Blinks at 4Hz OFF
Update Blue, Blinks at 10Hz

7.9 Where to Get Replacement Components

If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com. Click the "Where to Buy" tab.

7.10 Reporting an Issue

Technical Support Procedures

Before contacting Technical Support, please take the following steps. If your system was purchased through a distributor or reseller, please contact them for troubleshooting services. They have the best knowledge of your specific system configuration.

1. Please review the Troubleshooting Procedures in this manual and Frequently Asked Questions on our website before contacting Technical Support.
2. BIOS upgrades can be downloaded from our website. Note: Not all BIOS can be flashed depending on the modifications to the boot block code.

3. If you still cannot resolve the problem, include the following information when contacting us for technical support:

4. System, motherboard, and chassis model numbers and PCB revision number

5. BIOS release date/version (this can be seen on the initial display when your system first boots up)
6. System configuration

An example of a Technical Support form is posted on our website. Distributors: For immediate assistance, please have your account number ready when contacting our technical support department by email.

Returning Merchandise for Service

A receipt or copy of your invoice marked with the date of purchase is required before any warranty service will be rendered. You can obtain service by calling your vendor for a Returned Merchandise Authorization (RMA) number. When returning to the manufacturer, the RMA number should be prominently displayed on the outside of the shipping carton, and mailed prepaid or hand-carried. Shipping and handling charges will be applied for all orders that must be mailed when service is complete.

For faster service, RMA authorizations may be requested online (http://www.supermicro.com/support/rma/).

Whenever possible, repack the chassis in the original Supermicro carton, using the original packaging material. If these are no longer available, be sure to pack the chassis securely, using packaging material to surround the chassis so that it does not shift within the carton and become damaged during shipping.

This warranty only covers normal consumer use and does not cover damages incurred in shipping, or from failure due to the alteration, misuse, abuse or improper maintenance of products.

During the warranty period, contact your distributor first for any product problems.

Vendor Support Filing System

For issues related to Intel, use the Intel IPS filing system:

https://www.intel.com/content/www/us/en/design/support/ips/training/welcome.html

For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative.

7.11 Feedback

Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at [e-mail] to provide feedback on our manuals.

7.12 Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Sales Inquiries)

[e-mail] (Gov. Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

[e-mail] (Webmaster)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail] (Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

Website: www.supermicro.com.tw

Appendix A

Standardized Warning Statements for AC Systems

About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

CAUTION: This unit has redundant power sources. Please disconnect all the power cords before servicing.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源装置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

Standardized Warning Statements for DC Systems

B.1 About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 60VDC, 20A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

CAUTION: This unit has redundant power sources. Please disconnect all the power cords before servicing.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源裝置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Warning! When stranded wiring is required, use approved wiring terminations, such as closedloop or spade-type with upturned lugs. These terminations should be the appropriate size for the wires and should clamp both the insulation and conductor.

警告

DC Power Disconnection

Warning! Before performing any of the following procedures, ensure that power is removed from the DC circuit.

警告

Hazardous Voltage or Energy Present on DC Power Terminals

Warning! Hazardous voltage or energy may be present on DC power terminals. Always replace cover when terminals are not in service. Be sure uninsulated conductors are not accessible when cover is in place.

警告

System Specifications

Processors

Dual 3rd Generation Intel® Xeon® Scalable processors in an LGA4189 socket; Supports CPU TDP up to 270W.

Supported CPUs: P4X-ICX6338T-SRKXF: ICX 6338T 2P 24C/48T 2.1G 36M 11.2GT 165W 4189 M1

Chipset

Intel® C621A

BIOS

AMI 256Mb SPI Flash EEPROM

Memory

32 DIMM slots for 3DS ECC DDR4-3200 RDIMM

Note: See the Memory section in Chapter 3 for supported memory.

Storage Drives

Six 2.5" hot-swap NVMe/SATA hybrid drive bays

Two M.2 PCIe 3.0 x4 NVMe/SATA hybrid slots (with support for M-Key 2280 and 22110)

PCI Expansion Slots

Three PCIe 4.0 x16 DW FHFL (10.5" L) and two PCIe 4.0 x8 FHHL or six PCIe 4.0 x8 FHFL (10.5" L) and two PCIe 4.0 x8 FHHL.

Two AIOM (Advanced I/O Module) PCIe 4.0 x16 slots

Input/Output

Network: LAN: One RJ45 dedicated BMC LAN port

USB: Two front USB 3.0 ports

Video : One VGA port

Motherboard

X12DHM-6; Length 17.0", Width 10.7" (431.8 mm x 271.8 mm)

Chassis

CSE-HE211-R000NFP 2U Rackmount, 3.5 x 17.2 x 22.6in. / 89 x 437 x 574mm (HxWxD)

System Cooling

Six 6cm heavy duty fans with optimal fan speed control

Four memory air shrouds

NEBS Compliance

GR-1089-CORE, Issue 7 and GR-63-CORE, Issue 5.

Note: To maintain NEBS compliance, use only validated processors and memory as listed on the website.

Power Supply

Model: (default) PWS-2K08F-1R, 2000W redundant modules, 80Plus Titanium level

AC Input

1000W: 100-127Vac / 50-60Hz

1800W: 200-220Vac / 50-60Hz

1980W: 220-230Vac / 50-60Hz

2000W: 220-240Vac / 50-60Hz

2000W: 230-240Vac / 50-60Hz

+12V

Max: 83A (100Vac-127Vac)

Max: 150A (200Vac-220Vac)

Max: 165A (220Vac-230Vac)

Max: 166A (220Vac-240Vac)

Max: 166A (230Vac-240Vac)

12V SB

Max: 3.5A / Min: 0A

DC Input

1300W: Input voltage opearates at -48Vdc

+12V

Max: 108.3A

12V SB

Max: 2.1A / Min: 0A

Operating Environment

Operating Temperature: 10° to 35° C (50° to 95° F)

Non-operating Temperature: -40^ to 60^ C ( -40^ to 140^ F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

FCC, ICES, CE, UKCA, VCCI, RCM, NRTL, CB, KCC

Applied Directives, Standards

EMC/EMI: 2014/30/EU (EMC Directive)

Electromagnetic Compatibility Regulations 2016

FCC Part 15

ICES-003

VCCI-CISPR 32

AS/NZS CISPR 32

BS/EN 55032

BS/EN 55035

CISPR 32

CISPR 24/CISPR 35

BS/EN 61000-3-2

BS/EN 61000-3-3

BS/EN 61000-4-2

BS/EN 61000-4-3

BS/EN 61000-4-4

BS/EN 61000-4-5

BS/EN 61000-4-6

BS/EN 61000-4-8

BS/EN 61000-4-11

KN32

KN35

Product Safety: 2014/35/EU (LVD Directive)

UL/CSA 62368-1 (USA and Canada)

Electrical Equipment (Safety) Regulations 2016

IEC/BS/EN 62368-1

Environment:

2011/65/EU (RoHS Directive)

EC 1907/2006 (REACH)

2012/19/EU (WEEE Directive)

Warning! This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate"