SuperServer SYS-220TP-HC8TR - Server Supermicro - Free user manual and instructions

USER MANUAL SuperServer SYS-220TP-HC8TR Supermicro

Front view of a server rack unit with multiple drive bays and ventilation grilles (no visible text or labels)

USER'S MANUAL

Revision 1.0a

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A or Class B digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in industrial environment for Class A device or in residential environment for Class B device. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.0a

Release Date: June 27, 2022

VC

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2022 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the server. Installation and maintenance should be performed by experienced technicians only.

Please refer to the SYS-220TP-H Series server specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: https://www.supermicro.com/support/manuals/
- Product drivers and utilities: https://www.supermicro.com/wdl
- Product safety info: https://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at: [e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Secure Data Deletion

A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/Lot9_Secure_Data_Deletion_Utility/

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Chapter 1 Introduction

1.1 Overview....10

Models....11

1.2 System Features ....12

Front View....12

Drive Carrier Indicators....12

Control Panel....13

Rear View....14

Power Supply Indicator....15

Expansion Slots and Riser Cards ....15

LAN Speed Indicator ....15

Top View, Node ....16

BMC Password ....16

1.3 System Architecture ....17

Main Components, Node ....17

Main Components, System Backplane....18

1.4 Motherboard Layout ....19

Quick Reference 20

Motherboard Block Diagram ....21

Chapter 2 Server Installation

2.1 Overview....22

2.2 Unpacking the System 22

2.3 Preparing for Setup....22

Choosing a Setup Location....22

Rack Precautions....23

Server Precautions....23

Rack Mounting Considerations....23

Ambient Operating Temperature....23

Airflow 24

Mechanical Loading....24

Circuit Overloading....24

Reliable Ground....24

2.4 Installing the Rails....25

Identifying the Rails....25

Releasing the Inner Rail....26

Installing the Inner Rails on the Chassis....27

Installing the Outer Rails onto the Rack....28

2.5 Installing the Chassis into a Rack....29

Removing the Chassis from the Rack....30

Chapter 3 Maintenance and Component Installation

3.1 Removing Power ....31

3.2 Accessing the System....32

Removing a Node ....32

Removing the Top Cover ....33

3.3 Processor and Heatsink Installation....34

The Processor Carrier Assembly ....35

The Processor Heatsink Module (PHM)....37

Installing the PHM into the CPU Socket....38

Removing the PHM from the CPU Socket ....41

Removing the Processor Carrier Assembly from the PHM 42

Removing the Processor from the Carrier Assembly....43

3.4 Memory....44

Memory Support....44

Guidelines Regarding Mixing DIMMs 45

DDR4 Memory Population Guidelines ....46

Optane PMem 200 Series....47

PMem Notes 48

Installing Memory....49

Removing Memory....49

3.5 Motherboard Battery....50

Replacing the Battery ....50

3.6 Storage Drives....51

Installing Drives....51

Removing Drive Carriers from the Chassis....51

Mounting a Drive in a Drive Carrier ....53

Removing a Drive from a Drive Carrier....53

Drive Carrier Indicators....54

Installing M.2 Solid State Drives....55

To Install M.2 SSDs....55

3.7 System Cooling....57

Fans 57

Changing a System Fan....57

Air Shrouds 59

Installing the Standard Air Shrouds....59

3.8 Power Supply 60

Power Supply LEDs....60

Changing the Power Supply Module: 60

3.9 PCI Expansion Slots 61

Expansion Slots and Riser Cards....61

Installing Expansion Cards....61

Chapter 4 Motherboard Connections

4.1 Power Connection....63
4.2 Headers and Connectors....63
4.3 Input/Output Ports 66
4.4 Jumpers....67
4.5 LED Indicators....68

Chapter 5 Software

5.1 Microsoft Windows OS Installation....69
5.2 Driver Installation....71
5.3 SuperDoctor ^® 5....72
5.4 BMC....73

BMC ADMIN User Password 73

Chapter 6 Optional Components

6.1 Storage Options 74
M.2 SSDs....74
6.2 TPM Security Module....75
6.3 Enabling Intel SGX in the UEFI BIOS Setup Utility....76

Requirements 76

Processor Requirements ....76

OS Requirements....76

Software Requirements....77

Supermicro Platform Support 77

Step 1: Entering the UEFI BIOS Utility to Enable TME Support....78
Step 2: Disabling Mirror Mode, ADDDC Sparing*, and Patrol Scrub Support in the Memory-RAS Configuration Submenu....79
Step 3: Enabling NUMA and Disabling UMA-Based Clustering Support in the ACPI Submenu....81
Step 4: Enabling SGX Support in the CPU Configuration Settings.....82

6.4 Intel Virtual RAID on CPU (VROC)....83

Requirements and Restrictions....83
Supported SSDs and Operating Systems 83
Additional Information 84
Hardware Key 84
Configuring NVMe RAID Manually....85
Related Information Links 89

Chapter 7 Troubleshooting and Support

7.1 Information Resources....90

Website 90

Direct Links for the SYS-220TP-H Series System....90
Direct Links for General Support and Information 90

7.2 BMC Interface 91

7.3 Troubleshooting Procedures 92

General Technique....92
No Power 92
No Video 93
System Boot Failure 93
Memory Errors 93
Losing the System Setup Configuration 93
When the System Becomes Unstable 93

7.4 BIOS Error POST Codes 95
7.5 Crash Dump Using the BMC Dashboard....96
7.6 UEFI BIOS Recovery .....97

Overview 97

Recovering the UEFI BIOS Image....97

Recovering the Main BIOS Block with a USB Device....97

7.7 CMOS Clear....102
7.8 BMC Reset....102
7.9 Where to Get Replacement Components....103
7.10 Reporting an Issue....103

Technical Support Procedures....103

Returning Merchandise for Service....103

Vendor Support Filing System ....104

7.11 Feedback....104
7.12 Contacting Supermicro....105

Appendix A Standardized Warning Statements for AC Systems

Appendix B System Specifications

BSMI/RoHS 128

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides a brief outline of the functions and features of the SuperServer SYS-220TP-H Series. The following provides an overview of the specifications and capabilities.

System Overview
Motherboard	(Per node) X12DPT-PT6 (up to 600W)
Chassis	CSE-217HQ+-R2K20BP4
Processor	(Per node) Dual 3rd Gen Intel Xeon Scalable processors, P+ (LGA4189) sockets; up to 185W TDP (thermal design power)
Memory	(Per node) 16 DIMM slots, DDR4 RDIMM/LRDIMM or Intel Optane PMem 200 Series*(up to 4TB for DDR4, or up to 4TB of PMem and 2TB DDR4)Up to 3200MHz; size up to 256GB* Note: PMem 200 Series are supported on 3rd gen Intel Xeon Scalable Platinum, Gold and selected Silver processors.
Drive Support	(Per node) Six hot-swap 2.5" drive bays:SYS-220TP-HC8TR: [SAS/SATA]SYS-220TP-HC9TR: [SAS/SATA]Two M.2 SSDs with carrier card included
Expansion Slots	(Per node) One PCIe 4.0 x16
I/O Ports	(Per node) Two 10Gbase-T ports; one dedicated BMC LAN portTwo USB 3.0 portsOne VGA port
System Cooling	Four 8-cm heavy duty fans with Optimal Fan Speed Control(Per node) One air shroud, CPU heatsinks
Power	Dual 2200W redundant 80Plus Titanium level modules
Form Factor	2U rackmount; (WxHxD) 17.3" x 3.5" x 28.75" (438 x 88 x 730mm)

A link to the Quick Reference Guide can be found on the SYS-220TP-HC8TR and SYS-220TP-HC9TR of the Supermicro website.

The following safety models associated with the SYS-220TP-H Series have been certified as compliant with UL or CSA: 217-22 / 217H-R22X12 / 217TWP-X12.

Models

Models
Model Drives Add-on	Card RAID
SYS-220TP-HC8TR SAS	S/SATA AOC-S	3808L-L8iT-P HBA only; no RAID
SYS-220TP-HC9TR SAS	S/SATA AOC-S	3908L-H8iR-P 0, 1, 5, 6, 10, 50

1.2 System Features

The following views of the system display the main features. Refer to Appendix B for additional specifications.

Front View

Node A Node B Node C Node D A0 A2 A3 A5 A4 B0 B1 B2 B3 B4 B5 C0 C1 C2 C3 C4 C5 D0 D1 D2 D3 D4 D5

Figure 1-1. Front View

Logical Storage Drive Numbers
Item Description
0 - 5 2.5" hot-swap SAS3/SATA drive bays for each of Nodes A, B, C, and D

Drive Carrier Indicators

Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare. For VROC configurations, refer to the VROC section in this manual.

Drive Carrier LED Indicators
	Color Blinking Pattern Behavior	for Device
Activity LED	Blue Solid On Idle SAS drive installed
	Blue Blinking I/O activity
	Off Idle SATA or no drive
Status LED	Red Solid On Failure of drive with RSTe support
	Red Blinking at 1 Hz Rebuild drive with RSTe support
	Red Blinking at 4 Hz Identify drive with RSTe support
	Red Blinking with two blinks and one stop at 1 Hz	Hot spare for drive with RSTe support
	Red On for five seconds, then off	Power on for drive with RSTe support

Control Panel

Power Button NIC LED Information LED UID Button/LED BMC Reset

Figure 1-2. Control Panel

Control Panel Features
Feature Description
Power button	The main power switch applies or removes primary power from the power supply to the associated node but maintains standby power. The power button has a built-in LED which turns green when the power is on.
NIC LED Indicates	network activity on LANs when flashing.
Information LED	Alerts operator to several states, as noted in the table below
UID button/LEDBMC reset	The unit identification (UID) button turns on or off the blue light function of the Information LED and a blue LED on the rear of the chassis. This can be used to locate the node.The BMC can be reset using the UID switch. SeeSection 7.8for details.

Information LED
Color, Status Description
Red, solid An overheat condition has occurred.
Red, blinking at 1Hz Fan failure, check for an inoperative fan.
Red, blinking at 0.25Hz	Power failure, check for a non-operational power supply.
Red, solid, with Power LED blinking green	Fault detected
Blue and red, blinking at 10 Hz Recovery mode
Blue, solid	UID has been activated locally to locate the server in a rack environment.
Blue, blinking at 1Hz	UID has been activated using the BMC to locate the server in a rack environment.
Blue, blinking at 2Hz BMC is resetting
Blue, blinking at 4Hz BMC is setting factory defaults
Blue, blinking at 10Hz with Power LED blinking green	BMC/BIOS firmware is updating

Rear View

C2 D C C1 LAN USB Ports VGA UID LED/BMC Reset BMC LAN PWS2 PWS1 A B CPU1 CPU2

Figure 1-3. System: Rear View

System Features: Rear
Feature Description
A,B,C,D Four compute nodes
Power Supplies Dual redundant power supply modules, PWS1 on the top, PWS2 on the bottom
C1	AOC-S3808L-L8iT (in 220TP-HC8TR)AOC-S3908L-H8iR (in 220TP-HC9TR)
C2	PCIe 4.0 x16 low-profile expansion slot
LAN Two RJ45 10G ports (per node)
USB Ports Two USB 3.0 ports (per node)
UID LED/BMC Reset	UID button and BMC reset button (per node) (see control panel description)
VGA Video port (per node)
BMC LAN BMC LAN port; for indicator details, see BMC LAN LEDs (per node)

Power Supply Indicator

LEDs on the power supplies indicate the status of the module.

Power Supply Indicator
LED Color and State Power Supply Condition
Solid Green Indicates that the power supply is on
Blinking Green Indicates that the power supply is plugged in and turned off by the system.
Blinking Amber	Indicates that the power supply has a warning condition and continues to operate.
Solid Amber	Indicates that the power supply is plugged in, and is in an abnormal state. The system might need service. Please contact Supermicro technical support.
Off No AC power to modules

Expansion Slots and Riser Cards

This system offers options for riser cards that provide custom PCIe 4.0 capabilities.

PCIe Riser Cards
Position* Part	Number Slot Description
Right side(SXB3)	RSC-PR-6-X2 1		AOC-S3808L-L8iT (in 220TP-HC8TR)AOC-S3908L-H8iR (in 220TP-HC9TR)
Left side(SXB4)	RSC-P-6G4	[206W]	x16 low profile (CPU2)

*Position in the node tray when looking from the back of the server.

LAN Speed Indicator

One LED indicates the network speed.

LAN LED (Speed Indicator)
Color Speed
Green 10Gbps
Amber 1Gbps
Off 100Mbps or less

Top View, Node

M.2-NVMe Adapter Dual 2280 PCIe 4.0 x4 Storage Adapter Dual Intel® Xeon® Scalable Processors 16 DDR4 DIMM Slots CPU2 PCIe 4.0 x16 Riser Card AOC-S3808L-L8iT (in 220TP-HC8TR) AOC-S3908L-H8iR (in 220TP-HC9TR) Dual RJ45 10G Ports BMC Password Sticker

Figure 1-4. Node: Top View, 220TP-HC9TR

BMC Password

Each node has a unique password for ADMIN user access to the BMC. This password can be found on a sticker on the back of the node. See Chapter 5 for more details.

1.3 System Architecture

This section shows the locations of the main components of a node.

Main Components, Node

Storage Adapter M.2-NVMe Adapter Processor Motherboard DIMM Slots Processor Add-on Card Riser, CPU2 Riser, CPU1

Figure 1-5. Node: Top View, 220TP-HC9TR

Main Components, System Backplane

Storage Backplane

Figure 1-6. Backplane Location

1.4 Motherboard Layout

Below is a layout of the X12DPT-PT6 motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.

VGA USB0/1 JUIDB1 LAN2 LAN1 BMC_LAN VGA JUIDB1 COM1 LEDM1 FAN3 JIPMB1 SXB3 LEDPWR BT1 JSD2 I-SATA5 I-SATA4 JSD1 P1-DIMMC1 P1-DIMMD1 P1-DIMMA1 P1-DIMMB1 CPU1 Pin1 SXB1 P2-DIMMG1 P2-DIMMH1 P2-DIMME1 P2-DIMMF1 JHS1 JHS1 JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSPB JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP8 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP6 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4 JSP4

Figure 1-7. Motherboard Layout

Quick Reference

Jumper Description Default Setting

JBT1 CMOS clear Open (Normal)
JPAUX1	10Gb LAN1/LAN2 AUX power Enable/Disable *Please consult Supermicro before enabling this jumper. There must be sufficient airflow to enable JPAUX1 in standby mode (S5 state).	Pins 2-3 (Disabled)
JPME2 ME Manufacturing Mode Pins 1-2 (Normal)
JPTG1 10Gb LAN1/LAN2 Enable/Disable Pins 1-2 (Enabled)

Connector Description

BMC_LAN Dedicated BMC LAN port
BT1 Onboard CMOS battery
COM1 Front accessible COM port header
FAN3, FAN4 4-pin CPU fan headers
JHS1	Supermicro proprietary front control panel header
JIPMB1	4-pin BMC external I2C header
JNCSI1	NC-SI (Network Controller Sideband Interface) connector
JRK1	Intel VROC key header for NVMe RAID
JSD1, JSD2	SATA DOM (Disk-On-Module) power connector
JTPM1	Trusted Platform Module/Port 80 connector
JUIDB1	Unit Identifier (UID) switch / BMC reset button
LAN1, LAN2 10Gb Base-T Ethernet ports
I-SATA4, I-SATA5	Intel PCH powered I-SATA 3.0 ports with support for SuperDOM (Disk on Module) devices
S-SATA0 - S-SATA5	Intel PCH S-SATA 3.0 ports (SW RAID 0, 1, 5, 10)
SXB1	PCIe 4.0 x8 slot supported by CPU1 for Supermicro proprietary riser card and six SATA connections (S-SATA0 - S-SATA5) supported by PCH
SXB3	PCIe 4.0 x16 slot supported by CPU1 for the Supermicro proprietary riser card
SXB4	PCIe 4.0 x16 slot supported by CPU2 for the Supermicro proprietary riser card
SXB5	PCIe 4.0 x8 slot supported by CPU1
SXB6	PCIe 4.0 x8 slot supported by CPU1 for the Supermicro proprietary M.2 adapter card
USB0, USB1	Rear I/O USB ports (USB 3.2 Gen 1)
VGA	Rear VGA port on the I/O back panel

LED	Description	State: Status
LEDM1	BMC heartbeat LED	Blinking Green: BMC normal (active)Solid Green: during BMC reset or during a cold reboot
LEDPWR	Power LED	LED On: Onboard power on
UID-LED	Unit Identifier (UID) LED	Solid Blue: Unit Identified

Motherboard Block Diagram

graph TD
    subgraph_CPU_1["CPU 1"]
        A1["08 DDR4 DIMM"] --> A2["AT7 DDR4 DIMM"]
        A2 --> A3["16.17 DDR4 DIMM"]
        A3 --> A4["15 DDR4 DIMM"]
        A4 --> A5["14 P1 DDR4 DIMM"]
        A5 --> A6["13 DDR4 DIMM"]
        A6 --> A7["12 P2 DDR4 DIMM"]
        A7 --> A8["11 P3 DDR4 DIMM"]
        A8 --> A9["10 P4 DDR4 DIMM"]
        A9 --> A10["10 P5 DDR4 DIMM"]
        A10 --> A11["10 P6 DDR4 DIMM"]
        A11 --> A12["10 P7 DDR4 DIMM"]
        A12 --> A13["10 P8 DDR4 DIMM"]
        A13 --> A14["10 P9 DDR4 DIMM"]
        A14 --> A15["10 P10 DDR4 DIMM"]
        A15 --> A16["10 P11 DDR4 DIMM"]
        A16 --> A17["10 P12 DDR4 DIMM"]
        A17 --> A18["10 P13 DDR4 DIMM"]
        A18 --> A19["10 P14 DDR4 DIMM"]
        A19 --> A20["10 P15 DDR4 DIMM"]
        A20 --> A21["10 P16 DDR4 DIMM"]
        A21 --> A22["10 P17 DDR4 DIMM"]
        A22 --> A23["10 P18 DDR4 DIMM"]
        A23 --> A24["10 P19 DDR4 DIMM"]
        A24 --> A25["10 P20 DDR4 DIMM"]
        A25 --> A26["10 P21 DDR4 DIMM"]
        A26 --> A27["10 P22 DDR4 DIMM"]
        A27 --> A28["10 P23 DDR4 DIMM"]
        A28 --> A29["10 P24 DDR4 DIMM"]
        A29 --> A30["10 P25 DDR4 DIMM"]
        A30 --> A31["10 P26 DDR4 DIMM"]
        A31 --> A32["10 P27 DDR4 DIMM"]
        A32 --> A33["10 P28 DDR4 DIMM"]
        A33 --> A34["10 P29 DDR4 DIMM"]
        A34 --> A35["10 P30 DDR4 DIMM"]
        A35 --> A36["10 P31 DDR4 DIMM"]
        A36 --> A37["10 P32 DDR4 DIMM"]
        A37 --> A38["10 P33 DDR4 DIMM"]
        A38 --> A39["10 P34 DDR4 DIMM"]
        A39 --> A40["10 P35 DDR4 DIMM"]
        A40 --> A41["GENZ SXB5"]
        A41 -->|PCIe 4.0 X8| BXC
        BXC -->|PCIe 4.0 X8| CXC
        CXC -->|PCIe 4.0 X8| DXC
        DXC -->|PCIe 4.0 X8| EXC
        EXC -->|PCIe 4.0 X8| FXC
        FXC -->|PCIe 4.0 X8| GXC
        GXC -->|PCIe 4.0 X8| HXC
        HXC -->|PCIe 4.0 X8| IXC
        IXC -->|PCIe 4.0 X8| JXC
        JXC -->|PCIe 4.0 X8| KXC
    end

    subgraph_CPU_2["CPU 2"]
        L["P0"] --> M["P2"] --> N["P1"] --> O["P3"] --> P["P0"] --> Q["P1"] & R["P3"] & S["XBM"]
    end

    subgraph_BMC["BMC AST2800"]
        R["X7*10 AT2/TM4"] --> S["RHM*5"]
        S --> T["SPT SFI SP1"]
    end

    subgraph_PCH["C621A"]
        U["UPLINK DM3"] --> V["SATA DOM x2"]
        V --> W["SXB1"]
        W --> X["USB 3.2 Sem 1"]
        X --> Y["USB 2.6 Sem 1"]
        Y --> Z["USB 2.6 Sem 1"]
        Z --> AA["USB 2.6 Sem 1"]
    end

    subgraph_CPLD["CPLD (PFR)"]
        AB["BKC FLAS-10"] --> AC["BKC FLAS-10"]
        AD["BIOS FLAS-10"] --> AE["BIOS FLAS-10"]
        AF["TPM HEADER Debug Card"] --> AG["TPM (for BMC)"]
    end

    subgraph Control_CPU
        AH["VGA CONN"] --> AI["COM1 Connector (Informa)"]
        AJ["Temp Sensor TMP#2"] --> AK["TMP Sensor TMP#2"]
    end

Figure 1-8. Motherboard Block Diagram

Chapter 2

Server Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Unpacking the System

Inspect the box in which the system was shipped, and note if it was damaged. If any equipment appears damaged, file a claim with the carrier.

Decide on a suitable location for the rack unit that will hold the server. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. It will also require a grounded AC power outlet nearby.

Be sure to read the precautions and considerations noted in Appendix A.

2.3 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).

- This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time - extending two or more simultaneously may cause the rack to become unstable.
• Do not use a two-post "telco" type rack for 2U or larger servers.

Server Precautions

• Review the electrical and general safety precautions in Appendix A.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the servers closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.
• Slide rail mounted equipment is not to be used as a shelf or a work space.

2.4 Installing the Rails

There are a variety of rack units on the market, which may require a slightly different assembly procedure. This rail set fits a rack between 26.8" and 36.4" deep.

The following is a basic guideline for installing the system into a rack with the rack mounting hardware provided. You should also refer to the installation instructions that came with the specific rack you are using.

Identifying the Rails

The chassis package includes two rail assemblies. Each assembly consists of three sections: An inner rail that secures directly to the chassis, an outer rail that secures to the rack, and a middle rail which extends from the outer rail. These assemblies are specifically designed for the left and right side of the chassis and labeled.

Outer Rail Middle Rail Locking Tab Inner Rail

Figure 2-1. Identifying the Outer Rail, Middle Rail and Inner Rail (Left Rail Assembly Shown)

Releasing the Inner Rail

Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing.

To mount the rail onto the chassis, first release the inner rail from the outer rails.

1. Pull the inner rail out of the outer rail until it is fully extended as illustrated below.
2. Press the locking tab down to release the inner rail.
3. Pull the inner rail all the way out.

Outer Rail 1 Middle Rail Locking Tab Inner Rail 2 3

Figure 2-2. Extending and Releasing the Inner Rail

Installing the Inner Rails on the Chassis

Installing the Inner Rails

1. Identify the left and right inner rails. They are labeled.
2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
3. Slide the inner rail forward toward the front of the chassis until the quick release bracket snaps into place, securing the rail to the chassis.
4. Optionally, you can further secure the inner rail to the chassis with screws.

Inner Rails 2 4 3 4

Figure 2-3. Installing the Inner Rails

Isometric line drawing of a server rack unit with multiple drive bays and ventilation grilles (no text or labels)

Figure 2-4. Inner Rails Installed on the Chassis

Installing the Outer Rails onto the Rack

Each end of the assembled outer rail includes a bracket with hooks and square, spring-loaded pegs to fit into the square holes in your rack.

Installing the Outer Rail

1. Press upward on the locking tab at the rear end of the middle rail.

2. Push the middle rail back into the outer rail.

3. Hang the hooks on the front of the outer rail onto the square holes on the front of the rack. If desired, use screws to secure the outer rails to the rack.

4. Pull out the rear of the outer rail, adjusting the length until it just fits within the posts of the rack.

5. Hang the hooks of the rear section of the outer rail onto the square holes on the rear of the rack. Take care that the proper holes are used so the rails are level. If desired, use screws to secure the rear of the outer rail to the rear of the rack.

Technical diagram illustrating four stages of a mechanical assembly with labeled components and directional arrows indicating motion or assembly.

Figure 2-5. Extending and Mounting the Outer Rails

Note: The figure above is for illustrative purposes only. Always install servers at the bottom of the rack first.

Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

Warning: Do not pick up the server with the front handles. They are designed to pull the system from a rack only.

2.5 Installing the Chassis into a Rack

Once rails are attached to the chassis and the rack, you can install the server.

Warning: Mounting the system into the rack requires at least two people to support the chassis during installation. Please follow safety recommendations printed on the rails.

Installing the Chassis into a Rack

1. Extend the outer rails as illustrated.
2. Align the inner rails of the chassis with the outer rails on the rack.
3. Slide the inner rails into the outer rails, keeping the pressure even on both sides. When the chassis has been pushed completely into the rack, it should click into the locked position.
4. Optional screws may be used to hold the front of the chassis to the rack.

Technical diagram showing a mechanical assembly with labeled components, including parts numbered 1 and 2.

Isometric line drawing of a four-legged table with legs and supports (no text or symbols)

Figure 2-6. Installing the Server into the Rack

Note: Keep the ball bearing shuttle locked at the front of the middle rail during installation.

Note: Figure is for illustrative purposes only. Always install servers to the bottom of a rack first.

Removing the Chassis from the Rack

Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack. Use a lift.

1. If necessary, loosen the thumb screws on the front of the chassis that hold it in the rack.
2. Pull the chassis forward out the front of the rack until it stops.
3. Press the release latches on each of the inner rails downward simultaneously and continue to pull the chassis forward and out of the rack.

Technical line drawing of a server rack with labeled component '3' (no text or symbols beyond label)

Figure 2-7. Removing the Chassis From the Rack

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components require that power first be removed from the system. Please follow the procedures given in each section.

3.1 Removing Power

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non hot-swap components or when replacing a non-redundant power supply.

1. Use the operating system to power down the system.
2. After the system has completely shut-down, disconnect the AC power cord(s) from the power strip or outlet. (If your system has more than one power supply, remove the AC power cords from all power supply modules.)
3. Disconnect the power cord(s) from the power supply module(s).

3.2 Accessing the System

Removing a Node

Compute nodes can be removed while the other nodes continue operating. Power down the node, remove the cables, then pull the node out using the handles

Internal view of a server rack with multiple drive bays and ports (no visible text or labels)

Figure 3-1. Removing the Compute Node

Removing the Top Cover

The system features a removable top cover, which allows access to the inside of the system.

- Remove the two top screws and lift the top cover up.

Check that all ventilation openings on the top cover and the top of the system are clear and unobstructed.

Caution: Except for short periods of time, do not operate the server without the cover in place.

The system cover must be in place to allow for proper airflow and to prevent overheating.

Technical line drawing of a server rack with internal components and mounting holes (no text or labels)

Figure 3-2. Removing the System Cover

3.3 Processor and Heatsink Installation

The processor (CPU) and processor carrier should be assembled together first to form the processor carrier assembly. This will be attached to the heatsink to form the processor heatsink module (PHM) before being installed onto the CPU socket.

Notes:

• Use ESD protection.
• Unplug the AC power cord from all power supplies.
• Check that the plastic protective cover is on the CPU socket and that none of the socket pins are bent. If they are, contact your retailer.
• When handling the processor, avoid touching or placing direct pressure on the land grid array (gold contacts).
• Improper installation or socket misalignment can cause serious damage to the processor or the socket and may require manufacturer repairs.
  • Thermal grease is pre-applied on new heatsinks. No additional thermal grease is needed.
  • Refer to the Supermicro website for updates on processor support.
• Graphics in this manual are for illustration only. Your components may look different.

The Processor Carrier Assembly

The processor carrier assembly is comprised of the processor and the processor carrier.

1. Hold the processor with the land grid array (LGA, gold contacts) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below. These triangles indicate the location of pin 1.

Pin 1

Processor

Pin 1

Carrier

1. Turn the processor over (with the gold LGA up). Locate the CPU keys on the processor and the four latches on the carrier as shown below.

Processor (Reverse Side Up) Latch Latch Carrier (Top Side Up) CPU Key Latch Latch CPU Key

1. Locate the lever on the carrier and, if necessary, press it down as shown below.

Lever

1. Align the CPU keys on the processor (A & B) with those on the carrier (a & b) as shown below.

CPU Key (on the processor) CPU Key (on the carrier) Latch B 1 A 2 a Latch CPU Key (on the processor) CPU Key (on the carrier)

1. Carefully place one end of the processor under latch 1 on the carrier, and then press the other end down until it snaps into latch 2 and is properly seated on the carrier.

Processor Carrier Assembly (Top View) Processor Carrier Assembly (Underside view)

The Processor Heatsink Module (PHM)

After creating the processor carrier assembly, mount the heatsink onto the carrier assembly to form the processor heatsink module (PHM).

Note: If this is a new heatsink, the thermal grease has been pre-applied. Otherwise, apply the proper amount of thermal grease to the underside of the heatsink.

1. Turn the heatsink over with the thermal grease facing up. Note the two triangle cutouts (A, B) located at the diagonal corners of the heatsink as shown in the drawing below.

2. On the processor carrier assembly, find pin 1, as noted by the triangles. Hold the processor carrier assembly over so that the gold LGA is facing up.

3. Align clip "a" (pin 1) on the carrier assembly with the triangular cutout A on the heatsink and b, c, d on the carrier assembly with B, C, D on the heatsink.

4. Push the carrier assembly onto the heatsink, making sure that all four clips on each corner are properly secured.

Processor Carrier Assembly Pin1 a b c D B A C Heatsink

Installing the PHM into the CPU Socket

1. Remove the plastic protective cover from the CPU socket. Gently squeeze the grip tabs then pull the cover off.

CPU Socket with Plastic Protective Cover Grip Tabs

1. Locate four threaded fasteners (a, b, c, d) on the CPU socket.

CPU Socket Threaded Fastener a b c d (a, b, c, d: Threaded Fasteners) CPU Socket Pin1

1. Locate four PEEK nuts (A, B, C, D) and four rotating wires (1, 2, 3, 4) on the heatsink as shown below.

A, B, C, D: Peek Nut 1, 2, 3, 4: Rotating Wire a, b, c, d: Threaded Fastener Heatsink Rotating Wire 2 B D Rotating Wire 4 Rotating Wire 3 Rotating Wire 1 Peek Nut A CPU Socket Rotating Wire Peek Nut (Unlatched) (latched)

1. Check that the rotating wires (1, 2, 3, 4) are in the unlatched position as shown.

Unlatched State Rotating Wire Side View Top View Peek Nut

1. Align nut A (next to the triangles and pin 1) on the heatsink with threaded fastener "a" on the CPU socket. Also align nuts B, C, D on the heatsink with threaded fasteners b, c, d on the CPU socket.

2. Gently place the heatsink on the CPU socket, making sure that each nut is properly aligned with its corresponding threaded fastener.

A, B, C, D: Peek Nut on the Heatsink B D C A b c a, b, c, d: Threaded Fastener on the CPU socket

1. Press all four rotating wires outward to latch the PHM onto the CPU socket.

Rotating Wire Rotating Wire Latched State Top View

1. With a t30-bit screwdriver, tighten all PEEK nuts in the sequence of A, B, C, and D with even pressure not greater than 12 lbf-in.

Technical diagram showing a mechanical assembly with labeled components (A, B, C, D) and a green arrow indicating transformation or assembly.

Removing the PHM from the CPU Socket

Be sure the system is shut down and all AC power cords are unplugged.

1. Use a t30-bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A, B, C, and D.

B D Peek Nut C

1. Press the four rotating wires inward to unlatch the PHM as shown below.

Unlatched State Rotating Wire Side View Peek Nut

1. Gently lift the PHM upward to remove it from the CPU socket.

Technical line drawing of a mechanical housing assembly with mounting holes and internal components (no text or symbols)

Removing the Processor Carrier Assembly from the PHM

Detach the four plastic clips (a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (A, B, C, D) as shown below, and lift off the processor carrier assembly.

Removing the Processor from the Carrier Assembly

Unlock the lever from its locked position and push it upwards to disengage the processor from the carrier as shown below right. Carefully remove the processor from the carrier.

Processor Carrier Assembly Lever

Note: Handle the processor with care to avoid damage.

Isometric technical diagram of a mechanical assembly with no visible text or symbols

3.4 Memory

Memory Support

The X12DPT-PT6 motherboard has 16 DIMM slots. It supports up to

• 6TB (PMem + DDR4): 4TB of Intel Optane PMem 200 series (on Platinum, Gold and selected Silver processors only) plus 2TB of DDR4.
• 4TB (DDR4 only): 3DS Load Reduced DIMM (3DS LRDIMM), 3DS Registered DIMM (3DS RDIMM), or Non-Volatile DIMMs (NV-DIMM) ECC memory with speeds of up to 3200 MHz.

For validated memory, use our Product Resources page.

DDR4 Memory Support for 3rd Gen Intel Xeon Scalable Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)		Speed (MT/s) and Voltage
		DRAM Density One DIMM per Channel
		8Gb 16Gb 1.2V
RDIMM	SRx8 8GB 16GB			3200*
	SRx4 16GB 32GB
	DRx8 16GB 32GB
	DRx4 32GB 64GB
RDIMM 3Ds (4R/8R) x4		2H-64GB4H-128GB	2H-128GB4H-256GB
LRDIMM QRx4	64GB 128GB
LRDIMM 3Ds (4R/8R) x4 4H-128GB			2H-128GB4H-256GB

*Only the 83xx and 63xx series support 3200MT/s; for other processors, memory speed as supported by the CPU.

P1-DIVM1 P1-DIVM1 P1-DIVM1 P1-DIVM1 CPU1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 CPU2 P1-DIVM1 P1-DIVM1 P1-DIVM1 P1-DIVM1 P1-DIVM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 P2-CIMM1 SXP1 CPU BIP RIO X 038

Figure 3-3. Memory Slots

Guidelines Regarding Mixing DIMMs

• All DIMMs must be DDR4 or a mixture of PMem and DDR4.
• x4 and x8 DIMMs can be mixed in the same channel.
• Mixing of LRDIMMs and RDIMMs is not allowed in the same channel, across different channels, and across different sockets.
• Mixing of non-3DS and 3DS LRDIMM is not allowed in the same channel, across different channels, and across different sockets.
• Mixing of PMem modules and RDIMMs is supported
• Mixing DDR4 and PMem memory operating frequencies is not validated within a socket or across sockets. If DIMMs of different frequencies are mixed in the same channel, all DIMs will run at the highest common frequency.
• Always populate the DIMM with the higher electrical loading on a channel in DIMMx1 (farther from CPU) followed by DIMMx2.

DDR4 Memory Population Guidelines

The following memory population table was created based on guidelines provided by Intel to support Supermicro motherboards.

Memory Population for DDR4-only Configurations, 16 DIMM Slots
CPUs/DIMMs DIMM Slots
1 CPU & 1 DIMM	A1
1 CPUs & 2 DIMMs*	A1, E1
1 CPUs & 4 DIMMs*	A1, C1, E1, G1
1 CPUs & 6 DIMMs	A1, B1, C1, E1, F1, G1
2 CPUs & 8 DIMMs*	A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 2 DIMMs*	CPU1: A1CPU2: A1
2 CPUs & 4 DIMMs*	CPU1: A1, E1CPU2: A1, E1
2 CPUs & 6 DIMMs	CPU1: A1, C1, E1, G1CPU2: A1, E1
2 CPUs & 8 DIMMs*	CPU1: A1, C1, E1, G1CPU2: A1, C1, E1, G1
2 CPUs & 10 DIMMs	CPU1: A1, B1, C1, E1, F1, G1CPU2: A1, C1, E1, G1
2 CPUs & 12 DIMMs*	CPU1: A1, B1, C1, E1, F1, G1CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 14 DIMMs	CPU1: A1, B1, C1, D1, E1, F1, G1, H1CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 16 DIMMs*	CPU1: A1, B1, C1, D1, E1, F1, G1, H1CPU2: A1, B1, C1, D1, E1, F1, G1, H1

* recommended for optimal performance

• Other Intel validated memory configurations are supported, although they may not provide optimal performance. See Intel documentation for more information.
• Must have at least one DIMM per CPU.

Optane PMem 200 Series

For 3rd Gen Intel Xeon Scalable Platinum, Gold and selected Silver processors

Symmetric Population for Each CPU with PMem + DDR4

DDR4 & PMem

Modes

AD interl- leve

DIMM

F1 F2 E

1 E2 H1

H2 G1 G

G2 C2 C1

D2 D1 A

A2 A1 B2

B1

4 DDR4

AD

1 - x4

PM

-

DDR4

-

PM

-

DDR4

-

-

DDR4

-

PM

-

DDR4

-

PM

4 PMem

MM

1 - x4

DDR4

-

PM

-

DDR4

-

PM

-

-

PM

-

DDR4

-

PM

-

DDR4

6 DDR4

AD

One - x1

DDR4

-

DDR4

-

-

-

DDR4

-

-

DDR4

-

PM

-

DDR4

-

DDR4

-

-

DDR4

-

DDR4

-

DDR4

-

-

DDR4

-

DDR4

-

DDR4

-

PM

DDR4

-

DDR4

-

PM

-

DDR4

-

-

DDR4

-

-

-

DDR4

-

DDR4

PM

-

DDR4

-

DDR4

-

DDR4

-

-

DDR4

-

DDR4

-

DDR4

-

-

DDR4

-

DDR4

-

DDR4

-

-

-

-

PM

-

DDR4

-

DDR4

-

DDR4

DDR4

-

-

-

DDR4

-

DDR4

-

-

DDR4

-

DDR4

-

PM

-

DDR4

DDR4

-

DDR4

-

DDR4

-

PM

-

-

-

-

DDR4

-

DDR4

-

DDR4

DDR4

-

PM

-

DDR4

-

DDR4

-

-

DDR4

-

DDR4

-

-

-

DDR4

AD: App Direct, MM: Memory Mode, PM: PMem

Validation Matrix (DDR4 DIMMs Validated with PMem 200 Series)
DIMM Type(up to 3200)	Ranks Per DIMM& Data Width(Stack)	DIMM Capacity (GB)
		DRAM Density
		8Gb 16Gb
RDIMM	1Rx8 N/A N/A
	1Rx4 16GB 32GB
	2Rx8 16GB 32GB
	2Rx4 32GB 64GB
RDIMM 3DS	4Rx4 (2H) N/A 128GB
	8Rx4 (4H) NA 256GB
LRDIMM	4Rx4	64GB 128GB
LRDIMM 3DS	4Rx4 (2H) N/A N/A
	8Rx4 (4H) 128GB	256GB

PMem Notes

• PMem 200 Series are supported on 3rd gen Intel Xeon Scalable Platinum, Gold and selected Silver processors.
• Do not mix PMem and NVDIMMs within the platform.
• For MM, NM/FM ratio is between 1:4 and 1:16. The capacity not used for FM can be used for AD. (NM = Near Memory; FM = Far Memory).
• Matrix targets configs for optimized PMem to DRAM cache ratio in MM and MM + AD modes.
• For each individual population, different PMem rearrangements among channels are permitted so long as the configuration does not break X12 DP Memory population rules.
• Ensure the same DDR4 DIMM type and capacity are used for each DDR4 + PMem population.
• If the system detects an unvalidated config, then the system issues a BIOS warning. The CLI functionality is limited in non-POR configurations, and select commands will not be supported.
• x4 and x8 DDR4 DIMMs cannot be mixed in the same channel in PMem configurations.

Installing Memory

ESD Precautions

Electrostatic Discharge (ESD) can damage electronic components including memory modules. To avoid damaging DIMM modules, it is important to handle them carefully. The following measures are generally sufficient.

• Use a grounded wrist strap designed to prevent static discharge.
• Handle the memory module by its edges only.
• Put the memory modules into the antistatic bags when not in use.

Installing Memory

Begin by removing power from the system as described in Section 3.1. Follow the memory population sequence in the table above.

1. Push the release tabs outwards on both ends of the DIMM slot to unlock it.

Notches Release Tabs

1. Align the key of the DIMM with the receptive point on the memory slot and with your thumbs on both ends of the module, press it straight down into the slot until the module snaps into place.

Key

1. Press the release tabs to the locked position to secure the DIMM module into the slot.

Caution: Exercise extreme caution when installing or removing memory modules to prevent damage to the DIMMs or slots.

Removing Memory

To remove a DIMM, unlock the release tabs then pull the DIMM from the memory slot.

3.5 Motherboard Battery

The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard.

Replacing the Battery

Begin by removing power from the system.

1. Push aside the small clamp that covers the edge of the battery. When the battery is released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+) side facing up. Then push the other side down until the clamp snaps over it.

Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

LITHIUM BATTERY BATTERY HOLDER

Figure 3-4. Installing the Onboard Battery

Warning: There is a danger of explosion if the onboard battery is installed upside down (which reverses its polarities). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).

3.6 Storage Drives

The system supports twenty-four hot-swap 2.5" hybrid storage drive bays, six per node. The drives are mounted in drive carriers that simplify their removal from the chassis. These carriers also help promote proper airflow.

Note: Enterprise level drives are recommended for use in Supermicro servers. For compatible drives, see the X12DPT-PT6 motherboard page.

Each node also supports two M.2 SSDs by means of an adapter card. See Chapter 6 for details.

Installing Drives

Node A Node B Node C Node D A0 A2A1 A3 A5A4 B0 E2B1 B3 E5B0 C2C1 C3 C5C4 D0 D2D1 D3 D5D4

Figure 3-5. Logical Drive Numbers

Removing Drive Carriers from the Chassis

1. Press the release button on the drive carrier. This extends the drive carrier handle.
2. Use the handle to pull the carrier out of the chassis (Figure 3-8).
3. Remove the dummy drive from the carrier (Figure 3-9).

Caution: Except for short periods of time (swapping drives), do not operate the server with the drive carriers removed from the bays, regardless of how many drives are installed, for proper airflow.

Technical diagram showing server rack and internal device with green directional arrows indicating rotation or movement.

Figure 3-6. Removing Drives

Mounting a Drive in a Drive Carrier

1. To add a new drive, install it into the carrier with the printed circuit board side facing down so that the mounting holes align with those in the carrier.
2. Secure the drive to the carrier with the screws provided, then push the carrier completely into the drive bay. You should hear a *click* when the drive is fully inserted.

Dummy Drive MM T289-ML+ABS 01-SB9005-XXG Hard Drive Carrier

Figure 3-7. Mounting a Drive in a Carrier

This indicates that the carrier has been fully seated and connected to the midplane, which automatically makes the power and logic connections to the hard drive.

Removing a Drive from a Drive Carrier

1. Remove the screws that secure the hard drive to the carrier and separate the hard drive from the carrier.
2. Replace the carrier back into the drive bay.

Drive Carrier Indicators

Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare. For VROC configurations, refer to the VROC section in this manual.

Drive Carrier LED Indicators
	Color Blinking Pattern Behavior	for Device
Activity LED	Blue Solid On Idle SAS drive installed
	Blue Blinking I/O activity
	Off Idle SATA or no drive
Status LED	Red Solid On Failure of drive with RSTe support
	Red Blinking at 1 Hz Rebuild drive with RSTe support
	Red Blinking at 4 Hz Identify drive with RSTe support
	Red Blinking with two blinks and one stop at 1 Hz	Hot spare for drive with RSTe support
	Red On for five seconds, then off	Power on for drive with RSTe support

Installing M.2 Solid State Drives

Each node can accommodate two M.2 solid state drives (SSDs) using a storage controller card (SCC-P2N2M2-P2). This card supports PCIe Gen4 M.2-NVMe, size 2280/60/42 with a regular GenZ-2C pin as the interface connector.

SSD Socket (slot0) for JMD1 Hole for Standoffs (choose one) SSD Socket (slot1) for JMD2 HannStar K MV-6 94V-0 RL E89382 2 I I I B M.2_5iv10 M.2_5iv11 M.2_5iv12 M.2_5iv13 M.2_5iv14 M.2_5iv15 M.2_5iv16 M.2_5iv17 M.2_5iv18 M.2_5iv19 M.2_5iv20 M.2_5iv21 M.2_5iv22 M.2_5iv23 M.2_5iv24 M.2_5iv25 M.2_5iv26 M.2_5iv27 M.2_5iv28 M.2_5iv29 M.2_5iv30 M.2_5iv31 M.2_5iv32 M.2_5iv33 M.2_5iv34 M.2_5iv35 M.2_5iv36 M.2_5iv37 M.2_5iv38 M.2_5iv39 M.2_5iv40 M.2_5iv41 M.2_5iv42 M.2_5iv43 M.2_5iv44 M.2_5iv45 M.2_5iv46 M.2_5iv47 M.2_5iv48 M.2_5iv49 M.2_5iv50 M.2_5iv51 M.2_5iv52 M.2_5iv53 M.2_5iv54 M.2_5iv55 M.2_5iv56 M.2_5iv57 M.2_5iv58 M.2_5iv59 M.2_5iv60 M.2_5iv61 M.2_5iv62 M.2_5iv63 M.2_5iv64 M.2_5iv65 M.2_5iv66 M.2_5iv67 M.2_5iv68 M.2_5iv69 M.2_5iv70 M.2_5iv71 M.2_5iv72 M.2_5iv73 M.2_5iv74 M.2_5iv75 M.2_5iv76 M.2_5iv77 M.2_5iv78 M.2_5iv79 M.2_5iv80 M.2_5iv81 M.2_5iv82 M.2_5iv83 M.2_5iv84 M.2_5iv85 M.2_5iv86 M.2_5iv87 M.2_5iv88 M.2_5iv89 M.2_5iv90 M.2_5iv91 M.2_5iv92 M.2_5iv93 M.2_5iv94 M.2_5iv95 M.2_5iv96 M.2_5iv97 M.2_5iv98 M.2_5iv99 M.2_5iv100

Figure 3-8. M.2 SSD Card

To Install M.2 SSDs

Caution: Use industry-standard anti-static equipment, such as gloves or wrist strap, and follow precautions to avoid damage caused by ESD.

1. Pull the controller card up and out of the motherboard slot (SXB6). On the motherboard, remove any DIMMs obstructing access to the carrier card slot.

Controller Card

Figure 3-9. M.2 Storage Controller Card Slot

1. For each 22x80mm M.2 SSD, install on the standard standoff with the provided screw. For 22x42mm or 22x60mm SSDs, obtain an additional standoff to support each.

Line drawing of two hands assembling a circuit board component (no text or symbols)

Figure 3-10. Inserting the Standoff Plug

Line drawing of two hands assembling a mechanical component (no text or symbols)

Figure 3-11. Inserting the Standoff (drawing shows hole for 60~mm SSD)

1. Insert the SSD into the socket on the card. Then push it flat against the card and the plastic standoff.
2. Secure the SSD by firmly inserting the standoff plug.
3. Push the controller card into the slot on the motherboard. With the screws provided, secure it to the side of the node chassis.
4. Replace any DIMMs that may have been removed.
5. Replace the node into the chassis, and power up the system.

3.7 System Cooling

Fans

The chassis contains four 8-cm high-performance fans. Fan speed is controlled by the BMC depending on the system temperature. If a fan fails, the remaining fans will ramp up to full speed. The system will continue to run with a failed fan, although it may shut down if the heat gets too great. Replace any failed fan immediately with the same model. Failed fans can be identified through the BMC.

Changing a System Fan

1. Determine which fan has failed using the BMC, or if necessary, open the chassis while the system is running. Never run the server for long without the chassis cover.

2. Power down the entire server. If that is difficult, at least power down the two nodes (A and B, or C and D) associated with the failed fan.

3. Remove the failed fan's power cable from the backplane.

4. Lift the fan housing up and out of the chassis.

Technical line drawing of a server rack with two fans and green directional arrows indicating mounting points (no text or symbols present)

Figure 3-12. System Fan Placement

1. Push the fan up from the bottom and out of the top of the housing.

2. Replace the failed fan with an identical fan, available from Supermicro. Push the new fan into the housing, making sure the air flow direction is the same.

3. Put the fan housing back into the chassis and reconnect the fan power cables.

4. Power up the node and check that the fan is working properly and that the LED on the control panel has turned off. Re-install the chassis cover.

HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC HDEC AECOCHUZICN

Figure 3-13. Replacing a System Fan

Air Shrouds

Air shrouds concentrate airflow to maximize cooling efficiency.

Installing the Standard Air Shrouds

1. Screw the guide pins into the sled as shown below.
2. Position the air shrouds and drop them onto the guide pins and into place.

Guide PIns

Figure 3-14. Installing the Air Shrouds

3.8 Power Supply

The chassis features redundant power supplies. The system will continue to operate if one module fails. It should be replaced as soon as convenient. The power supply modules are hot-swappable, meaning they can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors.

These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 100-127Vac or 200-240Vac, 50-60Hz

Power Supply LEDs

On the rear of the power supply module, an LED displays the status.

• Solid Green: When illuminated, indicates that the power supply is on.
• Blinking Green: When blinking, indicates that the power supply is plugged in and turned off by the system.
• Blinking Amber: When blinking, indicates that the power supply has a warning condition and continues to operate.
• Solid Amber: When illuminated, indicates that the power supply is plugged in, and is in an abnormal state. The system might need service. Please contact Supermicro technical support.

Changing the Power Supply Module:

1. Unplug the AC cord from the module to be replaced.
2. On the back of the module, push the release tab sideways.
3. Pull the module out using the handle.
4. Push the new power supply module into the power bay until it clicks. Replace with the same model.
5. Plug the AC power cord back into the module.

Release Tab PWS1 PWS2

Figure 3-15. Replacing the Power Supply

3.9 PCI Expansion Slots

Each node offers options for riser cards that provide custom PCIe capabilities—one right-facing WIO riser card, and one left-facing WIO card.

Back view of a server rack with labeled ports and connectors (no readable text or symbols)

Figure 3-16. Expansion Card Chassis Slots

Expansion Slots and Riser Cards

This system offers options for riser cards that provide custom PCIe 4.0 capabilities.

PCIe Riser Cards
Position* Part	Number Slot Description
Right side(SXB3)	RSC-PR-6-X2 1	[2A87]	AOC-S3808L-L8iT (in 220TP-HC8TR)AOC-S3908L-H8iR (in 220TP-HC9TR)
Left side(SXB4)	RSC-P-6G4	[1X55]	x16 low profile (CPU2)

*Position in the node tray when looking from the back of the server.

Installing Expansion Cards

(Figure on next page)

1. Use the control panel to power down the computing node, and pull the node drawer out of the chassis.
2. Open the PCI slot clip in the rear of the node drawer and remove the PCI slot shield.
3. If the riser card is not already installed, push it into the motherboard slot.
4. Slide the expansion card into the riser card slot while fitting the expansion card shield into the opening in the rear of the node drawer.
5. Close the PCI slot clip to secure the expansion card shield.
6. Secure the riser card screw.
7. Return the node drawer and power-up.

Riser Card Bracket Riser Card Expander Card PCI Slot Shield

Figure 3-17. Installing the Expansion Card

Chapter 4

Motherboard Connections

This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1. More detail can be found in the Motherboard Manual Please review the Safety Precautions in Appendix A before installing or removing components.

4.1 Power Connection

JHS1 is a proprietary power and front control panel connector. It connects as the compute node slides into the system enclosure.

4.2 Headers and Connectors

Fan Headers

There are two 4-pin fan headers (FAN3, FAN4) on the motherboard. These connect as the compute node slides into the system enclosure.

TPM Header

The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro. A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the storage drive is not installed in the system. For more information on the TPM: http://www.supermicro.com/manuals/other/TPM.pdf.

Trusted Platform Module/Port 80 Header Pin Definitions
Pin# Definition Pin# Definition
1 P3V3 2 SPI_TPM_CS_N
3 PCI-E_RESET_N# 4 SPI_PCH_MISO
5 SPI_PCH_CLK# 6 Ground
7 SPI_PCH_MOSI 8 N/A
9 JTPM1_P3V3A 10 IRQ_TPM_SPIN_N

RAID Key Header

An Intel VROC RAID Key header is located at JRK1. It supports VMD used in creating optional advanced NVMe RAID configurations.

RAID Key HeaderPin Definitions

Pin# Definition

1 Ground

2 3.3V Standby

3 Ground

4 PCH_RAID_KEY

VROC Key Header (JRK1)

Note: This drawing is for illustration only. Your motherboard may look different.

BMC External I²C Header

A 4-pin system management bus header for the BMC is located at JIPMB1. Connect a cable to this header to use the IPMB I²C connection on your system.

External I2C Header Pin Definitions
Pin#	Definition
1 Data
2 Ground
3 Clock
4 No Connection

Disk-On-Module Power Connector

Two power connectors for SATA DOM (Disk-On-Module) devices are located at JSD1 and JSD2. Connect appropriate cables here to provide power support for your Serial Link DOM devices.

DOM Power Pin Definitions
Pin# Definition
1 5V
2 Ground
3 Ground

NCSI Connector

The NCSI connector (JNSCI1) is used to connect a Network Interface Card (NIC) to the motherboard which will allow the onboard BMC (Baseboard Controller) to communicate with a network.

Note 1: For detailed instructions on how to configure Network Interface Card (NIC) settings, refer to the Network Interface Card Configuration User's Guide posted on the web page under the link: www.supermicro.com/support/manuals/.

Note 2: LAN1 is the default shared LAN port.

I-SATA 3.0 and S-SATA 3.0 Ports

There are two I-SATA 3.0 ports (I-SATA4, I-SATA5) and six S-SATA ports (S-SATA0–5) on the motherboard. These SATA ports are supported by the Intel PCH C621A chipset. I-SATA4 and I-SATA5 can be used with Supermicro SuperDOMs, which are orange SATA DOM connectors with power pins built in and do not require external power cables. S-SATA0–5 are supported by PCH and are connected to Supermicro storage backplane.

4.3 Input/Output Ports

See the figure below for the locations and descriptions of the I/O ports on the rear of the motherboard.

Diagram showing seven labeled components of a network device, including Ethernet ports, USB port, and VGA connectors.

Figure 4-1. Rear I/O Ports

Rear I/O Ports
# Description # Description
1 LAN1 5 UID switch/BMC reset
2 LAN2 6 VGA port
3 USB0 (3.2 Gen1) 7 Dedicated BMC LAN
4 USB1 (3.2 Gen1)

UID Switch

A Unit Identifier (UID) switch and a UID LED indicator are located on the rear of the system. When you press the UID switch, both front and rear UID LED indicators are toggled on or off. The UID indicators provide easy identification of a system in a rack. The UID can also be triggered using the BMC.

The BMC can be reset using the UID switch. See Section 7.8 for details.

4.4 Jumpers

Explanation of Jumpers

To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

Note: On a two-pin jumper, "Closed" means the jumper is on both pins and "Open" indicates the jumper is either on only one pin or has been completely removed.

Connector Pins Jumper Setting 3 2 1 3 2 1

LAN Port Enable/Disable

JPTG1 allows the user to enable or disable the onboard LAN ports. The default setting is pins 1-2 to enable the connection.

LAN Enable/DisableJumper Settings
Jumper Setting Definition
Pins 1-2 Enable
Pins 2-3 Disabled

LAN Port AUX Power Enable/Disable

JPAUX1 allows the user to enable/disable the LAN port AUX power to enable/disable onboard LAN ports when the system is in power off status. The default setting is to short pins 2-3 to disable onboard LAN ports when the system is in power off status. Refer to the table below for jumper settings.

LAN Port AUX Power Enable/Disable Jumper Settings
Jumper Setting Definition
Pins 1-2 Enabled
Pins 2-3 Disabled

ME Recovery

JPME2 is used for ME Firmware Recovery mode, which will limit system resource for essential function use only without putting restrictions on power use. In the single operation mode, online upgrade will be available via Recovery mode.

ME RecoveryJumper Settings

Jumper Setting Definition

Pins 1-2 Normal (Default)

Pins 2-3 ME Recovery

4.5 LED Indicators

Network LAN LEDs

The Ethernet ports each have two LEDs. One LED indicates activity when flashing green. The other may be green, amber or off to indicate the speed of the connection.

LAN LED (Speed Indicator)

Color Definition

Green 10Gbps

Amber 1Gbps

Off 100Mbps or less

Dedicated BMC LAN LEDs

A dedicated BMC LAN port is also included on the motherboard. The amber LED on the right of the BMC LAN port indicates activity, while the LED color on the left indicates the speed of the connection.

BMC Link LED

Color Definition

Off No Connection

Green 100 Mb/s

Amber 1 Gb/s

Link LED (speed) Activity LED

Chapter 5

Software

After the hardware has been installed, you can install the Operating System (OS), configure RAID settings and install the drivers.

5.1 Microsoft Windows OS Installation

If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals.

Installing the OS

1. Create a method to access the MS Windows installation ISO file. That might be a USB flash or media drive, or the BMC KVM console.
2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
3. Boot from a bootable device with Windows OS installation. You can see a bootable device list by pressing F11 during the system startup.

Please select boot device: ATEN Virtual CDROM YSOJ → IPMI virtual drive (Legacy) ASUS SDRW-08D2S-U F601 → USB DVD device (Legacy) USB FLASH DRIVE PMAP → USB flash drive with OS installation (Legacy) IBA 40-10G Slot 1900 v1060 → PXE boot (Legacy) UEFI: ATEN Virtual CDROM YSOJ → IPMI virtual drive (UEFI) UEFI: ASUS SDRW-08D2S-U F601 → USB DVD device (UEFI) UEFI: Built-in EFI Shell Enter Setup ↑ and ↓ to move selection ENTER to select boot device ESC to boot using defaults

Figure 5-1. Select Boot Device

1. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on "Load driver" link at the bottom left corner.

Where do you want to install Windows? Name Total size Free space Type Refresh Delete Format New Load driver Extend We couldn't find any drives. To get a storage driver, click Load driver. Next

Figure 5-2. Load Driver Link

To load the driver, browse the USB flash drive for the proper driver files.

• For RAID, choose the SATA/sSATA RAID driver indicated then choose the storage drive on which you want to install it.

• For non-RAID, choose the SATA/sSATA AHCI driver indicated then choose the storage drive on which you want to install it.

• Once all devices are specified, continue with the installation.

• After the Windows OS installation has completed, the system will automatically reboot multiple times.

5.2 Driver Installation

The Supermicro website contains drivers and utilities for your system at https://www.supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver.

After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash or media drive. (You may also use a utility to extract the ISO file if preferred.)

Another option is to go to the Supermicro website. On the product page for your motherboard, "Download the Latest Drivers and Utilities".

Insert the flash drive or disk and the screenshot shown below should appear.

SUPERMICRO X12DPT-PT6 Motherboard Drivers & Tools (Win2019) Intel C621A Chipset X12DPT-PT6/ PT46 SUPERMICRO Computer Inc. Intel Chipset INF files Microsoft .Net Framework 4.8 (Optional) ASPEED Graphics Driver Intel Virtual RAID on CPU Intel PRO Network Connections Drivers SUPERMICRO SuperDoctor 5 Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information, please visit SUPERMICRO's web site.

Figure 5-3. Driver and Tool Installation Screen

Note: Click the icons showing a hand writing on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you must re-boot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire contents.

5.3 SuperDoctor® 5

The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server), you can remotely control power on/off and reset chassis intrusion for multiple systems with SuperDoctor 5 or the BMC. SuperDoctor 5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

SuperDoctor® Manual and Resources

SuperDoctor 5 Home: 100 Certificate error: localhost:10000000000000000000000000000000000000000000000000000000000000000000000000000000000000 Loading Motherboard: C7B360-C8-ML Voltage 1.24V 2.4V 3.6V 4.9V 6.2V 7.5V 8.8V 9.1V 10.3V 11.5V 12.7V 13.9V 15.2V 16.5V 17.7V 18.9V 19.2V 20.5V 21.8V 23.1V 24.4V 25.7V 27.0V 28.3V 29.6V 31.9V 33.2V 34.5V 35.8V 37.1V 38.4V 39.7V 41.0V 42.3V 43.6V 44.9V 46.2V 47.5V 48.8V 49.1V 50.4V 51.7V 53.0V 54.3V 55.6V 56.9V 58.2V 59.5V 60.8V 62.1V 63.4V 64.7V 66.0V 67.3V 68.6V 69.9V 71.2V 72.5V 73.8V 75.1V 76.4V 77.7V 79.0V 80.3V 81.6V 82.9V 84.2V 85.5V 86.8V 88.1V 89.4V 90.7V 92.0V 93.3V 94.6V 95.9V 97.2V 98.5V 99.8V 101.1V 102.4V 103.7V 105.0V 106.3V 107.6V 108.9V 110.2V 111.5V 112.8V 114.1V 115.4V 116.7V 118.0V 119.3V 120.6V 121.9V 123.2V 124.5V 125.8V 127.1V 128.4V 129.7V 131.0V 132.3V 133.6V 134.9V 136.2V 137.5V 138.8V 140.1V 141.4V 142.7GPa Terms CPU Terms Racker Terms Passphone Terms

Figure 5-4. SuperDoctor 5 Interface Display Screen (Health Information)

5.4 BMC

The motherboard provides remote access, monitoring and management through the baseboard management controller (BMC) and other management controllers distributed among different system modules. There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at:

www.supermicro.com/en/solutions/management-software/bmc-resources

BMC ADMIN User Password

For security, each system is assigned a unique default BMC password for the ADMIN user. This can be found on a sticker on the chassis and a sticker on the motherboard. The sticker also displays the BMC MAC address.

BMC AC1F6BC PWD SUOKJ

Figure 5-5. BMC Password Label

The sticker can be found on the rear of the node tray. See Chapter 1 for the location.

Chapter 6

Optional Components

This chapter describes alternate configurations and optional system components.

Optional Parts

Storage options

TPM security module

Enabling Intel SGX in the UEFI BIOS Setup Utility

Intel VROC RAID Key

6.1 Storage Options

Each node supports six hot-swap 2.5" SATA/SAS drives. Additional storage can be attained using M.2 SSDs.

M.2 SSDs

Two M.2 SSDs per node can be added using the carrier card (SCC-P2N2M2-P2) inserted in the motherboard connector SXB6. The carrier card supports 2280 form factor NVMe SSDs. You can request additional standoffs to support 2260 or 2242 form factors. See Chapter 3 for details.

6.2 TPM Security Module

SPI capable TPM 2.0 (or 1.2) with Infineon 9670 controller, horizontal form factor

The JTPM1 header is used to connect a Trusted Platform Module (TPM). A TPM is a security device that supports encryption and authentication in hard drives. It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system.

Details and installation procedures are at:

http://www.supermicro.com/manuals/other/TPM.pdf.

• AOM-TPM-9670H
• AOM-TPM-9671H

6.3 Enabling Intel SGX in the UEFI BIOS Setup Utility

This section provides instructions to enable Intel Software Guide Extensions support on the UEFI BIOS.

Requirements

To ensure that Intel SGX is supported by your system, be sure to meet the following requirements:

• Use processors that support Intel SGX.
- Use BIOS Rev. 1.1a or a newer version.
- Install DIMM modules based on the memory configuration supported by Intel SGX as listed in the tables below.

Memory Configuration Tables for SGX Support

Processor Requirements

• 3rd Gen Intel Xeon Scalable Processors (in Socket P+ (LGA-4189))

OS Requirements

• Windows Server 2019
• Linux: Ubuntu 20.04, Ubuntu 18.04, Red Hat Enterprise Linux Server 8.2

For more information, refer to the Intel website.

Software Requirements

Intel SGX Platform Software

• For Intel SGX application to work properly in a system, Intel SGX PSW is required to be pre-installed before shipping.
• A standalone Intel SGX PSW for Windows OS is also available. (Please refer to Intel's website.)

Note: Depending on Windows version, PSW and drivers may already be automatically installed.

Supermicro Platform Support

• Supermicro systems based on X12DP Series or X12SP Series motherboards

Step 1: Entering the UEFI BIOS Utility to Enable TME Support

To enable Intel SGX support on the BIOS setting, enter the BIOS Setup utility by following the instructions below:

1. Press during system boot to enter the BIOS Setup utility.
2. Select the Advanced tab on the top of the screen.
3. Using the down arrow key, select CPU Configuration and press .
4. When the CPU Configuration submenu displays, scroll down to select Total Memory Encryption (TME) and press . The TME option dialog will display.

Aptio Setup - AMI Main Advanced Event Logs IPMI Security Boot Save & Exit ▶ Boot Feature ▶ CPU Configuration ▶ Chipset Configuration ▶ Server ME Information ▶ PCH SATA Configuration ▶ PCH sSATA Configuration ▶ Network Configuration ▶ PCIe/PCI/PnP Configuration ▶ Super IO Configuration ▶ Serial Port Console Redirection ▶ ACPI Settings ▶ Trusted Computing ▶ HTTP Boot Configuration ▶ SMC-KMS Server Configuration ▶ Intel(R) Ethernet Controller X550 - 3C:EC:EF:30:52:3E ▶ Intel(R) Ethernet Controller X550 - 3C:EC:EF:30:52:3F ▶ Intel(R) I350 Gigabit Network Connection - 3C:EC:EF:2D:32:C4 ▶ Intel(R) I350 Gigabit Network Connection - 3C:EC:EF:2D:32:C5 ▶ Intel(R) I350 Gigabit Network Connection - 3C:EC:EF:2D:32:C6 ▶ Intel(R) I350 Gigabit Network Connection - 3C:EC:EF:2D:32:C7 ▶ TLS Authenticate Configuration ▶ Driver Health CPU Configuration +:- Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.22.1282 Copyright (C) 2021 AMI

1. From the option dialog, select Enabled and press to enable TME support.

Step 2: Disabling Mirror Mode, ADDDC Sparing\*, and Patrol Scrub Support in the Memory-RAS Configuration Submenu

For Intel SGX to function properly, disable the following features in the Memory-RAS submenu first:

• Mirror Mode
• ADDDC (Adaptive Double Device Data Correction) Sparing* (See the notes below.)
• Patrol Scrub

Note 1: The feature "ADDDC Sparing" will only be activated and displayed on the BIOS screen when x4 DRAM DIMMs, which support ADDDC(+1), are installed in the system. Without required DRAMs present, this feature will not be activated but remains dormant, hidden from the user's view. For ADDDC memory support, refer to the Memory RAS Configuration User's Guide posted on our website at: https://www.supermicro.com/manuals/other/Memory_RAS_Configuration_User_Guide.pdf.

Note 2: If ADDDC Sparing does not appear on your BIOS screen, this feature is inactive and masked off by default, and you will not need to disable it manually.

To disable Mirror Mode, Patrol Scrub, and ADDDC Sparing (if needed), follow the instructions below:

1. In the UEFI BIOS Utility, from the Advanced tab menu, select Chipset Configuration and press .
2. Select North Bridge and press .
3. Select Memory Configuration and press as shown below.
4. When the Memory Configuration submenu displays, scroll down to select the Memory RAS Configuration submenu and, press . The memory RAS Configuration submenu will display.
5. Check to ensure that Mirror Mode is Disabled as shown below.

Aptio Setup - AMI Memory RAS Configuration Memory RAS Configuration Setup Enable Pcode WA for SAI PG [Disabled] Mirror Mode [Disabled] UEFI ARM Mirror [Disabled] Correctable Error Threshold 512 Partial Cache Line Sparing PCLS [Enabled] ADDDC Sparing Patrol Scrub ADDDC Sparing Disabled Enabled Enable/Disable ADDDC Sparing ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.22.1282 Copyright (C) 2021 AMI

1. Scroll down to check if the feature ADDDC Sparing displays on your screen.

If ADDDC Sparing does not appear on your screen, this feature is not activated, and you do not need to disable it manually.

If ADDDC Sparing is displayed on your screen, use the arrow keys to select it and press . The ADDDC Sparing option dialog appears. Select Disabled from the option box and press .

1. Using the down arrow key, select the feature "Patrol Scrub" and press .
2. From the option dialog, select Disabled and press .

Step 3: Enabling NUMA and Disabling UMA-Based Clustering Support in the ACPI Submenu

For Intel SGX to function properly, please enable NUMA (Non-Uniform Memory Access) and disable UMA-Based Clustering support in the ACPI submenu by following the instructions below.

1. In the UEFI BIOS Utility, from the Advanced tab menu, scroll down to select ACPI Settings and press .
2. Select NUMA and press .
3. Select Enabled, and press .
4. Scroll down to select UMA-Based Clustering and press .
5. When the option dialog displays, select Disable (ALL2ALL) and press to disable UMA-Based Clustering support.

Advanced ACPI Settings NUMA [Enabled] UMA-Based Clustering [Disable (A112A11)] WHEA Support [Enabled] High Precision Event Timer [Enabled] UMA-Based Clustering Disable (A112A11) Hemisphere (2-clusters) UMA Based Clustering options include Disable (ALL2ALL), Hemisphere (2 cluster), and Quadrant (4 cluster, not supported on ICX). These option are only valid when SNC is disabled. If SNC is enabled, UMA-Based Clustering is automatically disabled by BIOS. +: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.22.1282 Copyright (C) 2021 AMI

Step 4: Enabling SGX Support in the CPU Configuration Settings

After configuring the memory-related features in the UEFI BIOS utility as instructed above, your system is ready to support Intel Software Guard Extensions. To use SGX, follow the instructions below.

1. In the UEFI BIOS Utility, from the Advanced tab on top of the screen, select CPU Configuration and press .
2. Scroll down to select SW Guard Extensions (SGX) and press .
3. From the option dialog, select Enabled to enable SGX support.

Advanced CPU1 Core Disable Bitmap Hyper-Threading [ALL] [Enable] Hardware Prefetcher [Enable] Adjacent Cache Prefetch [Enable] DCU Streamer Prefetcher [Enable] DCU IP Prefetcher [Enable] LLC Prefetch [Enable] Extended APIC [Disable] VMX [Enable] Enable SMX SW Guard Extensions (SGX)—— PPIN Control Disabled AES-NI Enabled TME, TME-MT, TDX Total Memory Encryption (TME) [Enabled] Total Memory Encryption [Disabled] Multi-Tenant(TME-MT) Max TME-MT Keys 0x0 Software Guard Extension (SGX) SGX Factory Reset [Disabled] SW Guard Extensions (SGX) [Enabled] Enable/Disable Software Guard Extensions (SGX). Will disable and grayed out ADDDC , UMA-Based Clustering SGX, mirror and enable NUMA. SGX cannot co-exists PMem(Persistent Memory),ADDDC, MCA Recovery-Execution Path, Run Sure, Memory Mirroing, Address Range Mirroing(in the same memory regison), dynamice change CPU/memory/Ilo, static/Hard Partitioning +: Select Screen +: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.22.1282 Copyright (C) 2021 AMI

1. Press to save the settings and reboot the system for the changes to take effect.

6.4 Intel Virtual RAID on CPU (VROC)

Intel® Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex.

Strip sizes are 4K, 8K, 16K, 32K, 64K, 128K.

Requirements and Restrictions

• Intel VROC is only available when the system is configured for UEFI boot mode.

• To enable the mdadm command and support for RSTe, install the patch from

• Linux: https://downloadcenter.intel.com/download/28158/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Linux-

• Windows: https://downloadcenter.intel.com/download/28108/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Windows-

• To enable Intel VROC, a hardware key must be inserted on the motherboard, and the appropriate processor's Virtual Management Devices must be enabled in the BIOS setup.

• It is possible to enable Intel VROC without a hardware key installed, but only RAID0 will be enabled.
• Intel VROC is not compatible with secure boot. This feature must be disabled.
• When creating bootable OS RAID1 devices, you must have both devices on the same CPU, and a VMD on that CPU.
• Spanning drives when creating RAID devices is not recommended to due to performance issues, even though it is supported.

Supported SSDs and Operating Systems

To see the latest support information: https://www.intel.com/content/www/us/en/support/articles/000030310/memory-and-storage/ssd-software.html

Additional Information

Additional information is available on the product page for the Supermicro add-on card and the linked manuals.

www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm

Hardware Key

The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly. The key must be plugged into the Supermicro motherboard (connector JRK1; location can be found in Chapter 1). The key options are:

Intel® VROC Keys
VROC Package Description Part Number Intel MM Number
Standard	RAID 0, 1, 10Supports 3rd party SSDs	AOC-VROCSTNMOD 95	1605
Premium	RAID 0, 1, 5, 10Supports 3rd party SSDs	AOC-VROCPREMOD 95	1606
Intel SSD only	RAID 0, 1, 5, 10Supports Intel SSDs only	AOC-VROCINTMOD 95	822

VROC Key Header, JRK1

Figure 6-1. Intel VROC RAID Key and Motherboard Connector JRK1

Configuring NVMe RAID Manually

RAID for NVMe SSDs is enabled by default when Intel VROC Raid Key is populated. It may be managed manually through the UEFI BIOS.

1. Reboot the server and press [DEL] key to access the BIOS options.

2. Switch to Advanced > Chipset Configuration > North Bridge > IIO Configuration > Intel® VMD Technology.

Aptio Setup - AMI Advanced Intel® VMD Technology NVMe Mode Switch [Auto] ► Intel® VMD for Volume Management Device on CPU1 ► Intel® VMD for Volume Management Device on CPU2 NVMe Mode Switch Manual VMD Auto Select NVMe Mode, default Auto mode - enable VMD when VROC key presence

Figure 6-2. BIOS, Selecting VMD Mode

You can select a mode. The default is Auto. The VMD switch enables VMD mode for all NVMe ports despite the presence of the VROC key. The Manual switch allows the user to choose devices on which to enable VMD.

The onboard M.2 NVMe from PCH is located in the CPU1 section.

The screenshot below show example choices in Manual mode.

Aptio Setup - AMI Advanced VMD Config for PCH ports Enable/Disable VMD [Enable] M.2-P1 VMD [Disable] M.2-P2 VMD [Disable] VMD Config for IOU 0 Enable/Disable VMD [Enable] RSC-D2-668G4 SLOT1 VMD [Disable] RSC-D2-668G4 SLOT2 VMD [Disable] Hot Plug Capable [Disable] VMD Config for IOU 1 Enable/Disable VMD [Enable] RSC-D2-668G4 SLOT3 VMD [Disable] Hot Plug Capable [Disable] VMD Config for IOU 3 Enable/Disable VMD [Enable] Hot Plug Capable [Disable] VMD Config for IOU 4 Enable/Disable VMD [Enable] CPU1 NVMe1 VMD [Disable] CPU1 NVMe2 VMD [Disable] CPU1 NVMe3 VMD [Disable] Enable/Disable VMD Enable/Disable VMD Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Enable/Disable VMD in this Stack. ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.21.1279 Copyright (C) 2021 AMI

Figure 6-3. BIOS, Manual Mode (Example—your server may look different.)

1. Select the desired PStack# to Enable or Disable the corresponding Intel VMD controller

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack2 Intel® VMD for Volume Management Device [Disable] Intel® VMD for Volume Management Device for PStack0 Disable Enable Enable/Disable Intel® Volume Management Device Technology in this Stack.

Figure 6-4. BIOS, Enabling VMD for Pstack0

1. Select the desired PCIe slot to Enable or Disable Intel VMD functionality according to the current hardware configuration being used. Hot Plug Capability can also be Enabled or Disabled.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Enable] CPU1 SLOT1 PCI-E 3.0 X8 VMD [Disable] Hot Plug Capable [Disable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack2 Intel® VMD for Volume Manage CPU1 SLOT1 PCI-E 3.0 X8 VMD Disable Enable Enable/Disable Intel® Volume Management Device Technology on specific root port

Figure 6-5. BIOS, Enabling VMD Functionality per Slot

1. Repeat steps 3 and 4 for each PStack# on each CPU to be enabled or disabled. In this example, we enabled CPU1 Slot1 (Figure 6-11) and CPU2 Slot5 (Figure 6-12) (four U.2 form factor SSDs), as well as CPU1 M.2 C-1 and CPU1 M2. C-2 (two M.2 form factor SSDs)

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced

VMD Config for PStack0 Intel® VMD for Volume Management Device [Enable] CPU1 SLOT1 PCI-E 3.0 X8 VMD [Enable] Hot Plug Capable [Enable]

VMD Config for PStack1 Intel® VMD for Volume Management Device [Enable] CPU1 M.2 C-2 PCI-E 3.0 X4 VMD [Enable] CPU1 M.2 C-1 PCI-E 3.0 X4 VMD [Enable] CPU1 SLOT3 PCI-E 3.0 X8 VMD [Disable] Hot Plug Capable [Enable]

VMD Config for PStack2 Intel® VMD for Volume Management Device [Disable]

Figure 6-6. BIOS, Enabling CPU1 Example

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Advanced VMD Config for PStack0 Intel® VMD for Volume Management Device [Disable] VMD Config for PStack1 Intel® VMD for Volume Management Device [Enable] CPU2 SLOTS PCI-E 3.0 X16 VMD [Enable] Hot Plug Capable [Enable] VMD Config for PStack2 Intel® VMD for Volume Management Device [Disable] Enable/Disable Hot Plug for PCIe Root Ports 2A-2D Wu Dosek Power

Figure 6-7. BIOS, Enabling CPU2 Example

1. Press [F4] to save the configuration and reboot the system and press [DEL] to enter BIOS.

Note: Disabling the VMD controller without first deleting the associated existing RAID volume can lead to unexpected behavior. This action is strongly not recommended.

Note: The effects of physically changing or swapping a CPU on the VMD controller enablement has not yet been thoroughly tested or documented.

1. Switch to Advanced > Intel(R) Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume.
2. Set Name.

3. Set RAID Level.

4. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller.

Auto Setup Utility - Copyright (1) DOS American Markets, Inc. Advanced Create RAID Volume Name: RIO Level1 Volume0 INACIO(Drive) Enable RAID scanned over AMD Controller [3] Select Event: INTEL SODERISHIATT (SOPERTOSKAPPS) INTEL SODERISHIATT (SOPERTOSKAPPS) INTEL SODERISHIATT (SOPERTOSKAPPS) INTEL SODERISHIATT (SOPERTOSKAPPS) Strike Type: 110MB Capacity: 2476.43 * Create Volume x - To Select Data ←: Select Screen M1: Select New Enter Select +/- Change Rate, F1: General Hold P2: Previous Value P3: Untitled Defaults P4: Down & Exit ESC: Help

Figure 6-8. Created Volume without enabling RAID spanned over VMD controller

AutoCAD Utility - Copyright ©1 2000 American Regenetrol, Inc. Advanced Create AVBD Volume Name: AVBD Level: AVBD AVBD spanned over AVBD Controller Select Output: AVBD, AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBC AVBD, AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AGD Select Output: AVBD, AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBC EVBD, EVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBC EVBD, EVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBC EVBD, EVBD/AVBD/AVBD/AVBD/AVBD/AVBD/AVBC EVBD, EVBD/AVBD/AVBD/AVBD/AVBC EVBD, EVBD/AVBD/AVBC EVCD: Select Screen Ttl: Select Item Editor: Select A+/+ Change for F1: General Note F2: Typical Values F3: Optimal Defaults F4: Game & Exit F5: Exit Version 2.18.2000 Copyright ©1 2000 AMER Markets, Inc.

Figure 6-9. Created Volume with enabling RAID spanned over VMD controller

1. Select specific disks for RAID with an [X].

• RAID0: Select at least two [2 - 24] disks
• RAID1: Select only two disks
• RAID5: Select at least three [3 - 24] disks
• RAID10: Select only four disks

1. Select Strip Size (Default 64KB).
2. Select Create Volume.
3. If another RAID is needed, start again at step 9.
4. Press [F4] to save and reboot.

Related Information Links

[1] https://kb.vmware.com/s/article/2151404
[2] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-1B56EF97-F60E-4F21-82A7-8F2A7294604D.html
[3] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-F2E75F67-740B-4406-9F0C-A2D99A698F2A.html

Chapter 7

Troubleshooting and Support

7.1 Information Resources

Website

A great deal of information is available on the Supermicro website, supermicro.com.

SUPERMICRO Products Solutions Company News Support JumpStart Free Online Access to Cloud Infrastructure Total Solution Test and Validate Your Cloud Infrastructure Online and Deploy On-Prem With Up to 70% Cost Savings Start Now

Figure 7-1. Supermicro Website

• Specifications for servers and other hardware are available by clicking the Products option.
• The Support option offers downloads (manuals, BIOS/BMC, drivers, etc.), FAQs, RMA, warranty, and other service extensions.

Direct Links for the SYS-220TP-H Series System

Web specifications pages: SYS-220TP-HC8TR, SYS-220TP-HC9TR, and

X12DPT-PT6 motherboard page for links to the Quick Reference Guide, User Manual, validated storage drives, etc.

BPN-SAS3-217HQ3 Backplane Manual

AOC-S3808L-L8iT

AOC-S3908L-H8iR

Direct Links for General Support and Information

Frequently Asked Questions

TPM User Guide

General Memory Configuration Guide

Direct Links (continued)

BMC User Guide

SuperDoctor5 Large Deployment Guide

For validated memory, use our Product Resources page

Product Matrices page for links to tables summarizing specs for systems, motherboards, power supplies, riser cards, add-on cards, etc.

Security Center for recent security notices

Supermicro Phone and Addresses

7.2 BMC Interface

The system supports a Baseboard Management Controller (BMC) interface. It provides remote access, monitoring and management. There are several BIOS settings related to the BMC.

For general documentation and information on the BMC, please visit our website at: www.supermicro.com/manuals/other/BMC_Users_Guide_X12_H12.pdf.

Dashboard System Component Info Health Event Log Configuration + Remote Control Maintenance + Advanced Settings Filter x Sensor specific x Threshold x Genets x OEM x Unspecified Health Event Log Clear Health Event Log Export to Excel Severity > ★★ Data/Time Sensor Type Categories Description Event Type 2005-10-15 18:57:06 ACPowerOr [OEM] First AC Power on - Assertion Service specific 2005-10-15 18:56:03 System.NC [OEM] Dedicated LAN Link Up - Assertion Service specific 2005-10-15 17:41:07 ACPowerOr [OEM] First AG Power on - Assertion Service specific 2005-10-15 17:41:17 System.NC [OEM] Dedicated LAN Link Up - Assertion Service specific 2005-10-15 17:41:14 System.NC [OEM] Dedicated LAN Link Down - Assertion Service specific 2005-10-15 17:41:12 System.NC [OEM] Dedicated LAN Link Up - Assertion Service specific

Figure 7-2. BMC Dashboard Sample

7.3 Troubleshooting Procedures

Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures or Returning Merchandise for Service sections in this chapter. Power down the system before changing any non hot-swap hardware components.

General Technique

If you experience unstable operation or get no boot response, try:

1. With power off, remove all but one DIMM and other added components, such as add-on cards, from the motherboard. Make sure the motherboard is not shorted to the chassis.
2. Set all jumpers to their default positions.
3. Power up. If the system boots, check for memory errors and add-on card problems.

No Power

- Check that the power LED on the motherboard is on.

VGA UID-LED USB0/1 3.2 Gen 1 COM1 JUIDB1 FAN3 LEDM1 JIPMB1 JPTG1 JPAUX1 JPMIE2 BAR CODE LAN2 LAN1 LEDPWR SXB3 RT1 BMC LEDPWR LAN CTRL

Figure 7-3. Location of the MB Power LED

• Make sure that the power connector is connected to the power supply.
• Check that the motherboard battery still supplies approximately 3VDC. If it does not, replace it.
• Check that the system input voltage is 100-127Vac or 200-240Vac, 50-60Hz.
• Turn the power switch on and off to test the system

No Video

If the power is on but you have no video, remove all add-on cards and cables.

System Boot Failure

If the system does not display Power-On-Self-Test (POST) or does not respond after the power is turned on, try the following:

- Turn on the system with only one DIMM module installed. If the system boots, check for bad DIMM modules or slots by following the Memory Errors Troubleshooting procedure below.

Memory Errors

• Make sure that the DIMM modules are properly and fully installed.
• Confirm that you are using the correct memory. Also, it is recommended that you use the same memory type and speed for all DIMMs in the system. See Section 3.4 for memory details.
• Check for bad DIMM modules or slots by swapping modules between slots and noting the results.

Losing the System Setup Configuration

• Always replace power supplies with the exact same model that came with the system. A poor quality power supply may cause the system to lose the CMOS setup configuration.
• Check that the motherboard battery still supplies approximately 3VDC. If it does not, replace it.

If the above steps do not fix the setup configuration problem, contact your vendor for repairs.

When the System Becomes Unstable

If the system becomes unstable during or after OS installation, check the following:

• CPU/BIOS support: Make sure that your CPU is supported and that you have the latest BIOS installed in your system.
• Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility.

• Storage drives: Make sure that all drives work properly. Replace if necessary.

• System cooling: Check that all heatsink fans and system fans work properly. Check the hardware monitoring settings in the BMC to make sure that the CPU and system temperatures are within the normal range. Also check the Control panel Overheat LED.

• Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements.
• Proper software support: Make sure that the correct drivers are used.

If the system becomes unstable before or during OS installation, check the following:

• Source of installation: Make sure that the devices used for installation are working properly, including boot devices.
• Cable connection: Check to make sure that all cables are connected and working properly.
• Use the minimum configuration for troubleshooting: Remove all unnecessary components (starting with add-on cards first), and use the minimum configuration (but with a CPU and a memory module installed) to identify the trouble areas.

• Identify a bad component by isolating it. Check and change one component at a time.

• Remove a component in question from the chassis, and test it in isolation. Replace it if necessary.

• Or swap in a new component for the suspect one.
• Or install the possibly defective component into a known good system. If the new system works, the component is likely not the cause or the problem.

7.4 BIOS Error POST Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

The AMI BIOS supplies additional checkpoint codes, which are documented online at http://www.supermicro.com/support/manuals/ ("AMI BIOS POST Codes User's Guide").

When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20).

For information on AMI updates, please refer to http://www.ami.com/products/.

7.5 Crash Dump Using the BMC Dashboard

In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using the BMC Dashboard. The BMC manual is available at www.supermicro.com/manuals/other/BMC_Users_Guide_X12_H12.pdf.

Check Error Log

1. Access the BMC web interface.
2. Click the Server Health tab, then Event Log to verify an IERR error.

Dashboard System Component Info Health Event Log Configuration Remote Control Maintenance Advanced Settings Filter x Sensor-specific x Threshold x Generic x OEM x Unspecified Health Event Log Clear Health Event Log Expte to Excel Severity Date/Time Sensor Type Categories Description Event Type 2025-10-15 18:57:36 ACP/WorkOn [OEM] First AC Power on - Assertion Sensor-specific 2025-10-15 18:56:43 System NIC [OEM] Dedicated LAN Link Up - Assertion Sensor-specific 2025-10-15 17:41:37 ACP/WorkOn [OEM] First AC Power on - Assertion Sensor-specific 2025-10-15 17:41:17 System NIC [OEM] Dedicated LAN Link Up - Assertion Sensor-specific 2025-10-15 17:41:14 System NIC [OEM] Dedicated LAN Link Down - Assertion Sensor-specific 2025-10-15 17:41:12 System NIC [OEM] Dedicated LAN Link Up - Assertion Sensor-specific + + + / + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Figure 7-4. BMC Event Log

In the event of an IERR, the BMC executes a crash dump. You must download the crash dump and save it.

7.6 UEFI BIOS Recovery

Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you do update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.

Overview

The Unified Extensible Firmware Interface (UEFI) provides a software-based interface between the operating system and the platform firmware in the pre-boot environment. The UEFI specification supports an architecture-independent mechanism that will allow the UEFI OS loader stored in an add-on card to boot the system. The UEFI offers clean, hands-off management to a computer during system boot.

Recovering the UEFI BIOS Image

A UEFI BIOS flash chip consists of a recovery BIOS block and a main BIOS block (a main BIOS image). The recovery block contains critical BIOS codes, including memory detection and recovery codes for the user to flash a healthy BIOS image if the original main BIOS image is corrupted. When the system power is turned on, the recovery block codes execute first. Once this process is complete, the main BIOS code will continue with system initialization and the remaining POST (Power-On Self-Test) routines.

Note 1: Follow the BIOS recovery instructions below for BIOS recovery when the main BIOS block crashes.

Note 2: When the BIOS recovery block crashes, you will need to follow the procedures to make a Returned Merchandise Authorization (RMA) request. Also, you may use the Supermicro Update Manager (SUM) Out-of-Band (https://www.supermicro.com.tw/products/nfo/SMS_SUM.cfm) to reflash the BIOS.

Recovering the Main BIOS Block with a USB Device

This feature allows the user to recover the main BIOS image using a USB-attached device without additional utilities used. A USB flash device such as a USB Flash Drive, or a USB CD/DVD ROM/RW device can be used for this purpose. However, a USB Hard Disk drive cannot be used for BIOS recovery at this time.

The file system supported by the recovery block is FAT (including FAT12, FAT16, and FAT32) which is installed on a bootable or non-bootable USB-attached device. However, the BIOS might need several minutes to locate the SUPER.ROM file if the media size becomes too large due to the huge volumes of folders and files stored in the device.

To perform UEFI BIOS recovery using a USB-attached device, follow the instructions below.

1. Using a different machine, copy the "Super.ROM" binary image file into the Root "\" directory of a USB device or a writable CD/DVD.
   Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
   Note 2: Before recovering the main BIOS image, confirm that the "Super.ROM" binary image file you download is the same version or a close version meant for your motherboard.
2. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and reset the system when the following screen appears.
3. After locating the healthy BIOS binary image, the system will enter the BIOS Recovery menu as shown below.

SUPERIOR BMC IP:10.132.161.13 PEI--Could Not Find Recovery Image... 87

Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below.

Ratio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs Email Recovery Security Boot Save a Exit Please select blocks you want to update Reset: NVR6M [Enabled] Boot Block Update [Enabled] ► Proceed with flash update Set this option to reset NVR6M to default values +: Select Screen T4: Select Item Enter: Select +/-: Change Out. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1706. Copyright (C) 2017 American Megatrends, Inc.

1. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update" and press the key. You will see the BIOS recovery progress as shown in the screen below.

Note: Do not interrupt the BIOS flashing process until it has completed.

1. After the BIOS recovery process is complete, press any key to reboot the system.

2. Using a different system, extract the BIOS package into a USB flash drive.

Auto Setup Utility - Copyright (C) 2017 American Regatrends, Inc. Recovery WARNING System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF!!. Once firmware update is completed press any key to reboot the system Program new data Write new boot block... 17% +: Select Screen T4: Select Items Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.15.1266, Copyright (C) 2017 American Regatrends, Inc.

1. Press continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot

Ratio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recoverers WARNING: System firmware is being updated, Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed Press any key to reboot the system Flash update Flash update completed. Press any key to reset the system +: Select Screen F1: Select Item Enter: Select +/-: Change Opt. F3: General Help F5: Previous Values F8: Optimized Defaults F4: Save & Exit E8D: Exit Version 2.19, IDF6, Copyright (C) 2017 American Megatrends, Inc.

Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press to save the settings and exit the BIOS Setup utility.

1. When the UEFI Shell prompt appears, type fs# to change the device directory path. Go to the directory that contains the BIOS package you extracted earlier from Step 6. Enter flash.nsh BIOSname.### at the prompt to start the BIOS update process.

Auto Setup Utility - Copyright (CI) 2017 American Megatrends, Inc. Main Advanced Event Logs JPMS Security SCOTs Save & Exit Boot Configuration Boot mode select [DOBL] LEGACY to EPI Support [Disabled] EXP# BOOT INDEX Priorities Boot Option #3 [DEFI MP/DEFI: Max...] Boot Option #2 [DD/VVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CD/DVI] Boot Option #5 [USB Key[ScanDisk]] Boot Option #6 [USB Floppy] Boot Option #7 [USB Lan] Boot Option #8 [Network:JBA GE SI...] Boot Option #9 [DEFI Hard Disk] Boot Option #10 [DEFI CD/DVD] Boot Option #11 [DEFI USB Hard Disk] Boot Option #12 [DEFI USB CD/DVI] Boot Option #13 [DEFI USB Key:UEFI...] Boot Option #14 [DEFI USB Floppy] Boot Option #15 [DEFI USB Lan] Boot Option #16 [DEFI Network] Boot Option #17 [Halo Disk] Add New Boot Option Sets the system boot order +: Select Screen TI: Select Item Enter: Select +/-: Change Opt. F1: General) Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (CI) 2017 American Megatrends, Inc.

Note: Do not interrupt this process until the BIOS flashing is complete.

UEFI Interactive Shell v2.1 EDI: II UEFI v2.50 (American Regatrends, 0x00890XX) Mapping table: FS0: A106(0):H0D(0):BLK1; Ps:Root(0x0)/Pc(0x14,0x0)/USB(0x11,0x0)/M0II,MER,xG79B1P2,0x800,0x1 CRASSO BLK0: Rldo(s): Ps:Root(0x0)/Pc(0x14,0x0)/USB(0x11,0x0) Press FSS to 1 seconds to skills startup.moh or any other key to continue. Shell: fss FS0: CS FLOODS FS0:WPLOOS> CS SHAPHE2_03162012 FS0:WPLOOS\SHAPHE2_03162017\ flash.nsh X13F07.34_

1. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug

Done. [ Access Oxos Part Ex ] Index 0x51: 0x18 Done. ********************************************************************** * Program BIOS and ME (including DOT) regions... * ********************************************************************** APT Firmware Update Utility v5.09-01.1317 Copyright (C)2017 American Megatrends Inc. All Rights Reserved. OPUD = 50652 Reading Flash ....... none - HE Data Size checking . ok - PFS checksum ....... ok, - Check RowLayout ....... ok, Erasing Boot Black ....... none Updating Boot Black ....... none Varifying Boot Block ....... none Erasing Main Black ....... 0x00132000 (0x0)

the AC power cable in the power supply again to power on the system.

1. Press continuously to enter the BIOS Setup utility.

Verifying NCM Block ....... done - Update success for FOR - Update success for DS. - - Successful Update Recovery Loader to 0PRx!! - Successful Update MFS011- - Successful Update FFM11- - Successful Update WNS, DRL and T00211 - Successful Update F500 and UTOX11 - ME Entire Image update success || MAYWINE : System must power-off to have the changes take effect!! Moving FS01:AFU00S/SWPM2E_03162017/40X64.efi -> FS01:AFU00S/SWPM2E_03162017/f df,mc - [o] Moving FS01:AFU00S/SWPM2E_03162017/aufefix4.efi -> FS01:AFU00S/SWPM2E_0316201 Trafefi,mc - [o] ********************************************************************** * Please ignore this 'shell cannot read from file - device error' * Warning message due to it does not impact flashing process. ********************************************************************** * Deleting * Delete successful. FS01v2.

1. Press to load the default settings.
2. After loading the default settings, press to save the settings and exit the BIOS Setup utility.

7.7 CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the node completely.
2. Remove the node to access the motherboard.
3. Remove the onboard battery from the motherboard.
4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
5. Remove the screwdriver or shorting device.
6. Replace the cover, reconnect the power cords and power on the system.
   JBT1 contact pads

Notes: Clearing CMOS will also clear all passwords.

Do not use the PW_ON connector to clear CMOS.

7.8 BMC Reset

The BMC can be reset using the UID button.

• Reset – Press and hold the button. After six seconds, the LED blinks at 2Hz. The BMC resets and the reset duration is \~250 ms. Then the BMC starts to boot.
• Restore factory default configuration – Hold the button for twelve seconds. The LED blinks at 4Hz while defaults are configured. Note: All BMC settings including username and password will be removed except the FRU and network settings.

Firmware update – When the BMC firmware is being updated, the UID LED blinks at 10Hz.

BMC Reset Options
Event UID LED	BMC Heartbeat LED
Reset Blue, Blinks at 2Hz Green, solid
Restore Defaults	Blue, Blinks at 4Hz Off
Update Blue, Blinks at 10Hz

7.9 Where to Get Replacement Components

If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com. Click the "Where to Buy" tab.

7.10 Reporting an Issue

Technical Support Procedures

Before contacting Technical Support, please take the following steps. If your system was purchased through a distributor or reseller, please contact them for troubleshooting services. They have the best knowledge of your specific system configuration.

1. Please review the Troubleshooting Procedures in this manual and Frequently Asked Questions on our website before contacting Technical Support.
2. BIOS upgrades can be downloaded from our website. Note: Not all BIOS can be flashed depending on the modifications to the boot block code.

3. If you still cannot resolve the problem, include the following information when contacting us for technical support:

4. System, motherboard, and chassis model numbers and PCB revision number

5. BIOS release date/version (this can be seen on the initial display when your system first boots up)
6. System configuration

An example of a Technical Support form is posted on our website. Distributors: For immediate assistance, please have your account number ready when contacting our technical support department by email.

Returning Merchandise for Service

A receipt or copy of your invoice marked with the date of purchase is required before any warranty service will be rendered. You can obtain service by calling your vendor for a Returned Merchandise Authorization (RMA) number. When returning to the manufacturer, the RMA number should be prominently displayed on the outside of the shipping carton, and mailed prepaid or hand-carried. Shipping and handling charges will be applied for all orders that must be mailed when service is complete.

For faster service, RMA authorizations may be requested online (http://www.supermicro.com/support/rma/).

Whenever possible, repack the chassis in the original Supermicro carton, using the original packaging material. If these are no longer available, be sure to pack the chassis securely, using packaging material to surround the chassis so that it does not shift within the carton and become damaged during shipping.

This warranty only covers normal consumer use and does not cover damages incurred in shipping or from failure due to the alteration, misuse, abuse or improper maintenance of products.

During the warranty period, contact your distributor first for any product problems.

Vendor Support Filing System

For issues related to Intel, use the Intel IPS filing system:

https://www.intel.com/content/www/us/en/design/support/ips/training/welcome.html

For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative.

7.11 Feedback

Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. To provide feedback on our manuals, please email us at [e-mail].

7.12 Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

Appendix A

Standardized Warning Statements for AC Systems

About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

CAUTION: This unit has redundant power sources. Please disconnect all the power cords before servicing.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源裝置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

System Specifications

Processors

Dual 3rd Gen Intel Xeon Scalable processors in a P+ (LGA4189) socket with up to 28 cores and the thermal design power (TDP) of up to 185W

Chipset

Intel PCH C621A

BIOS

AMI BIOS; ACPI 3.0 or later, PCI firmware 4.0 support, BIOS rescue hot-key, SPI dual/quad speed support, RTC (Real Time Clock) wakeup, and SMBIOS 3.0 or later

Memory

(Per node) 16 DIMM slots, DDR4 RDIMM/LRDIMM or Intel Optane PMem 200 Series* (up to 4TB for DDR4, or up to 4TB of PMem and 2TB DDR4) Up to 3200MHz; size up to 256GB * Note: PMem 200 Series are supported on 3rd gen Intel Xeon Scalable Platinum, Gold and selected Silver processors.

Storage Drives

(Per node) Six 2.5" SATA/SAS drive bays Two M.2 SSDs with adapter

PCI Expansion Slots

(Per node) One PCIe 4.0 x16, low profile

Input/Output

(Per node) Two 10Gbase-T ports; one dedicated BMC LAN port Two USB 3.0 ports One VGA port BMC: Dedicated LAN port

Motherboard

(Per node) X12DPT-PT6; proprietary 6.8" (W) x 18.86" (L) (173 mm x 479 mm)

Chassis

CSE-217HQ+-R2K20BP4; 2U Rackmount, (WxHxD) 17.3" x 3.5" x 28.75" (438 x 88 x 730mm)

System Cooling

Four 8-cm heavy-duty PWS fans; (per node) two CPU heatsinks, one air shroud to direct air flow

Power Supply

Model: PWS-2K20A-1R, 2200W dual redundant modules, 80Plus Titanium level

AC Input

100-127 Vac, 50-60 Hz 200-240 Vac, 50-60 Hz

+12V

1200W, 100A (100 Vac–127 Vac) 2200W, 183.3A (200 Vac–240 Vac)

5V standby: 1A

Operating Environment

Operating Temperature: 10° to 35° C (50° to 95° F)

Non-operating Temperature: -40^ to 60^ C ( -40^ to 140^ F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

FCC, ICES, CE, UKCA, VCCI, RCM, NRTL, CB

Certified Safety Models

Compliant with UL or CSA: 217-22 / 217H-R22X12 / 217TWP-X12

Applied Directives, Standards

EMC/EMI: 2014/30/EU (EMC Directive) CLASS A

Electromagnetic Compatibility Regulations 2016

FCC Part 15 Subpart B

ICES-003

VCCI-CISPR 32

AS/NZS CISPR 32

BS/EN55032

BS/EN55035

CISPR 32

BS/EN 61000-3-2

BS/EN 61000-3-3

BS/EN 61000-4-2

BS/EN 61000-4-3

BS/EN 61000-4-4

BS/EN 61000-4-5

BS/EN 61000-4-6

BS/EN 61000-4-8

BS/EN 61000-4-11

Environment:

2011/65/EU (RoHS Directive)

EC 1907/2006 (REACH)

2012/19/EU (WEEE Directive)

California Proposition 65

Product Safety: 2014/35/EU (LVD Directive)

UL/CSA 62368-1 (USA and Canada)

Electrical Equipment (Safety) Regulations 2016

IEC/BS/EN 62368-1

Warning! This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate

限用物質含有情況標示聲明書
Declaration of the Presence Condition of the Restricted Substances Marking

設備名稱: 伺服器/ServerEquipment name型號(型式):217H-R22X12Type designation (Type)(系列型號:217-22,217TWP-X12,SYS-220TP-HC9TR,SYS-220TP-HC8TR,SYS-220TP-HTTR,827H-R22X12,827-22,827TWP-X12,SYS-620TP-HC9TR,SYS-620TP-HC8TR,SYS-620TP-HTTR)
單元Unit	限用物質及其化學符號 symbols
	鉛Lead(Pb)	汞Mercury(Ig)	鎘Cadmium(Cd)	六價鉻Hexavalent chromium( Cr^6 )	多溴聯苯Polybrominated biphenyls(PBB)	多溴二苯醚Polybrominated diphenyl ethers(PBDE)
機殼(Chassis)	○	○	○	○	○	○
機殼風扇(Chassis Fan)	-	○	○	○	○	○
線材(Cable)	○	○	○	○	○	○
主機板(Motherboard)	-	○	○	○	○	○
電源供應器(Power Supply)	-	○	○	○	○	○
電源背板(PDB)	-	○	○	○	○	○
硬碟(HDD)	-	○	○	○	○	○
附加卡(Add-on Card)	-	○	○	○	○	○
備考1:“超出0.01 wt%”及“超出0.01 wt%”係指限用物質之百分比含量超出百分比含量基準值。Note 2:“○”indicates that the percentage content of the restricted substance does not exceed the percentage of reference value of presence.備考2.“○”係指該項限用物質之百分比含量未超出百分比含量基準值。Note 3:The “-” indicates that the restricted substance corresponds to the exemption.備考3.“-”係指該項限用物質為排除項目。

警告使用者：