SuperServer SYS-440P-TNRT - Server Supermicro - Free user manual and instructions

USER MANUAL SuperServer SYS-440P-TNRT Supermicro

Front view of a server rack unit with black mesh ventilation grilles and red drive bays (no visible text or labels)

USER'S MANUAL

Revision 1.0

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A or Class B digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in industrial environment for Class A device or in residential environment for Class B device. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.0

Release Date: February 21, 2023

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2023 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the server. Installation and maintenance should be performed by experienced technicians only.

Please refer to the SYS-440P-TNRT server specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: https://www.supermicro.com/wdl/driver
• Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at:

[e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Secure Data Deletion

A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/Lot9_Secure_Data_Deletion_Utility/

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Contacting Supermicro....8

Chapter 1 Introduction

1.1 Overview....9
1.2 System Features ....10

Front View....10

Drive Carrier Indicators....11

Control Panel....12

Rear View....13

1.3 System Architecture ....16

Main Components....16

System Block Diagram....17

1.4 Motherboard Layout....18

Quick Reference Table....19

Chapter 2 Server Installation

2.1 Overview....21
2.2 Unpacking the System 21
2.3 Preparing for Setup....21

Choosing a Setup Location....21
Rack Precautions....22
Server Precautions....22
Rack Mounting Considerations....22

Ambient Operating Temperature....22
Airflow 23
Mechanical Loading....23
Circuit Overloading....23
Reliable Ground....23

2.4 Procedure for Rack Mounting ....24

Identifying the Inner Rack Rails....24
Installing the Inner Rails on the Chassis....25
Installing the Outer Rails onto the Rack....26
Installing the Chassis into a Rack....27

Removing the Chassis from the Rack....28

Chapter 3 Maintenance and Component Installation

3.1 Powering Down the System ....29

3.2 Accessing the System....30

Removing the Top Cover....30

3.3 Static-Sensitive Devices....31

Precautions ....31

3.4 Processor and Heatsink Installation....32

The Processor Carrier Assembly....33

The Processor Heatsink Module (PHM)....35

Preparing the CPU Socket for Installation....36

Installing the PHM into the CPU Socket....37

Removing the PHM from the CPU Socket ....39

Removing the Processor Carrier Assembly from the PHM 40

Removing the Processor from the Processor Carrier Assembly 41

3.5 Memory....42

Memory Support....42

Memory Installation Sequence....42

General Memory Population Requirements....42

DDR4 Memory Population Table 43

Memory Population Sequence for Half Memory Configuration....43

Memory Population Table with Full Memory Configuration....43

Intel® Optane™ PMem 200 Series Memory Population (Full Configuration)....43

DIMM Installation 45

DIMM Removal 45

3.6 Motherboard Battery....46

3.7 Storage Drives....47

Installing Drives....47

Installing M.2 Solid State Drives....49

Installing M.2 Drives ....49

3.8 System Cooling ....50

Fans 50

Air Shrouds 51

3.9 Expansion Cards....53

Installing Expansion Cards....53

3.10 Power Supply....54
3.11 BMC ....55

Chapter 4 Motherboard Connections

4.1 Power Connections ....56
4.2 Headers and Connectors ....57

Control Panel....59

4.3 Input/Output Ports 62
Rear I/O Ports....62
4.4 Jumpers....64
4.5 LED Indicators....67
4.6 Storage Ports 69

Chapter 5 Software

5.1 Microsoft Windows OS Installation....70
5.2 Driver Installation....72
5.3 SuperDoctor® 5....73
5.4 BMC....74

BMC ADMIN User Password 74

Chapter 6 Optional Components

6.1 Optional Parts List....75
6.2 Storage Control Cards ....76
6.3 Network Cards....76
6.4 Intel Virtual RAID on CPU (VROC)....77

Requirements and Restrictions....77

Supported SSDs and Operating Systems 77

Additional Information ....78

Hardware Key 78

Chapter 7 Troubleshooting and Support

7.1 Information Resources....79

Website 79

Direct Links for the SYS-440P-TNRT System....79

Direct Links for General Support and Information ....79

7.2 Baseboard Management Controller Interface....80

7.3 Troubleshooting Procedures ....81

General Technique....81

No Power 81

No Video 82

System Boot Failure 82

Memory Errors 82

Losing the System's Setup Configuration....82

When the System Becomes Unstable 83

7.4 BIOS Error Beep (POST) Codes 85

Additional BIOS POST Codes ....85

7.5 Crash Dump Using BMC....86

7.6 UEFI BIOS Recovery ....87

Overview 87

Recovering the UEFI BIOS Image....87

Recovering the Main BIOS Block with a USB Device....87

7.7 CMOS Clear....92

7.8 Where to Get Replacement Components....93

7.9 Reporting an Issue....93

Technical Support Procedures....93

Returning Merchandise for Service....93

Vendor Support Filing System 94

7.10 Feedback....94

7.11 Contacting Supermicro....95

Appendix A Standardized Warning Statements for AC Systems Appendix B System Specifications

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Sales Inquiries)

[e-mail] (Gov. Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

[e-mail] (Webmaster)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail] (Sales Inquiries)

[e-mail] (Technical Support)

[e-mail] (RMA Support)

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides a brief outline of the functions and features of the SuperServer SYS-440P-TNRT. It is based on the X12QCH+-P motherboard and the CSE-418HTS-R3K3AWP chassis.

The following provides an overview of the specifications and capabilities.

System Overview
Motherboard	X12QCH+-P
Chassis	CSE-418HTS-R3K3AWP
Processor Support	3rd Generation Intel® Xeon® Scalable processors
Memory*	48 DIMM slots for up to 12TB 3DS ECC DDR4-3200:RDIMM/LRDIMM or 18TB Intel® OptaneTM DDR4-3200:DCPMM, RDIMM/LRDIMM//DCPMM
Drive Support	24 hot-swap 2.5" SAS3/SATA3 drive baysTwo M.2 SATA/NVMeOptional: 48 hot-swap 2.5" drives (please contact Sales)
Expansion Slots	Up to 18 PCIe 3.0 slots: two x16 slots, sixteen x8 slots or eight x16 slot plus four x8 slotsSupport up to six double-width GPUs (GPU info shown in OS only, not via IPMI)
I/O Ports	Two 10G BaseT with Intel® X710-TM4Two 10G SFP+ with Intel X710-TM4(Optional): AIOM up to 100G QSFP 28One BMC portOne VGA portOne serial (COM) portTwo rear USB 3.0 portsOne USB 3.0 Type A header
System Cooling	Eight 9-cm heavy duty fans
Power	Four redundant power supply modules1600W (Platinum Level)
Form Factor	4U H x W x D: 6.96" x 17.3" x 29.68" (177 x 440.9 x 754.10mm)

Notes: A Quick Reference Guide can be found on the product page of the Supermicro website.

The following safety models associated with the SYS-440P-TNRT have been certified as compliant with BSMI, UL, or CSA: 418H-Q16X12, 418H-16.

1.2 System Features

The following views of the system display the main features. Refer to Appendix B for additional specifications.

Front View

Control Panel 0 7 0 1 0 18 19 23 SUPERMICR

Figure 1-1. Front View

Logical Storage Drive Numbers
Item Description
0_7	Default - Eight 2.5" hot-swap SATA3 HDD/SSD
0118	Four 2.5" hot-swap NVMe* via optional CBL-SAST-1306LPL-85 and CBL-SAST-1267FLP-85 cables
0_23	24 2.5" hot-swap SAS3/SATA3 via optional RAID controller and cables

*For more NVMe support, please contact Supermicro your sales rep.

Drive Carrier Indicators

Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare. For VROC configurations, refer to the VROC appendix in this manual.

Drive Carrier LED Indicators
	Color Blinking Pattern Behavior for Device
Activity LED	Blue Solid On Idle SAS/NVMe drive installed
	Blue Blinking I/O activity
	Off Idle SATA drive
Status LED	Red Solid On Failure of drive with RSTe support
	Red Blinking at 1 Hz Rebuild drive with RSTe support
	Red Blinking with two blinks and one stop at 1 Hz		Hot spare for drive with RSTe support
	Red On for five seconds, then off		Power on for drive with RSTe support
	Red Blinking at 4 Hz Identify drive with RSTe support

Control Panel

Power Button UID Button/LED, BMC Reset UID Power LED HDD NIC (LAN1) LED NIC (LAN2) LED Information LED Power Fail LED

Figure 1-2. Control Panel

Control Panel Features
Feature Description
Power button	The main power switch applies or removes primary power from the power supply to the server but maintains standby power.
UID button/LED BMC button	The unit identification (UID) button turns on or off the blue light function of the Information LED and a blue LED on the rear of the chassis.This button can also be used to reset the BMC. See Chapter 3.
Power LED	Indicates power is being supplied to the system power supply units. This LED is illuminated when the system is operating normally.
HDD Indicates activity on the storage drives when flashing.
NIC (LAN1) LED	Indicates network activity on LAN1 when flashing.
NIC (LAN2) LED	Indicates network activity on LAN2 when flashing.
Power Fail LED	Indicates a power supply module has failed.
Information LED	Alerts operator to several states, as noted in the table below.

Information LED
Status Description
Continuously on and red	An overheat condition has occurred. (This may be caused by cable congestion.)
Blinking red (1Hz) Fan failure, check for an inoperative fan.
Blinking red (0.25Hz)	Power failure, check for a non-operational power supply.
Solid blue	UID has been activated locally to locate the server in a rack environment.
Blinking blue	UID has been activated using the BMC to locate the server in a rack environment.

Rear View

IPMI LAN Port 10G SFP+ Ports 18 17 16 15 14 13 12 11 10 9 8 7 PWS1 PWS2 2 M.2 SATA3 AIOM x16 Slot VGA Port Serial Port USB Ports 10GBaseT LAN Ports 1 3 2 1 PWS3 PWS4 CPU1 CPU2 CPU3 CPU4

Figure 1-3. System: Rear View

System Features: Rear
Feature Description
PWS1-4 Four (redundant) 1600W power supply modules
VGA Port Video port
USB Two USB 3.0 ports
COM Port Serial port
IPMI LAN Port Dedicated IPMI LAN port
Ethernet Ports Two 10GBaseT Ethernet ports (see Section 1.1 for details)
LAN Ports Two 10G SFP+ ports

PCIe Slot Configuration
Slot Number Slot Name Slot	Description
1 4	PCIe slot 1, 4 PCIe Gen3 x16, FHHL
8 10 12 14 16 18	PCIe slot 8, 10, 12, 14, 16, 18 PCIe Gen3 x16, FHFL
2 3 5 6	PCIe slot 2, 3, 5, 6 PCIe Gen3 x8 in x16 slot, FHHL
7 9 11 13 15 17	PCIe slot 7, 9, 11, 13, 15, 17 PCIe Gen3 x8, FHFL

Expansion Slot Location
Slot	Mech-anical	Electrical			Associated Riser Card
		Option 1 Option 2 Option 3
1	FHHL	x16 (CPU1) x16 (CPU1) x16 (CPU1)			RSC-D2-668G4
2	FHHL	x8 (CPU1, in x16 slot)	NA	x8 (CPU1, in x16 slot)
3	FHHL	x8 (CPU1, in x16 slot)	x8 (CPU1, in x16 slot)	x8 (CPU1, in x16 slot)
4 FHHL x16 (CPU2) x16 (CPU2) x16 (CPU2)					RSC-D2R-668G4
5	FHHL	x8 (CPU2, in x16 slot)	x8 (CPU2, in x16 slot)	x8 (CPU2, in x16 slot)
6	FHHL	x8 (CPU2, in x16 slot)	x8 (CPU2, in x16 slot)	x8 (CPU2, in x16 slot)
7 FHFL NA NA x8 (CPU4)					RSC-H2-68G4
8	FHFL	x16 (CPU4) for DW GPU	x16 (CPU4) for DW GPU	x8 (CPU4, in x16 slot)
9 FHFL NA NA x8 (CPU3)					RSC-H2-68G4
10 FHFL x16 (CPU4) for DW GPU x16 (CPU4) for DW GPU x8 (CPU4, in x16 slot)
11	FHFL NA NA x8 (CPU3)				RSC-H2-68G4
12 FHFL x8 (CPU3 ,in x16 slot) x8 (CPU3, in x16 slot) x8 (CPU3, in x16 slot)
13 FHFL x8 (CPU4) x8 (CPU4) x8 (CPU4)					RSC-H2-68G4
14 FHFL x8 (CPU4, in x16 slot) x8 (CPU4, in x16 slot) x8 (CPU4, in x16 slot)
15 FHFL NA NA x8 (CPU3)					RSC-H2-68G4
16 FHFL x16 (CPU3) for DW GPU x16 (CPU3) for DW GPU x8 (CPU3 ,in x16 slot)
17 FHFL NA NA x8 (CPU3)					RSC-H2-68G4
18 FHFL x16 (CPU3) for DW GPU x16 (CPU3) for DW GPU x8 (CPU3 ,in x16 slot)

Notes: FHFL = full height, full length. FHHL = full height, half length. HHHL = half height, half length.
Full height = 4.2", low profile = 2.5", full length = 10.5", half length = 6.6"

Power Supply Indicators
Power Supply Condition Green LED	Amber LED
No AC Power to Power Supply OFF OFF
Power Supply critical events causing a shutdown/ failure/ OCP/ OVP/ Fan Fail/ OTP/ UVP	OFF Amber LED
Power Supply Warning Events Where the power supply continues to operate; High temperature; Over voltage; under voltage, etc	OFF 1Hz Blink Amber
AC present only 12vsb on (PS off) 1Hz Blink	Green OFF
Output ON and OK Green OFF
AC cord unplugged and in redundant mode	OFF Amber

1.3 System Architecture

This section covers the locations of the system electrical components, a system block diagram, and a motherboard layout with the connectors and jumpers called out.

Main Components

1600W redundant power supplies with PMBus REAR Heavy duty fans w/ optimal fan speed control Quad Socket P+ 3rd Generation Intel® Xeon® Scalable Processors DIMM Slots

Figure 1-4. Main Component Locations

System Features: Top
Feature Description
Power Supplies Four (redundant) power supply modules
DIMM slots 48 memory module slots
Processors Quad Socket P+ 3rd Generation Intel® Xeon® Scalable processors
System fans Eight 9-cm heavy duty fans

System Block Diagram

The block diagram below shows the connections and relationships between the subsystems and major components of the overall system.

graph TD
    subgraph SLOT1_LUIO_Riser
        A["Ethernet X710-TM4"] --> B["CPU1 SKT P5 (4186 pins; CPX6)"]
        C["SLOT2 RUIO-Riser"] --> D["CPU2 SKT P5 (4180 pins; CPX0)"]
        E["SLOT3 AIOM"] --> F["CPU3 SKT P5 (4180 pins; CPX6)"]
    end

    subgraph SLOT1_Riser
        G["DDR4 DIMM X2"] --> H["CPU1"]
        I["DDR4 DIMM X2"] --> J["CPU2"]
        K["DDR4 DIMM X2"] --> L["CPU3"]
    end

    subgraph SLOT2_Riser
        M["DDR4 DIMM X2"] --> N["CPU2"]
        O["DDR4 DIMM X2"] --> P["CPU3"]
    end

    subgraph SLOT3_AIOM
        Q["DDR4 DIMM X2"] --> R["CPU3"]
    end

    A --> G
    A --> H
    A --> J
    A --> L
    A --> M
    C --> N
    C --> P
    C --> R
    C --> S
    D --> N
    D --> P
    D --> R
    D --> S
    E --> N
    E --> P
    E --> R
    E --> S
    F --> N
    F --> P
    F --> R
    F --> S
    G --> H
    G --> J
    G --> L
    G --> M
    H --> N
    H --> P
    H --> R
    H --> S
    I --> N
    I --> P
    I --> R
    I --> S
    J --> N
    J --> P
    J --> R
    J --> S
    K --> N
    K --> P
    K --> L
    K --> M
    L --> N
    L --> P
    L --> R
    L --> S
    M --> N
    M --> P
    M --> R
    M --> S
    N --> O
    N --> P
    N --> Q
    N --> R
    O --> P
    P --> Q
    P --> R
    Q --> R

Figure 1-5. System Block Diagram

1.4 Motherboard Layout

Below is a layout of the X12QCH+-P motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.

LEDT1 JWD1 BMC_HB_LED1 JPTG1 PCIE M.2 FAN12 J5 JPME2 P1_PCIE2A P1_HIO_L1PCIE3.0x16 P1_PCIE2B I-SATA4~7 I-SATA0~3 S-SATA0~3 JBT1 USB2 (3.0) P1_PCIE3B PDB_I2C1 J47 LED2 JF1 IPMB GPU_PWR2 GPU_PWR1 BP_PWR1 J58 FP1 FP2 Battery P4_PCIE2A P4_PCIE2B P4_PCIE1A P4_PCIE1B P4_PCIE3A P4_PCIE3B JL1 FAN4 FAN8 FAN7 FAN3 FAN6 FAN2 FAN1 FAN5 SUPER X12QCH+ RDV 1.01 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CPU25 CPU26 CPU27 CPU28 CPU29 CPU30 CPU31 CPU32 CPU33 CPU34 CPU35 CPU36 CPU37 CPU38 CPU39 CPU40 CPU41 CPU42 CPU43 CPU44 CPU45 CPU46 CPU47 CPU48 CPU49 CPU50 CPU51 CPU52 CPU53 CPU54 CPU55 CPU56 CPU57 CPU58 CPU59 CPU60 CPU61 CPU62 CPU63 CPU64 CPU65 CPU66 CPU67 CPU68 CPU69 CPU70 CPU71 CPU72 CPU73 CPU74 CPU75 CPU76 CPU77 CPU78 CPU79 CPU80 CPU81 CPU82 CPU83 CPU84 CPU85 CPU86 CPU87 CPU88 CPU89 CPU90 CPU91 CPU92 CPU93 CPU94 CPU95 CPU96 CPU97 CPU98 CPU99 CPU100

Figure 1-6. Motherboard Layout

Quick Reference Table

Jumper Description Default Setting

J34 Power-Failure Throttling Enable Pins 1-2 (Normal)

J58 Select Switch for FP1_Reset Button or UID Button Closed (UID)

JBT1 Clear CMOS Open (Normal)

JPME2 Manufacturing Mode (ME) Select Pins 1-2 (Normal)

JPTG1 10G LAN Enable/Disable Pins 1-2 (Enabled)

JWD1 Watch Dog Timer Enable Pins 1-2 (Reset to System)

LED Description Status

BMC_HB_LED1	BMC Heartbeat LED	Blinking Green: BMC Normal
LED1	Unit Identifier (UID) LED	Solid Blue: Unit Identified
LED2	Onboard Power LED	Solid Green: Power On
LEDT1	10G LAN Activity LED	Green: LAN4: Active
LEDT2	10G LAN Activity LED	Green: LAN3: Active

Connector	Description
AIOM1 (J46)	PCIe 3.0 x8 AIOM (Advanced I/O Module) slot
Battery (JBAT1)	Onboard CMOS battery
COM1 (JCOM1)	Rear I/O COM port
FAN1 - FAN12	System cooling fan headers
FP1	Front Control Panel header with I^2C
FP2	Front Control Panel header with USB and VGA support
IPMB (JIPMB1)	4-pin BMC External I^2C header (for an BMC-supported card)
BMC_LAN (JUSBRJ45)	Dedicated BMC LAN port
J5/J6	6-pin power connector used for PCIe 3.0 x16 HIO left side slot (P1_HIO_L1PCIE) (J5)/power connector for right side slot (P2_HIO_R1PCIE) (J6)
J26/J47	PDB (Power Delivery Board) cable connector for CPU3 (J47)/PDB cable connector for CPU4 (J26)
JF1	Front Control Panel header
JL1	Chassis Intrusion header
BP_PWR1/2/3	8-pin power connectors 1/2/3 used for backplane devices
GPU_PWR1/2/3/4	8-pin power connectors 1/2/3/4 for GPU use
JSTBY1	5V standby power header
JTPM1	Trusted Platform Module/Port 80 connector
LAN1, LAN2 (JLAN1, JLAN2)	Ethernet (RJ45) 10G LAN Port1/10G LAN Port2
LAN3, LAN4 (JLAN3, JLAN4)	10G LAN Port3/10G LAN Port4 (w/SFP28 support)
P2_AIOM PCIE 3.0 x16 Slot (J7)	PCIe 3.0 x16 AIOM slot supported by CPU2 (J7)
P1_HIO_L1PCIE/P2_HIO_R1PCIE	PCIe 3.0 x16 HIO (High_Speed I/O) left_side slot supported by CPU1/PCIe 3.0 x16 HIO right_side slot supported by CPU2
P1_PCIE2A/P1_PCIE2B (J50/J51)	SMCIproprietary PCIe 3.0 x8 slots supported by CPU1
P2_PCIE3A/P1_PCIE3B (J52/J53)	SMCIproprietary PCIe 3.0 x8 slots supported by CPU2
P1_PCIE3B/P2_PCIE2A (J43/J44)	PCIe 3.0 x8 slots supported by CPU1 (J43) & CPU2 (J44)

P3-PCIE1A/1B/2A/2B/3A/3B PCIe 3.0 x8 slots supported by CPU3 (J19/J18/J21/J20/J17/J16)

P4-PCIE1A/1B/2A/2B/3A/3B PCIe 3.0 x8 slots supported by CPU4 (J12/J13/J10/J11/J14/J15)

PDB_I2C1/PDB_I2C2 (PSU1/PSU2) PDB (Power Delivery Board) I²C1 (PSU1)/PDB I²C2 (PSU2)

PCIE M.2 PCIe 3.0 x4 M.2 slot (with 2280 and 22110 support)

(I-)SATA 0-3, (I-)SATA 4-7 Intel® PCH SATA 3.0 connectors 0-3, 4-7 (with RAID 0, 1, 5, 10)

(S-)SATA 0-3 S-SATA 3.0 Connector 0-3 (supported by Intel PCH)

(M.2-HC) S-SATA 4/5 (JMD1/JMD2) PCIe 3.0 x4 M.2 slots for NVMe/SATA SSDs (with support of M-Key 2280, and 22110 via SlimSAS x8 cables)

UID (JUIDB1) Unit Identifier (UID) button

USB0/1 (3.0) (JUSBRJ45) Rear I/O USB 3.0 ports 0/1

USB2 (3.0) (JUSB1) Internal Type A USB 3.0 header

VGA (JVGA1) Rear VGA port on the I/O backpanel

VROC (JRK1) Intel VROC key header for NVMe RAID support

Chapter 2

Server Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Unpacking the System

Inspect the box in which the SYS-440P-TNRT was shipped, and note if it was damaged in any way. If any equipment appears damaged, file a damage claim with the carrier who delivered it. Decide on a suitable location for the rack unit that will hold the server. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. It will also require a grounded AC power outlet nearby. Be sure to read the precautions and considerations noted in Appendix A.

2.3 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).

- This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time - extending two or more simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Appendix A.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the servers closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.
• Slide rail mounted equipment is not to be used as a shelf or a work space.

Slide rail mounted equipment is not to be used as a shelf or a work space.

Warning: do not pick up the server with the front handles. They are designed to pull the system from a rack only.

2.4 Procedure for Rack Mounting

This section provides information on installing a 4U chassis into a rack unit with the rails provided. There are a variety of rack units on the market, so the assembly procedure may differ slightly. Also refer to the installation instructions for your rack unit.

Note: This rail will fit a rack between 26.5"and 36.4" deep.

Identifying the Inner Rack Rails

The chassis package includes one pair of rack rail assemblies in the rack mounting kit. Each assembly consists of an inner rail that secures to the chassis and an outer rail that is attached directly to the rack. The inner rails are etched with "L" (Left side) and "R" (Right side).

Inner Rail Assembly

Figure 2-1. Identifying the Rack Rails

Note: The figure above is for illustrative purposes only. Always install servers at the bottom of the rack first.

Technical diagram of a server rack with labeled components and directional arrows indicating assembly or movement.

Figure 2-2. Installing the Inner Rails

Warning: do not pick up the server with the front handles. They are designed to pull the system from a rack only.

Installing the Inner Rails on the Chassis

Installing the Inner Rails

1. Identify the left and right side inner rails. Place the correct inner rail on the side of the chassis, aligning the hooks of the chassis with the inner rail holes. Make sure the rail faces "outward" so that it will fit with the rack's mounting bracket.
2. Slide the rail toward the front of the chassis to hook the inner rail onto the side of the chassis.
3. If desired, secure the rail with two flat head M4 x 4mm screws as illustrated.
4. Repeat for the other inner rail.

Installing the Outer Rails onto the Rack

Installing the Outer Rails

1. Press upward on the locking tab at the rear end of the middle rail.
2. Push the middle rail back into the outer rail.
3. Hang the hooks on the front of the outer rail onto the square holes on the front of the rack. If desired, use screws to secure the outer rails to the rack.
4. Pull out the rear of the outer rail, adjusting the length until it just fits within the posts of the rack.
5. Hang the hooks of the rear section of the outer rail onto the square holes on the rear of the rack. Take care that the proper holes are used so the rails are level. If desired, use screws to secure the rear of the outer rail to the rear of the rack.
6. Repeat for the other outer rail.

Technical diagram illustrating four different mechanical assembly configurations with labeled parts and directional arrows.

Figure 2-3. Extending and Mounting the Outer Rails

Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

Technical diagram of a server rack with labeled components A and B, showing mounting hardware and structural supports.

Figure 2-4. Installing the Chassis into a Rack

Note: Figures are for illustrative purposes only. Always install servers into racks in the lower positions first.

Installing the Chassis into a Rack

Installing the Chassis into a Rack:

1. Align the chassis rails (A) with the front of the rack rails (B).
2. Slide the chassis rails into the rack rails, keeping the pressure even on both sides. You may have to depress the locking tabs while inserting. When the server has been pushed completely into the rack, the locking tabs should "click" into the locked position.
3. If screws are used, tighten the screws on the front and rear of the outer rails.
4. (Optional) Insert and tightening the thumbscrews that hold the front of the server to the rack.

Removing the Chassis from the Rack

Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack. Use a lift.

Technical line drawing of a server rack unit with mounting holes and internal components (no text or symbols)

Figure 2-5. Removing the Chassis From the Rack

Removing the Chassis from the Rack

1. Pull the chassis forward out the front of the rack until it stops.
2. Press the release latches on each of the inner rails downward simultaneously and move the chassis forward in the rack.

Note: The figure above is for illustrative purposes only. Always install servers at the bottom of the rack first.

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components require that power first be removed from the system. Please follow the procedures given in each section.

3.1 Powering Down the System

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non hot-swap components.

1. Use the operating system to power down the system.
2. After the system has completely shut down, disconnect the AC power cord(s) from the power strip or outlet and remove the AC power cords from all power supply modules.
3. Disconnect the power cord(s) from the power supply module(s).
4. When performing service on non hot-swap components, remove the system from the rack and place it on a bench or desk. Do not service with the system extended from the rack.

3.2 Accessing the System

The CSE-418HTS chassis features a removable top cover, which allows easy access to the inside of the chassis.

Removing the Top Cover

1. Remove the two screws at the front of the top cover.
2. Press the two release buttons and slide the cover toward the rear.
3. Lift the top cover up.

Check that all ventilation openings on the top cover and the top of the chassis are clear and unobstructed.

Caution: Except for short periods of time, do not operate the server without the cover in place. The chassis cover must be in place to allow for proper airflow and to prevent overheating.

Release Buttons

Figure 3-1. Removing the Chassis Cover

3.3 Static-Sensitive Devices

Electrostatic Discharge (ESD) can damage electronic components. To avoid damaging your motherboard, it is important to handle it very carefully. The following measures are generally sufficient to protect the system PCBs from ESD.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing any PCB (printed circuit board) from its antistatic bag.
• Handle PCBs by their edges only; do not touch its components, peripheral chips, memory modules or gold contacts.
• When handling chips or modules, avoid touching their pins.
• Put the PCBs back into their antistatic bags when not in use.
• Use only the correct type of onboard CMOS battery. Do not install the onboard battery upside down to avoid possible explosion.

3.4 Processor and Heatsink Installation

The processor (CPU) must first be attached to the processor carrier to form the processor carrier assembly. This assembly gets attached to the heatsink to form the processor heatsink module (PHM), which is then installed into the CPU socket. Before installing, be sure to perform the steps below:

• Please carefully follow the instructions given on ESD precautions.
  • After shutting down the system, unplug the AC power cords from all power supplies.
• Check that the plastic protective cover is on the CPU socket and that none of the socket pins are bent. If they are, contact your retailer.
• When handling the processor, avoid touching or placing direct pressure on the LGA lands (gold contacts). Improper installation or socket misalignment can cause serious damage to the processor or the socket, and may require manufacturer repairs.
  • Thermal grease is pre-applied on new heatsinks. No additional thermal grease is needed.
  • Refer to the Supermicro website for updates on processor and memory support.
• All graphics in this manual are for illustration only. Your components may look different.

The Processor Carrier Assembly

The processor carrier assembly is comprised of the processor and the processor carrier.

To create the processor carrier assembly, please follow the steps below:

Note: Before installation, be sure to review the Static-Sensitive Devices section earlier in this chapter.

1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below. These triangles indicate the location of pin 1.

2. Turn the processor over (with the gold pins up). Locate the CPU keys on the processor and the four latches on the carrier as shown below.

(with Processor Seated inside the Carrier)

1. Locate the lever on the carrier and press it down as shown below.

Lever

1. Using pin 1 as a guide, carefully align the CPU keys on the processor (A & B) with those on the carrier (a & b) as shown below.

CPU Key (on the processor) CPU Key (on the carrier) Latch 1 2 a Latch CPU Key (on the processor) CPU Key (on the carrier)

1. Once aligned, carefully place one end of the processor under latch 1 on the carrier, and then press the other end down until it snaps into latch 2.

2. After the processor is placed inside the carrier, examine the four sides of the processor, making sure that the processor is properly seated on the carrier.

Processor Carrier Assembly (Top Side View) Processor Carrier Assembly

The Processor Heatsink Module (PHM)

After creating the processor carrier assembly, follow the instructions below to mount the heatsink onto the carrier assembly to form the processor heatsink module (PHM).

Note: If this is a new heatsink, the thermal grease has been pre-applied. Otherwise, apply the proper amount of thermal grease to the underside of the heatsink.

1. Turn the heatsink over with the thermal grease facing up. Pay attention to the two triangle cutouts (A, B) located at the diagonal corners of the heatsink as shown in the drawing below.

2. Hold the processor carrier assembly upside-down to locate the triangles on the processor and the carrier, which indicate pin 1.

3. Turn the processor carrier assembly over so that the gold pins are facing up. Locate the two pin 1 locations ("A on the processor and "a" on the processor carrier assembly).

4. Align "a" on the processor carrier assembly with the triangular cutout "A" on the heatsink along with "b", "c", "d" on the processor assembly with "B", "C", "D" on the heatsink.

5. Once properly aligned, place the heatsink on the processor carrier assembly with all corners matched up, making sure that the four clips are properly securing the heatsink.

Processor Carrier Assembly Pin1 a b c D A B C Heatsink

Preparing the CPU Socket for Installation

The CPU socket comes with a plastic protective cover, which needs to be removed before installing the Processor Heatsink Module (PHM). Do this by gently squeezing the grip tabs then pulling the cover off.

CPU Socket with Plastic Protective Cover Grip Tab

Installing the PHM into the CPU Socket

After assembling the Processor Heatsink Module (PHM), you are ready to install it into the CPU socket.

1. Locate four threaded fasteners (a, b, c, d) on the CPU socket.

CPU Socket Threaded Fastener (a, b, c, d: Threaded Fasteners) CPU Socket Pin1

1. Locate four peek nuts (A, B. C. D) and four rotating wires (1, 2, 3, 4) on the heatsink as shown below.

Heatsink A, B, C, D: Peek Nut 1, 2, 3, 4: Rotating Wire a, b, c, d: Threaded Fastener Rotating Wire 4 Rotating Wire 3 Rotating Wire 1 Peek Nut CPU Socket d a Threaded Fastener Rotating Wire Peek Nut (Unlatched) (latched)

1. Check the rotating wires (1, 2, 3, 4) to make sure that they are in the unlatched position as shown.

Unlatched State Rotating Wire Side View Peak Nut Top View

1. Align peek nut "A" (next to the triangular pin 1 on the heatsink) with threaded fastener "a" on the CPU socket. Then align peek nuts "B", "C", "D" on the heatsink with threaded fasteners "b", "c", "d" on the CPU socket, making sure that all peek nuts and threaded fasteners are properly aligned.

2. Once aligned, gently place the heatsink on the CPU socket, making sure that each peek nut is properly attached to its corresponding threaded fastener.

A, B, C, D: Peek Nut on the Heatsink B D A C b c d a, b, c, d: Threaded Fastener on the CPU socket

1. Press all four rotating wires outward and make sure that the heatsink is securely latched into the CPU socket.

Rotating Wire Rotating Wire Latched State Top View

1. With a t30-bit screwdriver, tighten all peek nuts in the sequence of "A", "B", "C", and "D" with even pressure. To avoid damaging the processor or socket, do not use a force greater than 12 lbf-in when tightening the screws.

2. Examine all corners of the heatsink to ensure that the PHM is firmly attached to the CPU socket.

Technical diagram showing two mechanical components with labeled parts A, B, C, D and red arrows indicating motion or force directions.

Removing the PHM from the CPU Socket

Before removing the PHM from the motherboard, first shut down the system and unplug the AC power cord from all power supplies.

1. Use a t30-bit screwdriver to loosen the four peek nuts on the heatsink in the sequence of A, B, C, and D.

B C D A Peek Nut C

1. Once the peek nuts have been loosened from the CPU socket, press the rotating wires inward to unlatch the PHM from the socket as shown below.

Technical illustration of a dual-chamber industrial cooling unit with heat exchangers and cooling fins (no text or symbols)

Unlatched State Rotating Wire Peak Nut Side View

1. Gently lift the PHM upward to remove it from the CPU socket.

Technical diagram of an electronic component with mounting base and internal structure, showing red directional arrows indicating assembly or movement (no text or symbols present)

Removing the Processor Carrier Assembly from the PHM

To remove the processor carrier assembly from the PHM, please follow the steps below:

1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown below.

Processor Carrier Assembly Pin1 Pin1 a b c D A B Heatsink C

1. When all plastic clips have been detached from the heatsink, remove the processor carrier assembly from the heatsink

Technical diagram of an electronic component with red arrows indicating assembly or force direction (no text or symbols present)

Removing the Processor from the Processor Carrier Assembly

Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below.

1. Unlock the lever from its locked position and push it upwards to disengage the processor from the processor carrier as shown below right.

Processor Carrier Assembly Lever

1. Once the processor has been loosened from the carrier, carefully remove the processor from the carrier.

Note: Please handle the processor with care to avoid damaging it or its pins.

Isometric technical diagram of a computer motherboard with a highlighted component and red arrow indicating upward motion (no text or symbols present)

3.5 Memory

Memory Support

The X12QCH+-P has 48 DIMM slots to support up to 12TB 3DS ECC DDR4-3200:RDIMM/LRDIMM or 18TB Intel® Optane™ DDR4-3200:DCPMM, RDIMM/LRDIMM//DCPMM. For validated memory, use our Product Resources page. Check the Supermicro website for possible updates to memory support.

Memory Installation Sequence

Memory for this motherboard is populated using the "Fill First" method. The DIMM slots with blue release tabs are considered the first DIMM of their channel and those with white release tabs are the second of the channel. When installing memory modules, be sure to populate the memory slots with the blue release tabs first and then populate the those with the white release tabs.

General Memory Population Requirements

1. Be sure to use the memory modules of the same type and speed on the motherboard. Mixing of memory modules of different types and speeds is not allowed.
2. Using unbalanced memory topology such as populating two DIMMs in one channel while populating one DIMM in another channel will result in reduced memory performance.
3. Populating memory slots with a pair of DIMM modules of the same type and size will result in interleaved memory, which will improve memory performance.

DDR4 Memory Support
Type	Ranks Per DIMM & Data Width	DIMM Capacity (GB)		Speed (MT/s); Voltage (V); Slots Per Channel (SPC) and DIMMs Per Channel (DPC)
				1DPC (1-DIMM Per Channel)	2DPC (2-DIMM Per Channel)
		8Gb 16Gb 1.2 V 1.2 V
RDIMM	SRx8 8GB 16GB			3200 2933
	SRx4 16GB 32GB
	DRx8 16GB 32GB
	DRx4 32GB 64GB
RDIMM-3Ds (4R/8R) x4		2H-64GB4H-128GB	2H-128GB4H-256GB
LRDIMM	QRx4	64GB	128GB	3200	3200
LRDIMM-3Ds	(4R/8R) x4 4H-128GB		2H-128GB4H-256GB	3200 3200

DDR4 Memory Population Table

Note: Unbalanced memory configurations decrease memory performance and is not recommended on Supermicro motherboards.

Memory Population Sequence for Half Memory Configuration

Memory Population Sequence: Half Memory Configuration(4 CPUs & 24 DIMMs Installed)
4 CPUs & 24 DIMMs(6 DIMMs per CPU)	Memory Population Sequence
CPU1 + 6 DIMMs CPU1	P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1
CPU2 + 6 DIMMs CPU2	P2-DIMMC1/P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1
CPU3 + 6 DIMMs CPU3	P3-DIMMC1/P3-DIMMB1/P3-DIMMA1/P3-DIMMD1/P3-DIMME1/P3-DIMMF1
CPU4 + 6 DIMMs CPU4	P4-DIMMC1/P4-DIMMB1/P4-DIMMA1/P4-DIMMD1/P4-DIMME1/P4-DIMMF1

Memory Population Table with Full Memory Configuration

Memory Population Sequence: Full Memory Configuration(4 CPUs & 48 DIMMs Installed)
4 CPUs & 48 DIMMs(12 DIMMs per CPU)	Memory Population Sequence
CPU1 + 12 DIMMs	CPU1:P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF2/P1-DIMMF1
CPU2 + 12 DIMMs	CPU2:P2-DIMMC1/P2-DIMMC2/P2-DIMMB1/P2-DIMMB2/P2-DIMMA1/P2-DIMMA2/P2-DIMMD2/P2-DIMMD1/P2-DIMME2/P2-DIMME1/P2-DIMMF2/P2-DIMMF1
CPU3 + 12 DIMMs	CPU3:P3-DIMMC1/P3-DIMMC2/P3-DIMMB1/P3-DIMMB2/P3-DIMMA1/P3-DIMMA2/P3-DIMMD2/P3-DIMMD1/P3-DIMME2/P3-DIMME1/P3-DIMMF2/P3-DIMMF1
CPU4 + 12 DIMMs	CPU4:P4-DIMMC1/P4-DIMMC2/P4-DIMMB1/P4-DIMMB2/P4-DIMMA1/P4-DIMMA2/P4-DIMMD2/P4-DIMMD1/P4-DIMME2/P4-DIMME1/P4-DIMMF2/P4-DIMMF1

Intel® Optane™ PMem 200 Series Memory Population (Full Configuration)

Note: Optane memory is supported by 3rd Generation Intel® Xeon® Scalable processors (83xxH/63xxH/53xxH Series) only.

Symmetric Population

2-2-2 (For Channel Configuration: 2-2-2)

Modes

CPU1

P1-DIMMF1

P1-DIMMF2

P1-DIMME1

P1-DIMME2

P1-DIMMD1

P1-DIMMD2

P1-DIMMA2

P1-DIMMA1

P1-DIMMB2

P1-DIMMB1

P1-DIMMC2

P1-DIMMC1

AD

DRAM1

PMem

DRAM1

PMem

DRAM1

PMem

PMem

DRAM1

PMem

DRAM1

PMem

DRAM1

CPU2

P2-DIMMF1

P2-DIMMF2

P2-DIMME1

P2-DIMME2

P2-DIMMD1

P2-DIMMD2

P2-DIMMA2

P2-DIMMA1

P2-DIMMB2

P2-DIMMB1

P2-DIMMC2

P2-DIMMC1

AD

DRAM1

PMem

DRAM1

PMem

DRAM1

PMem

PMem

DRAM1

PMem

DRAM1

PMem

DRAM1

CPU3

P3-DIMMF1

P3-DIMMF2

P3-DIMME1

P3-DIMME2

P3-DIMMD1

P3-DIMMD2

P3-DIMMA2

P3-DIMMA1

P3-DIMMB2

P3-DIMMB1

P3-DIMMC2

P3-DIMMC1

AD

DRAM1

PMem

DRAM1

PMem

DRAM1

PMem

PMem

DRAM1

PMem

DRAM1

PMem

DRAM1

CPU4

P4-DIMMF1

P4-DIMMF2

P4-DIMME1

P4-DIMME2

P4-DIMMD1

P4-DIMMD2

P4-DIMMA2

P4-DIMMA1

P4-DIMMB2

P4-DIMMB1

P4-DIMMC2

P4-DIMMC1

AD

DRAM1

PMem

DRAM1

PMem

DRAM1

PMem

PMem

DRAM1

PMem

DRAM1

PMem

DRAM1

Memory Population Sequence: Half Memory Configuration(4 CPUs & 16 DIMMs Installed)
4 CPUs & 16 DIMMs(4 DIMMs per CPU)	Memory Population Sequence
CPU1 + 4 DIMMs	CPU1:P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1
CPU2 + 4 DIMMs	CPU2:P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1
CPU3 + 4 DIMMs	CPU3:P3-DIMMB1/P3-DIMMA1/P3-DIMMD1/P3-DIMME1
CPU4 + 4 DIMMs	CPU4:P4-DIMMB1/P4-DIMMA1/P4-DIMMD1/P4-DIMME1

DIMM Population Order per CPU

CPU1 C1C

2B1B2A1A2D20

1E2E1F2F1

1 DIMM X

2 DIMMs* X

X

3 DIMMs* X

X X

4 DIMMs X

X X X

5 DIMMs* X

X X X X

6 DIMMs X

X X X X

X

7 DIMMs*

X

X

X

X

X

X

X

8 DIMMs*

X

X

X

X

X

X

X

X

9 DIMMs*

X

X

X

X

X

X

X

X

X

10 DIMMs*

X

X

X

X

X

X

X

X

X

X

11 DIMMs*

X

X

X

X

X

X

X

X

X

X

X

12 DIMMs

X

X

X

X

X

X

X

X

X

X

X

X

* Unbalance configuration (reduces performance and is not recommended).
"Incorrect Memory DIMM Population" message will appear during POST.

BIOS/OS will only show the total of the workable memory size, which may not total up to the amount that is physically in the system.

DIMM Installation

1. Insert the desired number of DIMMs into the slots based on the recommended DIMM population tables shown above.
2. Push the release tabs on both ends of the DIMM slot outwards to unlock it.

1. Align the key of the DIMM module with the receptive point on the memory slot.

Key

1. Align the notches on both ends of the module with the receptive points on the ends of the slot.

Notches

1. Push both ends of the module straight down into the slot until the module snaps into place.

Push both ends straight down into the memory slot.

Illustration of two hands holding a mechanical component with blue arrows indicating direction (no text or symbols)

1. Press the release tabs to the lock positions to secure the DIMM module into the slot.

DIMM Removal

Press both release tabs on the ends of the DIMM module to unlock it. Once the DIMM module is loose, remove it from the memory slot.

Warning! To avoid causing any damage to the DIMM module or the DIMM socket, do not use excessive force when pressing the release tabs on the ends of the DIMM socket. Handle DIMMs with care. Be aware and follow the ESD instructions given at he beginning of this chapter.

3.6 Motherboard Battery

The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard.

Replacing the Battery

Begin by removing power from the system.

1. Push aside the small clamp that covers the edge of the battery. When the battery is released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+) side facing up. Then push the other side down until the clamp snaps over it.

Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

LITHIUM BATTERY BATTERY HOLDER

Figure 3-2. Installing the Onboard Battery

Warning: There is a danger of explosion if the onboard battery is installed upside down (which reverses its polarities). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).

3.7 Storage Drives

The system supports 24 hot-swap 2.5" SAS3/SATA3 drive bays. Two M.2 SATA/NVMe slots are also supported. For compatible storage drives, see the motherboard page.

The drives are mounted in toolless drive carriers that simplify their removal from the chassis. These carriers also help promote proper airflow.

Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro website product pages at https://www.supermicro.com/products/nfo/Ultra.cfm.

Installing Drives

The front of the system has 24 hard drive bays that support SAS3 and SATA3 hard drives.

0 1 2 3 4 5 6 7 8 9 10 11 SUPERMIC®

Figure 3-3. Logical Drive Numbers

Removing a Hot-Swap Drive Carrier from the Chassis

1. Press the release button on the drive carrier, which will extend the drive carrier handle.
2. Use the drive carrier handle to pull the drive out of the chassis.

Installing a Hard Drive into a Drive Carrier

1. Insert a drive into the carrier with the PCB side facing down and the connector end toward the rear of the carrier.
2. Align the drive in the carrier so that the screw holes of both line up. Note that there are holes in the carrier marked "SATA" to aid in correct installation.
3. Secure the drive to the carrier with four screws.
4. Insert the drive carrier into its bay, keeping the carrier oriented so that the hard drive is on the top of the carrier and the release button is on the right side. When the carrier reaches the rear of the bay, the release handle will retract.
5. Push the handle in until it clicks into its locked position.

Note: Your operating system must have RAID support to enable the hot-plug capability of the hard drives.

Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers.

Technical line drawing of a server rack unit with cooling fins and drive bays (no text or symbols)

Figure 3-4. Removing a Drive Carrier

Installing M.2 Solid State Drives

The X12QCH+-P supports M.2 SSDs with a PCIe 3.0 M.2 slot (PCIE M.2) and two M.2-HC S-SATA slots (JMD1/JMD2), which support PCIe 3.0 x4 NVMe/SATA SSDs. These M.2 slots support 2280 and 22110 form factors via SlimSAS x8 cables.

Caution: DO NOT perform this service with the system mounted inside the rack.

Caution: The handles used for pulling the system from the rack are not intended to be used to pick up or lift the system.

Installing M.2 Drives

1. Power down the system as described in Section 3.1.
2. Remove the system from the rack and place it on a bench, then remove the cover as described previously.
3. Begin by removing the riser brackets from the chassis.
4. Insert the M.2 sideways into the connector so that it lays flat, then secure it to the bracket with the plastic clip.
5. Repeat as necessary for more M.2 drives.
6. With the drives installed and secured to the bracket, replace the bracket back into the chassis as before.
7. Finish by replacing the cover and restoring power to the system.

Technical line drawing of a server rack with internal components and mounting holes (no text or labels)

Figure 3-6. Installing an M.2 SSD

3.8 System Cooling

Fans

Eight 9cm heavy duty fans provide the cooling for the system. Fans are hot-swap and can be replaced without powering down the system. The electrical connections are automatically made when a fan is inserted into its slot.

Ensure the chassis cover is only off for a short time and makes a good seal when replaced for the cooling air to circulate properly. Fan speed is controlled by system temperature via BMC. If a fan fails, the remaining fans will ramp up to full speed. Replace any failed fan at your earliest convenience with the same type and model (the system can continue to run with a failed fan).

Changing a System Fan

1. Determine which fan has failed using BMC if possible. If not, remove the chassis cover while the power is on and examine the fans to determine which one has failed.
2. Pull the system partially out from the rack.
3. With the top cover partially pushed back, depress the release buttons on the front section of the top cover to swing it open on its hinges.
4. Squeeze the fan tabs of the failed fan and lift the fan housing up and out of the chassis.
5. To install a fan, push it into the proper location until it clicks.
6. Finish by fully closing the cover and pushing the system back into the rack.

Technical line drawing of a server rack with ventilation ducts and drive bays (no text or labels)

Figure 3-7. Installing a Fan (positions indicated)

Air Shrouds

Air shrouds concentrate airflow to maximize fan efficiency. The SYS-440P-TNRT includes three different sets of air shrouds.

Caution: DO NOT perform this service with the system mounted inside the rack.

Air Shroud for Memory (CPU1/2)

Four 2U air shrouds cool the DIMM slots controlled by CPUs 1 and 2 (see figure below).

1. Power down the system as described in Section 3.1.
2. Remove the system from the rack and place it on a bench, then remove the cover as described previously.
3. Place each air shroud over six DIMM slots at a time for both CPU1 and CPU2-controlled DIMM slots, as illustrated below.
4. Close the cover and push the system back into the rack.

Technical line drawing of a server rack with internal components and ventilation ducts (no text or labels)

Figure 3-8. Installing Air Shrouds for CPU1/2 DIMMs

Caution: The handles used for pulling the system from the rack are not intended to be used to pick up or lift the system.

Air Shroud for Memory (CPU3/4)

Four 1U air shrouds cool the DIMM slots controlled by CPUs 3 and 4 (see figure below).

Caution: DO NOT perform this service with the system mounted inside the rack.

1. Power down the system as described in Section 3.1.
2. Remove the system from the rack and place it on a bench, then remove the cover as described previously.
3. Place each air shroud over six DIMM slots at a time for both CPU3 and CPU4-controlled DIMM slots, as illustrated below. Close the cover and push the system back into the rack.

Technical line drawing of a server rack with internal components and mounting holes (no text or labels)

Figure 3-9. Installing Air Shrouds for CPU3/4 DIMMs

Caution: The handles used for pulling the system from the rack are not intended to be used to pick up or lift the system.

3.9 Expansion Cards

The SYS-440P-TNRT includes eight riser cards to support the use of expansion (add-on) cards.

Caution: DO NOT perform this service with the system mounted inside the rack.

Installing Expansion Cards

1. Power down the system as described in Section 3.1.
2. Remove the system from the rack and place it on a bench, then remove the cover as described previously.
3. Remove the slimline SAS cable and pull up the riser card brackets.

- For the right side (looking from the node rear), open the clip of each slot on the right.

- For the left side, open the clip of each slot.

1. Remove the blank PCI shield from the chassis.

2. Slide the expansion card shield into the open shield slot while plugging the expansion card into the riser card.

Technical line drawing of a server rack with multiple drive bays and ventilation fans (no text or labels)

Figure 3-10. Installing Riser Cards

Caution: The handles used for pulling the system from the rack are not intended to be used to pick up or lift the system.

3.10 Power Supply

The system includes four hot-plug, 1600W power supply modules. These modules will automatically sense and operate at an input voltage between 100v to 240v. Note that different input voltages will result in different maximum power output levels.

In the event of a power module failure, the other power module will continue to power the system on its own. Failed power supply modules can be replaced without powering-down the system. Replacement modules can be ordered directly from Supermicro.

An amber light on the power supply is illuminated when the power is switched off. A green light indicates that the power supply is operating.

Replacing the Power Supply

1. Unplug the AC power cord from the failed power supply module.
2. Push and hold the release tab on the back of the power supply.
3. Grasp the handle of the power supply and pull it out of its bay.
4. Push the new power supply module into the power bay until it clicks into the locked position.
5. Plug the AC power cord back into the power supply module.

Technical line drawing of a server rack unit with internal components and mounting holes (no text or symbols)

Figure 3-11. Installing a Power Supply Module

3.11 BMC

The BMC can be reset using the button on the front control panel or on the chassis rear.

• Reset—Press and hold the button. After six seconds, the LED blinks at 2 Hz. The BMC resets and the reset duration is \~250 ms. Then the BMC starts to boot.
• Restore factory default configuration—Hold the button for twelve seconds. The LED blinks at 4 Hz while defaults are configured.
• Firmware update—the UID LED blinks at 10Hz during a firmware update.

BMC Reset Options
Event LED (Green)
Reset Blinks at 2 Hz
Restore Defaults	Blinks at 4 Hz
Update Blinks at 10 Hz

Chapter 4

Motherboard Connections

This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1. More detail can be found in the Motherboard Manual Please review the Safety Precautions in Appendix A before installing or removing components.

4.1 Power Connections

Two power connections supply the motherboard and several more supply for onboard devices.

Main Power Connections

Two Power Delivery I²C1/2 Boards (PDB), located at PSU1 and PSU2, are used to provide main power to your system.

Important: To provide adequate power to your system, be sure to connect the Power Delivery Boards (PSU1/2) and all 8-pin PWR connectors (BP_PWR1/2/3 & GPU_PWR1/2/3/4) to the power supply. Failure to do so may void the manufacturer warranty on your power supply and motherboard.

Backplane Power Connectors & GPU Power Connectors

In addition to the main power headers, three 8-pin power connectors (BP_PWR1/2/3) are used for backplane devices. Another four 8-pin power connectors (GPU_PWR1/2/3/4) are for GPU device use. These 8-pin power connectors meet the ATX SSI EPS 12V specification and must be connected to your power supply to provide adequate power to your system.

12V 8-pin Power Pin Definitions

Pin# Definition

1 - 4 Ground

5 - 8 +12V

PDB Cable Connectors for CPU3/CPU4

Two PDB (Power Delivery Board) cable connectors for CPU3 and CPU4 are located at J26 and J47. J47 is used for CPU3, and J26 is for CPU4. See the layout below for the locations for J47 and J26.

Power Connectors for PCIe 3.0 x16 HIO Slots (J5/J6)

Two 6-pin power connectors used for PCIe 3.0 x16 High_Speed (HIO) slots are located at J5/J6. J5 is used for the left side PCIe 3.0 x16 slot (P1_HIO_L1PCIE), while J6 is for the right side PCIe 3.0 x16 slot (P2_HIO_R1PCIE). See the layout below for the locations for J5 and J6.

4.2 Headers and Connectors

Fan Headers

There are twelve 6-pin fan headers (FAN1 - FAN12) on the motherboard. The fan speed control for these fans are supported by Thermal Management via BMC.

TPM/Port 80 Header

The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. For more information on TPM go to http://www.supermicro.com/manuals/other/TPM.pdf.

Trusted Platform Module Header Pin Definitions
Pin# Definition Pin# Definition
1 +3.3V 2 SPI_CS#
3 RESET# 4 SPI_MISO
5 SPI_CLK 6 GND
7 SPI_MOSI 8 NC
9 +3.3V Stdby 10 SPI_IRQ#

VROC RAID Key Header

A VROC RAID Key header is located at JRK1 on the motherboard. For NVMe RAID support, install a VROC RAID Key on JRK1 as shown in the illustration below.

Intel VROC KeyPin Definitions
Pin#	Definition
1	Ground
2	3.3V Standby
3	Ground
4	PCH RAID Key

VROC Key VROC Key Header (JRK1)

Note: The graphics contained in this user's manual are for illustration purposes only. The components installed in your system may or may not look exactly the same as the graphics shown in the manual.

Standby Power

The Standby Power header is located at JSTBY1 on the motherboard. You must have a card with a Standby Power connector and a cable to use this feature. Refer to the table below for pin definitions.

Standby Power Pin Definitions
Pin# Definition
1 +5V	Standby
2 Ground
3 No Connection

4-pin BMC External I²C Header

A System Management Bus header for BMC is located at JIPMB1. Connect the appropriate cable here to use the IPMB I ^2 C connection on your system. Refer to the table below for pin definitions.

External I2C Header Pin Definitions
Pin#	Definition
1	Data
2	Ground
3	Clock
4	No Connection

Chassis Intrusion

A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable from the chassis to inform you when the chassis is opened. Refer to the table below for pin definitions.

Chassis Intrusion Pin Definitions

Pin# Definition

1 Intrusion Input

2 Ground

Control Panel

JF1 contains header pins for various control panel connections. See the figure below for the pin locations and definitions of the control panel buttons and LED indicators.

All JF1 wires have been bundled into a single cable to simplify this connection. Make sure the red wire plugs into pin 1 as marked on the motherboard. The other end connects to the control panel PCB board.

PWR Power Button Reset Reset Button 3.3V UID LED 3.3V Stby 3.3V Stby 3.3V Stby X NMI 1 2 Ground Ground Power Fail LED OH/Fan Fail/PWR Fail LED NIC2 Active LED NIC1 Active LED HDD LED PWR LED X Ground 19 20

Figure 4-1. JF1 Control Panel Pins

Power Button

The Power Button connection is located on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system. Refer to the table below for pin definitions.

Power ButtonPin Definitions (JF1)

Pin# Definition

1 Signal

2 Ground

Reset Button

The Reset Button connection is located on pins 3 and 4 of JF1. Momentarily contacting both pins will reset the system. Refer to the table below for pin definitions.

Reset ButtonPin Definitions (JF1)

Pin# Definition

3 Reset

4 Ground

Power Fail LED

The Power Fail LED connection is located on pins 5 and 6 of JF1. Refer to the table below for pin definitions.

Power Fail LEDPin Definitions (JF1)
Pin# Definition
5 3.3V
6 PWR Supply Fail

Information LED (OH/Fan Fail/PWR Fail/UID LED)

The Information LED (OH/Fan Fail/PWR Fail/UID LED) connection is located on pins 7 and 8 of JF1. The LED on pin 7 is active when the UID switch on the rear I/O panel is pressed. The LED on pin 8 provides warnings of overheat, power failure, or fan failure. Refer to the tables below for more information.

Information LED-UID/OH/PWR Fail/Fan Fail LED Pin Definitions (JF1)
Status Description
Solid red	An overheat condition has occurred. (This may be caused by cable congestion).
Blinking red (1Hz)	Fan failure: check for an inoperative fan.
Blinking red (0.25Hz)	Power failure: check for a non-operational power supply
Solid blue	Local UID is activated. Use this function to locate a unit in a rack mount environment that might be in need of service.
Blinking blue (300 msec)	Remote UID is on. Use this function to identify a unit from a remote location that might be in need of service.

The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11 and 12 of JF1, and LAN port 2 is on pins 9 and 10. These LAN ports support 10G LAN Ethernet connections. Attach the NIC LED cables here to display network activity. Refer to the table below for pin definitions.

LAN1/LAN2 LEDPin Definitions (JF1)
Pins Definition
9 NIC	2 Activity LED
11 NIC	1 Activity LED

HDD LED

The HDD LED connection is located on pins 13 and 14 of JF1. Attach a cable to pins 13 and 14 to show hard drive activity status. Refer to the table below for pin definitions.

HDD LEDPin Definitions (JF1)
Pins Definition
13 3.3	V Stdby
14 HDD Active

Power LED

The Power LED connection is located on pins 15 and 16 of JF1. Refer to the table below for pin definitions.

Power LEDPin Definitions (JF1)

Pins Definition

15 3.3V

16 PWR LED

NMI Button

The non-maskable interrupt (NMI) button header is located on pins 19 and 20 of JF1. Refer to the table below for pin definitions.

NMI ButtonPin Definitions (JF1)

Pins Definition

19 Control

20 Ground

4.3 Input/Output Ports

Rear I/O Ports

See the figure below for the locations and descriptions of the I/O ports on the rear of the motherboard.

Diagram showing labeled network ports and connectors with numbered annotations

Rear I/O Ports
#	Description	#	Description	#	Description
1	UID Switch/LED (on the motherboard)	5	BMC_LAN	9	(10G) LAN3
2	VGA	6	COM1	10	(10G) LAN4
3	USB 0 (3.0)	7	(10G) LAN1	11	LEDT2 (LAN3 LED)
4	USB 1 (3.0)	8	(10G) LAN2	12	LEDT1 (LAN4 LED)

VGA Connections

There are two VGA connections on the X12QCH+-P. The rear VGA port is located at JVGA1 on the rear I/O panel, and the front VGA header is located at FP2 on the motherboard. These VGA connections provide analog interface support between the computer and the video displays.

COM Port

A COM port that supports a serial link interface is included on the rear I/O panel.

Four 10G LAN ports (LAN1/LAN2/LAN3/LAN4) and a dedicated BMC LAN port (BMC LAN) are located on the rear I/O panel. LAN1/LAN2 ports are supported by the RJ45 ethernet connections and require RJ45 cables. LAN3/LAN4 ports support SFP28. The dedicated BMC LAN, located above the USB0/1 ports on the rear I/O panel, provides LAN support for the BMC (Baseboard Management Controller). The LEDs for LAN1/LAN2 are on the LAN connectors. The LED indicator for LAN3 is located on LEDT2, and LED for LAN4 is on LEDT1. Please also refer to the LED Indicator section for LAN LED information.

Universal Serial Bus (USB) Ports and Headers

Two USB 3.0 ports (USB0/1) are located on the rear I/O panel, and an internal Type A USB 3.0 header (USB2) is located on the motherboard to provide front access.

Rear I/O Panel USB 0/1 (3.0)Pin Definitions
Pin# Definition Pin# Definition
A1 VBUS B1 Power
A2 D-B2 USB_N
A3 D+B3 USB_P
A4 GND B4 GND
A5 Stda_SSRX-B5 USB3_RN
A6 Stda_SSRX+B6 USB3_RP
A7 GND B7 GND
A8 Stda_SSTX-B8 USB3_TN
A9 Stda_SSTX+B9 USB3_TP

Type A USB 2 (3.0)Pin Definitions
Pin# Definition Pin# Definition
1 VBUS 5 SSRX-
2 USB_N	6 SSRX+
3 USB_P	7 GND
4 Ground	8 SSTX-
	9 SSTX+

Unit Identifier Switch and UID LED Indicator

A Unit Identifier (UID) switch and a rear UID LED (LED1) are located on the rear I/O panel. The front UID LED is located on pins 7 & 8 of the front panel control header (JF1). When you press the rear UID switch, both front and rear UID LEDs will be turned on. Press the UID switch again to turn off the LED indicators. The UID indicators provide easy identification of a system in a rack environment.

Note: UID can also be triggered via BMC on the motherboard.

UID LEDPin Definitions
Color	Status
Blue: On	Unit Identified

4.4 Jumpers

Explanation of Jumpers

To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

Note: On a two-pin jumper, "Closed" means the jumper is on both pins and "Open" indicates the jumper is either on only one pin or has been completely removed.

Connector Pins Jumper Setting 3 2 1 3 2 1

CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system and unplug the power cord(s).
2. Remove the cover of the chassis to access the motherboard and remove the battery from the motherboard.
3. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
4. Remove the screwdriver (or shorting device).
5. Replace the cover, reconnect the power cord(s), and power on the system.

Notes: Clearing CMOS will also clear all passwords. Do not use the PW_ON connector to clear CMOS.

Manufacturing Mode (ME Mode Select)

Close pins 2-3 of jumper JPME2 to bypass SPI flash security and force the system to operate in manufacturing mode, which will allow the user to flash the system firmware from a host server for system setting modifications. The default setting is Normal.

ME SelectJumper Settings
Jumper Setting Definition
Pins 1-2 Normal	(Default)
Pins 2-3 Manufacturer Mode

Watch Dog

JWD1 controls the Watch Dog function. Watch Dog is a monitor that can reboot the system when a software application hangs. Jumping pins 1-2 will cause Watch Dog to reset the system if an application hangs. Jumping pins 2-3 will generate a non-maskable interrupt signal for the application that hangs. Watch Dog must also be enabled in BIOS. The default setting is Reset.

Note: When Watch Dog is enabled, the user needs to write their own application software to disable it.

Watch DogJumper Settings
Jumper Setting Definition
Pins 1-2 Reset (Default)
Pins 2-3 NMI
Open Disabled

10G LAN Ports Enable/Disable

Jumper JPTG1 allows the user to enable the onboard 10G LAN ports. The default setting is pins 1-2 to enable the connection.

10G LAN Enable/DisableJumper Settings

Jumper Setting Definition

Pins 1-2 Enabled (Default)

Pins 2-3 Disabled

Power-Failure Throttling Enable

J34 is a power-failure throttling jumper which will allow the user to enable the CPU throttling mode when a power failure occurs. The default setting is on pins 1 and 2 for normal operation.

Power-Failure ThrottlingJumper Settings

Jumper Setting Definition

Pins 1-2 Normal (Default)

Pins 2-3 Power-Failure Throttling Enable

Select Switch for FP1_Reset Button or UID Button

Jumper J58 is used to select between the FP1_Reset button and the UID button. The default setting is to close J58 to use the UID button.

Select Switch for FP1_Reset Button& UID ButtonJumper Settings

Jumper Setting Definition

Closed UID Button (Default)

Open FP1_Reset Button

4.5 LED Indicators

10G LAN1/LAN2 LEDs

Two RJ45 Ethernet 10G LAN ports (LAN 1 and LAN 2) are located on the rear I/O panel of the motherboard. Each Ethernet LAN port has two LEDs. The green LED indicates activity, while the other Link LED may be green, amber, or off to indicate the speed of the connection. Refer to the tables below for more information.

10G LAN1/2 Activity LED (Right)LED State
Color Status Definition
Green Flashing Active

LAN1/2 Link LED (Left)LED State
LED Color Definition
Green 10Gbps

BMC LAN LEDs

In addition to LAN1 and LAN2, an BMC LAN is also located on the rear I/O panel. The amber LED on the right indicates activity, while the green LED on the left indicates the speed of the connection. Refer to the table below for more information.

BMC LAN LEDs
Color/State Definition
Link (left)	Green: Solid	100 Mbps
	Amber: Solid	1 Gbps
Activity (Right) Amber	Blinking Active

BMC LAN

Activity LEDLink LED

10G LAN3/4 LEDs

Two 10G LAN ports (LAN3/LAN4) that support SFP28 are also located on the rear I/O panel. The activity LED for LAN3 is located on LEDT2, while the activity LED for LAN4 is on LEDT1. Refer to the tables below for more information.

10G LAN3/4 Activity LED IndicatorsLED State
LED# LAN#
LEDT1 LAN4
LEDT2 LAN3

10G LAN3/4 Activity LEDsLED State
Color Status Definition
Green Flashing Active

Unit ID LED

A rear UID LED indicator (LED1) is located next to the UID switch. This UID indicator provides easy identification of a system unit that may need service.

UID LEDLED Indicator
LED Color Definition
Blue: On Unit	Identified

Onboard Power LED

The Onboard Power LED is located at LED2. When this LED is on, the system power is on. Be sure to turn off the system power and unplug the power cord before removing or installing components.

Onboard Power LED Indicator
LED Color Definition
Off System	Power Off
Green System	Power On

BMC Heartbeat LED

A BMC Heartbeat LED is located at BMC_HB_LED1 on the motherboard. When this LED is blinking, the BMC is functioning normally.

BMC Heartbeat LED Indicator
LED Color Definition
Green:Blinking	BMC Normal

4.6 Storage Ports

I-SATA 3.0 and S-SATA 3.0 Connectors

The X12QCH+ has eight I-SATA 3.0 ports (I-SATA0-3, I-SATA4-7) and four S-SATA (S-SATA0-3) in addition to the M.2 HC-S-SATA 4/5 slots. These SATA ports are supported by the Intel® C621A chipset

PCIe M.2 Slot & M.2-HC S-SATA4/5 Slots

A PCIe 3.0 M.2 slot (PCIE M.2) is located next to the TPM/Port80. In addition, two M.2-HC S-SATA slots (JMD1/JMD2) also support PCIe 3.0 x4 for NVMe/SATA Solid State Devices (SSDs). These M.2 slots support 2280 and 22110 form factors via SlimSAS x8 cables (required). The M.2 slots allow for a variety of card sizes with increased functionality and spatial efficiency.

Chapter 5

Software

After the hardware has been installed, you can install the Operating System (OS), configure RAID settings and install the drivers.

5.1 Microsoft Windows OS Installation

If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals.

Installing the OS

1. Create a method to access the MS Windows installation ISO file. That might be a DVD, perhaps using an external USB/SATA DVD drive, or a USB flash drive, or the BMC KVM console.
2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
3. Boot from a bootable device with Windows OS installation. You can see a bootable device list by pressing F11 during the system startup.

Please select boot device: ATEN Virtual CDROM YSOJ → IPMI virtual drive (Legacy) ASUS SDRW-08D2S-U F601 → USB DVD device (Legacy) USB FLASH DRIVE PMAP → USB flash drive with OS installation (Legacy) IBA 40-10G Slot 1900 v1060 → PXE boot (Legacy) UEFI: ATEN Virtual CDROM YSOJ → IPMI virtual drive (UEFI) UEFI: ASUS SDRW-08D2S-U F601 → USB DVD device (UEFI) UEFI: Built-in EFI Shell Enter Setup ↑ and ↓ to move selection ENTER to select boot device ESC to boot using defaults

Figure 5-1. Select Boot Device

1. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on "Load driver" link at the bottom left corner.

Where do you want to install Windows? Name Total size Free space Type Refresh Delete Format New Load driver Extend We couldn't find any drives. To get a storage driver, click Load driver. Next

Figure 5-2. Load Driver Link

To load the driver, browse the USB flash drive for the proper driver files.

• For RAID, choose the SATA/sSATA RAID driver indicated then choose the storage drive on which you want to install it.

• For non-RAID, choose the SATA/sSATA AHCI driver indicated then choose the storage drive on which you want to install it.

• Once all devices are specified, continue with the installation.

• After the Windows OS installation has completed, the system will automatically reboot multiple times.

5.2 Driver Installation

The Supermicro website contains drivers and utilities for your system at https://www.supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver.

After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash drive or a DVD. (You may also use a utility to extract the ISO file if preferred.)

Another option is to go to the Supermicro website at http://www.supermicro.com/products/. Find the product page for your motherboard, and "Download the Latest Drivers and Utilities". Insert the flash drive or disk and the screenshot shown below should appear.

SUPERMICRO X12QCH+ Motherboard Drivers & Tools (Win10) Intel Chipset INF files Microsoft .Net Framework 4.5.2 (Optional) ASPEED Graphics Driver Intel Virtual RAID on CPU Intel PRO Network Connections Drivers SUPERMICRO Computer Inc. SUPERMICRO SuperDoctor 5 Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information, please visit SUPERMICRO's web site.

Figure 5-3. Driver and Tool Installation Screen

Note: Click the icons showing a hand writing on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you must re-boot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire contents.

5.3 SuperDoctor® 5

The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server), you can remotely control power on/off and reset chassis intrusion for multiple systems with SuperDoctor 5 or BMC. SuperDoctor 5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

SuperDoctor 5 Health info Certificate error localhost:1444/SuperDoctor Loading Select language English ADMIN Layout Motherboard: C7B360-CB-ML Voltage CPU Time 2.0V 12 V 10 V 8 V 6 V 4 V 2 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 V 0 Temperature CPU Time 40Ω 10Ω 21Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3219.6Ω 3.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 3.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5V 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W 1.5W

Figure 5-4. SuperDoctor 5 Interface Display Screen (Health Information)

5.4 BMC

The X12QCH+-P provides remote access, monitoring and management through the baseboard management controller (BMC) and other management controllers distributed among different system modules. There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at:

www.supermicro.com/en/solutions/management-software/bmc-resources

BMC ADMIN User Password

For security, each system is assigned a unique default BMC password for the ADMIN user. This can be found on a sticker on the chassis and a sticker on the motherboard. The sticker also displays the BMC MAC address.

BMC AC1F6BC PWD SUOKJ

Figure 5-5. BMC Password Label

See Chapter 1 for label location.

Chapter 6

Optional Components

This chapter describes optional system components and installation procedures.

6.1 Optional Parts List

Optional Parts List
Description Part Number Quantity
Tool-less black hot-swap 2.5" NVMe drive tray	MCP-220-00167-0B	4
Black Gen3 hot-swap 2.5" tool-less SAS/SATA HDD tray MCP-220-001	47-0B 1-16
Add-on Cards	AOC-VROCPREMOD
	AOC-VROCSTNMOD
CacheVaults	BTR-TFM8G-LSICVM02 & BKT-BBU-BRACKET-05
	BTR-TFM8G-LSICVM02 & MCP-240-00127-0N
Network Cards	AOC-S40G-i2Q
	AOC-SGP-i2
	AOC-SGP-i4
	AOC-STG-b4S
	AOC-STGN-i2S
	AOC-STGN-i1S
	AOC-STG-i2T
AIOM Cards	AOC-AG-i4SM
	AOC-AG-i4M
	AOC-AG-i2M
	AOC-ATG-i2SM
Software	SFT-OOB-LIC 1
	SFT-DCMS-Single 1

6.2 Storage Control Cards

Storage Control Card Options
Part Number Cable HDD Configuration
AOC-S3008L-L8i x1 or AOC-S3108L-H8iR x1 or AOC-S3108L-H8iR-16DD x4	CBL-SAST-1295-100 (x2) 8 SAS3 HDDs
AOC-S3008L-L8i x2 or AOC-S3108L-H8iR x2 or AOC-S3108L-H8iR-16DD x2	CBL-SAST-1295-100 (x4)	16 SAS3 HDDs
AOC-S3916L-H16iR-32DD CBL-SAST	-1281-100 (x2)
AOC-S3008L-L8i x3 or AOC-S3108L-H8iR x3 or AOC-S3108L-H8iR-16DD x3	CBL-SAST-1295-100 (x6)	24 SAS3 HDDs
AOC-S3916L-H16iR-32DD x2 CBL-SAST	-1281-100 (x4)
AOC-SAS3-9361-24l x1 CBL-SAST-1	295-100 (x6)
AOM-TPM-9670V or AOM-TPM-9671V	n/a TPM security module

6.3 Network Cards

Network Card Options
Part Number Description
AOC-S40G-i2Q Standard LP	2-port 40GbE controller, based on Intel Fortville XL710
AOC-SGP-i2 Standard LP, 2x	GbE RJ45, PCIe x4, Intel i350AM2
AOC-SGP-i4 Standard LP, 4x	GbE RJ45, PCIe x4, Intel i350
AOC-STG-b4S Standard LP,	4x 10GbE SFP+, PCIe x8, Broadcom BCM57840S
AOC-STGN-i2S Standard LP,	2x 10GbE SFP+, PCIe x8, Intel 82599ES
AOC-STGN-i1S Standard LP,	1x 10GbE SFP+, PCIe x8, Intel 82599EN
AOC-STG-i2T	Standard LP, 2x 10GbE RJ45, PCIe x8, Intel X540

See Chapter 3 for the riser card installation procedure.

6.4 Intel Virtual RAID on CPU (VROC)

Intel® Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCI-E root complex.

• A single processor supports up to 12 NVMe SSDs and up to 6 RAID arrays.
• A dual processor system supports up to 24 NVMe SSDs and 12 RAID arrays.

Strip sizes are 4K, 8K, 16K, 32K, 64K, 128K.

Requirements and Restrictions

• Intel VROC is only available when the system is configured for UEFI boot mode.
• To enable the mdadm command and support for RSTe, install the patch from

- Linux: https://downloadcenter.intel.com/download/28158/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Linux

- Windows: https://downloadcenter.intel.com/download/28108/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Windows

• To enable Intel VROC, a hardware key must be inserted on the motherboard, and the appropriate processor's Virtual Management Devices must be enabled in the BIOS setup.
• It is possible to enable Intel VROC without a hardware key installed, but only RAID0 will be enabled.
• Intel VROC is not compatible with secure boot. This feature must be disabled.
• When creating bootable OS RAID1 devices, you must have both devices on the same CPU, and a VMD on that CPU.
• Spanning drives when creating RAID devices is not recommended to due to performance issues, even though it is supported.

Supported SSDs and Operating Systems

To see the latest support information: https://www.intel.com/content/www/us/en/support/articles/000030310/memory-and-storage/ssd-software.html

Additional Information

Additional information is available on the product page for the Supermicro add-on card and the linked manuals.

www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm

Hardware Key

The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly. The key must be plugged into the Supermicro motherboard (connector JRK1). The key options are:

Intel® VROC Keys
VROC Package Description Part Number Intel MM Number
Standard	RAID 0, 1, 10Supports 3rd party SSDs	AOC-VROCSTNMOD 95	1605
Premium	RAID 0, 1, 5, 10Supports 3rd party SSDs	AOC-VROCPREMOD 95	1606
Intel SSD only	RAID 0, 1, 5, 10Supports Intel SSDs only	AOC-VROCINTMOD 95	822

VROC_HW_KEY PIN 1 GND KEY1 GND KEY2

Figure 6-1. Intel® VROC RAID Key and Motherboard Connector JRK1

Chapter 7

Troubleshooting and Support

7.1 Information Resources

Website

A great deal of information is available on the Supermicro website, supermicro.com.

SUPERMICRO TECHNOLOGY & OUR PLANET Supermicro Resource-Saving Systems: Reduce Cost and Environmental Impact

Figure 7-1. Supermicro Website

• Specifications for servers and other hardware are available by clicking the menu icon, then selecting the Products option.
• The Support option offers downloads (manuals, BIOS/BMC, drivers, etc.), FAQs, RMA, warranty, and other service extensions.

Direct Links for the SYS-440P-TNRT System

SYS-440P-TNRT specifications page

X12QCH+-P motherboard page (Hyperlink will be updated once it is available on SME production website) for links to the Quick Reference Guide, User Manual, validated storage drives, etc.

Direct Links for General Support and Information

Frequently Asked Questions

Add-on card descriptions

TPM User Guide

General Memory Configuration Guide: X12

SuperDoctor5 Large Deployment Guide

Direct Links (continued)

For validated memory, see our Product Resources page

Product Matrices page for links to tables summarizing specs for systems, motherboards, power supplies, riser cards, add-on cards, etc.

Security Center for recent security notices

Supermicro Phone and Addresses

7.2 Baseboard Management Controller Interface

The system supports the Baseboard Management interface. BMC is used to provide remote access, monitoring and management. There are several BIOS settings that are related to BMC.

System System Storage UO Control Firmware Update Sensor Readings System Firmware Version 9:10:04 BETA Firmware Build Time 04/10/2020 Health Version 1.8.0 BIOs Version BIOs Build Time CPLD Version F0-05.05 BMC Mac Address AC 1F:88.30:22.0C LAN 1 Mac Address AC 1F:88.CA:22.BA LAN 2 Mac Address AC 1F:89.CA:22.BB LAN 1 Mac Address OC.C4.7A.DI:6C.7E LAN 2 Mac Address DC.C4.7A.DI:5E.TF LAN 1 Mac Address AC 1F:89.CF:37.FA LAN 2 Mac Address AC 1F:89.CF:37.FB Host Server Host Name Server IP Address 172.31.66.213 IPv6 Address 1 In80.0.0.ae IT:668 In3d.3463 IPv6 Address 2 IPv6 Address 3 IPv6 Address 4 IPv6 Address 5 IPv6 Address 6 Power Consumption Min Peak Average Usage Max Peak X.Time(min), Y:Power Consumption (Watt) Remote Console Preview Jakarta plug-in HTML5 reload image

Figure 7-2. BMC Sample

7.3 Troubleshooting Procedures

Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures or Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non hot-swap hardware components.

General Technique

If you experience unstable operation or get no boot response, try:

1. With power off, remove all but one DIMM and other added components, such as add-on cards, from the motherboard. Make sure the motherboard is not shorted to the chassis.

PWRLED

Figure 7-3. Location of the MB Power LED

1. Set all jumpers to their default positions.
2. Power up. If the system boots, check for memory errors and add-on card problems.

No Power

• As you try to power up the system, note any beep codes. Refer to the next section for details on beep codes.
• Check that the power LED on the motherboard is on.
• Make sure that the power connector is connected to your power supply.
• Make sure that no short circuits exist between the motherboard and chassis.
• Disconnect all cables from the motherboard, including those for the keyboard and mouse.

• Remove all add-on cards.

• Install a CPU, a heatsink, connect the internal speaker (if applicable), and the power LED to the motherboard. Make sure that the heatsink is fully seated.

• Use the correct type of onboard CMOS battery as recommended by the manufacturer. Check to verify that it still supplies approximately 3VDC. If it does not, replace it with a new one. Warning: To avoid possible explosion, do not install the battery upside down.
• Verify that all jumpers are set to their default positions.
• Check that the power supplies' input voltage operate at 100-120v or 180-240v.
• Turn the power switch on and off to test the system

No Video

If the power is on but you have no video, remove all add-on cards and cables.

System Boot Failure

If the system does not display Power-On-Self-Test (POST) or does not respond after the power is turned on, try the following:

- Turn on the system with only one DIMM module installed. If the system boots, check for bad DIMM modules or slots by following the Memory Errors Troubleshooting procedure below.

Memory Errors

• Make sure that the DIMM modules are properly and fully installed.
• Confirm that you are using the correct memory. Also, it is recommended that you use the same memory type and speed for all DIMMs in the system. See Section 3.5 for memory details.
• Check for bad DIMM modules or slots by swapping modules between slots and noting the results.

Losing the System's Setup Configuration

• Always replace power supplies with the exact same model that came with the system. A poor quality power supply may cause the system to lose the CMOS setup configuration.
• Check that the motherboard battery still supplies approximately 3VDC. If it does not, replace it.

If the above steps do not fix the setup configuration problem, contact your vendor for repairs.

When the System Becomes Unstable

If the system becomes unstable during or after OS installation, check the following:

1. CPU/BIOS support: Make sure that your CPU is supported and that you have the latest BIOS installed in your system.
2. Memory support: Make sure that the memory modules are supported by testing the modules using memtest86 or a similar utility.
   Note: Refer to the product page on our website at http://www.supermicro.com for memory and CPU support and updates.
3. HDD support: Make sure that all hard disk drives (HDDs) work properly. Replace the bad HDDs with good ones.
4. System cooling: Check the system cooling to make sure that all heatsink fans and CPU/system fans, etc., work properly. Check the hardware monitoring settings in the BMC to make sure that the CPU and system temperatures are within the normal range. Also check the front panel Overheat LED and make sure that it is not on.
5. Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Please refer to our website for more information on the minimum power requirements.
6. Proper software support: Make sure that the correct drivers are used.

If the system becomes unstable before or during OS installation, check the following:

1. Source of installation: Make sure that the devices used for installation are working properly, including boot devices such as CD.
2. Cable connection: Check to make sure that all cables are connected and working properly.
3. Using the minimum configuration for troubleshooting: Remove all unnecessary components (starting with add-on cards first), and use the minimum configuration (but with a CPU and a memory module installed) to identify the trouble areas. Refer to the steps listed in Section A above for proper troubleshooting procedures.
4. Identifying bad components by isolating them: If necessary, remove a component in question from the chassis, and test it in isolation to make sure that it works properly. Replace a bad component with a good one.

5. Check and change one component at a time instead of changing several items at the same time. This will help isolate and identify the problem.

6. To find out if a component is good, swap this component with a new one to see if the system will work properly. If so, then the old component is bad. You can also install the component in question in another system. If the new system works, the component is good and the old system has problems.

7.4 BIOS Error Beep (POST) Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

These fatal errors are usually communicated through a series of audible beeps. The table below lists some common errors and their corresponding beep codes encountered by users.

BIOS Error Beep (POST) Codes
Beep Code Error	Message Description
1 short Refresh Circuits have been reset (Ready to power up)
5 short, 1 long Memory error No memory detected in system
5 long, 2 short Display memory read/write error Video adapter missing or with faulty memory
1 long continuous System OH System overheat condition

Additional BIOS POST Codes

The AMI BIOS supplies additional checkpoint codes, which are documented online at http://www.supermicro.com/support/manuals/ ("AMI BIOS POST Codes User's Guide").

When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20).

For information on AMI updates, please refer to http://www.ami.com/products/.

7.5 Crash Dump Using BMC

In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using BMC.

Check BMC Error Log

1. Access the BMC web interface.
2. Click the Server Health tab, then Event Log to verify an IERR error.

Host Identification Server: 172 031 040 125 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Event Log For more special event log settings, please click here This page displays events from the system's event log. You can choose a category from the pull-down box to filter the events and also sort them by clicking on a column header. Clear Event Log Save Select an event log category: All Events Event ID : Time Stamp : Sensor Name : Sensor Type : Description : 1 2017/10/19 15:38:37 Processor IERR - Assertion 2 2017/10/19 15:59:20 Processor IERR - Assertion

Figure 7-4. BMC Event Log

In the event of an IERR, the BMC executes a crash dump. You must download the crash dump and save it.

7.6 UEFI BIOS Recovery

Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you do update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.

Overview

The Unified Extensible Firmware Interface (UEFI) provides a software-based interface between the operating system and the platform firmware in the pre-boot environment. The UEFI specification supports an architecture-independent mechanism that will allow the UEFI OS loader stored in an add-on card to boot the system. The UEFI offers clean, hands-off management to a computer during system boot.

Recovering the UEFI BIOS Image

A UEFI BIOS flash chip consists of a recovery BIOS block and a main BIOS block (a main BIOS image). The recovery block contains critical BIOS codes, including memory detection and recovery codes for the user to flash a healthy BIOS image if the original main BIOS image is corrupted. When the system power is turned on, the recovery block codes execute first. Once this process is complete, the main BIOS code will continue with system initialization and the remaining POST (Power-On Self-Test) routines.

Note 1: Follow the BIOS recovery instructions below for BIOS recovery when the main BIOS block crashes.

Note 2: When the BIOS recovery block crashes, you will need to follow the procedures to make a Returned Merchandise Authorization (RMA) request. Also, you may use the Supermicro Update Manager (SUM) Out-of-Band (https://www.supermicro.com.tw/products/nfo/SMS_SUM.cfm) to reflash the BIOS.

Recovering the Main BIOS Block with a USB Device

This feature allows the user to recover the main BIOS image using a USB-attached device without additional utilities used. A USB flash device such as a USB Flash Drive, or a USB CD/DVD ROM/RW device can be used for this purpose. However, a USB Hard Disk drive cannot be used for BIOS recovery at this time.

The file system supported by the recovery block is FAT (including FAT12, FAT16, and FAT32) which is installed on a bootable or non-bootable USB-attached device. However, the BIOS might need several minutes to locate the SUPER.ROM file if the media size becomes too large due to the huge volumes of folders and files stored in the device.

To perform UEFI BIOS recovery using a USB-attached device, follow the instructions below.

1. Using a different machine, copy the "Super.ROM" binary image file into the Root "\" directory of a USB device or a writable CD/DVD.
   Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
   Note 2: Before recovering the main BIOS image, confirm that the "Super.ROM" binary image file you download is the same version or a close version meant for your motherboard.
2. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and reset the system when the following screen appears.
3. After locating the healthy BIOS binary image, the system will enter the BIOS Recovery menu as shown below.

SUPERIOR BMC IP:10.132.161.13 PEI--Could Not Find Recovery Image... 87

Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below.

Optio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Recovery Security Boot Save & Exit Please select blocks you want to update: Boot Video: [Download] Boot Block update [Enabled] ▶ Proceed with flash update Set this option to reset NVRAM to default values +: Select Screen T4: Select item Enter Select +/- Change Opt. P1: General Help P2: Previous Values P3: Optimized Defaults P4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

1. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update" and press the key. You will see the BIOS recovery progress as shown in the screen below.

Note: Do not interrupt the BIOS flashing process until it has completed.

1. After the BIOS recovery process is complete, press any key to reboot the system.

2. Using a different system, extract the BIOS package into a USB flash drive.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING! System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Program new data Write new boot block... 178 +: Select Screen F1: Select Item Enter: Select +/-: Change Opt.. F3: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.12% Copyright (C) 2017 American Megatrends, Inc.

1. Press continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot

Optio Setup Utility - Copyright (C) 2017 American Megafrends, Inc. Recovery WARNING! System firmware is being updated. keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Flash update Flash update completed. Press any key to reset the system +: Select Screen T1: Select Item Enter: Select +/-: Change Opt. F1: General Hold F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.17/6. Copyright (C) 2017 American Megafrends, Inc.

Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press to save the settings and exit the BIOS Setup utility.

1. When the UEFI Shell prompt appears, type fs# to change the device directory path. Go to the directory that contains the BIOS package you extracted earlier from Step 6. Enter flash.nsh BIOSname.### at the prompt to start the BIOS update process.

Boot Configuration Boot mode select [DXPL] LEGACY to EFI support [Disabled] FIXED BOOT ORDER PRIORITIES Boot Option #1 [DXF1 MP:DXF1 MD...] Boot Option #2 [CD/DVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CD/DVD] Boot Option #5 [USB Key:SubDisk] Boot Option #6 [USB Floccy] Boot Option #7 [USB Lam] Boot Option #8 [Network:IMA GE SI...] Boot Option #9 [DXF1 Hard Disk] Boot Option #10 [DXF1 CD/DVD] Boot Option #11 [DXF1 USB Hard Disk] Boot Option #12 [DXF1 USB CD/DVD] Boot Option #13 [DXF1 USB Key:DXF1...] Boot Option #14 [DXF1 USB Floccy] Boot Option #15 [DXF1 USB Lam] Boot Option #16 [DXF1 Network] Boot Option #17 [Hard Disk] Add New Boot Option Sets the system boot order +: Select Screen T4: Select Item Enter: Select +/-: Change Opt. P1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

Note: Do not interrupt this process until the BIOS flashing is complete.

UFP1 Interactive (Shel) v0.1 ESK II UFP1 v2.5x (HyperCure Repatriroc, 3x8005000C) RMSING TABLE FSG: Altial(s) HDBY0b (BLK1): Pc:Altial(Shel)Pc1(Shel,0x4),USB(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD(Shel,0x4),WD (Shel,0x4) CADERS BLK1: Altial(s) Pc:Altial(Shel)Pc1(Shel,0x4),USB(Shel,0x4) Press USB to 1 seconds to skip startup.msh or any other key to continue. Shel: Altial FSG: V-CD PAPDOS FSG: VAPDOS(V) CD SAPME2_03163017 FSG: VAPDOS(V) SAPME2_03163017 - Flash.msh XISP7.316

1. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug

[Access Cess Port Ex 1 Index 0=511 0x18 Done. ********************************************************************** * Program BIOSI and ME (including PST) regions... ********************************************************************** [ ] HMI software update UTILITY v5.09-01-1217 [ ] Copyright (01)2017 American Markets Inc. All Rights Reserved. CNOTD = NAME Reading Flash ....... done - ME Data File checking .. on - HP3 checkouts ....... on - Check RemLayout ....... on Erasing Boot Block ....... done Updating Next Block ....... done Verifying Boot Block ....... done Erasing Match Block ....... 0x0132200 0x0

the AC power cable in the power supply again to power on the system.

1. Press continuously to enter the BIOS Setup utility.

verifying USB Block ......... done - Update success for FDM - Update success for 3L - - Successful Update Recovery Loader to OPRv1 - Successful Update MFB11- - Successful Update FTPM11- - Successful Update MFG, IWS and FB0211 - Successful Update FLOB and OTOK11 - ME Entire Image update success 11 WARNING: System not power-off to have the changes take effect! Moving F501:AF0000:04JPM2E_03162017:fdxt64_at1 -> F501:AF0000:04JPM2E_03162017:f dt.smc - (s) Moving F501:AF0000:04JPM2E_03162017:fdxt64_at1 -> F501:AF0000:04JPM2E_03162017: TrafueF_smc - (t) ********************************************************************** * • Please ignore this "Shield Correct from file - Device Error" • warning message due to it does not impact fileName process. * ********************************************************************** Deleting * Delete successful. fms(+) _

1. Press to load the default settings.

2. After loading the default settings, press to save the settings and exit the BIOS Setup utility.

7.7 CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system completely.
2. Remove the cover of the chassis to access the motherboard.
3. Remove the onboard battery from the motherboard.
4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
5. Remove the screwdriver or shorting device.
6. Replace the cover, reconnect the power cords and power on the system.

Notes: Clearing CMOS will also clear all passwords.

Do not use the PW_ON connector to clear CMOS.

JBT1 contact pads

7.8 Where to Get Replacement Components

If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com. Click the "Where to Buy" tab.

7.9 Reporting an Issue

Technical Support Procedures

Before contacting Technical Support, please take the following steps. If your system was purchased through a distributor or reseller, please contact them for troubleshooting services. They have the best knowledge of your specific system configuration.

1. Please review the Troubleshooting Procedures in this manual and Frequently Asked Questions on our website before contacting Technical Support.
2. BIOS upgrades can be downloaded from our website. Note: Not all BIOS can be flashed depending on the modifications to the boot block code.

3. If you still cannot resolve the problem, include the following information when contacting us for technical support:

4. System, motherboard, and chassis model numbers and PCB revision number

5. BIOS release date/version (this can be seen on the initial display when your system first boots up)
6. System configuration

An example of a Technical Support form is posted on our website. Distributors: For immediate assistance, please have your account number ready when contacting our technical support department by email.

Returning Merchandise for Service

A receipt or copy of your invoice marked with the date of purchase is required before any warranty service will be rendered. You can obtain service by calling your vendor for a Returned Merchandise Authorization (RMA) number. When returning to the manufacturer, the RMA number should be prominently displayed on the outside of the shipping carton, and mailed prepaid or hand-carried. Shipping and handling charges will be applied for all orders that must be mailed when service is complete.

For faster service, RMA authorizations may be requested online (http://www.supermicro.com/support/rma/).

Whenever possible, repack the chassis in the original Supermicro carton, using the original packaging material. If these are no longer available, be sure to pack the chassis securely, using packaging material to surround the chassis so that it does not shift within the carton and become damaged during shipping.

This warranty only covers normal consumer use and does not cover damages incurred in shipping or from failure due to the alteration, misuse, abuse or improper maintenance of products.

During the warranty period, contact your distributor first for any product problems.

Vendor Support Filing System

For issues related to Intel, use the Intel IPS filing system:

https://www.intel.com/content/www/us/en/design/support/ips/training/welcome.html

For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative.

7.10 Feedback

Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at [e-mail] to provide feedback on our manuals.

7.11 Contacting Supermicro

Headquarters

Super Micro Computer, Inc.

Address: 980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Address: Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

Appendix A

Standardized Warning Statements for AC Systems

About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

CAUTION: This unit has redundant power sources. Please disconnect all the power cords before servicing.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源装置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

System Specifications

Processors

3rd Generation Intel® Xeon® Scalable processors in an LGA4189 socket; UPI up to 10.4GT/s; supports CPU TDP up to 250W

Note: Refer to the motherboard specifications pages on our website for updates to supported processors.

Chipset

Intel® C621A

BIOS

AMI 128Mb SPI Flash EEPROM

Memory

48 DIMM slots for up to 12TB 3DS ECC DDR4-3200:RDIMM/LRDIMM or 18TB Intel® Optane™ DDR4-3200:DCPMM, RDIMM/LRDIMM//DCPMM

Storage Drives

24 hot-swap 2.5" SAS3/SATA3 drive bays

Two M.2 NVMe/SATA3

PCI Expansion Slots

Up to 18 single-wide PCIe 3.0 slots

-or-

Up to six double-wide GPUs

Input/Output

Network: Two 10G BaseT with Intel X710-TM4; 2x 10G SFP+ with Intel X710-TM4, and (optional) AIOM up to 100G QSFP 28

BMC: Dedicated LAN port

USB: Two rear USB 3.0 ports, one USB 3.0 Type A header

Video : One VGA port

COM: One serial port header

Motherboard

X12QCH+-P; Length 17.0", width 16.8" (431.8 mm x 426.7 mm)

Chassis

CSE-418HTS-R2K08P; 4U Rackmount, 7 x 17.2 x 29.8in. / 177 x 438.4 x 755mm (HxWxD)

System Cooling

Eight 9cm heavy duty fans

Power Supply

Model: PWS-1K69P-1R, Platinum Level Power Supply (80 Plus)

AC Input Voltages: 100-240 VAC auto-range

Rated Input Current: 100-127Vac / 13.8A / 47-63Hz

200-240Vac / 9.6A / 47-63Hz

240Vdc / 8.5A / 47-63Hz (only for China)

Rated Input Frequency: 47-63 Hz

Rated Output Power: 1000W: 100 - 127Vac

1600W: 200 - 240Vac

1600W: 240Vdc (only for China)

Rated Output Voltages: 12V+

Max: 83A / Min: 0A (100-127Vac)

Max: 132A / Min: 0A (200-240Vac)

Max: 132A / Min: 0A (240Vdc)

Operating Environment

Operating Temperature: 10° to 35° C (50° to 95° F)

Non-operating Temperature: -40^ to 60^ C ( -40^ to 140^ F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

FCC, ICES, CE, UKCA, VCCI, RCM, CSA/ UL, CB

Applied Directives, Standards

EMC/EMI: 2014/30/EU (EMC Directive) CLASS A

Electromagnetic Compatibility Regulations 2016

FCC Part 15 Subpart B

ICES-003

VCCI-CISPR 32

AS/NZS CISPR 32

BS/EN 55032

BS/EN 55035

CISPR 32

CISPR 35

BS/EN 61000-3-2

BS/EN 61000-3-3

BS/EN 61000-4-2

BS/EN 61000-4-3

BS/EN 61000-4-4

BS/EN 61000-4-5

BS/EN 61000-4-6

BS/EN 61000-4-8

BS/EN 61000-4-11

Product Safety: 2014/35/EU (LVD Directive)

UL/CSA 62368-1 (USA and Canada)

Electrical Equipment (Safety) Regulations 2016

IEC/BS/EN 62368-1

Environment:

2011/65/EU (RoHS Directive)

EC 1907/2006 (REACH)

2012/19/EU (WEEE Directive)

California Proposition 65

Warning! This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate