SuperServer 1029P-N32R - Server Supermicro - Free user manual and instructions

USER MANUAL SuperServer 1029P-N32R Supermicro

Front panel of a dual-chamber electronic device with labeled ports and status indicators

USER'S MANUAL

Revision 1.0a

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class B digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.0a

Release Date: May 09, 2019

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2019 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the SuperServer 1029P-N32R Installation and maintenance should be performed by experienced technicians only.

Please refer to the 1029P-N32R server specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: https://www.supermicro.com/wftp/driver
• Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at:

[e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Chapter 1 Introduction

1.1 Overview....8
1.2 Unpacking the System 8
1.3 System Features 9
1.4 Server Chassis Features....10

Control Panel 10

Drive Sled LEDs....11

Front Features....12

Rear Features 12

1.5 Motherboard Layout....13

Quick Reference Table....14

Chapter 2 Server Installation

2.1 Overview....17
2.2 Preparing for Setup....17

Choosing a Setup Location....17

Rack Precautions....17

Server Precautions....18

Rack Mounting Considerations ....18

Ambient Operating Temperature 18

Airflow 18
Mechanical Loading....18
Circuit Overloading....19
Reliable Ground....19

2.3 Installing the System into a Rack....20

Identifying the Sections of the Rack Rails ....20
Releasing the Inner Rails....21
Installing the Inner Rails on the Chassis 22
Installing the Outer Rails on the Rack 23
Installing the Chassis onto the Rack ....25

Chapter 3 Maintenance and Component Installation

3.1 Powering On the System 26
3.2 Removing Power....26
3.3 Accessing the System....26

3.4 Processor and Heatsink Installation....28

The Intel® Xeon® Scalable Series Processor ....28

Overview of the Processor Carrier Assembly 29

Overview of the CPU Socket....29

Overview of the Processor Heatsink Module 30

Creating the Non-F Model Processor Carrier Assembly....31

Assembling the Processor Heatsink Module 32

Preparing the CPU Socket for Installation 33

Installing the Processor Heatsink Module (PHM) 34

Removing the Processor Heatsink Module (PHM) from the Motherboard ....35

Memory Installation....36

ESD Precautions 36

Precautions....36

Introduction to Intel® Optane DC Persistent Memory 36

Memory Support....36

Memory Population Sequence ....37

General Memory Population Requirements ....38

DIMM Population Guidelines for Optimal Performance ....38

DIMM Installation....42

DIMM Module Removal....42

PCI Expansion Card Installation 43

Motherboard Battery 43

3.5 Chassis Components 44

2.5" NVMe Drives....44

Removing a Drive Using Linux....44

Removing a Drive Using Windows 47

Cable Connections....50

IPMI 50

PCI-E Slots 50

References....50

Installing Hard Drives....51

Hot-Swap for NVMe Drives 55

Checking the Temperature of an NVMe Drive ....55

System Fans ....56

Power Supply 57

Chapter 4 Motherboard Connections

4.1 Power Connections ....58
4.2 Rear I/O Ports ....59

Dedicated IPMI Port 60

4.3 Front Control Panel....61
4.3 Headers and Connectors....64
4.4 Jumpers....67

Explanation of Jumpers....67

4.5 LED Indicators....69

Chapter 5 Software

5.1 OS Installation....71

Installing the Windows OS for a RAID System ....71

Installing Windows to a Non-RAID System ....71

5.2 Driver Installation....72
5.3 SuperDoctor ^® 5....73
5.4 IPMI 73
5.5 Firmware Updates....74

Updating Switch Configuration....74

Updating the BMC Firmware....76

Chapter 6 BIOS

6.1 Introduction....78
Starting the Setup Utility 78
6.2 Main Menu....79
6.3 Advanced Setup Configurations....81
6.4 Event Logs ....108
6.5 IPMI 110
6.6 Security Settings 113
6.7 Boot Settings....116
6.8 Save & Exit....118

Appendix A BIOS Error Codes

Appendix B Standardized Warning Statements for AC Systems

Appendix C System Specifications

Appendix D UEFI BIOS Recovery

Appendix E CPU-Based RAID for NVMe

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides a brief outline of the functions and features of the 1029P-N32R. The 1029P-N32R is based on the X11DPS-RE motherboard and the SC136HTS-R1K69P-U2 chassis. The SC136HTS-R1K69P-U2 chassis features two front mounted sleds. The right side has a control panel, while the left side has a panel for status LEDs.

In addition to the motherboard and chassis, several important parts that are included with the system are listed below.

Main Parts List
Description Part Number Quantity
SC136 16-bay U.2 sled (without bezel) MCP-220-13601-0N 2
40x40x56 mm, 23.3K-20.3K RPM, counter-rotating fan FAN-0163L4 8
SC136H power supply air shroud MCP-310-13601-0N 1
Drive backplane FRU module for SC136 1U U.2 JBOF/Server	BPN-FRU-136U2	2
1U Passive CPU heat sink for equipped with a Narrow Retention Mechanism	SNK-P0067PS	2
Riser Card	RSC-R1U-E16R	2
Rail set	MCP-290-11809-0N	1
AC-DC 1600W at high and 1000W at low line, Platinum level	PWS-1K69P-1R	2

1.2 Unpacking the System

Inspect the box the SuperServer 1029P-N32R was shipped in and note if it was damaged in any way. If any equipment appears damaged, please file a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the server. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. It will also require a grounded AC power outlet nearby. Be sure to read the precautions and considerations noted in Appendix B.

1.3 System Features

The following table provides you with an overview of the main features of the 1029P-N32R. Please refer to Appendix C for additional specifications.

System Features

Motherboard

X11DPS-RE

Chassis

SC136HTS-R1K69P-U2

CPU

Dual Intel 82xx/81xx/62xx/61xx/52xx/51xx/42xx/41xx/31xx series

Socket Type

Socket P

Memory

The X11DPS-RE supports up to 6TB of RDIMM/NVDIMM DDR4 ECC 2933*/2666/2400/2133 MHz speed memory in 24 memory slots.*Notes: 1. 2933 MHz memory is supported by the 82xx/62xx series processors only. 2. Up to 9TB memory is supported with DCPMM modules installed.

Chipset

Intel® C627

Expansion Slots

2 PCI-E 3.0 x32 Tray cable connector interface2 PCI-E 3.0 x16 slots with riser card support

Hard Drives

Up to thirty-two (32) hot-swappable 2.5" NVMe/PCI-E drive bays in two 16-bay sleds

Power

Two (2) redundant 1600W power supplies

Form Factor

1U rackmount server

Dimensions

(WxHxD) 17.26 x 1.7 x 35.95 in. (438.4 x 43 x 913-mm) (without power supply bracket extortion)

1.4 Server Chassis Features

Control Panel

The switches and LEDs located on the control panel are described below. See Chapter 4 for details on the control panel connections.

SUPERMICRO 7 8 1 2 3 4 5 6 7 8

Figure 1-1. Control Panel View

Control Panel Features
Item Feature Description
1 Power		The main power switch is used to apply or remove power from the power supply to the server. Turning off system power with this button removes the main power but maintains standby power. To perform many maintenance tasks, you must unplug system before servicing.
2 Reset		The reset button performs a hard reset or reboot on the system. All activity in the system will stop and power will cycle, the system will be inaccessible while this happens.
3 Power LED		This indicates power is being supplied to the system power supply units. This LED is illuminated when the system is operating normally.
4Information LED		Alerts operator to several states, as noted in the table on the opposite page.
5 UID LED See Chapter 4 for details
6 NIC1/2 Indicates network activity when flashing.
7 Activity LED		Indicates the combined activity of the SSDs in this side of the sled. (See Sled Activity/Status LEDs table on the following page.)
8	Status LED	The Status LED indicates if there is a drive failure if it is Solid on Red.

Information LED
Status Description
Continuously on and red	An overheat condition has occurred.(This may be caused by cable congestion.)
Blinking red (1Hz) Fan failure, check for an inoperative fan.
Solid blue UID has been activated locally to locate the server in a rack environment.
Blinking blue UID has been activated using IPMI to locate the server in a rack environment.

Sled Activity/Status LEDs
	Status Description
Activity LED	Solid Blue Idle NVMe drive detected
	Blinking Blue I/O activity
	Off No drive detected
Status LED	Solid Red	Drive failure: extend the chassis sled to identify the failed drive.
	Blinking red (4 Hz)	Drive identifier: use IPMI to activate this status, which allows you to quickly identify a specified drive.

Drive Sled LEDs

Each sled has a one red fault LED mounted on its top for each drive, sixteen total. These are explained below.

Sled Top Fault LEDs

Sled Fault LEDs
Status Description
Off No failure
Solid Red	Drive failure.
Blinking Red (1 Hz) RAID	rebuild
Blinking Red (4 Hz)	Drive identifier: use IPMI to activate this status, which allows you to quickly identify a specified drive.

Front Features

The SC136HTS-R1K69P-U2 is a two-sled 1U chassis. See the illustration below for the features included on the front of the chassis.

Diagram of a multi-chamber network switch with labeled ports and indicator lights

Figure 1-2. Chassis Front View

Front Chassis Features
Item Feature	Description
1	Control Panel	Front control panel with LEDs and buttons (see preceding page)
2 Drive Bays	Bay that houses eight hot-swappable 2.5" SSDs
3	Sled Latch	Latch for releasing and extending the sled from the chassis

Rear Features

The illustration below shows the features included on the rear of the chassis.

Technical diagram of a multi-chamber electronic device with numbered components and labeled parts

Figure 1-3. Chassis Rear View

Rear Chassis Features
Item Feature Description
1 Power Supplies	Two redundant 1600W power supplies
2 I/O Ports See Chapter 4 for details on the I/O ports
3 Expansion Ports	Two PCI-E expansion ports are accessible from the rear chassis

1.5 Motherboard Layout

Below is a layout of the X11DPS-RE with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4.

JPOAT LE2 SP1 JPL1 LEDM1 VGA JLAN2 JLAN1JUSB1 IPMI LAN S-SATA5 JCOM1 JUIDB2 JWD1 JIPMB1 JTPM1 JKR1 JEWR1 LE1 JPWR1 BT1 JBT1 JPME1 JF1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEWR1 JEW3A 30000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 SUPER® X1DPS-RE REV:1.01 DESIGNED IN USA FE CE JUNI2 SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5SATA5S-TSD2 SD1 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JP42 JUID82 LED1 S-SATA4 JCOM2 LED3 J31 J30 JSD2 JP1 JSD1 JPME2 JP6 JP5 JP6 PSU2 PSU1 JL1 PSU2 PSU1 JL1 CPU1 CPU2 CPU3 CPU4 CPU5 FAN7FAN8 FAN9FAN6 FAN8 FAN7 FAN6 FAN5 FAN4 FAN3 FAN2 FAN1 FAN2 FAN1 FAN3 FAN2 FAN1 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN3 FAN4 FAN3 FAN2 FAN1 FAN3 FAN3 FAN4 FAN3

Figure 1-4. Motherboard Layout

Notes:

• See Chapter 4 for detailed information on jumpers, I/O ports, and JF1 front panel connections.
  • " " indicates the location of Pin 1.
• Jumpers/LED indicators not indicated are used for testing only.
• To avoid causing interference with other components, please be sure to use an add-on card that is fully compliant with the PCI-standard on a PCI slot.
• Use only the correct type of onboard CMOS battery as specified by the manufacturer. Do not install the onboard battery upside down to avoid possible explosion.

Quick Reference Table

Jumper Description Default Setting

JBT1 CMOS Clear Open (Normal)
JP1 BIOS Advance Function Pins 2-3 (Normal)
JP5 BMC Power Button Ready Test Header Pins 1-2 (Normal)
JPB1 BMC Enable/Disable Pins 1-2 (Enabled)
JPL1	GLAN Enable/Disable	Pins 1-2 (Enabled)
JPME1	ME Recovery	Pins 1-2 (Normal)
JPME2	Manufacturing Mode	Pins 1-2 (Normal)
JPQAT	QAT (QuickAssist Technology) Enable/Disable	Pins 1-2 (Enabled)
JWD1	Watch Dog Timer Enable	Pins 1-2 (Reset)

LED	Description	Status
LE1	CPLD Heartbeat LED	Blinking Green: Normal
LE2	Onboard Power LED	Solid Green: Power on
LED1	UID LED	Solid Blue: Unit Identified
LED3	PCI-E/SATA Hybrid M.2 SLOT 1 LED	Blinking Green: M.2 Active
LED4	PCI-E/SATA Hybrid M.2 SLOT 2 LED	Blinking Green: M.2 Active
LEDM1	BMC Heartbeat LED	Blinking Green: Normal

Connector Description

BT1 Onboard CMOS battery
FAN1 ~ FAN8 System/CPU fan headers (FAN1: CPU Fan)
J30 PCI-E/SATA Hybrid M.2 Slot 1
J31 PCI-E/SATA Hybrid M.2 Slot 2
JCOM1/JCOM2 COM ports
JF1 Front control panel header
JIPMB1 4-pin external I2C header (for an IPMI card)
JIPMILAN IPMI-Dedicated LAN port
JL1	Chassis intrusion header (Note: Please connect a cable from the Chassis Intrusion header at JL1 to the chassis to receive an alert via IPMI.)
JLAN1/JLAN2 10G LAN ports 1 and 2
JPWR1/JPWR2 Backplane power connectors
JRK1 Intel VROC RAID key header for NVMe Solid State Devices (SSD)
JSDCARD1 SD card socket
JSD1 - JSD2 SATA Disk-On-Module (DOM) power connectors
JTPM1 TPM/PORT80 Port 80 connector for Trusted Platform Module (TPM)
JUIDB2 Unit Identifier (UID) switch
JUSB1 (3.0)	USB 3.0 rear ports (USB12/13)
PSU1	Power Supply Unit 1
PSU2	Power Supply Unit 2
S-SATA4~5	(Powered) SATA connectors with power-pins built-in with support of SuperDOMs
VGA	VGA port

Note: To avoid causing interference with other components, please be sure to use an add-on card that is fully compliant with the PCI-standard on a PCI slot.

graph TD
    subgraph Power Components
        A["CPU1"] -->|G| B["PCI 1"]
        A -->|H| C["PCI 2"]
        A -->|J| D["PCI 3"]
        A -->|J| E["PCI 4"]
        A -->|J| F["PCI 5"]
        A -->|J| G["PCI 6"]
        A -->|J| H["PCI 7"]
        A -->|J| I["PCI 8"]
        A -->|J| J["PCI 9"]
        A -->|J| K["PCI 10"]
        A -->|J| L["PCI 11"]
        A -->|J| M["PCI 12"]
        A -->|J| N["PCI 13"]
        A -->|J| O["PCI 14"]
    end

    subgraph Control Signals
        P["SPI FLASH"] --> Q["SPI FLASH"]
        R["SPI FLASH"] --> S["SPI FLASH"]
        T["SPI FLASH"] --> U["SPI FLASH"]
        V["SPI FLASH"] --> W["SPI FLASH"]
        X["SPI FLASH"] --> Y["SPI FLASH"]
        Z["SPI FLASH"] --> AA["SPI FLASH"]
        AB["SPI FLASH"] --> AC["SPI FLASH"]
        AD["SPI FLASH"] --> AE["SPI FLASH"]
        AF["SPI FLASH"] --> AG["SPI FLASH"]
        AH["SPI FLASH"] --> AI["SPI FLASH"]
        AJ["SPI FLASH"] --> AK["SPI FLASH"]
        AL["SPI FLASH"] --> AM["SPI FLASH"]
        AN["SPI FLASH"] --> AO["SPI FLASH"]
        AP["SPI FLASH"] --> AQ["SPI FLASH"]
        AR["SPI FLASH"] --> AS["SPI FLASH"]
        AT["SPI FLASH"] --> AU["SPI FLASH"]
        AV["SPI FLASH"] --> AW["SPI FLASH"]
        AX["SPI FLASH"] --> AY["SPI FLASH"]
        AZ["SPI FLASH"] --> BA["SPI FLASH"]
        BB["SPI FLASH"] --> BC["SPI FLASH"]
        BD["SPI FLASH"] --> BE["SPI FLASH"]
        BF["SPI FLASH"] --> BG["SPI FLASH"]
        BH["SPI FLASH"] --> BI["SPI FLASH"]
        BJ["SPI FLASH"] --> BK["SPI FLASH"]
        BL["SPI FLASH"] --> BM["SPI FLASH"]
        BN["SPI FLASH"] --> BO["SPI FLASH"]
        BP["SPI FLASH"] --> BQ["SPI FLASH"]
        BR["SPI FLASH"] --> BS["SPI FLASH"]
        BT["SPI FLASH"] --> BU["SPI FLASH"]
        BV["SPI FLASH"] --> BW["SPI FLASH"]
        BX["SPI FLASH"] --> BY["SPI FLASH"]
        BZ["PCHL MUX"] --> CA["PCHL MUX"]
        CB["PCHL MUX"] --> CC["PCHL MUX"]
    end

    subgraph Control Signals
        D1["X16"] --> D2["X16"]
        D3["X16"] --> D4["X16"]
    end

    subgraph Control Signals
        E1["X16"] --> E2["X16"]
    end

    subgraph Control Signals
        F1["X16"] --> F2["X16"]
    end

    subgraph Control Signals
        G1["X16"] --> G2["X16"]
    end

    subgraph Control Signals
        H1["X16"] --> H2["X16"]

    subgraph Control Signals
        I1["X16"] --> I2["X16"]

    subgraph Control Signals
        J1["X16"] --> J2["X16"]

    subgraph Control Signals
        K1["X16"] --> K2["X16"]

    subgraph Control Signals
        L1["X16"] --> L2["X16"]

    subgraph Control Signals
        M1["X16"] --> M2["X16"]

    subgraph Control Signals
        N1["X16"] --> N2["X16"]

    subgraph Control Signals
        O1["X16"] --> O2["X16"]

    subgraph Control Signals
        P1["X16"] --> P2["X16"]

    subgraph Control Signals
        Q1["X16"] --> Q2["X16"]

    subgraph Control Signals
        R1["X16"] --> R2["X16"]

    subgraph Control Signals
        S1["X16"] --> S2["X16"]

    subgraph Control Signals
        T1["X16"] --> T2["X16"]

    subgraph Control Signals
        U1["X16"] --> U2["X16"]

    subgraph Control Signals
        V1["X16"] --> V2["X16"]

    subgraph Control Signals
        W1["X16"] --> W2["X16"]

    subgraph Control Signals
        X1["X16"] --> X2["X16"]

    subgraph Control Signals
        Y1["X16"] --> Y2["X16"]

    subgraph Control Signals
        Z1["X16"] --> Z2["X16"]

    subgraph Control Signals
        AA["X16"] --> AB["X16"]

    subgraph Control Signals
        AC["X16"] --> AD["X16"]

    subgraph Control Signals
        AE["X16"] --> AF["X16"]

    subgraph Control Signals
        AG["X16"] --> AH["X16"]

    subgraph Control Signals
        AI["X16"] --> AJ["X16"]

    subgraph Control Signals
        AK["X16"] --> AL["X16"]

    subgraph Control Signals
        AM["X16"] --> AN["X16"]

    subgraph Control Signals
        AO["X16"] --> AP["X16"]

    subgraph Control Signals
        AQ["X16"] --> AR["X16"]

    subgraph Control Signals
        AS["X16"] --> AT["X16"]

    subgraph Control Signals
        AU["X16"] --> AV["X16"]

    subgraph Control Signals
        AWX["X16"] --> AX["X16"]

    subgraph Control Signals
        AY["X16"] --> AZ["X16"]

    subgraph Control Signals
        BA["X16"] --> BB["X16"]

    subgraph Control Signals
        BC[YI*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*IF*
    end

    subgraph Polarity Inversion
    end

    subgraph Polarity Inversion
    end

    style Control Signals fill:#f9f,stroke:#333,stroke-width:2px

Figure 1-3. System Block Diagram

Note: This is a general block diagram and may not exactly represent the features on your motherboard. See the previous pages for the actual specifications of your motherboard.

Chapter 2

Server Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 4 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).
• This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

- Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.

• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time - extending two or more simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Appendix B.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the servers closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.

Slide rail mounted equipment is not to be used as a shelf or a work space.

Warning: do not pick up the server with the front handles. They are designed to pull the system from a rack only.

2.3 Installing the System into a Rack

This section provides information on installing the SC136HTS-R1K69P-U2 chassis into a rack unit with the rails provided. Due to the variety of rack units on the market, the assembly procedure might differ slightly. You should also refer to the installation instructions that came with the rack unit you are using.

Identifying the Sections of the Rack Rails

The 1029P-N32R includes two rack rail assemblies in the rack mounting kit. Each assembly consists of three sections: An inner chassis rail which secures directly to the chassis, an outer rail that secures to the rack, and a middle rail which extends from the outer rail. These assemblies are specifically designed for the left and right side of the chassis.

Rail Assembly (Shown with Rails Retracted) Outer Rail Middle Rail Locking Tab Inner Rail This Side Faces Outward

Figure 2-1. Identifying the Rail Sections

Note: Both front chassis rails and the rack rails have a locking tab, which serves two functions. First, it locks the system into place when installed and pushed fully into the rack (its normal operating position). In addition, these tabs lock the system in place when fully extended from the rack. This prevents the system from coming completely out of the rack when pulled out for servicing.

Releasing the Inner Rails

Releasing the Inner Rails from the Outer Rails

1. Pull the inner rail out of the outer rail until it is fully extended as illustrated below.
2. Press the locking tab down to release the inner rail.
3. Fully extend the inner rail.
4. Repeat steps 1-3 for the second outer rail.

graph TD
    A["Step 1: Initial component"] --> B["Step 2: Arrow pointing to component"]
    B --> C["Step 3: Inlet with green arrow and magnified detail"]
    C --> D["Step 4: Final assembly with arrows indicating direction"]

Figure 2-2. Extending and Releasing the Inner Rails

Warning: Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

Installing the Inner Rails on the Chassis

Installing the Inner Rails

1. Identify the left and right inner rails. They are labeled.
2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
3. Slide the inner rail forward toward the front of the chassis until the quick release bracket snaps into place, securing the rail to the chassis.
4. Optionally, you can further secure the inner rail to the chassis with a screw.
5. Repeat for the other inner rail.

Inner Rails 4 2 4 3

Figure 2-3. Installing the Inner Rails

Technical line drawing of a server rack with multiple drive bays and ventilation grilles (no text or labels)

Figure 2-4. Inner Rails Installed on the Chassis

Installing the Outer Rails on the Rack

Installing the Outer Rails

1. If your rack has round mounting holes, adjust the fittings on the outer rails. Press the latch at the end of the rail to change from square fittings to round fittings.

Figure 2-5. Adjusting Outer Rail Fittings

1. Push the middle rail back into the outer rail. An audible click indicates that the rail is fully inserted.

1 Push Rear 2 Lock!

Figure 2-5. Adjusting the Middle Rail

1. Insert the pegs on the rear of the outer rail into the rear rack holes. An audible click indicates that the rail is locked into place.
2. Press upward on the locking tab near the rear end of the middle rail, and extend the outer rail until the length fits within the posts of the rack.
3. On the front end of the outer rail, turn the latch to the open position and push the pegs into the front rack holes.
4. Turn the latch to the locked position.
5. Repeat steps 1-6 for the remaining outer rail.

1 Rear FRONT CLICK!!

2 L1 L2

3

Technical diagram showing a mechanical assembly with an inset close-up of a component being inserted, labeled with number 4.

Figure 2-6. Installing Outer Rails to a Rack

Installing the Chassis onto the Rack

Installing the Chassis onto the Rack

1. Fully extend the outer rails as illustrated in Figure 2-7.

2. Align the inner rails of the chassis with the outer rails on the rack.

3. Slide the inner rails into the outer rails, keeping pressure even on both sides. Hold down the locking lever on the inner rail to push the chassis fully onto the rack. An audible click indicates that the chassis is secured into the rails.

Warning: Mounting the system into the rack requires at least two people to support the chassis during installation. Follow safety recommendations printed on the rails.

Push Hold down Make sure the auto-lock latch is locked.

Figure 2-7. Installing the System into a Rack

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components require that power first be removed from the system. Please follow the procedures given in each section.

3.1 Powering On the System

Use the procedure below to power on the system.

1. Connect a power cord from a grounded AC outlet to the 1029P-N32R. Do not power on the system.

2. Press the power button on the 1029P-N32R, or power on the system using the IPMI command interface.

3.2 Removing Power

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non hot-swap components or when replacing a non-redundant power supply.

1. Use either the power button on the control panel or IPMI to power down the system.

2. After the system has completely shut-down, disconnect the AC power cord(s) from the power strip or outlet. (If your system has more than one power supply, remove the AC power cords from all power supply modules.)

3. Disconnect the power cord(s) from the power supply module(s).

3.3 Accessing the System

The SC136 chassis features a removable top cover, which allows easy access to the inside of the chassis.

Removing the Top Cover

1. Remove power from the system as described in Section 3.1.

2. Remove the screws securing the middle panel to the chassis.

3. Lift the middle panel up and off the chassis.

4. Remove the screws securing the second panel to the chassis.
5. Slide the second panel toward the rear of the chassis and lift it off.

Warning: Except for short periods of time, do not operate the system without the cover in place. The chassis cover must be in place to allow for proper airflow and to prevent overheating.

Technical line drawing of an internal server rack with multiple ports and ventilation grilles (no text or labels)

Figure 3-1. Removing the Chassis Cover

3.4 Processor and Heatsink Installation

The processor (CPU) and processor carrier should be assembled together first to form the processor carrier assembly. This will be attached to the heatsink to form the processor heatsink module (PHM) before being installed onto the CPU socket.

Notes:

• Use ESD protection.
• Unplug the AC power cord from all power supplies after shutting down the system.
• Check that the plastic protective cover is on the CPU socket and none of the socket pins are bent. If they are, contact your retailer.
• When handling the processor, avoid touching or placing direct pressure on the LGA lands (gold contacts). Improper installation or socket misalignment can cause serious damage to the processor or CPU socket, which may require manufacturer repairs.
  • Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed.
  • Refer to the Supermicro website for updates on processor support.
• All graphics in this manual are for illustrations only. Your components may look different.

The Intel® Xeon® Scalable Series Processor

Technical line drawing of a mechanical component with mounting holes and internal channels (no text or symbols)

Non-Fabric Model

Overview of the Processor Carrier Assembly

The processor carrier assembly contains the Intel Xeon Non-Fabric (Non-F) processor and a processor carrier.

1. Non-F Processor

Line drawing of a rectangular electronic component or housing with mounting holes and internal channels (no text or symbols)

1. Processor Carrier

Technical line drawing of a mechanical bracket or frame structure (no text or symbols)

Overview of the CPU Socket

The CPU socket is protected by a plastic protective cover.

1. Plastic Protective Cover

Line drawing of a mechanical component with mounting holes and a central plate (no text or symbols)

1. CPU Socket

Technical line drawing of a microprocessor base with mounting holes and a central slot (no text or symbols)

Overview of the Processor Heatsink Module

The Processor Heatsink Module (PHM) contains a heatsink, a processor carrier, and the Intel Xeon Non-Fabric (Non-F) processor.

1. Heatsink with Thermal Grease

2. Processor Carrier

3. Non-F Processor

Processor Heatsink Module

Technical line drawing of a computer processor housing with heatsink and mounting bracket (no text or symbols)

Bottom View

Creating the Non-F Model Processor Carrier Assembly

To install a Non-F model processor into the processor carrier, follow the steps below:

1. Hold the processor with the LGA lands (gold contacts) facing up. Locate the small, gold triangle in the corner of the processor and the corresponding hollowed triangle on the processor carrier. These triangles indicate pin 1. See the images below.
2. Using the triangles as a guide, carefully align and place Point A of the processor into Point A of the carrier. Then gently flex the other side of the carrier for the processor to fit into Point B.
3. Examine all corners to ensure that the processor is firmly attached to the carrier.

CPU (Upside Down) with CPU LGA Lands up Align Point A of the CPU and Point A of the Processor Carrier Pin 1 Align Point B of the CPU and Point B of the Processor Carrier A B A B Processor Carrier (Upside Down) Align CPU Pin 1

Allow carrier to latch onto CPU A B Allow carrier to latch onto CPU Pin 1

Processor Carrier Assembly (Non-F Model)

Assembling the Processor Heatsink Module

After creating the processor carrier assembly for the Non-F model processor, mount it onto the heatsink to create the processor heatsink module (PHM):

1. Note the label on top of the heatsink, which marks the heatsink mounting holes as 1, 2, 3, and 4. If this is a new heatsink, the thermal grease has been pre-applied on the underside. Otherwise, apply the proper amount of thermal grease.
2. Turn the heatsink over with the thermal grease facing up. Hold the processor carrier assembly so the processor's gold contacts are facing up, then align the triangle on the assembly with hole 1 of the heatsink. Press the processor carrier assembly down. The plastic clips of the assembly will lock outside of holes 1 and 2, while the remaining clips will snap into their corresponding holes.
3. Examine all corners to ensure that the plastic clips on the processor carrier assembly are firmly attached to the heatsink.

Non-Fabric Processor Carrier Assembly (Upside Down) Triangle on the CPU Triangle on the Processor Carrier Heatsink (Upside Down) Remaining plastic clips snap into the other corner holes of the heatsink Plastic clips 1 and 2 lock outside the heatsink's mounting holes

Preparing the CPU Socket for Installation

This motherboard comes with a plastic protective cover installed on the CPU socket. Remove it from the socket to install the Processor Heatsink Module (PHM). Gently pull up one corner of the plastic protective cover to remove it.

Technical line drawing of a computer processor casing with visible mounting holes and a warning label (no text or symbols on the diagram itself)

CPU Socket with Plastic Protective Cover

Remove the plastic protective cover from the CPU socket. Do not touch or bend the socket pins. Socket Pins

Installing the Processor Heatsink Module (PHM)

1. Once you have assembled the processor heatsink module (PHM) by following the instructions, you are ready to install the processor heatsink module (PHM) into the CPU socket on the motherboard. To install the PHM into the CPU socket, follow the instructions below.
2. Locate the triangle (pin 1) on the CPU socket, and locate the triangle (pin 1) at the corner of the PHM that is closest to "1." (If you have difficulty locating pin 1 of the PHM, turn the PHM upside down. With the LGA-lands side facing up, you will note the hollow triangle located next to a screw at the corner. Turn the PHM right side up, and you will see a triangle marked on the processor clip at the same corner of hollow triangle.)
3. Carefully align pin 1 (the triangle) on the the PHM against pin 1 (the triangle) on the CPU socket.
4. Once they are properly aligned, insert the two diagonal oval holes on the heatsink into the guiding posts.
5. Using a T30 Torx-bit screwdriver, install four screws into the mounting holes on the socket to securely attach the PHM onto the motherboard starting with the screw marked "1" (in the sequence of 1, 2, 3, and 4).

Note: Do not use excessive force when tightening the screws to avoid damaging the LGA-lands and the processor.

Guiding Post Triangle (Pin 1) on the socket Mounting the PHM into the CPU socket Tighten the screws in the sequence of 1, 2, 3, 4 (top 3 quarter view) #1 #2 #3 Use a torque of 12 lbf T30 Torx Driver

Removing the Processor Heatsink Module (PHM) from the Motherboard

Before removing the processor heatsink module (PHM), unplug power cord from the power outlet.

1. Using a T30 Torx-bit screwdriver, turn the screws on the PHM counterclockwise to loosen them from the socket, starting with screw marked #4 (in the sequence of 4, 3, 2, 1).
2. After all four screws are removed, wiggle the PHM gently and pull it up to remove it from the socket.

Note: To properly remove the processor heatsink module, be sure to loosen and remove the screws on the PHM in the sequence of 4, 3, 2, 1 as shown below.

Removing the screws in the sequence of 4, 3, 2, 1 #1 #2 #3 #4 CPU Socket After removing the screws, lift the Processor Heatsink Module off the CPU socket.

Memory Installation

ESD Precautions

Electrostatic Discharge (ESD) can damage electronic components including memory modules. To avoid damaging your DIMM modules, it is important to handle it very carefully. The following measures are generally sufficient to protect your equipment from ESD.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.
• Handle the memory module by its edges only.
• Put the memory modules into the antistatic bags when not in use.
• Check the Supermicro website for recommended memory modules

Introduction to Intel® Optane DC Persistent Memory

Intel® 82xx/62xx/52xx/42xx supports new DCPMM (Optane™ DC Persistent Memory Modules) technology. DCPMM offers data persistence with higher capacity at lower latencies than the existing memory modules and provides hyper-speed storage capability for high performance computing platforms with flexible configuration options.

Memory Support

The X11DPS-RE supports up to 6TB of LRDIMM/RDIMM/NVDIMM DDR4 ECC 2933*/2666/2400/2133 MHz speed memory in twenty-four memory slots.

Populating these DIMM modules with a pair of memory modules of the same type and size will result in interleaved memory, which will improve memory performance.

Note: 2933 MHz memory is supported by the 82xx/62xx series processors only.

DDR4 Memory Support for 81xx/61xx/51xx/41xx/31xx Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)		Speed (MT/s)
				One Slot per Channel	Two Slots per Channel
		DRAM Density		One DIMM per Channel	One DIMM per Channel	Two DIMMs per Channel
		4 Gb 8 Gb 1.2 Volts 1.2 Volts 1.2 Volts
RDIMM	SRx4 4 GB	8 GB		2666 2666 2666
	SRx8 8 GB	16 GB
	DRx8 8 GB	16 GB
	DRx4 16 GB	32 GB
RDIMM 3Ds	QRX4 N/A	2H-64GB
	8RX4 N/A	4H-128GB
LRDIMM QRx4	32 GB	64 GB
LRDIMM 3Ds	QRx4 N/A	2H-64GB
	8Rx4 N/A	4H-128 GB

DDR4 Memory Support for 82xx/62xx/52xx/42xx/32xx Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)			Speed (MT/s)
					One Slot per Channel	Two Slots per Channel
		DRAM Density			One DIMM per Channel	One DIMM per Channel	Two DIMMs per Channel
		4 Gb 8	Gb	16 Gb 1.2 Volts	1.2 Volts	1.2 Volts
RDIMM	SRx4	4 GB	8 GB	16 GB	2933	2933	2933
	SRx8	8 GB	16 GB	32 GB
	DRx8	8 GB	16 GB	32 GB
	DRx4	16 GB	32 GB	64 GB
RDIMM 3Ds	QRX4	N/A 2H-	64GB	2H-128GB
	8RX4	N/A 4H-	128GB	4H-256GB
LRDIMM	QRx4	32 GB	64 GB	128 GB
LRDIMM 3Ds	QRx4	N/A 2H-	64GB	2H-64GB
	8Rx4	N/A 4H-	128 GB	4H-256 GB

Check the Supermicro website for possible updates to memory support.

Memory Population Sequence

Memory modules for the X11 UP/DP/MP motherboards are populated using the "Fill First" method. The blue memory slot of each channel is considered the "first DIMM module" of the channel, and the black slot, the second module of the channel. When installing memory modules, be sure to populate the blue memory slots first and then populate the black slots.

To maximize memory capacity and performance, please populate all DIMM slots on the motherboard, including all blue slots and black slots.

General Memory Population Requirements

1. Be sure to use the memory modules of the same type and speed on the motherboard. Mixing of memory modules of different types and speeds is not allowed.
2. Using unbalanced memory topology such as populating two DIMMs in one channel while populating one DIMM in another channel on the same motherboard will result in reduced memory performance.
3. Populating memory slots with a pair of DIMM modules of the same type and size will result in interleaved memory, which will improve memory performance.

DIMM Population Guidelines for Optimal Performance

For optimal memory performance, follow the instructions listed in the tables below when populating memory modules.

Key Parameters for DIMM Configuration

Key Parameters for DIMM Configurations
Parameters Possible Values
Number of Channels 1, 2, 3, 4, 5, or 6
Number of DIMMs per Channel 1	DPC (1 DIMM Per Channel) or 2DPC (2 DIMMs Per Channel)
DIMM Type RDIMM (w/ECC), 3DS	RDIMM, LRDIMM, 3DS LRDIMM
DIMM Construction non-3DS RDIM	MM Raw Cards: A/B (2Rx4), C (1Rx4), D (1Rx8), E (2Rx8)3DS RDIMM Raw Cards: A/B (4Rx4)non-3DS LRDIMM Raw Cards: D/E (4Rx4)3DS LRDIMM Raw Cards: A/B (8Rx4)

DIMM Mixing Guidelines

General DIMM Mixing Guidelines

All DIMMs must be all DDR4 DIMMs.x4 and x8 DIMMs can be mixed in the same channel.Mixing of LRDIMMs and RDIMMs is not allowed in the same channel, across different channels, and across different sockets.Mixing of non-3DS and 3DS LRDIMM is not allowed in the same channel, across different channels, and across different sockets.

Mixing of DIMM Types within a Channel
DIMM Types RDIMM	LRDIMM	3DS LR	DIMM
RDIMM	Allowed	Not Allowed	Not Allowed
LRDIMM	Not Allowed	Allowed	Not Allowed
3DS LRDIMM	Not Allowed	Not Allowed	Allowed

Memory Population Table for the X11DP Motherboard w/24 DIMM Slots Onboard
CPUs/DIMMs Memory Population Sequence
1 CPU & 1 DIMM CPU1: P1-DIMMA1
1 CPU & 2 DIMMs CPU1: P1-DIMMA1/P1-DIMMD1
1 CPU & 3 DIMMs CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1
1 CPU & 4 DIMMs CPU1: P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1
1 CPU & 5 DIMMs* CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1
1 CPU & 6 DIMM CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1
1 CPU & 7 DIMMs*	CPU1: P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD1/P1-DIMME1/P1-DIMMF1
1 CPU & 8 DIMMs	CPU1: P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1
1 CPU & 9 DIMMs*	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD1/P1-DIMME1/P1-DIMMF1
1 CPU & 10 DIMMs*	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF1
1 CPU & 11 DIMMs*	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF1
1 CPU & 12 DIMMs	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF2/P1-DIMMF1
2 CPUs & 2 DIMMs	CPU1: P1-DIMMA1CPU2: P2-DIMMA1
2 CPUs & 4 DIMMs	CPU1: P1-DIMMA1/P1-DIMMD1CPU2: P2-DIMMA1/P2-DIMMD1
2 CPUs & 6 DIMMs	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1CPU2: P2-DIMMC1/P2-DIMMB1/P2-DIMMA1
2 CPUs & 8 DIMMs	CPU1: P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1CPU2: P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1
2 CPUs & 10 DIMMs	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1CPU2: P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1
2 CPUs & 12 DIMMs	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1CPU2: P2-DIMMC1/P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1
2 CPUs & 14 DIMMs	CPU1: P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1CPU2: P2-DIMMC1/P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1
2 CPUs & 16 DIMMs	CPU1: P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1CPU2: P2-DIMMB1/P2-DIMMB2/P2-DIMMA1/P2-DIMMA2/P2-DIMMD2/P2-DIMMD1/P2-DIMME2/P2-DIMME1
2 CPUs & 18 DIMMs	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF2/P1-DIMMF1CPU2: P2-DIMMC1/P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1
2 CPUs & 20 DIMMs	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF1CPU2: P2-DIMMB1/P2-DIMMB2/P2-DIMMA1/P2-DIMMA2/P2-DIMMD2/P2-DIMMD1/P2-DIMME2/P2-DIMME1
2 CPUs & 22 DIMMs*	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF1CPU2: P2-DIMMC1/P2-DIMMC2/P2-DIMMB1/P2-DIMMB2/P2-DIMMA1/P2-DIMMA2/P2-DIMMD2/P2-DIMMD1/P2-DIMME2/P2-DIMME1/P2-DIMMF1
2 CPUs & 24 DIMMs	CPU1: P1-DIMMC1/P1-DIMMC2/P1-DIMMB1/P1-DIMMB2/P1-DIMMA1/P1-DIMMA2/P1-DIMMD2/P1-DIMMD1/P1-DIMME2/P1-DIMME1/P1-DIMMF2/P1-DIMMF1CPU2: P2-DIMMC1/P2-DIMMC2/P2-DIMMB1/P2-DIMMB2/P2-DIMMA1/P2-DIMMA2/P2-DIMMD2/P2-DIMMD1/P2-DIMME2/P2-DIMME1/P2-DIMMF2

*Unbalanced, not recommended.

Note: Unbalanced memory configuration decreases memory performance and is not recommended for Supermicro motherboards.

P1-DIMMF1 P1-DIMMF2 P1-DIMMF1-P P1-DIMMF2 P1-DIMMD1 P1-DIMMD2 P1-DIMMD2 Pin 1 CPU1 P1-DIMMA2 P1-DIMMA1 P1-DIMMB2 P1-DIMMB1 P1-DIMMC2 P1-DIMMC1 P1-DIMMD2-P P2-DIMME2 P2-DIMME1 P2-DIMMD1 P2-DIMMD2 CPU2 P2-DIMMA2 P2-DIMMA1 P2-DIMMB2 P2-DIMMB1 P2-DIMMC2 P2-DIMMC1

Symmetric Population within 1 CPU Socket

Modes

P1-DIMMF1

P1-DIMMF2

P1-DIMME1

P1-DIMME2

P1-DIMMD1

P1-DIMMD2

P1-DIMMA2

P1-DIMMA1

P1-DIMMB2

P1-DIMMB1

P1-DIMMC2

P1-DIMMC1

Channel Config.

AD DRAM1

DCPMM DRAM1

DRAM1 DCPMM

DM DRAM1

DCPMM D

CPMM DRAM1

DCPMM DRAM1

DCPMM DRAM1

DM 2-2-2

MM DRAM1

DCPMM DRAM1

DRAM1 DCPMM

MM DRAM1

DCPMM D

CPMM DRAM1

DCPMM DRAM1

DM 2-2-2

AD + MM DRAM3

DRAM3 DCPMM

MM DRAM3

DCPMM D

DRAM3 DCPMM

MM DCPMM

DRAM3 DCPMM

DM 2-2-2

AD DRAM1

- DRAM1

- DRAM1 DCPMM

DPM DCPMM

MM DRAM1

- DRAM1

- DRAM1

2-1-1

MM DRAM2

- DRAM2

- DRAM2 DCPMM

DCPMM

MM DRAM2

- DRAM2

- DRAM2

2-1-1

AD + MM DRAM3

- DRAM3

- DRAM3

DCPMM

DCPMM

DRAM3

- DRAM3

2-1-1

AD DRAM1

- DRAM1

DCPMM DRAM1

DCPMM

DCPMM

DRAM1

DCPMM DRAM1

- DRAM1

2-2-1

MM DRAM1

- DRAM1

DCPMM DRAM1

DCPMM

DCPMM

DRAM1

DCPMM DRAM1

- DRAM1

2-2-1

AD + MM DRAM3

- DRAM3

DCPMM

DRAM3

DCPMM

DRAM3

DCPMM

DRAM3

- DRAM3

2-2-1

AD DCPMM

- DRAM1

- DRAM1

- DRAM1

- DRAM1

- DRAM1

- DCPMM 1-1-1

MM DCPMM

- DRAM1

- DRAM1

- DRAM1

- DRAM1

- DRAM1

- DCPMM 1-1-1

AD + MM DCPMM

- DRAM3

- DRAM3

- DRAM3

- DRAM3

- DRAM3

- DCPMM 1-1-1

AD DCPMM

- DRAM1

DRAM1

DRAM1

DRAM1

DRAM1

DRAM1

- DCPMM 2-2-1

Asymmetric Population within 1 CPU Socket

Modes

P1-DIMMF1

P1-DIMMF2

P1-DIMME1

P1-DIMME2

P1-DIMMD1

P1-DIMMD2

P1-DIMMA2

P1-DIMMA1

P1-DIMMB2

P1-DIMMB1

P1-DIMMC2

P1-DIMMC1

Channel Config.

AD DRAM1 - DRAM1

- DRAM1

- DCPMM D

DRAM1 - DRAM1

- DRAM1 - DRAM1

- DRAM1 2/1-1-1

AD ^A DRAM1 - DRAM1

- DRAM1

- DCPMM D

DRAM1 - DRAM1

- DRAM1 - DRAM1

- DRAM1 2/1-1-1

Legend (for the two tables above)

DDR4 Type Capacity
DRAM1	RDIMM	3DS RDIMM	LRDIMM	3DS LRDIMM	Any Capacity
DRAM2 RDIMM		-		-	Refer to Validation Matrix (DDR4 DIMMs validated with DCPMM) below.
DRAM3 RDIMM 3DS RDIMM LRDIMM			-

Note: DDR4 single rank x8 is not available for DCPMM Memory Mode or App-Direct Mode.

Legend (for the two tables above)

Capacity

DCPMM Any Capacity (Uniformly for all channels for a given configuration)

• * 2nd socket has no DCPMM DIMM
- For MM, general NM/FM ratio is between 1:4 and 1:16. Excessive capacity for FM can be used for AD. (NM = Near Memory; FM = Far Memory)
- For each individual population, rearrangements between channels are allowed as long as the resulting population is compliant with the PDG rules for the 82xx/62xx/52xx/42xx platform.
- For each individual population, please use the same DDR4 DIMM in all slots.
- For each individual population, sockets are normally symmetric with exceptions for 1 DCPMM per socket and 1 DCPMM per node case. Currently, DCPMM modules operate at 2666 MHz.
- No mixing of DCPMM and NVMDIMMs within the same platform is allowed.
- This DCPMM population guide targets a balanced DCPMM-to-DRAM-cache ratio in MM and MM + AD modes.

Validation Matrix (DDR4 DIMMs Validated w/DCPMM)
DIMM Type	Ranks Per DIMM & Data Width (Stack)	DIMM Capacity (GB)
		DRAM Density
		4Gb 8Gb
RDIMM	1Rx4 8GB 16GB
	2Rx8 8GB 16GB
	2Rx4 16GB 32GB
LRDIMM 4Rx4 N/A 64GB
LRDIMM 3DS 8Rx4 (4H) N/A 128GB

DIMM Installation

1. Follow the instructions given in the memory population guidelines listed in the previous sections to install memory modules on your motherboard. For the system to work properly, please use memory modules of the same type and speed on the motherboard. (See the Note below.)

2. Push the release tabs outwards on both ends of the DIMM slot to unlock it.

3. Align the key of the DIMM module with the receptive point on the memory slot.

4. Align the notches on both ends of the module against the receptive points on the ends of the slot.

5. Use two thumbs together to press the DIMM module straight down into the slot until the module snaps into place.

6. Press the release tabs to the lock positions to secure the DIMM module into the slot.

Exploded view of a computer motherboard showing CPU socket, RAM slots, and circuitry (no readable text or symbols)

Notches

Release Tabs

Insert the DIMM module into the memory slot.

Illustration of two hands holding a metal rod with blue directional arrows indicating force or movement (no text or symbols)

DIMM Module Removal

Press the release tabs on both ends of the DIMM socket to release the DIMM module from the socket as shown in the drawing on the right.

Technical illustration of a mechanical assembly with two views: top view shows a cylindrical component, bottom view shows a rod-like structure (no text or symbols)

Warning! 1. T to avoid damage to the DIMM module or the DIMM socket, do not use excessive force when pressing the release tabs on the ends of the DIMM socket. 2. Handle DIMM modules with care. Carefully follow all the instructions given in Section 1 of this user guide to avoid ESD-related damage to your components or system. 3. All graphics, including the layout drawing above, are for reference only. Your system components may or may not look the same as shown in this user guide.

PCI Expansion Card Installation

The system includes two pre-installed riser cards (RSC-R1U-E16R) that allow you to position standard size PCI-E cards at a 90-degree angle, allowing them to fit inside the chassis.

Installing PCI Expansion Cards

The riser cards have already been pre-installed into the motherboard. Perform the following steps to install an add-on card into one of them:

Begin by removing power from the system as described in section 3.1.

1. Remove the chassis cover to access the inside of the system.
2. Remove the PCI slot shield on the chassis by releasing the locking tab.
3. Insert the expansion (add-on) card into the riser card.
4. Secure the card with the locking tab.

Motherboard Battery

The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard.

Replacing the Battery

Begin by removing power from the system as described in section 3.1.

1. Push aside the small clamp that covers the edge of the battery. When the battery is released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+) side facing up. Then push the other side down until the clamp snaps over it.

Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

LITHIUM BATTERY BATTERY HOLDER

Figure 3-2. Installing the Onboard Battery

Warning: There is a danger of explosion if the onboard battery is installed upside down (which reverses its polarities). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).

3.5 Chassis Components

2.5" NVMe Drives

Your system likely came with drives installed. The 1029P-N32R supports thirty-two (32) hot-swappable 2.5" NVMe SSDs.

This section is intended to address the need to prepare the NVMe SSDs to be hot-plugged in Supermicro SuperServer 1029P-N32R system.

Warning: Hot removing an NVMe SSD from any deployed systems requires careful planning. If possible, it is generally a good idea to stop the I/O access to the target NVMe SSD and migrate out its data first. Make sure that the target NVMe SSD is identified correctly. Then, prepare and remove the target NVMe SSD with every precaution.

Removing a Drive Using Linux

Examples listed here were done under Linux RHEL 7.4. Command output in this section may be abbreviated for easier reading. Additional notes are added with marking “←”.

As NVMe SSD events are generally associated with their /dev entries in Linux, this document shows a method to correlate the slot number of an NVMe SSD in a server enclosure to its kernel /dev entry, and prepare the target SSD for hot removal.

Removing an NVMe SSD in the Linux Environment

1. Find the target NVMe SSD information. To find the information of any target NVMe SSD, such as /dev/nvme12n1 in this example, use the following command:

<h1 id="udevadm-info-n-devnvme12n1-a">udevadm info -n /dev/nvme12n1 -a</h1>
...
looking at parent device '/devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/0000:3c:06.0/0000:43:00.0/nvme/nvme12':
    KERNELS=="nvme12"
    SUBSYSTEMS=="nvme"
    DRIVERS==""
    ATTRS{transport}=="pcie"
    ATTRS{model}=="INTEL SSDPERKX040T7 ← /dev/nvme12n1's vendor & model
    ATTRS{cntlid}=="0"
    ATTRS{serial}=="BTLF736500FD4P0SGN " ← /dev/nvme12n1's serial number
    ATTRS{firmware_rev}=="QDV101D0" 

1. Find the slot information of the target NVMe SSD. In the server BMC GUI (under Server Health/NVMe SSD), the probed target NVMe SSD information can be used find its slot location in the enclosure:

SUPERMICR BMC Network: 172.031.036.028 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Power/Temperature Record NVMe SSD Power Source NVMe SSD This page displays NVMe SSD information Locate / Stop Locate SSD Slot:22 Locate Stop locate Eject CPLD Version: 80.10 80.10 Slot:22 Status: Present Temperature: 35 degrees C Vendor ID: 80 86 Serial Number: BTLF730500FD4P09GN Model Number: INTEL SSDPERKX040T7 VMD Mode: Off

As shown in above BMC GUI screen shot, the target NVMe SSD is in Slot 22, with its Vendor/Model/Serial matching what we probed.

Besides the slot labeling on the drive tray, the slot physical position could also be located through the Locate function in the BMC GUI (as shown above). When located, the slot LED will blink RED.

1. Prepare the target NVMe SSD for hot removal. On the BMC GUI, once the target NVMe SSD has been correctly identified, click the Eject button for its slot to remove it from the OS:

SUPERMICR BMC Network: 172.031.036.028 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Power/Temperature Record NVMe SSD Power Source NVMe SSD This page displays NVMe SSD information Locate / Stop Locate SSD Slot:22 Locate Stop locate Eject CPLD Version: 80.10 80.10 Slot:22 Status: Present Temperature: 35 degrees C Vendor ID: 80.86 Serial Number: BTLF736500FD4P03GN Model Number: INTEL SSDPERKX040T7 VMD Mode: Off

Confirm the eject operation by clicking the "OK" button on the following pop-up window. Once the GUI indicates that the NVMe SSD has been rejected successfully, the target is removed from the OS.

To confirm that target SSD has been removed from OS, do the following:

• Execute the #lsblk command and check that the /dev entry has been removed.
• Execute the #dmesg command and check the related messages.
  • The slot LED should become solid GREEN.

After confirming that the target NVMe SSD has been removed from by the OS, it can then be safely removed from its slot.

In case the above action needs to be reversed, the ejected NVMe SSD can be re-installed back into OS by clicking its Insert button:

SUPERMICK BMC Network: 172.031.036.028 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Power/Temperature Record NVMe SSD Power Source NVMe SSD This page displays NVMe SSD information. Locate / Stop Locate SSD Slot:22 Insert CPLD Version: 80.10 80.10

1. The replacement NVMe SSD can now be hot inserted. After the OS has discovered the newly inserted NVMe SSD, it will be ready for configuration and access.

Removing a Drive Using Windows

Examples listed here were done under Windows Server 2016. Command output in this section may be abbreviated for easier reading. Additional notes are added with marking “←”.

Windows generally reports NVMe SSD events associated with a disk or harddisk number. In this section, a method is shown how to correlate an NVMe SSD's slot number in a server enclosure to its Disk #, and prepare the target SSD for hot removal.

1. Get the target NVMe SSD information. From Start (Right Click)\Disk Management, all the installed NVMe SSD information can be obtained:

Disk Management File Action View Help Volume Layout Type File System Status Capacity Free Spa... % Free (C) Simple Basic NTFS Healthy (B... 58.51 GB 44.27 GB 76 % System Reserved Simple Basic NTFS Healthy (S... 500 MB 139 MB 28 % Disk 0 Basic 3725.90 GB Online 3725.90 GB Unallocated Disk 1 Basic 3725.90 GB Online 3725.90 GB Unallocated Disk 2 Basic 3725.90 GB Online 3725.90 GB Unallocated Disk 3 Basic 3725.90 GB Online 3725.90 GB Primary partition

Also, with Intel SSD data center tool, all the installed Intel SSD information could be listed with the following command:

isdct show -intelssd

...

- Intel SSD DC P4500 Series BTLF736500FD4P0SGN - ← Serial number

Bootloader : 0136

DevicePath : \\.\PHYSICALDRIVE12 ← Disk / Harddisk #

DeviceStatus : Healthy

Firmware : QDV101D0

FirmwareUpdateAvailable : The selected Intel SSD contains current firmware as of this tool release.

Index : 4

ModelNumber : INTEL SSDPERKX040T7 ← Vendor / Model

ProductFamily : Intel SSD DC P4500 Series

SerialNumber : BTLF736500FD4P0SGN ← Serial number

• • •

1. Find the slot information of the target NVMe SSD. With the serial number of a target NVMe SSD, its slot information can be found from the server BMC GUI (under Server Health/NVMe SSD):

SUPERMICR BMC Network: 172.031.036.028 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Power/Temperature Record NVMe SSD Power Source NVMe SSD This page displays NVMe SSD information Locate / Stop Locate $SD Slot:22 Locate Stop locate Eject CPLD Version: 80.10 80.10 Slot:22 Status: Present Temperature: 35 degrees C Vendor ID: 80 86 Serial Number: BTLF736500FD4P0SGN Model Number: INTEL SSDPERKX040T7 VMD Mode: Off

Using the Locate function as shown above, the physical position of the slot and the target NVMe SSD can be located. When located, the slot LED will blink RED.

1. Prepare the target NVMe SSD for hot removal. On the BMC GUI, once the target NVMe SSD has been correctly identified, click the Eject button for its slot to remove it from the OS:

SUPERMICR BMC Network: 172.031.036.028 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Power/Temperature Record NVMe SSD Power Source NVMe SSD This page displays NVMe SSD information. Locate / Stop Locate SSD Slot:22 Locate Stop locate Eject CPLD Version: 80.10 80.10 Slot:22 Status: Present Temperature: 35 degrees C Vendor ID: 80.86 Serial Number: BTLF736500FD4P0SGN Model Number: INTEL SSDPERKX040T7 VMD Mode: Off

Confirm the eject operation by clicking the "OK" button on the following pop-up window.

Once the GUI indicates that the NVMe SSD has been rejected successfully, the target would have been removed from the OS.

Please wait for the target SSD to be fully removed from host by checking

• Its Disk # & information removed from Disk management.
  • The slot LED should become solid GREEN.

After confirming that target SSD has been removed from Windows, it can now be safely removed from its slot.

In case the above action needs to be reversed, the ejected NVMe SSD can be re-installed back into OS by clicking the Insert button:

SUPERMICR BMC Network: 172 031.036.028 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Power/Temperature Record NVMe SSD Power Source NVMe SSD This page displays NVMe SSD information. Locate / Stop Locate SSD Slot:22 Insert CPLD Version: 80.10 80.10

1. Hot insert the replacement NVMe SSD. The replacement NVMe SSD could simply be hot inserted. After Windows discovers the newly inserted SSD, it will be ready for configuration and access.

References

Internal References

Supermicro SuperServer SYS-1029P-N32R information and documents:

https://www.supermicro.com/products/system/1U/1029/SYS-1029P-N32R.cfm

Supermicro SuperServer SYS-1029P-NR32R information and documents:

https://www.supermicro.com/products/system/1U/1029/SYS-1029P-NR32R.cfm

External References

Intel SSD Data Center Tool information and downloads:

https://downloadcenter.intel.com/download/27863?v=t

Cable Connections

IPMI

The SC136 chassis offers intelligent management with IPMI providing hardware health monitoring and remote power control. To enable, connect to the storage enclosure using the dedicated IPMI LAN connectors.

For details on configuring and using IPMI, refer to the Supermicro IPMI manual.

IPMI

Figure 3-3. IPMI Cables

PCI-E Slots

The SC136 chassis supports two low profile PCI-E slots on the rear, to add PCI-E expansion cards.

PCI-E Slots

Figure 3-4. Location of PCI-E Sots

Installing Hard Drives

The SC136 supports two sleds with 16 hot-swappable NVMe (Non-Volatile Memory Express) drives each. These drives can be removed without powering down the system. Only Supermicro qualified NVMe drives are recommended. To install the NVMe drives, the sleds will need to be extended from the chassis. For drive bay numbering identification see Figure 3-6 on the next page.

Top View Sled #2 Sled #1 Pull 1 Each sled has two levers. Pull these levers outward to unlock the sled. Pull

Once the levers are unlocked, the sleds can now be pulled out from the chassis to expose the NVMe SSD drive bays.. Sled #1 Sled #2

Figure 3-5. Removing the Sleds

Notes: 1. Do not leave a sled extended from the chassis for longer than two minutes. 2. Use Supermicro qualified NVMe SSDs only. For information on recommended SSDs, visit the Supermicro website at http://www.supermicro.com/products/nfo/storage.cfm.

NVMe Drive Bay Identification

Left Sled 1 3 5 7 0 2 4 6 OUTER INNER Right Sled 17 19 21 23 16 18 20 22 INNER OUTER 15 13 14 9 10 8 31 29 28 27 26 25 30 24

Figure 3-6. NVMe Drive Bay Identification

Mounting a Drive in a Drive Carrier

1. Release and swing open the locking latches on the side of the drive carrier.
2. Insert a drive into the carrier with the PCB side facing down and the connector end toward the rear of the carrier. Insert the drive at an angle as shown in Figure 3-7. Verify that the mounting holes on the drive align with the mounting holes on the carrier.
3. Swing both locking latches shut. An audible click indicates that the drive is locked in place.
4. Insert the drive and drive carrier into its bay. When the drive is fully inserted, push the release tab until it clicks shut. Refer to Figure 3-8.

Diagram of a computer drive with labeled components and directional arrows indicating motion or assembly.

Diagram of a computer drive chassis with red arrows indicating rotation, labeled with number 3 (no text or symbols on the device itself)

Figure 3-7. Mounting a Drive in a Carrier

Diagram showing a hand pressing a device component with a red arrow indicating the press direction

Illustration of a hand pressing a component on a server rack (no text or symbols visible)

Figure 3-8. Installing a Drive Carrier into the Sled

Removing a Drive

1. Push the release tab on the drive carrier that you want to remove.
2. Use the release tab to retract the drive carrier from its bay, then fully remove the drive carrier and its drive.
3. Release and swing open the locking latches on the side of the drive carrier.
4. Remove the drive from its carrier at an angle as shown in Figure 3-10.

Diagram showing two steps of installing or adjusting a device panel, labeled 1 and 2 with red arrows indicating movement.

Figure 3-9. Removing a Drive Carrier from a Sled

Diagram of a computer drive with labeled components and directional arrows indicating motion or movement.

Figure 3-10. Removing a Drive from a Carrier

Hot-Swap for NVMe Drives

An NVMe drive can be inserted and replaced using IPMI.

Note: If you are using VROC, see the VROC appendix in this manual instead.

Ejecting a Drive

1. IPMI > Server Health > NVMe SSD
2. Select Device, Group and Slot, and click Eject. After ejecting, the drive Status LED indicator turns green.
3. Remove the drive.

Note that Device and Group are categorized by the CPLD design architecture.

Slot is the slot number on which the NVMe drives are mounted.

Host Identification Server: 172.031.049.114 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Health Event Log Power Consumption Power Source NVMe SSD NVMe SSD This page displays NVMe SSD information Locate / Stop Locate SSD Device:0 Group:0 Slot0 Locate Stop Locate Eject CPUD / RPM ID: 8F Rev: 10 Slot0 Status: Present Temperature: 35 degrees C Vendor ID: 80.86 Serial Number: RTLFT270087M4P0IGN Model Number: INTEL SSDPE2KX84T7 Slot1 Status: Present Temperature: 33 degrees C Vendor ID: 80.86 Serial Number: PHLFT20500884P0IGN Model Number: INTEL SSDPE2KX84T7 Slot2 Copyright © 2018 Super MicroComputer, Inc.

Figure 3-11. IPMI Screenshot

Replacing the Drive

1. Insert the replacement drive.
2. IPMI > Server Health > NVMe SSD
3. Select Device, Group and slot and click Insert. The drive Status LED indicator flashes red, then turns off. The Activity LED turns blue.

Checking the Temperature of an NVMe Drive

There are two ways to check using IPMI.

Checking a Drive

• IPMI > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives, as in Figure 3-11.
• IPMI > Server Health > Sensor Reading > NVME_SSD – Shows the single highest temperature among all the NVMe drives.

System Fans

The chassis contains eight 4-cm counter-rotating, high-performance fans.

Fan speed is controlled by system temperature via IPMI. If a fan fails, the remaining fan will ramp up to full speed and the overheat/fan fail LED on the control panel will turn on. Replace any failed fan at your earliest convenience with the same type and model (the system can continue to run with a failed fan).

Remove the top chassis cover while the system is still running to determine which of the fans has failed. Then power down the system before replacing a fan.

Replacing System Fans

1. After determining which fan has failed, turn off the system power.
2. Unplug the fan wiring from the serverboard and remove the failed fan.
3. Press the fan release tab to lift the failed fan from the chassis and pull it completely from the chassis.
4. Place the new fan into the vacant space in the housing while making sure the arrows on the top of the fan (indicating air direction) point in the same direction as the arrows on the other fans.
5. Power up the system and check that the fan is working properly before replacing the chassis cover.

Technical diagram of an internal server rack with multiple ports and a highlighted component (no text or labels)

Figure 3-12. Placing the System Fan

Power Supply

The chassis has two redundant power supplies. The power modules are hot-swappable, enabling the power supplies to be changed without powering down the system. These power supplies are auto-switching capable. This enables the power supply to automatically sense and operate at a 100v to 240v input voltage. An amber light will be illuminated on the power supply when the power is off. An illuminated green light indicates that the power supply is operating.

Changing the Power Supply

1. Determine which power supply needs to be replaced and unplug the power cord to that module.
2. Push the release tab (on the back of the power supply) as illustrated, to release the power module from the chassis.
3. While holding down the release tab, pull the power supply out using the handle provided on the power module.
4. Replace the failed power module with the same model power supply.
5. Push the new power supply module into the power bay until the tab clicks into the locked position.
6. Plug the AC power cord back into the module and the replacement power module will automatically power-up.

Technical line drawing of a server rack with multiple ports and ventilation grilles (no text or labels)

Figure 3-13. Power Supply Modules

Chapter 4

Motherboard Connections

This section describes the connections on the motherboard and provides pinout definitions.

Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.

Please review the Safety Precautions in Appendix B before installing or removing components.

4.1 Power Connections

Two power connections on the X11DPS-RE must be connected to the power supply. The wiring is included with the power supply.

• SMCI-Proprietary Power (PSU1/PSU2)
• 8-pin Processor Power (JPWR1/JPWR2)

SMCI-Proprietary Power Connectors

Two SMCI-proprietary Power Supply Unit connectors, located at PSU1/PSU2, provide main power to your system. Please note that these power connectors are reserved for Supermicro system use only.

PCIE-Proprietary Power Connectors

JPWR1/2 are 12-pin power connectors used by proprietary PCIE-based memory backplane designs. Connect appropriate power cables here to provide power to your PCI-E devices.

12V 8-pin Power Pin Definitions

Pin# Definition

1 - 6 Ground

7 - 12 +12V

Required Connection

Important: To provide adequate power to the motherboard, connect the 24-pin and the 8-pin power connectors to the power supply. Failure to do so may void the manufacturer's warranty on your power supply and motherboard.

4.2 Rear I/O Ports

See Figure 4-1 below for the locations and descriptions of the various I/O ports on the rear of the motherboard.

1 2 3 4 5 6 7 8 SUPER X110PS-RE RBV1.01 DESIGNED IN USA CPU1 CPU2 FXAM1 FXAM2 FXAM3 FXAM4 FXAM5 FXAM6 FXAM7 FXAM8 FXAM9 FXAM10 FXAM11 FXAM12 FXAM13 FXAM14 FXAM15 FXAM16 FXAM17 FXAM18 FXAM19 FXAM20 FXAM21 FXAM22 FXAM23 FXAM24 FXAM25 FXAM26 FXAM27 FXAM28 FXAM29 FXAM30 FXAM31 FXAM32 FXAM33 FXAM34 FXAM35 FXAM36 FXAM37 FXAM38 FXAM39 FXAM40 FXAM41 FXAM42 FXAM43 FXAM44 FXAM45 FXAM46 FXAM47 FXAM48 FXAM49 FXAM50 FXAM51 FXAM52 FXAM53 FXAM54 FXAM55 FXAM56 FXAM57 FXAM58 FXAM59 FXAM60 FXAM61 FXAM62 FXAM63 FXAM64 FXAM65 FXAM66 FXAM67 FXAM68 FXAM69 FXAM70 FXAM71 FXAM72 FXAM73 FXAM74 FXAM75 FXAM76 FXAM77 FXAM78 FXAM79 FXAM80

Figure 4.1 Rear I/O Ports

Back Panel I/O Ports
No. Description No. Description
1. Unit Identifier Switch (JUIDB2) 5. USB13 (3.0)
2. JCOM1 6. JLAN1
3. IPMI LAN 7. JLAN2
4. USB12 (3.0) 8. VGA

Serial Port

There is a COM connector (JCOM1) near the I/O back panel, next to the IPMI LAN connector. This COM connector provides serial communication support.

VGA Port

There is one VGA port on the IO back panel. Connect to this port for the VGA display.

Universal Serial Bus (USB) Ports

There are two USB 3.0 ports (USB12/13) on the I/O back panel located at JUSB1.

Back Panel USB 12/13 (3.0)Pin Definitions
Pin# Definition Pin# Definition
A1 VB	US B1 Power
A2 D-	B2 USB_N
A3 D+	B3 USB_P
A4 GND	B4 GND
A5 Stda	SSRX- B5 USB3_RN
A6 Stda	SSRX+ B6 USB3_RP
A7 GND	B7 GND
A8 Stda	SSTX- B8 USB3_TN
A9 Stda	SSTX+ B9 USB3_TP

Dedicated IPMI Port

A dedicated IPMI LAN that supports GbE LAN is located on the backplane. This Ethernet port accepts an RJ45 type cable. Please refer to the LED Indicator Section for LAN LED information.

LAN Ports

Two 10G LAN ports (JLAN1, JLAN2) are located on the I/O back panel. These ports accept RJ45 type cables.

4.3 Front Control Panel

JF1 contains header pins for various buttons and indicators that are normally located on a control panel at the front of the chassis. These connectors are designed specifically for use with Supermicro chassis. See the figure below for the descriptions of the front control panel buttons and LED indicators.

SOP 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 SOPCARDI LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED/LED 2.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-2.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V 2.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V 2.5V-4.5V-4.5V-4.5V-2.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V-4.5V 2.5V-4.5V-4.5V-2.5V-4.5V-4.5V-2.5V-4.5V-2.5V 2.5V-2.5V-2.5V-2.5V 2.5V-2.5V-2.5V 2.5V-2.5V-2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V 2.5V

Power Button Reset Button 3.3V UID LED 3.3V Stby 3.3V Stby 3.3V Stby 1 2 Ground Ground Power Fail LED OH/PWR Fail/Fan Fail LED NIC2 Active LED NIC1 Active LED HDD LED PWR LED

JF1 Header Pins

Power Button

The Power Button connection is located on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system. This button can also be configured to function as a suspend button (with a setting in the BIOS - see Chapter 4). To turn off the power when the system is in suspend mode, press the button for 4 seconds or longer. Refer to the table below for pin definitions.

Power ButtonPin Definitions (JF1)

Pins Definition

1 Signal

2 Ground

Reset Button

The Reset Button connection is located on pins 3 and 4 of JF1. Attach it to a hardware reset switch on the computer case to reset the system. Refer to the table below for pin definitions.

Reset ButtonPin Definitions (JF1)

Pins Definition

3 Reset

4Ground

Power Fail LED

The Power Fail LED connection is located on pins 5 and 6 of JF1. Refer to the table below for pin definitions.

Power Fail LEDPin Definitions (JF1)
Pin#	Definition
5	3.3V
6	PWR Supply Fail

OH/Fan Fail/PWR Fail/UID LED

Connect an LED cable to pins 7 and 8 of the Front Control Panel (JF1) to use UID/Overheat/Fan Fail/Power Fail LED connections. The LED on pin 8 provides warnings of overheat, power failure or fan failure. Refer to the tables below for details.

Information LED-UID/OH/PWR Fail/Fan Fail LEDPin Definitions (Pin 7 & Pin 8 of JF1)
Status Description
Solid red An overheat condition has occurred. (This may be caused by cable congestion).
Blinking red (1Hz) Fan failure: check for an inoperative fan.
Blinking red (0.25Hz) Power failure: check for a non-operational power supply
Solid blue Local UID is activated. Use this function to locate a unit in a rack mount environment that might be in need of service.
Blinking blue (300 msec)	Remote UID is on. Use this function to identify a unit from a remote location that might be in need of service.

The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11 and 12 of JF1, and LAN port 2 is on pins 9 and 10. Attach the NIC LED cables here to display network activity. Refer to the table below for pin definitions.

LAN1/LAN2 LEDPin Definitions (JF1)
Pin# Definition Pin# Definition
9 +3.3V	10	NIC	2 Activity LED
11	+3.3V	12	NIC 1 Activity LED

HDD LED

The HDD LED connection is located on pins 13 and 14 of JF1. Attach a cable to pin 14 to show hard drive activity status. Refer to the table below for pin definitions.

HDD LEDPin Definitions (JF1)
Pins Definition
13	3.3V Stdby
14	HDD Active

Power LED

The Power LED connection is located on pins 15 and 16 of JF1. Refer to the table below for pin definitions.

Power LEDPin Definitions (JF1)
Pins Definition
15	3.3V
16	PWR LED

4.3 Headers and Connectors

Onboard Fan Header

This motherboard has eight headers (FAN1\~8). All these 4-pin fan headers are backward-compatible with traditional 3-pin fans. However, onboard fan speed control is available only when all 4-pin fans are used on the motherboard. Fan speed control is supported by Thermal Management via IPMI 2.0 interface. See the table below for pin definitions.

Fan HeaderPin Definitions
Pin#	Definition
1	Ground (Black)
2	+12V (Red)
3	Tachometer
4PWM	Control

TPM Header

The Trusted Platform Module (TPM)/Port 80 is located at JTPM1 and is available from SMCI (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. See the table below for pin definitions.

TPM/Port 80 HeaderPin Definitions
Pin# Definition Pin# Definition
1 +3.3	V 2 SPI_CS#
3 RESET# 4SPI_MISO
5 SPI_CLK 6 GND
7 SPI_MOSI 8
9 +3.3	V Stdby 10	SPIIRQ

VROC RAID Key Header

A VROC RAID key header is located at JRK1 on the motherboard and is used to support onboard NVMe devices.

Chassis Intrusion

A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable from the chassis to inform you of a chassis intrusion when the chassis is opened. Refer to the table below for pin definitions.

Chassis Intrusion Pin Definitions

Pin# Definition

1 Intrusion Input

2 Ground

NVMe Slots (PCI-E 3.0 x32)

There are two PCI-E 3.0 x32 slots with Tray Cable Connector Interface connections on the motherboard.

PCI-E 3.0 Slots

There are two PCI-E 3.0 x16 slots located on the motherboard. CPU1 SLOT1 PCI-E and CPU2 SLOT2 PCI-E are supported by their corresponding CPU's, and offer riser card support.

Note: To avoid causing interference with other components, please be sure to use an add-on card that is fully compliant with the PCI-standard on a PCI slot.

PCI-E Hybrid M.2 Slots

The X11DPS-RE motherboard has two PCI-E hybrid M.2 slots, J30 (SLOT1), and J31 (SLOT2). M.2 was formerly Next Generation Form Factor (NGFF) and serves to replace mini PCI-E. M.2 allows for a variety of card sizes, increased functionality, and spatial efficiency.

The M.2 socket on the motherboard supports PCI-E 3.0 X2 SSD cards in the 2280 and 22110 form factors.

A Holder Locked position B Holder Mount Turn 90 degrees to lock Locked position C Card Holder Mount Turn 90 degrees to lock Locked position with M.2 card D Plastic screw STOP

Press in here Rectangle hole on MB Hole Location on the MB 42 M.2 Card 80 A+B+C M.2 Card 110 A+B+C A+B+C A+B+D Copyright © 2017 by Super Micro Computer, Inc. All rights reserved.

S-SATA 3.0 Ports

The X11DPS-RE has two SATA DOM 3.0 ports (S-SATA4, S-SATA5). S-SATA4/S-SATA5 can be used with Supermicro SuperDOMs which are yellow SATA DOM connectors with power pins built in, and do not require external power cables. Supermicro SuperDOMs are backward-compatible with regular SATA HDDs or SATA DOMs that need external power cables.

SATA 3.0 PortPin Definitions

Pin# Signal

1 Ground

2 SATA_TXP

3 SATA_TXN

4Ground

5 SATA_RXN

6 SATA_RXP

7 Ground

Internal Speaker/Buzzer

The Internal Speaker/Buzzer (SP1) is used to provide audible indications for various beep codes. Refer to the table below for pin definitions.

Internal BuzzerPin Definitions
Pin# Definition
1 Pos	(+) Beep In
2 Neg	(-) Alarm Speaker

4.4 Jumpers

Explanation of Jumpers

To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

Note: On a two-pin jumper, "Closed" means the jumper is on both pins and "Open" indicates the jumper is either on only one pin or has been completely removed.

Connector Pins Jumper Setting 3 2 1 3 2 1

CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system and unplug the power cord(s).
2. Remove the cover of the chassis to access the motherboard.
3. Remove the onboard battery from the motherboard.
4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
5. Remove the screwdriver (or shorting device).
6. Replace the cover, reconnect the power cord(s) and power on the system.

Notes: Clearing CMOS will also clear all passwords.

Do not use the PW_ON connector to clear CMOS.

JBT1 contact pads

Management Engine (ME) Recovery

Use jumper JPME1 to select ME Firmware Recovery mode, which will limit resource allocation for essential system operation only in order to maintain normal power operation and management. In the single operation mode, online upgrade will be available via Recovery mode. See the table below for jumper settings.

ME Recovery ModeJumper Settings
Jumper Setting Definition
Pins 1-2 Normal
Pins 2-3 ME Recovery

Manufacturing Mode Select

Close JPME2 to bypass SPI flash security and force the system to use the Manufacturing Mode, which will allow you to flash the system firmware from a host server to modify system settings. See the table below for jumper settings.

Manufacturing Mode SelectJumper Settings
Jumper Setting Definition
Pins 1-2 Normal	(Default)
Pins 2-3 Manufacturing Mode

Watch Dog Timer

The Watch Dog function is a monitor controlled by the JWD1 that can reboot the system when a software application hangs. It must be enabled in BIOS, where the default is set to Reset. In the case an application hangs, jumping pins 1-2 will cause Watch Dog to reset the system while jumping pins 2-3 will generate a non-maskable interrupt signal.

Watch DogJumper Settings
Jumper Setting	Definition
Pins 1-2 Reset
Pins 2-3 NMI
Open Disabled

4.5 LED Indicators

Dedicated IPMI LAN LEDs

A dedicated IPMI LAN is located on the I/O Backplane of the motherboard. The amber LED on the right indicates activity, while the green LED on the left indicates the speed of the connection. See the tables at right for more information.

IPMI LAN Link LED (Left) & Activity LED (Right)
Color State Definition
Link (Left) Green: Solid 100 MbpsActivity (Right) Amber: Blinking Active

IPMI LAN Link LED Activity LED

BMC Heartbeat LED

LEDM1 is the BMC heartbeat LED. When the LED is blinking green, BMC is functioning normally. See the table below for the LED status.

BMC Heartbeat LED Indicator

LED Color Definition

Green: Blinking BMC Normal

Onboard Power LED

The Onboard Power LED is located at LE2 on the motherboard. When this LED is on, the system is also on. Be sure to turn off the system and unplug the power cord before removing or installing components. Refer to the table below for more information.

Onboard Power LED Indicator
LED Color Definition
Off	System Off (power cable not connected)
Green	System On

Unit ID LED

A rear UID LED indicator at LED1 is located near the UID switch on the I/O back panel. This UID indicator provides easy identification of a system unit that may need service.

UID LEDLED Indicator

LED Color Definition

Blue: On Unit |identified

UID SWITCH UID LED

Chapter 5

Software

After the hardware has been installed, you should install the Operating System (OS), configure RAID settings and install the drivers. Necessary drivers and utilities may be found at https://www.supermicro.com/wftp/driver.

5.1 OS Installation

You must first configure RAID settings (if using RAID) before you install the Windows OS and the software drivers. To configure RAID settings, please refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals.

Installing the Windows OS for a RAID System

1. Insert Microsoft's Windows Setup DVD in the DVD drive and the system will start booting up from the DVD.
2. Insert the USB stick containing Windows drivers to a USB port on the system. Note: for older legacy OS's, please use a method to slipstream the drivers.
3. Select the partition on the drive in which to install Windows.
4. Browse the USB folder for the proper driver files.
5. Choose the RAID driver indicated in the Windows OS Setup screen, then choose the hard drive in which you want to install it.
6. Once all devices are specified, continue with the installation.
7. After the Windows OS installation is completed, the system will automatically reboot.

Installing Windows to a Non-RAID System

1. Insert Microsoft's Windows OS Setup DVD in the DVD-ROM drive and the system will start booting up from the DVD.
2. Continue with the installation. The Windows OS Setup screen will display.
3. From the Windows OS Setup screen, press the key. The OS Setup will automatically load all device files and then continue with the Windows installation.
4. After the installation has completed, the system will automatically reboot.

5.2 Driver Installation

The Supermicro website contains drivers and utilities for your system at https://www.supermicro.com/wftp/driver. Some of these must be installed, such as the chipset driver.

After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to create a DVD of the drivers and utilities it contains. (You may also use a utility to extract the ISO file if preferred.)

After creating a DVD with the ISO files, insert the disk into the DVD drive on your system and the display shown in Figure 5-1 should appear.

Another option is to go to the Supermicro website at http://www.supermicro.com/products/. Find the product page for your motherboard here, where you may download individual drivers and utilities to your hard drive or a USB flash drive and install from there.

Note: To install the Windows OS, please refer to the instructions posted on our website at http://www.supermicro.com/support/manuals/.

SUPERMICRO X11DPS-RE Motherboard Drivers & Tools (Win10) Intel Chipset INF files Microsoft .Net Framework 4.5.2 (Optional) ASPEED Graphics Driver Intel Rapid Storage Technology Enterprise Intel USB 3.0 Drivers Intel PRO Network Connections Drivers SUPERMICRO Computer Inc. SUPERMICRO SuperDoctor 5 Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information, please visit SUPERMICRO's web site.

Figure 5-1. Driver & Tool Installation Screen

Note: Click the icons showing a hand writing on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you must re-boot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire contents.

5.3 SuperDoctor® 5

The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server), you can remotely control power on/off and reset chassis intrusion for multiple systems with SuperDoctor 5 or IPMI. SuperDoctor 5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

Note: The default User Name and Password for SuperDoctor 5 is admin / admin.

SuperDoctor 5 Main Info SuperMicro SuperDirects Certificate error LocalHost:1444SugarDirects Master Board: Motherboard: C78360-CB-ML Voltage 3.0k 12.0k 10.0k 8.0k 6.0k 4.0k 2.0k 1.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k 3.4k 12.4k 10.4k 8.4k 6.4k 4.4k 2.4k 1.4k 0.4k 0.2k 0.1k 0.05k 0.02k 0.01k 0.005k 0.002k 0.001k 0.0005k 0.0002k 0.0001k 0.00005k 0.00002k 0.00001k 0.000005k 0.000002k 0.000001k 0.0000005k 0.0000002k 0.0000001k Power/CTS/FTTL Voltage 33K Voltage MAX Voltage Temperature 127116A CPU Time System Temp. Phingenta Time 12396A 29842. Hard Disk : Solar Shockwave. SUPRIVICAL/SWDRS (2536GAT) Memory Select Language: English | ADMIN | Local | Status: C:\Users\Interset

Figure 5-2. SuperDoctor 5 Interface Display Screen (Health Information)

5.4 IPMI

The X11DPS-RE supports the Intelligent Platform Management Interface (IPMI). IPMI is used to provide remote access, monitoring and management. There are several BIOS settings that are related to IPMI.

For general documentation and information on IPMI, please visit our website at: http://www.supermicro.com/products/nfo/IPMI.cfm.

5.5 Firmware Updates

Updating Switch Configuration

Use IPMI to update the configuration of the PCIe switches.

1. Log into the IPMI.

SUPERMICRO Please Login Username Password Login

The default Username and Password are ADMIN / ADMIN.

1. Under the Maintenance tab, select PCIE Switch FW Update.

System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help System FRU Reading Hardware Information System Firmware Version : 3.65 IP address : 172.31 49:36 Firmware Build Time : 8/05/2019 BMC MAC address : 0c:04-7a 88:25:78 BIOS Version : 3.6a System LAN1 MAC address : 0c:04-7a 88 BIOS Build Time : 01/23/2019 System LAN2 MAC address : 0c:04-7a 88 Redfish Version : 1.0.1 CPLD Version : 01.01.19 Remote Console Review Refresh Preview image Power Control via IPMI Hold a currently on Power On Power Down Reset Firmware Update Unit Reset IKVM Reset Factory Default IPMI Configuration Maintenance Event Log BIOS Update Troubleshooting PCIE Switch FW Update

1. Click Choose File to select configuration file, and click the Update button.

System Server Health Configuration Remote Control Virtual Media Maintenance Macellaneous Help Maintenance Forequire Update Unit Reset IMVM Forward Factory Default IPM Configuration Maintenance Event Log BCH Update ThermalShooting PCIE Switch File Update PCIE Switch FW update Update Forms for PCIE Switch Lift Tray Status: Ready L. Trip Switch Forequire Version 1 R Trip Switch Forequire Version 2 Choose File No file chosen Update Open This PC - Desktop - log > 004 - updates Organize - New folder Quick access Drive Two PC 3D Objects Desktop Documents Downloads Music Pictures Videos Local Disk (C:) Name Date modified Type IPM-IVME3-130PL_0951_PMB538_09202018.pmc K:\3\018.231 PM PNC File File name: IPM-IVME3-130PL_0951_PMB538_09202018.pmc Add File Open Cancel

4. Click OK to confirm.

172.31.49.36 says Do you want to update firmware? If yes, please Press the Confirm button. PCIE Switch FW update Update firmware for PCIE Switch. Please do not turn off the power during the firmware update. L/R Tray Status: Ready L Tray Switch Firmware Version: 1050658 R Tray Switch Firmware Version: 1080056 Choose File : BPN-NVME3...62018.pmc Update

Both switches are updated consecutively, and the progress is reported.

5. Click OK to finish.

172.31.49.36 says PCIE Switch firmware update is completed. Normal Refresh Layout English System Server Health Help PCIE Switch FW update Updating the firmware of POE Switch. Please wait until the percentage of the Firmware Image to be 100 percent. After that, PCIE Switch will be fixed automatically. Do not power on/off reset during updating. Upgrade progress: 99% - Switch2 Upgrade progress: 99% - Switch2

Updating the BMC Firmware

Use IPMI to update the BMC firmware.

1. Log into the IPMI.

SUPERMIXC Please Login Username Password Login

The default Username and Password are ADMIN / ADMIN.

1. Under the Maintenance tab, select Firmware Update.

System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help System FRU Reading Hardware Information System Firmware Revision : 3.65 Firmware Build Time : 02/05/2019 BIOS Version : 3.0a BIOS Build Time : 01/22/2019 Redfish Version : 1.0.1 CFLD Version : 01.b1.19 IP address : 172.31.49.35 EMC MAC address : 0c:04.7a.68:25.76 System LAN1 MAC address : 0c:04.7a.68 System LAN2 MAC address : 0c:04.7a.68 Remote Console Preview Refresh Preview Image Power Control via IPMI Firmware Update Unit Reset IKVM Reset Factory Default IPMI Configuration Maintenance Event Leg BIOS Update Troubleshooting PCIE Switch FW Update

1. Click the Enter Update Mode button.

System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Maintenance Firmware Update Unit Reset IKVM Reset Factory Default Firmware Update This page press [Enter Update Model] to put the device in a special mode that allows firmware update. Please note that once you enter update mode the device will reset if the update process is cancelled. Enter Update Mode

Read the caution message and click OK.

1. Click Choose File, select the configuration file, then click the Upload Firmware button.

System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Firmware Upload This device is now in upgrade burning gel 100 percent. After removed to the Log page suite. Open This PC Desktop Documents Downloads Music Pictures Videos Organize New folder This PC 3D Objects Desktop Documents Downloads Music Pictures Videos File name: SMT_X11BPM_363_V.bsn File name: SMT_X11BPM_363_V.bsn All Files Open Cancel

1. Clear all check box options and click the Start Upgrade button.

System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Firmware Upload Upgradesible Modules Module Name : Verification Result : Existing Version : New Version : IPMI_FW Valid Signature 03.65 03.65 Preserve Configuration(Unchecking this option will restore the factory default setting of BMC.) Preserve SDR (Unchecking this option will restore the default of SDR.) Preserve SSL certificate (Unchecking this option will restore the default of SSL certificate.) Start Upgrade Cancel

1. Click OK to confirm and wait.

172.31.36.153 says Upgrade complete: Please wait for 1 minute OK Firmware upload The device is now in upgrade mode. Please wait until the percentage of the Firmware Image burning reaches 100 percent. After that, please wait for the system to reboot. The web page will restrict to the Login page automatically. Upgrade progress : 100%

The system reboots to complete the update.

Chapter 6

BIOS

6.1 Introduction

This chapter describes the AMIBIOS™ Setup utility for the X11DPS-RE motherboard(s). The is stored in a flash chip and can be easily upgraded using a floppy disk-based program.

Note: Due to periodic changes to the BIOS, some settings may have been added or deleted and might not yet be recorded in this manual. Please refer to the Manual Download area of our website for any changes to BIOS that may not be reflected in this manual.

Starting the Setup Utility

To enter the BIOS Setup Utility, hit the key while the system is booting-up. (In most cases, the key is used to invoke the BIOS setup screen. There are a few cases when other keys are used, such as , , etc.) Each main BIOS menu option is described in this manual.

The Main BIOS screen has two main frames. The left frame displays all the options that can be configured. "Grayed-out" options cannot be configured. The right frame displays the key legend. Above the key legend is an area reserved for a text message. When an option is selected in the left frame, it is highlighted in white. Often a text message will accompany it. (Note that BIOS has default text messages built in. We retain the option to include, omit, or change any of these text messages.) Settings printed in Bold are the default values.

A "▶" indicates a submenu. Highlighting such an item and pressing the key will open the list of settings within that submenu.

The BIOS setup utility uses a key-based navigation system called hot keys. Most of these hot keys (, , , , keys, etc.) can be used at any time during the setup navigation process.

6.2 Main Menu

When you first enter the AMI BIOS setup utility, you will enter the Main setup screen. You can always return to the Main setup screen by selecting the Main tab on the top of the screen. The Main BIOS setup screen is shown below. The following Main menu items will be displayed:

System Date [Thu 04/05/2018] System Time [08:27:30]	Set the Date. Use Tab to switch between Date elements.
Supermicro X11DPS-R BIOS Version 2.0a Build Date 03/26/2018 CPLD Version 01.b1.18
Memory Information Total Memory 16384 MB Memory Speed 2132 MT/s	++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

System Date/System Time

Use this item to change the system date and time. Highlight System Date or System Time using the arrow keys. Enter new values using the keyboard. Press the key or the arrow keys to move between fields. The date must be entered in Day MM/DD/YYYY format. The time is entered in HH:MM:SS format.

Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00. The date's default value is 01/01/2014 after RTC reset.

Supermicro X11DPS-RE

BIOS Version

This item displays the version of the BIOS ROM used in the system.

Build Date

This item displays the date when the version of the BIOS ROM used in the system was built.

CPLD Version

This item displays the version of the CPLD (Complex-Programmable Logical Device) used in the system.

Memory Information

Total Memory

This item displays the total size of memory available in the system.

This feature allows you to specify the boot sequence from the list of available USB drives. A device that is in parenthesis has been disabled in the corresponding type menu.

▶ Network Drives

This feature allows you to specify the boot sequence from the list of available network drives. A device that is in parenthesis has been disabled in the corresponding type menu.

Retry Boot Devices

This option allows you to retry boot devices. Options include Enabled and Disabled.

6.3 Advanced Setup Configurations

Use the arrow keys to select the Advanced submenu and press to access the submenu items:

Aptio Setup Utility - Copyright (C) 2018 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Boot Feature CPU Configuration Chipset Configuration Server ME Information SATA Configuration ssATA Configuration PCIe/PCI/PnP Configuration Super IO Configuration Serial Port Console Redirection ACPI Settings Trusted Computing	Boot Feature Configuration Page
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

Warning: Take caution when changing the Advanced settings. An incorrect value, a very high DRAM frequency, or an incorrect DRAM timing setting may make the system unstable. When this occurs, revert to the default to the manufacture default settings.

▶Boot Feature

Quiet Boot

Use this feature to select the screen between displaying POST messages or the OEM logo at bootup. Select Disabled to display the POST messages. Select Enabled to display the OEM logo instead of the normal POST messages. The options are Enabled and Disabled.

Note: POST message is always displayed regardless of the item setting.

Option ROM Messages

Use this feature to set the display mode for the Option ROM. Select Keep Current to use the current AddOn ROM display setting. Select Force BIOS to use the Option ROM display mode set by the system BIOS. The options are Force BIOS and Keep Current.

Bootup NumLock State

Use this feature to set the Power-on state for the Numlock key. The options are Off and On.

Wait For 'F1' If Error

Select Enabled to force the system to wait until the 'F1' key is pressed if an error occurs. The options are Disabled and Enabled.

INT19 Trap Response

Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Immediate, the ROM BIOS of the host adaptors will "capture" Interrupt 19 at bootup immediately and allow the drives that are attached to these host adaptors to function as bootable disks. If this item is set to Postponed, the ROM BIOS of the host adaptors will not capture Interrupt 19 immediately and allow the drives attached to these adaptors to function as bootable devices at bootup. The options are Immediate and Postponed.

Re-try Boot

When EFI (Expansible Firmware Interface) Boot is selected, the system BIOS will automatically reboot the system from an EFI boot device after an initial boot failure. Select Legacy Boot to allow the BIOS to automatically reboot the system from a Legacy boot device after an initial boot failure. The options are Disabled, Legacy Boot, and EFI Boot.

Power Configuration

Watch Dog Function

Select Enabled to allow the Watch Dog timer to reboot the system when it is inactive for more than 5 minutes. The options are Disabled and Enabled.

Power Button Function

This feature controls how the system shuts down when the power button is pressed. Select 4 Seconds Override for the user to power off the system after pressing and holding the power button for 4 seconds or longer. Select Instant Off to instantly power off the system as soon as the user presses the power button. The options are Instant Off and 4 Seconds Override.

Restore on AC Power Loss

Use this feature to set the power state after a power outage. Select Power-Off for the system power to remain off after a power loss. Select Power-On for the system power to be turned on after a power loss. Select Last State to allow the system to resume its last power state before a power loss. The options are Power-On, Stay-Off and Last State.

▶CPU Configuration

Warning: Setting the wrong values in the following sections may cause the system to malfunction.

▶ Processor Configuration

The following CPU information will be displayed:

• Processor BSP Revision
• Processor Socket
• Processor ID
• Processor Frequency
• Processor Max Ratio
• Processor Min Ratio
• Microcode Revision
• L1 Cache RAM
• L2 Cache RAM
• L3 Cache RAM
• Processor 0 Version
• Processor 1 Version

Hyper-Threading (ALL)

Select Enable to use Intel Hyper-Threading Technology to enhance CPU performance. The options are Disabled and Enabled.

Cores Enabled

Use this feature to enable or disable CPU cores in the processor specified by the user. Enter 0 to enable all cores available in the processor. Please note that the maximum of 16 CPU cores are currently available in each CPU package. The default option is 0.

Execute Disable Bit (Available if supported by the OS & the CPU)

Select Enable to enable Execute Disable Bit, support which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot, thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor, damaging the system during a virus attack. The options are Disable and Enable. (Refer to Intel and Microsoft websites for more information.)

Intel Virtualization Technology

Select Enable to use Intel Virtualization Technology which will allow the I/O device assignments to be directly reported to the VMM (Virtual Memory Management) through the DMAR ACPI tables. This feature offers fully-protected I/O resource-sharing across the Intel platforms, providing the user with greater reliability, security and availability in networking and data-sharing. The settings are Disable and Enable.

PPIN Control

Select Unlock/Enable to use the Protected-Processor Inventory Number (PPIN) in the system. The options are Unlock/Disable and Unlock/Enable.

Hardware Prefetcher (Available when supported by the CPU)

If this feature is set to Enable, the hardware prefetcher will prefetch streams of data and instructions from the main memory to the Level 2 (L2) cache to improve CPU performance. The options are Enable and Disable.

Adjacent Cache Prefetch (Available when supported by the CPU)

Select Enable for the CPU to prefetch both cache lines for 128 bytes as comprised. Select Disable for the CPU to prefetch both cache lines for 64 bytes. The options are Enable and Disable.

Note: Please power off and reboot the system for the changes you've made to take effect. Please refer to Intel's website for detailed information.

DCU Streamer Prefetcher (Available when supported by the CPU)

If this item is set to Enable, the DCU (Data Cache Unit) streamer prefetcher will prefetch data streams from the cache memory to the DCU (Data Cache Unit) to speed up data accessing and processing for CPU performance enhancement. The options are Enable and Disable.

DCU IP Prefetcher

If this item is set to Enable, the IP prefetcher in the DCU (Data Cache Unit) will prefetch IP addresses to improve network connectivity and system performance. The options are Enable and Disable.

LLC Prefetch

If this feature is set to Enable, LLC (hardware cache) prefetching on all threads will be supported. The options are Disable and Enable.

Extended APIC (Extended Advanced Programmable Interrupt Controller)

Based on the Intel Hyper-Threading technology, each logical processor (thread) is assigned 256 APIC IDs (APIDs) in 8-bit bandwidth. When this feature is set to Enable, the APIC ID will be expanded from 8 bits to 16 bits to provide 512 APIDs to each thread to enhance CPU performance. The options are Disable and Enable.

AES-NI

Select Enable to use the Intel Advanced Encryption Standard (AES) New Instructions (NI) to ensure data security. The options are Disable and Enable.

▶Advanced Power Management Configuration

Power Technology

This feature allows for switching between stored CPU Power Management profiles. The options are Disable, Energy Efficient and Custom.

Power Performance Tuning (Available when "Power Technology" is set to Custom

Select BIOS to allow the system BIOS to configure the Power-Performance Tuning Bias setting below. The options are BIOS Controls EPB and OS Controls EPB.

ENERGY\_PERF\_BIAS\_CFG Mode Energy (ENERGY PERFORMANCE BIAS CONFIGURATION Mode) (Available when supported by the Processor and when "Power Performance Tuning" is set to BIOS Controls EPB)

This feature allows the user to set the desired processor power use policy for the machine by prioritizing system performance or energy savings. Selecting Maximum Performance will maximize performance (to its highest potential); however, this may result in maximum power consumption. The higher the performance is, the higher the power consumption will be. Select Max Power Efficient to prioritize power saving; however, system performance may be substantially impacted. The options are Maximum Performance, Performance, Balanced Performance, Balanced Power, Power, and Max Power Efficient.

▶CPU P State Control

SpeedStep (PStates)

EIST (Enhanced Intel SpeedStep Technology) allows the system to automatically adjust processor voltage and core frequency in an effort to reduce power consumption and heat dissipation. Please refer to Intel's website for detailed information. The options are Disable and Enable.

EIST PSD Function (Available when SpeedStep is set to Enable)

Use this item to configure the processor's P-State coordination settings. During a P-State, the voltage and frequency of the processor will be reduced when it is in operation. This makes the processor more energy efficient, resulting in further energy gains. The options are HW_ALL, SW_ALL and SW-ANY.

Turbo Mode (Available when SpeedStep is set to Enable)

Select Enable for processor cores to run faster than the frequency specified by the manufacturer. The options are Disable and Enable.

▶Hardware PM (Power Management) State Control

Hardware P-States

If this feature is set to Disable, hardware will choose a P-state setting for the system based on an OS request. If this feature is set to Native Mode, hardware will choose a P-state setting based on OS guidance. If this feature is set to Native Mode with No Legacy Support, hardware will choose a P-state setting independently without OS guidance. The options are Disable, Native Mode, Out of Band Mode, and Native Mode with No Legacy Support.

▶CPU C State Control

Autonomous Core C-State

Select Enable to support Autonomous Core C-State control which will allow the processor core to control its C-State setting automatically and independently. The options are Disable and Enable.

CPU C6 Report

Select Enable to allow the BIOS to report the CPU C6 state (ACPI C3) to the operating system. During the CPU C6 state, power to all caches is turned off. The options are Disable, Enable, Auto.

Enhanced Halt State (C1E)

Select Enable to enable "Enhanced Halt State" support, which will significantly reduce the CPU's power consumption by minimizing CPU's clock cycles and reduce voltage during a "Halt State." The options are Disable and Enable.

▶Package C State Control

Package C State

Use this feature to set the limit on the C-State package register. The options are C0/C1 state, C2 state, C6 (non-Retention) state, C6 (Retention) state, No Limit, and Auto.

▶Chipset Configuration

Warning: Setting the wrong values in the following sections may cause the system to malfunction.

▶North Bridge

This feature allows the user to configure the settings for the Intel North Bridge.

▶UPI (Ultra Path Interconnect) Configuration

This section displays the following UPI General Configuration information:

• Number of CPU
• Number of IIO
• Current UPI Link Speed
• Current UPI Link Frequency
• UPI Global MMIO Low Base/Limit
• UPI Global MMIO High Base/Limit
• UPI PCI-E Configuration Base/Size

Degrade Precedence

Use this feature to select the degrading precedence option for Ultra Path Interconnect connections. Select Topology Precedent to degrade UPI features if system options are in conflict. Select Feature Precedent to degrade UPI topology if system options are in conflict.

The options are Topology Precedence and Feature Precedence.

Link L0p Enable

Select Enable to enable Link L0p. The options are Disable, Enable, and Auto.

Link L1 Enable

Select Enable to enable Link L1 (Level 1 link). The options are Disable, Enable, and Auto.

IO Directory Cache

Select Enable for the IODC (I/O Directory Cache) to generate snoops instead of generating memory lockups for remote IIO (InvIToM) and/or WCiLF (Cores). Select Auto for the IODC to generate snoops (instead of memory lockups) for WCiLF (Cores). The options are Disable, Auto, Enable for Remote InvItoM Hybrid Push, InvItoM AllocFlow, Enable for Remote InvItoM Hybrid AllocNonAlloc, and Enable for Remote InvItoM and Remote WViLF.

Isoc Mode

Select Enabled for Isochronous support to meet QoS (Quality of Service) requirements. This feature is especially important for Virtualization Technology. The options are Enable and Disable.

SNC

Sub NUMA Clustering (SNC) is a feature that breaks up the Last Level Cache (LLC) into clusters based on address range. Each cluster is connected to a subset of the memory controller. Enabling SNC improves average latency and reduces memory access congestion to achieve higher performance. Select Auto for 1-cluster or 2-clusters depending on IMC interleave. Select Enable for Full SNC (2-clusters and 1-way IMC interleave). The options are Disable, Enable, and Auto.

Stale AtoS

This feature optimizes A to S directory. When all snoop responses found in directory A are found to be Rspl, then all data is moved to directory S and is returned in S-state. The options are Disable, Enable, and Auto.

LLC dead line alloc

Select Enable to optimally fill dead lines in LLC. Select Disable to never fill dead lines in LLC. The options are Disable, Enable, and Auto.

▶ Memory Configuration

Enforce POR

Select POR to enforce POR restrictions for DDR4 memory frequency and voltage programming. The options are POR and Disable.

Memory Frequency

Use this feature to set the maximum memory frequency for onboard memory modules. The options are Auto, 1866, 2000, 2133, 2200, 2400, 2600, and 2666.

IMC Interleaving

This feature allows the user to configure Integrated Memory Controller (IMC) Interleaving settings. The options are Auto, 1-way Interleave, and 2-way Interleave.

Data Scrambling for NVDIMM

Select Enable to enable data scrambling for onboard NVDIMM memory to enhance system performance and security. The options are Auto, Disable, and Enable.

Data Scrambling for DDR4

Select Enable to enable data scrambling for DDR4 memory to enhance system performance and security. The options are Auto, Disable, and Enable.

tCCD\_L Relaxation

If this feature is set to Enable, SPD (Serial Presence Detect) will override tCCD_L ("Column to Column Delay-Long", or "Command to Command Delay-Long" on the column side.) If this feature is set to Disable, tCCD_L will be enforced based on the memory frequency. The options are Disable and Auto.\

tRWSR Relaxation

If this feature is set to Enabled, the tRWSR overrides the SPD. If this feature is set to Disabled, it is enforced based on memory frequency. The options are Enable and Disable.

Enable ADR

Select Enable for ADR (Automatic Diagnostic Repository) support to enhance memory performance. The options are Disable and Enable.

▶ Memory Topology

This item displays the information of onboard memory modules as detected by the BIOS.

▶Memory RAS (Reliability\_Availability\_Serviceability) Configuration

Use this submenu to configure the following Memory RAS settings.

Mirror Mode

Select Enable to set all 1LM/2LM memory installed in the system on the mirror mode, which will create a duplicate copy of data stored in the memory to increase memory security, but it will reduce the memory capacity into half. The options are Disable, Mirror Mode 1LM and Mirror Mode 2LM.

Memory Rank Sparing

Select Enable to support memory-rank sparing to optimize memory performance. The options are Disable and Enable.

Note: This item will not be available when memory mirror mode is enabled.

Correctable Error Threshold

Use this item to enter the threshold value for correctable memory errors. The default setting is 10.

SDDC Plus One (Available when this feature is supported by the CPU & the item: Intel Run Sure is set to Disable)

SDDC (Single Device Data Correction) checks and corrects single-bit or multiple-bit (4-bit max.) memory faults that affect an entire single x4 DRAM device. SDDC Plus One is the enhanced feature to SDDC. SDDC+1 will spare the faulty DRAM device out after an SDDC event has occurred. After the event, the SDDC+1 ECC mode is activated to protect against any additional memory failure caused by a 'single-bit' error in the same memory rank. The options are Disable and Enable*. (The option "Enable" can be set as default when it is supported by the motherboard.)

ADDDC (Adaptive Double Device Data Correction) Sparing

Select Enable for Adaptive Double Device Data Correction (ADDDC) support, which will not only provide memory error checking and correction but will also prevent the system from issuing a performance penalty before a device fails. Please note that virtual lockstep mode will only start to work for ADDDC after a faulty DRAM module is spared. The options are Enable* and Disable. (The option "Enable" can be set as default when it is supported by the motherboard.)

Patrol Scrub

Patrol Scrubbing is a process that allows the CPU to correct correctable memory errors detected in a memory module and send the corrections to the requestor (the original source). When this item is set to Enable, the IO hub will read and write back one cache line every 16K cycles if there is no delay caused by internal processing. By using this method, roughly 64 GB of memory behind the IO hub will be scrubbed every day. The options are Disable and Enable.

Patrol Scrub Interval

Use this item to specify the number of hours (between 0 to 24) required for the system to complete a full patrol scrubbing. Enter 0 for patrol scrubbing to be performed automatically. The default setting is 24.

Note: This item is hidden when Patrol Scrub item is set to Disable.

▶IIO Configuration

EV DFX (Device Function On-Hide) Features

When this feature is set to Enable, the EV_DFX Lock Bits that are located in a processor will always remain clear during electric tuning. The options are Disable and Enable.

▶CPU1 Configuration

IOU0 (IIO PCIe Br1)

This item configures the PCI-E Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU1 (IIO PCIe Br2)

This item configures the PCI-E Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU2 (IIO PCIe Br3)

This item configures the PCI-E Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

MCP0 (IIO PCIe Br4)

This item configures the PCI-E Bifuraction setting for a PCI-E port specified by the user. The options are x16 and Auto.

MCP1 (IIO PCIe Br5)

This item configures the PCI-E Bifuraction setting for a PCI-E port specified by the user. The options are x16 and Auto.

▶Socket 0 PcieBr0D00F0 - Port 0/DMI PcieBr1D00F0 - Port 1A PcieBr2D00F0 - Port 2A PcieBr3D00F0 - Port 3A PcieBr4D00F0 - MCP 0 PcieBr5D00F0 - MCP 1

Link Speed

Use this item to select the link speed for the PCI-E port specified by the user. The options are Auto, Gen 1 (2.5 GT/s), Gen 2 (5 GT/s), and Gen 3 (8 GT/s).

PCI-E Port Max Payload Size

Selecting Auto for this feature will enable the motherboard to automatically detect the maximum Transaction Layer Packet (TLP) size for the connected PCI-E device, allowing for maximum I/O efficiency. Selecting 128B or 256B will designate maximum packet size of 128 or 256. Options are Auto, 128, and 256. Auto is enabled by default.

▶IOAT Configuration

Disable TPH (TLP Processing Hint)

TPH is used for data-tagging with a destination ID and a few important attributes. It can send critical data to a particular cache without writing through to memory. Select No in this item for TLP Processing Hint support, which will allow a "TPL request" to provide "hints" to help optimize the processing of each transaction occurred in the target memory space. The options are No and Yes.

Prioritize TPH (TLP Processing Hint)

Select Yes to prioritize the TPL requests that will allow the "hints" to be sent to help facilitate and optimize the processing of certain transactions in the system memory. The options are Enable and Disable.

Relaxed Ordering

Select Enable to enable Relaxed Ordering support which will allow certain transactions to violate the strict-ordering rules of PCI and to be completed prior to other transactions that have already been enqueued. The options are Disable and Enable.

▶Intel VT for Directed I/O (VT-d)

Intel® VT for Directed I/O (VT-d)

Select Enable to use Intel Virtualization Technology support for Direct I/O VT-d by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables. This feature offers fully-protected I/O resource sharing across Intel platforms, providing greater reliability, security and availability in networking and data-sharing. The options are Enable and Disable.

Interrupt Remapping

Select Enable for Interrupt Remapping support to enhance system performance. The options are Enable and Disable.

PassThrough DMA

Select Enable for the Non-Iscoh VT-d engine to pass through DMA (Direct Memory Access) to enhance system performance. The options are Enable and Disable.

ATS

Select Enable to enable ATS (Address Translation Services) support for the Non-Iscoh VT-d engine to enhance system performance. The options are Enable and Disable.

Posted Interrupt

Select Enable to support VT_D Posted Interrupt which will allow external interrupts to be sent directly from a direct-assigned device to a client machine in non-root mode to improve virtualization efficiency by simplifying interrupt migration and lessening the need of physical interrupts. The options are Enable and Disable.

Coherency Support (Non-Isoch)

Select Enable for the Non-Iscoh VT-d engine to pass through DMA (Direct Memory Access) to enhance system performance. The options are Enable and Disable.

▶Intel® VT for Directed I/O (VT-d)

Intel® VT for Directed I/O (VT-d)

Select Enable to use Intel Virtualization Technology for Direct I/O VT-d support by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables. This feature offers fully-protected I/O resource sharing across Intel platforms, providing greater reliability, security and availability in networking and data-sharing. The options are Disable and Enable.

Interrupt Remapping

Select Enable for Interrupt Remapping support to enhance system performance. The options are Enable and Disable.

PassThrough DMA

Use this feature to allow devices such as network cards to access the system memory without using a processor. Select Enable to use the Non-Isoch VT_D Engine Pass Through Direct Memory Access (DMA) support. The options are Enable and Disable.

ATS

Use this feature to enable Non-Isoch VT-d Engine Address Translation Services (ATS) support. ATS translates virtual addresses to physical addresses. The options are Enable and Disable.

Posted Interrupt

Use this feature to enable VT_D Posted Interrupt. The options are Enable and Disable.

Coherency Support (Non-Isoch)

Use this feature to maintain setting coherency between processors or other devices. Select Enable for the Non-Iscoh VT-d engine to pass through DMA to enhance system performance. The options are Enable and Disable.

IIO-PCIE Express Global Options

The section allows the user to configure the following PCI-E global options:

PCE-E Hot Plug

Select Enable to support Hot-plugging for the selected PCI-E slots which will allow the user to replace the devices installed in the slots without shutting down the system. The options are Enable and Disabled.

PCI-E Completion Timeout (Global)

Use this item to select the PCI-E Completion Time-out settings. The options are Yes, No, and Per-Port.

▶ South Bridge

The following South Bridge information will display:

• USB Module Version
• USB Devices

Legacy USB Support

Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disable to have all USB devices available for EFI applications only. The options are Enabled, Disabled and Auto.

XHCI Hand-Off

This is a work-around solution for operating systems that do not support XHCI (Extensible Host Controller Interface) hand-off. The XHCI ownership change should be claimed by the XHCI driver. The options are Enabled and Disabled.

Port 60/64 Emulation

Select Enabled for I/O port 60h/64h emulation support, which in turn, will provide complete legacy USB keyboard support for the operating systems that do not support legacy USB devices. The options are Disabled and Enabled.

Port 61h Bit-4 Emulation

Select Enabled to enable the emulation of Port 61h but-4 toggling in SMM (System Management Mode). The options are Disabled and Enabled.

Install Windows 7 USB support

EHCI needs to be supported in order for USB 2.0 to work properly during the installation of Windows 7; however, EHCI support was removed from X11 DP Motherboard platforms. When this item is enabled, this feature will allow USB keyboard and mouse to work properly during installation of Windows 7. After installation of Windows 7 and all the drivers, please disable this feature. The options are Disabled and Enabled.

▶Server ME (Management Engine) Configuration

This feature displays the following General ME Configuration settings.

Operational Firmware Version

Backup Firmware Version

Recovery Firmware Version

ME Firmware Status #1

ME Firmware Status #2

Current State

Error Code

▶SATA Configuration

When this submenu is selected, the AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the following items:

SATA Controller

This item enables or disables the onboard SATA controller supported by the Intel PCH chip. The options are Enable and Disable.

Configure SATA as (Available when the item above: SATA Controller is set to enabled)

Select AHCI to configure a SATA drive specified by the user as an AHCI drive. Select RAID to configure a SATA drive specified by the user as a RAID drive. The options are AHCI and RAID. (Note: This item is hidden when the SATA Controller item is set to Disabled.)

SATA HDD Unlock

Select Enable to unlock SATA HDD password in the OS. The options are Enable and Disable.

SATA/sSATA RAID Boot Select (Available when the item "Configure SATA as" is set to "RAID")

This feature allows the user to decide which controller should be used for system boot. The options are None, SATA Controller, sSATA Controller, and Both.

Aggressive Link Power Management

When this item is set to Enabled, the SATA AHCI controller manages the power use of the SATA link. The controller will put the link in a low power mode during an extended period of I/O inactivity, and will return the link to an active state when I/O activity resumes. The options are Enable and Disable.

SATA RAID Option ROM/UEFI Driver (Available when the item "Configure SATA as" is set to "RAID")

Select EFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disable, EFI, and Legacy.

SATA Port 0 - SATA Port 7

Hot Plug

Select Enable to support Hot-plugging for the device installed on a selected SATA port which will allow the user to replace the device installed in the slot without shutting down the system. The options are Enable and Disable.

Spin Up Device

On an edge detect from 0 to 1, set this item to allow the SATA device installed on the SATA port specified by the user to start a COMRESET initialization. The options are Enable and Disable.

SATA Device Type

Use this item to specify if the device installed on the SATA port selected by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶ sSATA Configuration

When this submenu is selected, AMI BIOS automatically detects the presence of the sSATA devices that are supported by the sSATA controller and displays the following items:

sSATA Controller

This item enables or disables the onboard sSATA controller supported by the Intel SCU. The options are Enable and Disable.

Configure sSATA as

Select AHCI to configure an sSATA drive specified by the user as an AHCI drive. Select RAID to configure an sSATA drive specified by the user as a RAID drive. The options are AHCI and RAID. (Note: This item is hidden when the sSATA Controller item is set to Disabled.)

SATA HDD Unlock

Select Enable to unlock sSATA HDD password in the OS. The options are Enable and Disable.

SATA/sSATA RAID Boot Select (Available when the item "Configure SATA as" is set to "RAID")

This feature allows the user to decide which controller should be used for system boot. The options are None, SATA Controller, sSATA Controller, and Both.

Aggressive Link Power Management

When this item is set to Enable, the sSATA AHCI controller manages the power use of the SATA link. The controller will put the link in a low power mode during an extended period of I/O inactivity, and will return the link to an active state when I/O activity resumes. The options are Disable and Enable.

sSATA RAID Option ROM/UEFI Driver (Available when the item "Configure SATA as" is set to "RAID")

Select EFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disable, EFI, and Legacy.

sSATA Port 0 - sSATA Port 5

Hot Plug

Select Enable to support Hot-plugging for the device installed on an sSATA port selected by the user which will allow the user to replace the device installed in the slot without shutting down the system. The options are Disable and Enabled.

Spin Up Device

On an edge detect from 0 to 1, set this item to allow the sSATA device installed on the sSATA port specified by the user to start a COMRESET initialization. The options are Enable and Disable.

sSATA Device Type

Use this item to specify if the device installed on the sSATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶PCIe/PCI/PnP Configuration

The following PCI information will be displayed:

• PCI Bus Driver Version
• PCI Devices Common Settings:

Above 4G Decoding (Available if the system supports 64-bit PCI decoding)

Select Enabled to decode a PCI device that supports 64-bit in the space above 4G Address. The options are Disabled and Enabled.

SR-IOV Support (Available if the system supports Single-Root Virtualization)

Select Enabled for Single-Root IO Virtualization support. The options are Disabled and Enabled.

MMIO High Base

Use this item to select the base memory size according to memory-address mapping for the IO hub. The base memory size must be between 4032G to 4078G. The options are 56T, 48T, 24T, 16T, 4T, and 1T.

MMIO High Granularity Size

Use this item to select the high memory size according to memory-address mapping for the IO hub. The options are 1G, 4G, 16G, 64G, 256G, and 1024G.

PCI PERR/SERR Support

Use this feature to enable or disable the runtime event for SERR (System Error)/ PERR (PCI/PCI-E Parity Error). The options are Disabled and Enabled.

Maximum Read Request

Select Auto for the system BIOS to automatically set the maximum size for a read request for a PCI-E device to enhance system performance. The options are Auto, 128 Bytes, 256 Bytes, 512 Bytes, 1024 Bytes, 2048 Bytes, and 4096 Bytes.

MMCFG Base

This feature determines the lowest MMCFG (Memory-Mapped Configuration) base assigned to PCI devices. The options are 1G, 1.5G, 1.75G. 2G, 2.25G, and 3G.

VGA Priority

Use this item to select the graphics device to be used as the primary video display for system boot. The options are Auto, Onboard and Offboard.

RSC-R1U SLOT1 PCI-E x16 OPROM/RSC-R1U SLOT2 PCI-E x16 OPROM

Select EFI to allow the user to boot the computer using an EFI (Expansible Firmware Interface) device installed on the PCI-E slot specified by the user. Select Legacy to allow the user to boot the computer using a legacy device installed on the PCI-E slot specified by the user. The options are Disabled, Legacy and EFI. (Note: Riser card names may differ in each system.)

Onboard LAN Option ROM Type

Use this to select firmware type to be loaded for onboard LANs. The options are Legacy and EFI.

Onboard Video Option ROM

Use this feature to select the Onboard Video Option ROM type. The options are Disabled, Legacy and EFI.

Onboard LAN1 Option ROM

Use this feature to select the type of device installed in LAN Port1 used for system boot. The options are Legacy, EFI and Disabled.

Onboard LAN2 Option ROM

Use this feature to select the type of device installed in LAN Port2 used for system boot. The options are Legacy, EFI and Disabled.

▶Network Stack Configuration

Network Stack

Select Enabled to enable PXE (Preboot Execution Environment) or UEFI (Unified Extensible Firmware Interface) for network stack support. The options are Disabled and Enabled.

*If "Network Stack" is set to Enabled, the following items will display:

Ipv4 PXE Support

Select Enabled to enable lpv4 PXE boot support. If this feature is disabled, it will not create the lpv4 PXE boot option. The options are Disabled and Enabled.

Ipv4 HTTP Support

Select Enabled to enable lpv4 HTTP boot support. If this feature is disabled, it will not create the lpv4 HTTP boot option. The options are Disabled and Enabled.

Ipv6 PXE Support

Select Enabled to enable lpv6 PXE boot support. If this feature is disabled, it will not create the lpv6 PXE boot option. The options are Disabled and Enabled.

Ipv6 HTTP Support

Select Enabled to enable lpv6 HTTP boot support. If this feature is disabled, it will not create the lpv6 HTTP boot option. The options are Disabled and Enabled.

PXE Boot Wait Time

Use this feature to select the wait time to press the key to abort the PXE boot. The default is 0.

Media Detect Count

Select this to assign the number of times presence of media will be checked. The default is 1.

▶Super IO Configuration

Super IO Chip AST2500

▶ Serial Port 1 Configuration

Serial Port 1

Select Enabled to enable the onboard serial port specified by the user. The options are Disabled and Enabled.

Device Settings

This item displays the base I/O port address and the Interrupt Request address of a serial port specified by the user.

Change Settings

This feature specifies the base I/O port address and the Interrupt Request address of Serial Port 1. Select Auto for the BIOS to automatically assign the base I/O and IRQ address to a serial port specified.

The options for Serial Port 1 are Auto, (IO=3F8h; IRQ=4), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12).

▶ Serial Port 2 Configuration

Serial Port 2

Select Enabled to enable the onboard serial port specified by the user. The options are Disabled and Enabled.

Device Settings

This item displays the base I/O port address and the Interrupt Request address of a serial port specified by the user.

Note: This item is hidden when Serial Port 2 is set to Disabled.

Change Settings

This feature specifies the base I/O port address and the Interrupt Request address of Serial Port 2. Select Auto for the BIOS to automatically assign the base I/O and IRQ address to a serial port specified. The options for Serial Port 2 are Auto, (IO=2F8h; IRQ=3), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12).

Serial Port 2 Attribute

Select SOL to use COM Port 2 as a Serial_Over_LAN (SOL) port for console redirection. The options are SOL and COM.

▶Serial Port Console Redirection

COM 1 Console Redirection

Select Enabled to enable COM Port 1 for Console Redirection, which will allow a client machine to be connected to a host machine at a remote site for networking. The options are Disabled and Enabled.

*If the item above set to Enabled, the following items will become available for configuration:

▶Console Redirection Settings (for COM1)

Terminal Type

Use thid feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are VT100, VT100+, VT-UTF8 and ANSI.

Bits Per second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 (Bits) and 8 (Bits).

Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start sending data when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Disabled and Enabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

Redirection After BIOS Post

Use this feature to enable or disable legacy Console Redirection after BIOS POST. When the option-Bootloader is selected, legacy Console Redirection is disabled before booting the OS. When the option-Always Enable is selected, legacy Console Redirection remains enabled upon OS bootup. The options are Always Enable and Bootloader.

COM2/SOL (Serial-Over-LAN) Console Redirection

Select Enabled to use the SOL port for Console Redirection. The options are Disabled and Enabled.

*If the item above set to Enabled, the following items will become available for user's configuration:

▶Console Redirection Settings (for SOL)

Use this feature to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are VT100, VT100+, VT-UTF8 and ANSI.

Bits Per second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 (Bits) and 8 (Bits).

Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Disabled and Enabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

Redirection After BIOS Post

Use this feature to enable or disable legacy Console Redirection after BIOS POST (Power-On Self-Test). When this feature is set to Bootloader, legacy Console Redirection is disabled before booting the OS. When this feature is set to Always Enable, legacy Console Redirection remains enabled upon OS boot. The options are Always Enable and Bootloader.

▶Legacy Console Redirection

Legacy Serial Redirection Port

Use the feature to select the COM port to display redirection of Legacy OS and Legacy OPROM messages. The default setting is COM1 and SOL.

Serial Port for Out-of-Band Management/Windows Emergency Management Services (EMS)

The submenu allows the user to configure Console Redirection settings to support Out-of-Band Serial Port management.

Console Redirection (for EMS)

Select Enabled to use a COM port selected by the user for EMS Console Redirection. The options are Disabled and Enabled.

*If the item above set to Enabled, the following items will become available for user's configuration:

▶Console Redirection Settings (EMS)

Out-of-Band Management Port

The feature selects a serial port in a client server to be used by the Windows Emergency Management Services (EMS) to communicate with a remote host server. The options are COM1 and SOL.

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII character set. Select VT100+ to add color and function key support. Select ANSI to use the extended ASCII character set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are VT100, VT100+, VT-UTF8 and ANSI.

Bits Per Second

This feature sets the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in both host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 57600, and 115200 (bits per second).

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop data-sending when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty. The options are None, Hardware RTS/CTS and Software Xon/Xoff.

Data Bits: 8

Parity: None

Stop Bits: 1

▶ACPI Settings

Use this feature to configure Advanced Configuration and Power Interface (ACPI) power management settings for your system.

NUMA Support (Available when the OS supports this feature)

Select Enabled to enable Non-Uniform Memory Access support to enhance system performance. The options are Disabled and Enabled.

WHEA Support

Select Enabled to support the Windows Hardware Error Architecture (WHEA) platform and provide a common infrastructure for the system to handle hardware errors within the Windows OS environment to reduce system crashes and to enhance system recovery and health monitoring. The options are Disabled and Enabled.

High Precision Timer

Select Enabled to activate the High Precision Event Timer (HPET) that produces periodic interrupts at a much higher frequency than a Real-time Clock (RTC) does in synchronizing multimedia streams, providing smooth playback and reducing the dependency on other timestamp calculation devices, such as an x86 RDTSC Instruction embedded in the CPU. The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer. The options are Disabled and Enabled.

▶Trusted Computing (Available when a TPM device is installed and detected by the BIOS)

When a TPM (Trusted-Platform Module) device is detected in your machine, the following information will be displayed.

• TPM2.0 Device Found
• Vendor
• Firmware Version

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Trusted Computing
TPM20 Device Found Vendor: IFX Firmware Version: 7.61 Security Device Support [Enable] Active PCR banks SHA-1,SHA256 Available PCR banks SHA-1,SHA256 Pending operation [None] Platform Hierarchy [Enabled] Storage Hierarchy [Enabled] Endorsement Hierarchy [Enabled] PH Randomization [Disabled]		Enables or Disables BIOS support for security device. O.S. will not show Security Device. TCG EFI protocol and INT1A interface will not be available.
TXT Support [Disabled]		+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

Security Device Support

If this feature and the TPM jumper (JPT1 if installed onboard) on the motherboard are both enabled, the onboard security (TPM) device will be enabled in the BIOS to enhance data integrity and system security. Please note that the OS will not show the security device. Neither TCG EFI protocol nor INT1A interaction will be made available for use. If you have made changes on the setting on this item, be sure to reboot the system for the change to take effect. The options are Disable and Enable. If this option is set to Enable, the following screen and items will display:

• Active PCR Banks
• Available PCR Banks

Pending Operation

Use this feature to schedule a TPM-related operation to be performed by a security (TPM) device at the next system boot to enhance system data integrity. Your system will reboot to carry out a pending TPM operation. The options are None and TPM Clear.

Note: Your system will reboot to carry out a pending TPM operation.

Platform Hierarchy (for TPM Version 2.0 and above)

Select Enabled for TPM Platform Hierarchy support which will allow the manufacturer to utilize the cryptographic algorithm to define a constant key or a fixed set of keys to be used for initial system boot. This early boot code is shipped with the platform and is included in the list of "public keys". During system boot, the platform firmware uses this trusted public key to verify a digital signature in an attempt to manage and control the security of the platform firmware used in a host system via a TPM device. The options are Enabled and Disabled.

Storage Hierarchy

Select Enabled for TPM Storage Hierarchy support that is intended to be used for non-privacy-sensitive operations by the platform owner such as an IT professional or the end user. Storage Hierarchy has an owner policy and an authorization value, both of which can be set and are held constant (-rarely changed) through reboots. This hierarchy can be cleared or changed independently of the other hierarchies. The options are Enabled and Disabled.

Endorsement Hierarchy

Select Enabled for Endorsement Hierarchy support, which contains separate controls to address the user's privacy concerns because the primary keys in this hierarchy are certified by the TPM or a manufacturer to be constrained to an authentic TPM device that is attached to an authentic platform. A primary key can be an encrypted, and a certificate can be created using TPM2_ActivateCredential. It allows the user to independently enable "flag, policy, and authorization value" without involving other hierarchies. A user with privacy concerns can disable the endorsement hierarchy while still using the storage hierarchy for TPM applications and permitting the platform software to use the TPM. The options are Enabled and Disabled.

PH (Platform Hierarchy) Randomization (for TPM Version 2.0 and above)

Select Enabled for Platform Hierarchy Randomization support, which is used only during the platform developmental stage. This feature cannot be enabled in the production platforms. The options are Disabled and Enabled.

TXT Support

Select Enabled to enable Intel Trusted Execution Technology (TXT) support to enhance system security and data integrity. The options are Disabled and Enabled.

Note 1: If the option for this item (TXT Support) is set to Enabled, be sure to disable EV DFX (Device Function On-Hide) support for the system to work properly. (EV DFX is under "IIO Configuration" in the "Chipset/North Bridge" submenu).

Note 2: For more information on TPM, please refer to the TPM manual at http://www.supermicro.com/manuals/other.

6.4 Event Logs

Use this feature to configure Event Log settings.

Aptio Setup Utility - Copyright (C) 2018 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Change Smbios Event Log Settings View Smbios Event Log	Press <Enter> to change the Smbios Event Log configuration.
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

▶Change SMBIOS Event Log Settings

Enabling/Disabling Options

SMbios Event Log

Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot. The options are Disabled. and Enabled.

Erasing Settings

Erase Event Log

Select Enabled to erase all error events in the SMBIOS (System Management BIOS) log before an event logging is initialized at bootup. The options are No; Yes, Next Reset; Yes, Every Reset.

When Log is Full

Select Erase Immediately to immediately erase all errors in the SMBIOS event log when the event log is full. Select Do Nothing for the system to do nothing when the SMBIOS event log is full. The options are Do Nothing and Erase Immediately.

SMBIOS Event Log Standard Settings

Log System Boot Event

Select Enabled to log system boot events. The options are Enabled and Disabled.

MECI (Multiple Event Count Increment)

Enter the increment value for the multiple event counter. Enter a number between 1 to 255. The default setting is 1.

METW (Multiple Event Count Time Window)

This item is used to determine how long (in minutes) should the multiple event counter wait before generating a new event log. Enter a number between 0 to 99. The default setting is 60.

Note: Please reboot the system for the changes to take effect.

Custom Options

Log OEM Codes

This feature Enables or Disables the logging of EFI Status Codes as OEM Codes (if not already converted to legacy). The options are Enabled or Disabled.

Convert OEM Codes

This feature Enables or Disables the converting of EFI Status Codes to Standard Smbios Typed (Not all may be translated). The options are Enabled or Disabled.

▶View SMBIOS Event Log

This item allows the user to view the event in the system event log. Select this item and press to view the status of an event in the log. The following categories are displayed:

Date/Time/Error Code/Severity

6.5 IPMI

Use this feature to configure Intelligent Platform Management Interface (IPMI) settings.

Aptio Setup Utility - Copyright (C) 2018 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
IPMI Firmware Revision 1.47 Status Of BMC Working	Press <Enter> to change the SEL event log configuration.
System Event Log BMC Network Configuration
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

When you select this submenu and press the key, the following information will display:

• IPMI Firmware Revision: This item indicates the IPMI firmware revision used in your system.
• Status of BMC: This item indicates the status of the BMC (Baseboard Management Controller) installed in your system.

▶System Event Log

Enabling/Disabling Options

SEL Components

Select Enabled for all system event logging at bootup. The options are Disabled and Enabled.

Erasing Settings

Erase SEL

Select Yes, On next reset to erase all system event logs upon next system reboot. Select Yes, On every reset to erase all system event logs upon each system reboot. Select No to keep all system event logs after each system reboot. The options are No; Yes, On next reset; Yes, On every reset.

When SEL is Full

This feature allows the user to determine what the BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately.

Custom EFI Logging Options

Log EFI Status Codes

This feature allows the user to determine whether the BIOS will log EFI Status Cods, error code only, progress code only, or both. The options are Disabled, Both, Error code, and Progress code

Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

▶BMC Network Configuration

Configure IPV4 support

IPMI LAN Selection

This item displays the IPMI LAN setting. The default setting is Failover.

IPMI Network Link Status

This item displays the IPMI Network Link status. The default setting is Dedicated LAN.

Current Configuration Address source

This feature allows the user to select the source of the IP address for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the field. If DHCP is selected, the BIOS will search for a DHCP (Dynamic Host Configuration Protocol) server in the network that is attached to and request the next available IP address for this computer. The options are DHCP and Static.

Station IP Address

This item displays the Station IP address for this computer. This should be in decimal and in dotted quad form (i.e., 192.168.10.253).

Subnet Mask

This item displays the sub-network that this computer belongs to. The value of each three-digit number separated by dots should not exceed 255.

Station MAC Address

This item displays the Station MAC address for this computer. Mac addresses are 6 two-digit hexadecimal numbers.

Gateway IP Address

This item displays the Gateway IP address for this computer. This should be in decimal and in dotted quad form (i.e., 172.31.0.1).

VLAN

Enabling this item displays the virtual LAN settings. The options are Enabled and Disabled.

Update IPMI LAN Configuration

Select Yes for the BIOS to implement all IP/MAC address changes at the next system boot. The options are No and Yes.

*If the item above set to Yes, the following items will become available for user's configuration:

IPMI LAN Selection

This item displays the IPMI LAN setting. The default setting is Failover.

VLAN

Enabling this item displays the virtual LAN settings. The options are Enabled and Disabled.

Configuration Address Source

6.6 Security Settings

This menu allows the user to configure the following security settings for the system.

Aptio Setup Utility - Copyright (C) 2018 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Password Description If ONLY the Administrator's password is set, then this only limits access to Setup and is only asked for when entering Setup. If ONLY the User's password is set, then this is a power on password and must be entered to boot or enter Setup. In Setup the User will have Administrator rights. The password length must be in the following range: Minimum length 3 Maximum length 20 Administrator Password User Password Password Check [Setup] ▶ Secure Boot	Set Administrator Password ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

Administrator Password

Use this feature to set the administrator password which is required to enter the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

User Password

Press Enter to create a new, or change an existing User password.

Password Check

Select Setup for the system to check for a password at Setup. Select Always for the system to check for a password at bootup or upon entering the BIOS Setup utility. The options are Setup and Always.

▶Secure Boot

When you select this submenu and press the key, the following items will display:

• System Mode
• Secure Boot
• Vendor Keys

Attempt Secure Boot

Use this item to enable secure boot. The options are Disabled and Enabled.

Secure Boot Mode

Use this feature to select the desired secure boot mode for the system. The options are Standard and Custom.

CSM Support

Use this feature to select the desired secure boot mode for the system. The options are Disabled and Enabled.

▶Key Management

Provision Factory Defaults

Select Enabled to install all manufacturer default keys for the following system security settings. The options are Disabled and Enabled.

▶Enroll all Factor Default Keys

Select Yes to install all manufacturer defaults for the following system security settings. The options are Yes and No.

▶Enroll EFI Image

Select this item and press to select an EFI (Extensible Firmware Interface) image for the system to operate in Secure Boot mode.

▶Save All Secure Boot Variables

This feature allows the user to set and save the secure boot key variables specified by the user.

Secure Boot Variable/Size/Key#/Key Sources

▶ Platform Key (PK)

This feature allows the user to enter and configure a set of values to be used as a platform firmware key for the system. This set of values also indicate the size, the keys numbers, and the key source of the Platform Key. The options are Save to File, Set New, and Erase

▶Key Exchange Keys

This feature allows the user to enter and configure a set of values to be used as a Key-Exchange-Keys for the system. This set of values also indicate the size, the keys numbers, and the key source of the Key-Exchange-Keys. The options are Save to File, Set New, Append and Erase.

▶ Authorized Signatures

This feature allows the user to enter and configure a set of values to be used as Authorized Signatures for the system. This set of values also indicate the size, the keys numbers, and the key source of the Authorized Signatures. The options are Save to File, Set New, Append and Erase.

▶Forbidden Signatures

This feature allows the user to enter and configure a set of values to be used as Forbidden Signatures for the system. This set of values also indicate the size, the keys numbers, and the key source of the Forbidden Signatures. The options are Save to File, Set New, Append and Erase.

▶ Authorized TimeStamps

This feature allows the user to set and save the timestamps for Authorized Signatures to indicate when these signatures were entered into the system. The options are Save to File, Set New, Append and Erase.

▶OsRecovery Signatures

This feature allows the user to set and save the Authorized Signatures used for OS recovery. The options are Save to File, Set New, Append and Erase.

6.7 Boot Settings

Use this feature to configure Boot Settings:

Optio Setup Utility - Copyright (C) 2018 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit Boot mode select [DUAL] FIXED BOOT ORDER Priorities Boot Option #1 [Hard Disk] Boot Option #2 [CD/DVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CD/DVD] Boot Option #5 [USB Key] Boot Option #6 [USB Floppy] Boot Option #7 [USB Lan] Boot Option #8 [Network: IBA XE (X55...)] Boot Option #9 [UEFI Hard Disk] Boot Option #10 [UEFI CD/DVD] Boot Option #11 [UEFI USB Hard Disk] Boot Option #12 [UEFI USB CD/DVD] Boot Option #13 [UEFI USB Key] Boot Option #14 [UEFI USB Floppy] Boot Option #15 [UEFI USB Lan] Boot Option #16 [UEFI Network] Boot Option #17 [UEFI AP:UEFI: Built...] ► Delete Boot Option ► Delete Driver Option ► Select boot mode LEGACY/UEFI ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

Boot Mode Select

Use this feature to select the type of devices that the system is going to boot from. The options are Legacy, UEFI (Unified Extensible Firmware Interface), and Dual.

Legacy to EFI support

The options are Disabled and Enabled.

Fixed Boot Order Priorities

This feature prioritizes the order of a bootable device from which the system will boot. Press on each entry from top to bottom to select devices. When the item above - "Boot Mode Select" is set to Dual (default), the following items will be displayed for configuration:

- Boot Option #1 - Boot Option #17

When the item above - "Boot Mode Select" is set to Legacy, the following items will be display for configuration:

• Boot Option #1 - Boot Option #8

When the item above - "Boot Mode Select" is set to UEFI, the following items will be display for configuration:

• Boot Option #1 - Boot Option #9

▶ Delete Boot Option

This feature allows the user to select a boot device to delete from the boot priority list.

Delete Boot Option

Use this item to remove an EFI boot option from the boot priority list.

▶ Delete Driver Option

This feature allows the user to add a new boot option to the boot priority features for your system.

▶UEFI Application Boot Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

▶NETWORK Drive BBS Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

- Boot Option #2

6.8 Save & Exit

Select the Save & Exit tab from the BIOS setup screen to configure the settings below.

Aptio Setup Utility - Copyright (C) 2018 American Megatrends, Inc.
Main Advanced Event Logs IPMI Security Boot Save & Exit
Save Options Discard Changes and Exit Save Changes and Reset Save Changes Discard Changes Default Options Restore Optimized Defaults Save as User Defaults Restore User Defaults Boot Override IBA XE (X550) Slot 0100 v2413 UEFI: Built-in EFI Shell	Exit system setup without saving any changes. ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2018 American Megatrends, Inc.

Save Options

Discard Changes and Exit

Select this option to quit the BIOS setup without making any permanent changes to the system configuration and reboot the computer. Select Discard Changes and Exit from the Exit menu and press .

Save Changes and Reset

When you have completed the system configuration changes, select this option to leave the BIOS setup utility and reboot the computer for the new system configuration parameters to take effect. Select Save Changes and Exit from the Exit menu and press .

Save Changes

When you have completed the system configuration changes, select this option to save all changes made. This will not reset (reboot) the system.

Discard Changes

Select this option and press to discard all the changes and return to the AMI BIOS setup utility.

Default Options

Restore Optimized Defaults

To set this feature, select Restore Defaults from the Exit menu and press to load manufacturer default settings which are intended for maximum system performance but not for maximum stability.

Save As User Defaults

To set this feature, select Save as User Defaults from the Exit menu and press . This enables the user to save any changes to the BIOS setup for future use.

To set this feature, select Restore User Defaults from the Exit menu and press . Use this feature to retrieve user-defined settings that were saved previously.

Boot Override

UEFI: Built-in EFI Shell

This feature allows the user to override the Boot priorities sequence in the Boot menu, and immediately boot the system with a device specified by the user instead of the one specified in the boot list. This is a one-time override.

Appendix A

BIOS Error Codes

A-1 BIOS Error Beep (POST) Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

The fatal errors are usually communicated through repeated patterns of audible beeps. Each pattern of audible beeps listed below corresponds to its respective error.

BIOS Error Beep (POST) Codes
Beep Code Error	Message Description
1 short Refresh Circuits have been reset (Ready to power up)
5 short, 1 long Memory error No memory detected in system
5 long, 2 short Display memory read/write error Video adapter missing or with faulty memory
1 long continuous System OH System overheat condition

A-2 Additional BIOS POST Codes

The AMI BIOS supplies additional checkpoint codes, which are documented online at http://www.supermicro.com/support/manuals/ ("AMI BIOS POST Codes User's Guide").

When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20).

For information on AMI updates, please refer to http://www.ami.com/products/.

Appendix B

Standardized Warning Statements for AC Systems

B.1 About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源装置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the code) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

System Specifications

Processors

Dual Intel 82xx/81xx/62xx/61xx/52xx/51xx/42xx/41xx/31xx series in an Socket P type socket

Note: Please refer to the motherboard specifications pages on our website for updates to supported processors.

Chipset

Intel® C627 chipset

BIOS

256 Mb SPI AMI BIOS® SM Flash UEFI BIOS

Memory

Supports up to 6 TB of LRDIMM/RDIMM/NVDIMM DDR4 ECC 2933*/2666/2400/2133 MHz speed memory in 24 memory slots.

Note: See the memory section in Chapter 3 for details and our website for updates to supported memory.

SATA Controller

On-chip (Intel® C627) controller

Drive Bays

Up to thirty-two (32) 2.5" internal drive bays

PCI Expansion Slots

2 PCI-E 3.0 x32 Tray cable connector interface

2 PCI-E 3.0 x16 slots with riser card support

Motherboard

X11DPS-RE; (17" (W) x 19.5" (L) (431.8-mm x 495.3-mm))

Chassis

SC136HTS-R1K69P-U2; 1U Rackmount, (WxHxD) 17.26 x 1.7 x 35.95 in. (438.4 x 43 x 913-mm)

System Cooling

Up to eight (8) 4-cm counter-rotating PWM fans

Power Supply

Model: PWS-1K69P-1R

AC Input Voltages: 100-240 VAC

Rated Input Current: 6-3A

Rated Input Frequency: 50-60 Hz

Rated Output Power: 1000/1600W

Rated Output Voltages: +12V (83A/132A)

Operating Environment

Operating Temperature: 10° to 30° C (50° to 86° F)

Non-operating Temperature: -40° to 70° C (-40° to 158° F))

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

Electromagnetic Emissions: FCC Class A, EN 55032 Class A, EN 61000-3-2/3-3, CISPR 32 Class A

Electromagnetic Immunity: EN 55024/CISPR 24, (EN 61000-4-2, EN 61000-4-3, EN 61000-4-4, EN 61000-4-5, EN 61000-4-6,

EN 61000-4-8, EN 61000-4-11), CNS14336-1, CNS13438, GB4943.1-2011, GB9254-2008(Class A) and GB17625.1-2012

Safety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe)

Other: VCCI-CISPR 32 and AS/NZS CISPR 32

Environmental: Directive 2011/65/EU and Delegated Directive (EU) 2015/863 and Directive 2012/19/EU

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate"

Appendix D

UEFI BIOS Recovery

Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you need to update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.

D.1 Overview

The Unified Extensible Firmware Interface (UEFI) provides a software-based interface between the operating system and the platform firmware in the pre-boot environment. The UEFI specification supports an architecture-independent mechanism that will allow the UEFI OS loader stored in an add-on card to boot the system. The UEFI offers clean, hands-off management to a computer during system boot.

D.2 Recovering the UEFI BIOS Image

A UEFI BIOS flash chip consists of a recovery BIOS block and a main BIOS block (a main BIOS image). The recovery block contains critical BIOS codes, including memory detection and recovery codes for the user to flash a healthy BIOS image if the original main BIOS image is corrupted. When the system power is turned on, the recovery block codes execute first. Once this process is complete, the main BIOS code will continue with system initialization and the remaining POST (Power-On Self-Test) routines.

Note 1: Follow the BIOS recovery instructions below for BIOS recovery when the main BIOS block crashes.

Note 2: When the BIOS recovery block crashes, you will need to follow the procedures to make a Returned Merchandise Authorization (RMA) request. (For a RMA request, please see section 3.5 for more information). Also, you may use the Supermicro Update Manager (SUM) Out-of-Band (OOB) (https://www.supermicro.com.tw/products/nfo/SMS_SUM.cfm) to reflash the BIOS.

D.3 Recovering the Main BIOS Block with a USB Device

This feature allows the user to recover the main BIOS image using a USB-attached device without additional utilities used. A USB flash device such as a USB Flash Drive, or a USB CD/DVD ROM device can be used for this purpose. However, a USB Hard Disk drive cannot be used for BIOS recovery at this time.

The file system supported by the recovery block is FAT (including FAT12, FAT16, and FAT32) which is installed on a bootable or non-bootable USB-attached device. However, the BIOS might need several minutes to locate the SUPER.ROM file if the media size becomes too large due to the huge volumes of folders and files stored in the device.

To perform UEFI BIOS recovery using a USB-attached device, follow the instructions below.

1. Using a different machine, copy the "Super.ROM" binary image file into the Root "\" directory of a USB device or a writable CD/DVD.

Notes: 1. If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use. 2. Before recovering the main BIOS image, confirm that the "Super.ROM" binary image file you download is the same version or a close version meant for your motherboard.

BMC IP:10.132.168.92 PEI--Could Not Find Recovery Image... 07

1. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and reset the system when the following screen appears.

Ratio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Loss IMI Recovery Security Boot Save & Exit Please select Blocks you want to update boot (NYM) Boot Block Update Enabled Enabled ► Proceed with flash update Set this option to reset INRMM TO DEFAULT VALUES ++: Select Screen M: Select Item Enter: Select +/-: Change Opt F3: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 5.19.156, Copyright 10/1 2017 American Megatrends, Inc.

1. After locating the healthy BIOS binary image, the system will enter the BIOS Recovery menu as shown below.

Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below.

Aotio Setup utility - Copyright (C) 2017 American Hegatrends, Inc. Recovery WARNING System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF III Drive firmware update is completed pross any key to reboot the system Program new data write new boot block... 1TB 4: Select Screen 14: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save a Exit EBGT Exit Version 2.19-1266. Copyright (C) 2017 American Hegatrends, Inc.

1. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update" and press the key. You will see the BIOS recovery progress as shown in the screen below.

Rotor Setup Utility - Copyright (CI) 2017 American Hega Trends, Inc. Rovering MENKING System firmware is being updated. Keyboard is locked. DO NOT THAN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Flash update Flash update completed. Press any key to reset the system ##: Select Screen ##: Select Item Enter: Select #/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESQ: Exit Version 0.19.1056. Copyright (CI) 2017 American Hega Trends, Inc.

Note: Do not interrupt the BIOS flashing process until it has completed.

1. After the BIOS recovery process is complete, press any key to reboot the system.
2. Using a different system, extract the BIOS package into a USB flash drive.
3. Press continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press to save the settings and exit the BIOS Setup utility.

Auto Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMS Security BOOT Save & Exit Boot Configuration Boot mode select LEGACY to EFI support (DUAL) (DUSB(Add)) FIXED BOOT ORDER Priorities Boot Option #1 [UKFI MP/UEFI: Max... Boot Option #2 [CD/DVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CD/DVD] Boot Option #5 [USB Key/SendDisk1] Boot Option #6 [USB Floppy] Boot Option #7 [USB Lan] Boot Option #8 [Network: IBM GE $1...] Boot Option #9 [UKFI Hard Disk] Boot Option #10 [UKFI CD/DVD] Boot Option #11 [UKFI Use Hard Disk] Boot Option #12 [UKFI USB CD/DVI] Boot Option #13 [UKFI USD Key-UEFI...] Boot Option #14 [UKFI USB Floppy] Boot Option #15 [UKFI USE Lan] Boot Option #16 [UKFI Network] Boot Option #17 [Hard Disk] Add New Boot Option Sets the system boot order **: Select Screen T4: Select Item Enteri Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1286. Copyright (C) 2017 American Megatrends, Inc.

1. When the UEFI Shell prompt appears, type fs# to change the device directory path. Go to the directory that contains the BIOS package you extracted earlier from Step 6. Enter flash.nsh BIOSname.### at the prompt to start the BIOS update process.

UEFI Interactive Shell v2.1 E0K II UEFI v2.50 (American Megatrends, 0x0805000C) Mapping table F50: Alias(s):HD0v0b::BLK1: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x11,0x0)/HD(1,M8R,0x37901072,0x880,0x1 CR3532) BLK0: Alias(s): PciRoot(0x0)/Pci(0x14,0x0)/USB(0x11,0x0) Press FSC in 1 seconds to skip startup.nsh or any other key to continue. Shell: f50 F50:CD VFL00S F50:VFL00S> cd SMJPEG2_05162017 F50:VFL00S\SMJPEG2_09162017\ flash.nsh x110PU7.314

Note: Do not interrupt this process until the BIOS flashing is complete.

[ Access Cosmos Port Ex ] Index 0x51: 0x18 Done. ********************************************************************** * * Program BIOS and ME (including PDT) regions... * ********************************************************************** • AMI Firmware Update Utility v9.03.01.131T Copyright (C)2027 American Hegatrends Inc. #21 Rights Reserved. DNIID = 50652 Reading Flash ......... done - ME Data Size checking , ok - FFS checksums ......... ok - Check RowLayout ......... ok Drasing Boot Block ......... done Updating Boot Block ......... done Verifying Boot Block ......... done Drasing Main Block ......... 0x00102009 (xx)

1. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

Verifying NCB Block ....... done - Update success for F86 - Update success for IE. - - Successful Update Recovery Loader to OPRx!! - Successful Update NFSD!!- - Successful Update FTPR!!- - Successful Update MFS, JW1 and IWD2!! - Successful Update FLOG and UTOK!! - NE Entire Image update success!! WARNING : System must power-off to have the changes take effect! Having F501\AFUDOS\SWPME2_03162017\tref=64.efi -> F501\AFUDOS\SWPME2_03162017\tnf df.smc - [b] Having F501\AFUDOS\SWPME2_03162017\tafuefix=64.efi -> F501\AFUDOS\SWPME2_03162017 Tafuefix.smc - [b] ****************************************************************************************** + Please ignore this 'Shell: Cannot read from file - Device Error' + warning message due to it does not impact flashing process. + ****************************************************************************************** Operating Delete successful. F501(b)

1. Press continuously to enter the BIOS Setup utility.
2. Press to load the default settings.
3. After loading the default settings, press to save the settings and exit the BIOS Setup utility.

Appendix E

CPU-Based RAID for NVMe

Intel® Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCI-E root complex.

• A single processor supports up to 12 NVMe SSDs and up to 6 RAID arrays.
• A dual processor system supports up to 48 NVMe SSDs and 24 RAID arrays.

Strip sizes are 4K, 8K, 16K, 32K, 64K, 128K.

Requirements and Restrictions

• Intel VROC is only available when the system is configured for UEFI boot mode.
• To enable the mdadm command and support for RSTe, install the patch from

- Linux: https://downloadcenter.intel.com/download/28158/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Linux-

- Windows: https://downloadcenter.intel.com/download/28108/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Windows-

• To enable Intel VROC, a hardware key must be inserted on the motherboard, and the appropriate processor's Virtual Management Devices must be enabled in the BIOS setup.
• It is possible to enable Intel VROC without a hardware key installed, but only RAID0 will be enabled.
• Intel VROC is not compatible with secure boot. This feature must be disabled.
• When creating bootable OS RAID1 devices, you must have both devices on the same CPU, and a VMD on that CPU.
• Spanning drives when creating RAID devices is not recommended to due to performance issues, even though it is supported.

Supported SSDs and Operating Systems

To see the latest support information: https://www.intel.com/content/www/us/en/support/articles/000030310/memory-and-storage/ssd-software.html

Additional Information

Additional information is available on the product page for the Supermicro add-on card and the linked manuals.

www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm

E.1 Hardware Key

The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly. The key must be plugged into the Supermicro motherboard (connector JRK1). The key options are:

Intel® VROC Keys
VROC Package Description Part Number Intel MM Number
Standard	RAID 0, 1, 10Supports 3rd party SSDs	AOC-VROCSTNMOD 95	1605
Premium	RAID 0, 1, 5, 10Supports 3rd party SSDs	AOC-VROCPREMOD 95	1606
Intel SSD only	RAID 0, 1, 5, 10Supports Intel SSDs only	AOC-VROCINTMOD 95	822

VROC_HW_KEY PIN 1 GND KEY1 GND KEY2

Figure E-1. Intel® VROC RAID Key and Motherboard Connector JRK1

E.2 Enabling NVMe RAID

RAID for NVMe SSDs must be enabled through the UEFI BIOS.

1. Install the patch as described in the Restrictions and Requirements section on a previous page.
2. Reboot the server.
3. Press [DEL] key to enter BIOS.
4. Switch to Advanced > Chipset Configuration > North Bridge > IIO Configuration > Intel® VMD Technology > CPU1 & CPU2.
5. Enable the VMD according to the following rules.

- For U.2 NVMe, enable all the sub-items under each PStack, based on the your model server:

VMD BIOS Setting for 1029P-N32R
CPU1 CPU2
VMD Config for PStack0 VMD	Config for PStack1

- For M.2 NVMe or NVMe AIC, enable the VMD according to which AOC card/slot it used. An example U.2 configuration follows.

Auto Setup Utility - Copyright (C) 2008 American Regatree, Inc. MVC MVC Config for P3240 MVC Config for P3241 MVC Config for P3242 MVC Config for P3243 MVC Config for P3244 MVC Config for P3245 MVC Config for P3246 MVC Config for P3247 MVC Config for P3248 MVC Config for P3249 MVC Config for P3250 MVC Config for P3251 MVC Config for P3252 MVC Config for P3253 MVC Config for P3254 MVC Config for P3255 MVC Config for P3256 MVC Config for P3257 MVC Config for P3258 MVC Config for P3259 MVC Config for P3260 MVC Config for P3261 MVC Config for P3262 MVC Config for P3263 MVC Config for P3264 MVC Config for P3265 MVC Config for P3266 MVC Config for P3267 MVC Config for P3268 MVC Config for P3269 MVC Config for P3270 MVC Config for P3271 MVC Config for P3272 MVC Config for P3273 MVC Config for P3274 MVC Config for P3275 MVC Config for P3276 MVC Config for P3277 MVC Config for P3278 MVC Config for P3279 MVC Config for P3280 MVC Config for P3281 MVC Config for P3282 MVC Config for P3283 MVC Config for P3284 MVC Config for P3285 MVC Config for P3286 MVC Config for P3287 MVC Config for P3288 MVC Config for P3289 MVC Config for P3290 MVC Config for P3291 MVC Config for P3292 MVC Config for P3293 MVC Config for P3294 MVC Config for P3295 MVC Config for P3296 MVC Config for P3297 MVC Config for P3298 MVC Config for P3299 MVC Config for P3300

Auto Setup Utility - Copyright (C) 2018 American Megatronek, Inc. VMD Config for Portfolio Initial VMD for Volume Management Device [Database] VMD Config for Portfolio Initial VMD for Volume Management Device [Database] VMD Config for Portfolio Initial VMD for Volume Management Device [Database] HDD-CURRENT NAME: VMD [Database] Hot Flag Console [Database] Chassis/Disable Details Volume Management Device Technology in this Black. CPU2 ConfigurationCPU1 Configuration ** Select Screen T1: Select Item Enter: Select A: Change Out F3: Status/Default F4: Save & Print GSC: Real

Figure E-2. BIOS VMD Setting Example for 24 Drives

1. Press [F4] to save the configuration and reboot the system.
2. Press [DEL] to enter BIOS.
3. Switch to Advanced > Intel® Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume.
4. Set Name.
5. Set RAID Level.
6. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller as shown in Figure E-4.

Auto Setup Utility - Copyright (C) 2018 American Markets, Inc. Options Create RASS Volume Name: RASS Level: Volume: (Industrial) SELECT BASE ANNISED OVER NASDURATION: [ ] Select Index: INTEL SUPRECKHARRI (SAPRFDZFDS40PAPRIS) [6] INTEL SUPRECKHARRI (NUPRFDZFDS40PAPRIS) [6] INTEL SUPRECKHARRI (SAPRFDZFDS40PAPRIS) [ ] INTEL SUPRECKHARRI (SAPRFDZFDS40PAPRIS) [ ] Strike Size: [10930] Capacity FABI: [975.43] Create Volume X = To Select Box ←: Select Screen F1: Select Draw Enter: Select +/- Change Opt. F1: General, Help F2: Previous Values F3: Defaulted Defaults F4: Save & Exit GND: Exit Version 2.10.2000 Copyright 167 2018 American Markets, Inc.

Figure E-3. Created Volume without enabling RAID spanned over VMD controller

Auto Setup Utility - Copyright (C) 2018 American MegaCADs, Inc. Advanced Create ISO Volume Name: VOLUME: ISO/Strain/ ISO Level: [ISO/Strain] Create ISO Turnover over ISO Controller: 50 Select Size: [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Strain] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [TSO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train] [ISO/Train]

Figure E-4. Created Volume with enabling RAID spanned over VMD controller

1. Select specific disks for RAID with an [X].

• RAID0: Select at least two [2 - 24] disks
• RAID1: Select only two disks
• RAID5: Select at least three [3 - 24] disks
• RAID10: Select only four disks

1. Select Strip Size (Default 64KB).

2. Select Create Volume.

3. If another RAID is needed, start again at step 6.

4. Press [F4] to save and reboot.

E.3 Status Indications

An LED indicator on the drive carrier shows the RAID status of the drive.

Drive Carrier Status LED Indicator
Status State (red)
Normal function Off
Locating 4 Hz blink
Fault Solid on
Rebuilding 1 Hz Blink

IBPI SFF 8489 Defined Status LED States

E.4 Hot Swap Drives

Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other manufacturers. Under vSphere ESXi, several steps are necessary to avoid potential stability issues. See the information at link [1] below.

Hot-unplug

1. Prevent devices from being re-detected during rescan:

esxcli storage core claiming autoclaim --enabled=false

1. Unmount the VMFS volumes on the device. Check [2] for details.
2. Detach the device. Check [3] for details.
3. Physically remove the device.

Hot-plug

• Physically install the device.

ESXi will automatically discover NVMe SSDs, but a manual scan may be required in some cases.

Related Information Links

[1] https://kb.vmware.com/s/article/2151404
[2] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-1B56EF97-F60E-4F21-82A7-8F2A7294604D.html
[3] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-F2E75F67-740B-4406-9F0C-A2D99A698F2A.html