SuperServer F629P3-RTBN - Server Supermicro - Free user manual and instructions

USER MANUAL SuperServer F629P3-RTBN Supermicro

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A or Class B digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in industrial environment for Class A device or in residential environment for Class B device. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.0b

Release Date: June 29, 2021

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2021 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the FatTwin F629P3-RTB/RTBN/RC0B/RC1B. Installation and maintenance should be performed by experienced technicians only.

Please refer to the F629P3-RTB/RTBN/RC0B/RC1B server specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
- Product drivers and utilities: https://www.supermicro.com/wdl/driver
- Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at:

[e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Secure Data Deletion

A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/Lot9_Secure_Data_Deletion_Utility/

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Chapter 1 Introduction

1.1 Overview....9
1.2 Unpacking the System ....10
1.3 FatTwin: System Notes ....10

Nodes....10

System Power....10

SAS/SATA/NVMe Backplane/Drives ....10

1.4 System Features ....11
1.5 Server Chassis Features....12

Control Panel 12

Front Features....13

Rear Features ....14

1.6 Motherboard Layout....15
Quick Reference Table....16

Chapter 2 Server Installation

2.1 Overview....18
2.2 Preparing for Setup....18

Choosing a Setup Location....18
Rack Precautions....19
Server Precautions....19
Rack Mounting Considerations....19

Ambient Operating Temperature....19
Airflow....19
Mechanical Loading....20
Circuit Overloading....20
Reliable Ground....20

2-5 Rack Mounting Instructions....21

Identifying the Sections of the Rack Rails....22
Adjusting the Rails ....22
Installing the Rails on a Rack....23
Chassis Installation 24

Chapter 3 Maintenance and Component Installation

3.1 Removing Power....25
3-2 Chassis Components ....26

Removing Nodes from the Chassis....26

Removing the Cover from the Node....27

Node Configurations....28

Overview of the Node....28

F424AS2 Node Layout....28

Associated Hard Drives....29

Installing and Removing 3.5" Hard Drives ....30

Removing the Rear Hard Drive Cage....32

Drive Carrier Indicators....35

Hot-Swap for NVMe Drives 35

Checking the Temperature of an NVMe Drive ....36

Removing and Installing the Backplane....37

Removing the Backplane....37

Installing the Backplane....38

Removing the Rear Hard Drive Cage Backplane....39

Installing the Serverboard ....40

Compatible Motherboards ....40

Permanent and Optional Standoffs ....40

Power Adapter Card Replacement 42

Installing Expansion Cards....43

F424AS2 PCI-E Slot Configurations....43

Installing the PCI-E Slot Bracket Assembly Into the Node 44

Installing a SIOM Module....45

Installing Air Shrouds 46

Removing and Installing System Fans ....47

Replacing the Power Supplies 49

Power Supply Replacement....49

3.3 Motherboard Components....51

Processor and Heatsink Installation....51

The Processor....51

Overview of the Processor Socket Assembly....52

Overview of the Processor Heatsink Module....53

Preparing the CPU Socket for Installation....54

Removing the Dust Cover from the CPU Socket ....54

Attaching the Processor to the CPU/Heatsink Carrier....55

Attaching the CPU/Carrier Assembly to the Passive Heatsink to Form the Processor Heatsink Module (PHM)....56

Installing the Processor Heatsink Module (PHM) ....57

Removing the Processor Heatsink Module (PHM)....58

Memory Support and Installation ....59

ESD Precautions....59

Precautions....59

Introduction to Intel® Optane DC Persistent Memory ....59

Memory Support 59

Memory Installation Sequence 60

General Memory Population Requirements 61

DIMM Population Guidelines for Optimal Performance ....61

X11DP Motherboards with 12 DIMM Slots....62

DIMM Installation 63

DIMM Module Removal....64

Motherboard Battery 65

Chapter 4 Motherboard Connections

4.1 Power Connections....66
4.2 Headers and Connectors ....66
4.3 Rear I/O Ports ....68
Ethernet Ports....69
4.4 Front Control Panel....70
4.5 Jumpers....73
Explanation of Jumpers....73
4.6 LED Indicators....75
4.7 PCI-E 3.0 Slots....76

Chapter 5 Software

5.1 Microsoft Windows OS Installation....77
5.2 Driver Installation....79
5.3 SuperDoctor ^® 5....80
5.4 IPMI 80

Chapter 6 BIOS

6.1 Introduction....81
Starting the Setup Utility 81
6.2 Main Menu....82
6.3 Advanced Settings Menu ....84
6.4 Trusted Computing 113
6.5 Event Logs 116
6.6 IPMI....118
6.7 Security Settings ....122
6.8 Boot Settings....125
6.9 Save & Exit....127

Appendix A BIOS Error Codes

Appendix B Standardized Warning Statements for AC Systems

Appendix C System Specifications

Appendix D UEFI BIOS Recovery

Appendix E CPU-Based RAID for NVMe

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides a brief outline of the functions and features of the F629P3-RTB/RTBN/RC0B/RC1B. The F629P3-RTB/RTBN/RC0B/RC1B is based on the X11DPFR-S/SN motherboard and the F424AS2-R1K23BP chassis. This FatTwin system includes four motherboard tray nodes in the chassis.

In addition to the motherboard and chassis, several important parts that are included with the system are listed below.

Main Parts List
Description Part Number Quantity
OCuLink v.1.0, 4x PCI-E, 37-cm cables (F629P3-RTBN only)	CBL-SAST-0974-1	8
2X mini-SAS HD to 2x SATA, 55-cm, AWG28 cables (F629P3-RTBN only)	CBL-SAST-1005-1	4
20 to 20-pin 7.5-cm, 28AWG backplane cables CBL-OTHR-0022L 4
Internal mini-SAS HD to 4 SATA 50-cm, w/50cm SB cables (F629P3-RTB /F629P3-RTBN only)	CBL-SAST-0616 4
Mini-SAS HD to 4x SATA, 55-cm, AWG28 cables (F629P3-RTB only)	CBL-SAST-1004-1	4
Internal RA reverse Mini-SAS HD to 2x Mini-SAS HD Y-splitter 15/59-cm, 30AWG cables (F629P3-RC0B/F629P3-RC1B only)	CBL-SAST-0691 4
Internal RA reverse Mini-SAS HD to Mini-SAS HD 11-cm, 30AWG, 12Gb/s cables (F629P3-RC0B/F629P3-RC1B only)	CBL-SAST-0706 4
2x 3.5" HDD backplane (F629P3-RTB only) BPN-SAS-F424-A2 4
6x 3.5" HDD backplane (F629P3-RTB /F629P3-RTBN only)	BPN-SAS-F424-A6	4
2-Port Hybrid Backplane supports 2x SAS3/SATA3/NVMe Storage Devices (F629P3-RTBN/F629P3-RC0B/F629P3-RC1B only)	BPN-SAS3-F424-A2N2A	4
Backplane for 6x 3.5" SAS3/SATA3 HDD/SSD (F629P3-RC0B/F629P3-RC1B only)	BPN-SAS3-F424-A6	4
2U passive CPU heat sink with a side air channel, equipped with a narrow retention mechanism	SNK-P0068PSC 4
1.5U proprietary 50-mm tall passive CPU heat sink with a side air channel	SNK-P0069PSC	4
Black gen 6.5 hot-swap 3.5 inch HDD trays	MCP-220-00094-0B	32
F424AS2 air shroud	MCP-310-42408-0B	4
80x80x38-mm, 13.5K RPM, HCP, LMV, and LPC Cooling Fan	FAN-0162L4	8
Fat twin F418/F424 static rail set support 28-33.5-inch depth rail	MCP-290-41803-0N	1

1.2 Unpacking the System

Inspect the box the SuperServer F629P3-RTB/RTBN/RC0B/RC1B was shipped in and note if it was damaged in any way. If any equipment appears damaged, please file a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the server. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. It will also require a grounded AC power outlet nearby. Be sure to read the precautions and considerations noted in Appendix B.

1.3 FatTwin: System Notes

As a FatTwin configuration, the FatTwin F629P3-RTB/RTBN/RC0B/RC1B is a unique server system. With four system boards incorporated into a single chassis acting as four separate nodes, there are several points you should keep in mind.

Nodes

Each of the four serverboards act as a separate node in the system. As independent nodes, each may be powered off and on without affecting the others. In addition, each node is a hot-swappable unit that may be removed from the chassis. The nodes are connected to the server backplane by means of an adapter card.

Note: A guide pin is located between the upper and lower nodes on the inner chassis wall. This guide pin also acts as a "stop" when a node is fully installed. If too much force is used when inserting a node this pin may break off. Take care to slowly slide a node in until you hear the "click" of the locking tab seating itself.

System Power

Four 1200 Watt power supplies are used to provide the power for all serverboards. Each serverboard however, can be shut down independently of the others with the power button on its own control panel.

SAS/SATA/NVMe Backplane/Drives

As a system, the FatTwin F629P3-RTB/RTBN/RC0B/RC1B supports the use of eight SAS/SATA, or six (6) SAS/SATA drives and two (2) NVMe 3.5" drives in front-mounted hot-swap drive trays per node, for a total of thirty-two (32) HDD drives in the system. Each of the eight backplanes works to apply system-based control for power and fan speed functions, yet at the same time logically connects a set of eight (8) SAS/SATA, or six (6) SAS/SATA drives and two (2) 3.5" NVMe drives to each backplane/serverboard. Consequently, RAID setup is limited to an eight-drive scheme (RAID cannot be spread across all drives). See Chapter 6 for the logical hard drive and node configuration.

1.4 System Features

The following table provides you with an overview of the main features of the F629P3-RTB/RTBN/RC0B/RC1B. Please refer to Appendix C for additional specifications.

System Features

Motherboard

X11DPFR-S/SN

Chassis

F424AS2-R1K23BP

CPU

Dual Intel Xeon 81xx/61xx/51xx/41xx/31xx and 82xx/62xx/52xx/42xx/32xx series which offer 2 UPI (UltraPath Interconnect) of up to 10.4GT/sNote: Both CPUs need to be installed for full access to the PCI-E slots, DIMM slots, and onboard controllers. Refer to the block diagram on page 17 to determine which slots or devices may be affected.

Socket Type

Socket P

Memory

Integrated memory controller supports up to 1536 GB of ECC Load Reduced DIMM (LRDIMM), Registered DIMM (RDIMM), and Non-Volatile DIMM (NV-DIMM) DDR4 (288-pin) 2933/2666/2400/2133 Mhz modules in 12 slots

Chipset

Intel C621 chipset

Expansion Slots

One PCI-Express 3.0 (x16) slotOne PCI-Express 3.0 x16 (x8 + x8) SMCI storage Slot (JSXB2)One PCI-Express 3.0 x16 SIOM LAN Port

Hard Drives

The amount and type of hard drives in the system depends upon the model number as follows:F629P3-RTB: eight 3.5" SATA3 drivesF629P3-RTBN: six 3.5" SATA3 and two (2) 2.5" NVME/SATA3 drivesF629P3-RC0B/F629P3-RC1B: eight 3.5" SAS3/SATA3 drives

Power

Four 1200 Watt redundant power supplies

Cooling

Up to two 8-cm cooling fans for each of the system's four serverboard nodes

Form Factor

Proprietary: (LxW): 9.66" x 8.53" (216.66 mm x 499.36 mm)

Dimensions

Chassis dimensions: (WxHxD) 17.63 x 6.96 x 29 in. (448 x 177 x 737 mm)

1.5 Server Chassis Features

Control Panel

The switches and LEDs located on the control panel are described below. See Chapter 4 for details on the control panel connections.

Node 1 1 2 3 4 UD

Figure 1-1. Control Panel View

Control Panel Features
Item Feature Description
1 Power Button		The main power button on each of the eight control panels is used to apply or remove power from the power supply to each of the eight systems in the chassis. Turning off system power with this button removes the main power, but keeps standby power supplied to the system. Therefore, you must unplug system before servicing. The power button has a built-in LED which will turn green when the power is on.
2	NIC	Indicates network activity on either LAN1 or LAN2 when flashing.
3 Information LED See the table below for full details on the Information LED.
4 UID LED		When used with a UID compatible serverboard, the UID indicator is used to turn on or off the blue light function of the LED. This is built into the front side of the UID button and at the rear end of each serverboard node, for those motherboards which support it. Once the blue light is activated, the unit can be easily located in very large racks and server banks.

Information LED
Status Description
Continuously on and red An overheat condition has occurred. (This may be caused by cable congestion.)
Blinking red (1 Hz) Fan failure: check for an inoperative fan.
Blinking red (0.25 Hz) Power failure: check for an inoperative power supply.
Solid blue Local UID has been activated. Use this function to locate the server in a rack environment.
Blinking blue (300 msec) Remote UID has been activated. Use this function to locate the server from a remote location.

Front Features

The F424AS2-R1K23BP is a 4U chassis with four server nodes. See the illustration below for the features included on the front of the chassis.

1 2 1 1

Figure 1-2. Chassis Front View

Front Chassis Features
Item Feature Description
1 Node Control	Panels (4) See the section for	Control Panel above for details.
2 Drive Bays		Each node has six bays in the front for 3.5" HDD/SSD/NVMe drives. The configuration of each drive depends upon the server model.

Rear Features

The illustration below shows the features included on the rear of the chassis.

PWS Slot2PWS Slot2

Diagram of server rack front panels with numbered ports and labeled connectors

PWS Slot1 PWS Slot1

Figure 1-3. Chassis Rear View

Rear Chassis Features
Item Feature Description
1 Power Supply Four redundant 1200 Watt power supplies are at rear of the chassis
2	Rear I/O Ports	Each node has its own rear I/O ports. See Chapter 3 for I/O port descriptions.
3	SIOM Module Bay	Each node has one rear SIOM module bay available for additional I/O ports.
4 Rear Drive Bays		Each node has two bays in the rear for 3.5" HDD/SSD/NVMe drives. The configuration of each drive depends upon the server model.
5 Expansion Card Slots Each node has one rear expansion card slots available for access.

1.6 Motherboard Layout

Below is a layout of the X11DPFR-S/SN with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4.

UIDLED1 VGA JPG1 USB0/1 IPMI LAN JPB1 BMC_HB_LED1 BMC COM1 LED1 JIPMB1 JVRM1_JVRM2 S_SATA1 JSXB1 JSIOM1 JSXB3 JRK1 JS2 I-SATA4~7 BT1 JPWR_HDD3 I-SATA0~3 JS1 JTPM1 JSXB2 SUPER X10PFR-SIN DESIGNED IN USA REV 1.00 JSDCARD1 S_SATA0 JPME1 JBT1 JCPLD1 JNVI2C1 FAN1 FAN3FAN2 JPWR10 JPWR9 JPWR_HDD2 JPWR_HDD1 JNVME3 JNVME1 JNVME4 JNVM2 JPWRBT1

Figure 1-4. Motherboard Layout

Notes:

• See Chapter 4 for detailed information on jumpers, I/O ports, and JF1 front panel connections.
• Jumpers/LED indicators not indicated are used for internal testing only.

Quick Reference Table

Jumper Description Default Setting

JBT1 Clear CMOS Open (Normal)

JPME1 ME Recovery Pins 1-2 (Normal)

JVRM1 VRM SMB Clock (to BMC or PCH) Pins 1-2 (BMC, Normal)

JVRM2 VRM SMB Data (to BMC or PCH) Pins 1-2 (BMC, Normal)

Connector Description

Battery (BT1) Onboard CMOS battery
FAN1~3 System cooling fan headers
IPMI_LAN Dedicated IPMI LAN port
JIPMB1 4-pin external BMC I	^2C header (for an IPMI card)
JNVME1~4	NVMe OcuLink Ports
JNVI ^2 C1	NVMe I^2C header
JPWR9/JPWR10	8-pin Power Connector 9 (12V_in)/Power Connector 10 (Ground)
JPWR_HDD1/2/3	HDD Power headers 1/2/3
JRK1	RAID Key for NVMe devices
JS1/2	MiniSAS HD SATA 3.0 Ports
JSDCARD1	Micro SD Card slot
JTPM1	Trusted Platform Module (TPM) connector
(I-)SATA0~3, 4~7	I- SATA 3.0 connectors supported by the Intel PCH
(S-)SATA0/1	S-SATA 3.0 connectors supported by the Intel PCH
JSXB1	PCI-E 3.0 x16 Right hand riser (CPU1)
JSXB2	PCI-E 3.0 (x8+x8) SMCI Proprietary slot (CPU1 & CPU2)
JSXB3	PCI-E 3.0 x16 Left hand riser (CPU2)
USB0/1	Back panel USB 3.0 ports
VGA	Back panel VGA port

LED	Description	State: Status
UID_LED1	UID (Unit Identifier) LED	Solid Blue: Unit Identified
LED1	Onboard Power LED	On: Onboard Power On
BMC_HB_LED1	BMC Heartbeat LED	Blinking Green: BMC Normal

```mermaid
graph TD
    subgraph Intel PCH
        A["Intel PCH"] --> B["SOCKET ID:0"]
        A --> C["SOCKET ID:1"]
        B --> D["PCI-E X16"]
        C --> E["PCI-E X8"]
        D --> F["PCI-E X16"]
        E --> G["PCI-E X8"]
        F --> H["PCI-E X16"]
        G --> I["PCI-E X8"]
        H --> J["PCI-E X16"]
        I --> K["PCI-E X8"]
        J --> L["PCI-E X16"]
        K --> M["PCI-E X8"]
        L --> N["PCI-E X16"]
        M --> O["PCI-E X8"]
        N --> P["PCI-E X16"]
        O --> Q["PCI-E X8"]
        P --> R["PCI-E X16"]
        Q --> S["PCI-E X16"]
        R --> T["PCI-E X16"]
        S --> U["PCI-E X16"]
        T --> V["PCI-E X16"]
        U --> W["PCI-E X16"]
        V --> X["PCI-E X16"]
        W --> Y["PCI-E X16"]
        X --> Z["PCI-E X16"]
        Y --> AA["PCI-E X16"]
        Z --> AB["PCI-E X16"]
    end

    subgraph Ethernet
        AC["Internet Master"] --> AD["NCSI master"]
        AC --> AE["BMC AST2500"]
        AC --> AF["M.2"]
        AC --> AG["RMI/NCSI"]
        AC --> AH["SFI"]
        AC --> AI["NCSI"]
    end

    subgraph System Power
        AJ["FAN SPEED CTRL"] --> AK["TPM HEADER Debug Card"]
        AL["FRONT PANEL"] --> AM["DATA MINISAS-HD I-SATA x8"]
        AN["SYSTEM POWER"] --> AO["SATA SATA-DOM"]
        AP["VCCP1 12vVCCP0 12v"] --> AQ["DDRIV 2133/2666"]
        AR["VCCP1 5+1 PHASE 165W"] --> AS["DDRIV 2133/2666"]
        AT["VCCP1 5+1 PHASE 165W"] --> AU["DDRIV 2133/2666"]
        AV["VCCP1 5+1 PHASE 165W"] --> AW["DDRIV 2133/2666"]
        AX["VCCP1 5+1 PHASE 165W"] --> AY["DDRIV 2133/2666"]
        AZ["VCCP1 5+1 PHASE 165W"] --> BA["DDRIV 2133/2666"]
        BB["VCCP1 5+1 PHASE 165W"] --> BC["DDRIV 2133/2666"]
        BD["VCCP1 5+1 PHASE 165W"] --> BE["DDRIV 2133/2666"]
        BF["VCCP1 5+1 PHASE 165W"] --> BG["DDRIV 2133/2666"]
    end

    subgraph System Power
        BH["VGA CONN"] --> BI["Temp Sensor NCT7718W"]
        BI --> BJ["COM1 Connector"]
        BJ --> BK["SIPI"]
        BK --> BL["NCSI master"]
        BL --> BM["BMC AST2500"]
        BL --> BN["M.2"]
        BN --> BO["PCI-E X4"]
        BO --> BP["NCSI master"]
    end

    subgraph System Power
        BQ["VGA CONN"] --> BR["LAN3 RTL8211F"]
        BR --> BS["RGRMII"]
    end

    subgraph System Power
        BT["VGA CONN"] --> BU["NCSI master"]
    end

    subgraph System Power
        BV["VGA CONN"] --> BW["NCSI master"]
    end

    subgraph System Power
        BX["VGA CONN"] --> BY["NCSI master"]
    end

    subgraph System Power
        BZ["VGA CONN"] --> CA["NCSI master"]
    end

    subgraph System Power
        CB["VGA CONN"] --> CC["NCSI master"]
    end

    subgraph System Power
        DD["VGA CONN"] --> DE["NCSI master"]
    end

    subgraph System Power
        DF["VGA CONN"] --> DG["NCSI master"]
    end

    subgraph System Power
        DH["VGA CONN"] --> DI["NCSI master"]
    end

    subgraph System Power
        DJ["VGA CONN"] --> DK["NCSI master"]
    end

    subgraph System Power
        DL["VGA CONN"] --> DN["NCSI master"]
    end

    subgraph System Power
        DO["VGA CONN"] --> DP["NCSI master"]
    end

    subgraph System Power
        DP["VGA CONN"] --> DP2["NCSI master"]
    end

    subgraph System Power
        DP2["NCSI master"]
    end

    subgraph System Power
        DP3["NCSI master"]
    end

    subgraph System Power
        DP4["NCSI master"]
    end

    subgraph System Power
        DP5["NCSI master"]
    end

    subgraph System Power
        DP6["NCSI master"]
    end

    subgraph System Power
        DP7["NCSI master"]
    end

    subgraph System Power
        DP8["NCSI master"]
    end

    subgraph System Power
        DP9["NCSI master"]
    end

    subgraph System Power
        DP10["NCSI master"]
    end

    subgraph System Power
        DP11["NCSI master"]
    end

    subgraph System Power
        DP12["NCSI master"]
    end

    subgraph System Power
        DP13["NCSI master"]
    end

    subgraph System Power
        DP14["NCSI master"]
    end

    subgraph System Power
        DP15["NCSI master"]
    end

    subgraph System Power
        DP16["NCSI master"]
    end

    subgraph System Power
        DP17["NCSI master"]
    end

    subgraph System Power
        DP18["NCSI master"]
    end

    subgraph System Power
        DP19["NCSI master"]
    end

    subgraph System Power
        DP20["NCSI master"]
    end

    subgraph System Power
        DP21["NCSI master"]
    end

    subgraph System Power
        DP22["NCSI master"]
    end

    subgraph System Power
        DP23["NCSI master"]
    end

    subgraph System Power
        DP24["NCSI master"]
    end

    subgraph System Power
        DP25["NCSI master"]
    end

    subgraph System Power
        DP26["NCSI master"]
    end

    subgraph System Power
        DP27["NCSI master"]
    end

    subgraph System Power
        DP28["NCSI master"]
    end

    subgraph System Power
        DP29["NCSI master"]
    end

    subgraph System Power
        DP30["NCSI master"]
    end

    subgraph System Power
        DP31["NCSI master"]
    end

    subgraph System Power
        DP32["NCSI master"]
    end

    subgraph System Power
        DP33["NCSI master"]
    end

    subgraph System Power
        DP34["NCSI master"]
    end

    subgraph System Power
        DP35["NCSI master"]
    end

    subgraph System Power
        DP36["NCSI master"]
    end

    subgraph System Power
        DP37["NCSI master"]
    end

    subgraph System Power
        DP38["NCSI master"]
    end

    subgraph System Power
        DP39["NCSI master"]
    end

    subgraph System Power
        DP40["NCSI master"]
    end

    subgraph System Power
        DP41["NCSI master"]
    end

    subgraph System Power
        DP42["NCSI master"]
    end

    subgraph System Power
        DP43["NCSI master"]
    end

    subgraph System Power
        DP44["NCSI master"]
    end

    subgraph System Power
        DP45["NCSI master"]
    end

    subgraph System Power
        DP46["NCSI master"]
    end

    subgraph System Power
        DP47["NCSI master"]
    end

    subgraph System Power
        DP48["NCSI master"]
    end

    subgraph System Power
        DP49["NCSI master"]
    end

    subgraph System Power
        DP50["NCSI master"]
    end

    subgraph System Power
        DP51["NCSI master"]
    end

    subgraph System Power
        DP52["NCSI master"]
    end

    subgraph System Power
        DP53["NCSI master"]
    end

    subgraph System Power
        DP54["NCSI master"]
    end

    subgraph System Power
        DP55["NCSI master"]
    end

    subgraph System Power
        DP56["NCSI master"]
    end

    subgraph System Power
        DP57["NCSI master"]
    end

    subgraph System Power
        DP58["NCSI master"]
    end

    subgraph System Power
        DP59["NCSI master"]
    end

    subgraph System Power
        DP60["NCSI master"]
    end

    subgraph System Power
        DP61["NCSI master"]
    end

    subgraph System Power
        DP62["NCSI master"]
    end

    subgraph System Power
        DP63["NCSI master"]
    end

    subgraph System Power
        DP64["NCSI master"]
    end

    subgraph System Power
        DP65["NCSI master"]
    end

    subgraph System Power
        DP66["NCSI master"]
    end

    subgraph System Power
        DP67["NCSI master"]
    end

    subgraph System Power
        DP68["NCSI master"]
    end

    subgraph System Power
        DP69["NCSI master"]
    end

    subgraph System Power
        DP70["NCSI master"]
    end

    subgraph System Power
        DP71["NCSI master"]
    end

    subgraph System Power
        DP72["NCSI master"]
    end

    subgraph System Power
        DP73["NCSI master"]
    end

    subgraph System Power
        DP74["NCSI master"]
    end

    subgraph System Power
        DP75["NCSI master"]
    end

    subgraph System Power
        DP76["NCSI master"]
    end

    subgraph System Power
        DP77["NCSI master"]
    end

    subgraph System Power
        DP78["NCSI master"]
    end

    subgraph System Power
        DP79["NCSI master"]
    end

    subgraph System Power
        DP80["NCSI master"]
    end

    subgraph System Power
        DP81["NCSI master"]
    end

    subgraph System Power
        DP82["NCSI master"]
    end

    subgraph System Power
        DP83["NCSI master"]
    end

    subgraph System Power
        DP84["NCSI master"]
    end

    subgraph System Power
        DP85["NCSI master"]
    end

    subgraph System Power
        DP86["NCSI master"]
    end

    subgraph System Power
        DP87["NCSI master"]
    end

    subgraph System Power
        DP88["NCSI master"]
    end

    subgraph System Power
        DP89["NCSI master"]
    end

    subgraph System Power
        DP90["NCSI master"]
    end

    subgraph System Power
        DP91["NCSI master"]
    end

    subgraph System Power
        DP92["NCSI master"]
    end

    subgraph System Power
        DP93["NCSI master"]
    end

    subgraph System Power
        DP94["NCSI master"]
    end

    subgraph System Power
        DP95["NCSI master"]
    end

end

Figure 1-5. Intel C621 Chipset: System Block Diagram

Note: This is a general block diagram and may not exactly represent the features on your motherboard. See the System Specifications appendix for the actual specifications of your motherboard.

Chapter 2

Server Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 4 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).
• This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time - extending two or more simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Appendix B.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the servers closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.

2-5 Rack Mounting Instructions

This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided. You should also refer to the installation instructions that came with the rack unit you are using.

Note: This rail will fit a rack between 26.5" and 36.4" deep. The F424AS2 is not designed for installation into a Telco post-style rack unit. Warning: Do not pick up the server with the front handles. They are designed to pull the system from a rack only.

Stability Hazard: The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

Warning: Slide rail mounted equipment is not to be used as a shelf or a work space.

Warning: When initially installing the server to a rack, test that the rail locking tabs engage to prevent the server from being overextended. Have a rack lift in place as a precaution in case the test fails.

Warning: In any instance of pulling the system from the rack, always use a rack lift and follow all associated safety precautions.

Identifying the Sections of the Rack Rails

The chassis package includes two rail assemblies in the rack mounting kit. Each assembly consists of two sections: A front section which secures to the front post of the rack and a rear section which adjusts in length and secures to the rear post of the rack. These assemblies are specifically designed for the left and right side of the chassis (see Figure 2-1).

Adjusting the Rails

Each rail assembly has an adjusting screw. Loosening this screw allows you to adjust the length of the rail to fit a variety of rack sizes.

Inner Rail Outer Rail This Side Faces Outward Adjusting Screw

Figure 2-1. Identifying the Rail Sections

Slide rail mounted equipment is not to be used as a shelf or a work space.

Warning: do not pick up the server with the front handles. They are designed to pull the system from a rack only.

Installing the Rails on a Rack

Installing the Rails

1. Adjust the length of both rails as described on the previous page.
2. Align the front section of the outer rail with the slots on the front post of the rack. Secure the front of the outer rail to the rack with two screws.
3. Pull out the rear section of the outer rail, adjusting the length until it fits within the posts of the rack.
4. Align the rear section of the rail with the slots on the rear post of the rack. Secure the rear of the outer rail to the rear of the rack with two screws.
5. Repeat steps 1-4 for the remaining rail.

Technical line drawing of a server rack cabinet with visible internal components and mounting points (no text or labels)

Figure 2-2: Attaching the Rails to a Rack

Chassis Installation

Installing the Chassis into a Rack

1. Confirm that the rails are correctly installed on the rack.
2. Align the bottom of the chassis with the bottom of the rails.
3. Insert the chassis into the rails, keeping the pressure even on both sides, pushing the chassis into the rack.
4. Secure the chassis handles to the front of the rack.

Technical line drawings of two server rack unit cellers with internal components (no text or labels)

Figure 2-3: Installing into a Rack

Note: The figure above is for illustration purposes only. Always install servers to the bottom of the rack first.

Note: Both front chassis rails and the rack rails have a locking tab, which serves two functions. First, it locks the server into place when installed and pushed fully into the rack (its normal operating position. In addition, these tabs lock the server in place when fully extended from the rack. This prevents the server from coming completely out of the rack when pulled out for servicing.

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components require that power first be removed from the system. Please follow the procedures given in each section.

3.1 Removing Power

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non hot-swap components or when replacing a non-redundant power supply.

Removing the Power Cord

1. Use the operating system to power down the system, following the on-screen prompts.
2. After the system has completely shut-down, carefully grasp the head of the power cord and gently pull it out of the back of the power supply.
3. If your system has dual redundant power supplies, remove the cords from both power supplies.
4. Disconnect the cord from the power strip or wall outlet.

3-2 Chassis Components

The chassis includes power supplies, rear I/O ports, expansion card slots and four nodes. Each node is a separate system containing a drawer with a serverboard, fans, and other components. Each node may be removed from the chassis separately.

Removing Nodes from the Chassis

Each of the four individual serverboard nodes may be removed from the chassis. Note that any time a node is removed from the chassis, the hard drives located in the node will shut-down.

Removing a Serverboard Node

1. Power down the system and remove the power cords from the rear of the node as described in Section 3-1.
2. Grasp the node by the handles on both sides of the front of the node.
3. Press down on the left handle to disengage the latch.
4. While holding down the left handle, carefully pull the node forward and out of the chassis.

Node 1 Node 2 Node 3 Node 4 ② ④

Figure 3-1. Nodes Corresponding to Locations in the Chassis

Warning: Except for short periods of time, do not operate the server without the cover in place. The chassis cover must be in place to allow for proper airflow and to prevent overheating.

Removing the Cover from the Node

Each node has a removable cover which will permit access to the nodes components. Removing the Node Cover

1. Remove the serverboard node completely from the chassis and place it on a flat, stable surface.
2. Remove the screw securing the cover to the node, as illustrated below.
3. Lift the cover up and off the node.

3 2

Figure 3-2. Removing the Node Cover

Node Configurations

Overview of the Node

Node configuration for a typical node is shown below in Figure 3-3.

F424AS2 Node Layout

The specifications for the F424AS2 nodes are shown in the table below.

F424AS2 Node Layout Specifications
Front of Node Rear of Node
Six (6) 3.5" hot-swappable hard drives	One SIOM ModuleOne low-profile expansion cardTwo (2) 3.5" hot-swappable hard drives

Front of the Node Rear of the Node

Figure 3-3: Front and Rear of the F424AS2 Serverboard Node (Your node may differ from the one shown in this illustration)

Associated Hard Drives

The F424AS2 chassis contains four individual motherboards in separate 2U nodes. Each node controls the eight hard drives contained within that node (six in front, two in the rear). Note that if a node is pulled out of the chassis, the hard drives associated with that node will power down as well. Refer to the table below and on the following pages for your specific chassis configuration.

F424AS2
Node 2Controls eight 3.5" HDDs, B1-B8	Node 4Controls eight 3.5" HDDs, D1-D8
Node 1Controls eight 3.5" HDDs, A1-A8	Node 3Controls eight 3.5" HDDs, C1-C8

Node 1 Node 2 Node 3 Node 4

Figure 3-4. Nodes Locations in the Chassis

Installing and Removing 3.5" Hard Drives

These instructions apply to hot-swappable 3.5" hard drives. Hot-swappable hard drives can be removed from the chassis without powering down the server or removing the node from the chassis.

Only enterprise level hard drives are recommended for use in Supermicro chassis.

Removing 3.5" Hard Drive Carriers from the Node

1. Press the release button on the drive carrier. This extends the drive bay handle.
2. Use the handle to pull the drive carrier out of the chassis.

The 3.5" hard drives are mounted in the drive carrier to simplify their installation and removal from the chassis. These carriers also help promote proper airflow for the drive bays.

Warning: Except for short periods of time while swapping hard drives, do not operate the server with the hard drives bays empty.

Technical diagram showing server rack and internal components with labeled parts 1 and 2, including a zoomed-in view of the internal structure.

Figure 3-5. Removing a Front Mounted 3.5" Hard Drive Carrier

Technical diagram showing server rack assembly with labeled components and connection to a device, including numbered annotations.

Figure 3-6. Removing a Rear Mounted 3.5" Hard Drive Carrier

Removing the Rear Hard Drive Cage

Removing the Rear Hard Drive Cage

1. Remove the four screws securing the Rear Hard Drive Cage from the Node Chassis.
2. Lift the Rear Hard Drive Cage from the node chassis.

Technical diagram of an industrial server rack with labeled components and numbered parts

Figure 3-7. Removing the Rear Hard Drive Cage

Removing the Dummy Drive from the 3.5" Drive Carrier

1. Remove the hard drive carrier from the chassis as described in the previous section and lay the drive carrier on a flat surface.
2. Remove the two screws securing the dummy drive to the drive carrier.
3. Lift the dummy drive from the drive carrier.

Drive Carrier Dummy Drive

Figure 3-8: Removing a Dummy Drive from the 3.5" Drive Carrier (Your drives may differ from the one shown in this illustration)

Installing a 3.5" Hard Drive into the Drive Carrier

1. Place the hard drive carrier on a flat surface.
2. Insert the hard drive into the carrier with the printed circuit board side facing downward and so that the mounting holes in the drive align with those in the drive carrier.
3. Secure the hard drive to the carrier with the four screws included with the hard drive.
4. Use the open handle of the drive carrier to insert the drive carrier into the open drive bay.
5. Secure the drive carrier into the drive bay by closing the drive carrier handle.

Note that if a node is pulled out of the chassis, the hard drives associated with that node will power down as well. The hard drives are hot-swappable and may be removed from the node without removing the node from the chassis or powering down the system.

SAS or SATA Hard Drive Drive Carrier

Figure 3-9: Installing a 3.5" Hard Drive into the Drive Carrier (Your drives may differ from the one shown in this illustration)

Drive Carrier Indicators

Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare. For VROC configurations, refer to the VROC appendix in this manual.

Drive Carrier LED Indicators
	Color Blinking Pattern Behavior		for Device
Activity LED	Blue Solid On SAS/NVMe drive installed
	Blue Blinking I/O activity
Status LED	Red Solid On Failure of drive with RSTe support
	Red Blinking at 1 Hz Rebuilding drive with RSTe support
	Red Blinking with two blinks and one stop at 1 Hz		Hot spare for drive with RSTe support (not supported in VMD mode)
	Red On for five seconds, then off		Power on for drive with RSTe support
	Red Blinking at 4 Hz Identify drive with RSTe support
	Green Solid On Safe to remove NVMe device (not supported in VMD mode)
	Amber Blinking at 1 Hz Attention state—do not remove NVMe device (not supported in VMD mode)

Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro website at https://www.supermicro.com/products/nfo/Ultra.cfm.

Hot-Swap for NVMe Drives

An NVMe drive can be inserted and replaced using IPMI.

Note: If you are using VROC, see the VROC appendix in this manual instead.

Ejecting a Drive

1. IPMI > Server Health > NVMe SSD
2. Select Device, Group and Slot, and click Eject. After ejecting, the drive Status LED indicator turns green.
3. Remove the drive.

Note that Device and Group are categorized by the CPLD design architecture. Slot is the slot number on which the NVMe drives are mounted.

Host Identification Server: 172 031.049.114 User: ADAMN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Health Event Log Power Consumption Power Source NVMe SSD NVMe SSD This page displays NVMe SSD information. Locate / Stop Locate SSD Device:0 Group:0 Slot:0 Locate Stop Locate Eject CPLD / BPN ID: EF Rev: 10 Slot:0 Status: Present Temperature: 35 degrees C Vendor ID: 00.06 Serial Number: BTLF7270087MAPOON Model Number: INTEL SSDPE2KX040T7 Slot:1 Status: Present Temperature: 22 degrees C Vendor ID: 00.06 Serial Number: PHLFT20500554P0ION Model Number: INTEL SSDPE2KX040T7 Slot:2 Copyright © 2018 Super Micro Computer, Inc.

Figure 3-4. IPMI Screenshot

Replacing the Drive

1. Insert the replacement drive.
2. IPMI > Server Health > NVMe SSD
3. Select Device, Group and slot and click Insert. The drive Status LED indicator flashes red, then turns off. The Activity LED turns blue.

Checking the Temperature of an NVMe Drive

There are two ways to check using IPMI.

Checking a Drive

• IPMI > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives, as in Figure 3-4.
• IPMI > Server Health > Sensor Reading > NVME_SSD – Shows the single highest temperature among all the NVMe drives.

Removing and Installing the Backplane

The F424AS2 chassis backplane is located behind the hard drives and in front of the front system fans in each serverboard node. Although backplane failure rarely occurs, in the event of a backplane failure, follow the instructions below.

Removing the Backplane

Removing the Backplane from the Chassis

1. Using the handles on the front of the serverboard node, pull the node completely out of the chassis and place it on a flat surface.
2. Remove the node cover (see the section Removing the Node Cover for details), and air shroud (see the Installing the Air Shroud section for details).
3. Remove the three screws securing the fan tray to the floor of the node.
4. Remove the three screws securing the backplane to the node (Figure 3-10).
5. Lift the backplane up and out of the chassis.

Technical diagram of a server rack with labeled components and assembly steps

Figure 3-10: Removing the Backplane from the Node Chassis (Your node and backplane may differ from the one shown in this illustration)

Installing the Backplane

Installing the Backplane into the Chassis

1. Ensure that all of the hard drive carriers have been removed from the bays in the front of the node (see the section Installing and Removing Hard Drives for details).
2. Ease the backplane forward, against the front of the chassis.
3. Align the mounting holes in the backplane with the holes in the chassis. Replace the three screws at the top of the backplane
4. Reconnect all cables and return the hard drive trays to their bays in the front of the serverboard node.

Technical diagram of an electronic device showing labeled components and wiring connections

Figure 3-11: Installing the Backplane (Your node and backplane may differ from the one shown in this illustration)

Removing the Rear Hard Drive Cage Backplane

Removing the Rear Hard Drive Cage Backplane

1. Remove the two screws securing the Rear Hard Drive Cage Backplane to the Rear Hard Drive Cage.

2. Lift the backplane off of the Rear Hard Drive Cage.

Technical line drawings of two electronic device modules with labeled components (no text or symbols present)

Figure 3-12: Removing the Backplane from the Rear Hard Drive Cage (Your node and backplane may differ from the one shown in this illustration)

Installing the Serverboard

Compatible Motherboards

For the most up-to-date information on compatible motherboards and other parts, visit the Supermicro Web site at www.supermicro.com.

Permanent and Optional Standoffs

Standoffs prevent short circuits by creating space between the serverboard and the floor of the node. The F424AS2 chassis includes permanent standoffs in locations used by most motherboards. These standoffs use the rounded Phillips head screws included in the chassis accessories packaging.

Some motherboards require additional screws for heatsinks, general components and/or non-standard security. Optional standoffs are used for these motherboards.

To use an optional standoff, compare the mounting holes in the serverboard with those in the floor of the serverboard node. Then place a screw through the bottom the node and secure the screw with a hexagonal nut (rounded side up).

Depending upon the configuration of the serverboard being used, it is also possible that some of the optional standoffs which are pre-installed in the chassis, may need to be removed. Add or remove standoffs as needed.

Installing the Serverboard

1. Review the documentation that came with your serverboard. Become familiar with component placement, requirements, cautions, and cable connections.
2. Power down the system and remove the power cord from the rear of the power supply. Remove the node from the chassis and place the node on a flat, stable surface. Then remove the cover from the node.
3. Compare the holes in the serverboard with those in the floor of the node, then add or remove standoffs as needed.
4. Secure the serverboard to the floor of the node tray using the rounded, Phillips head screws included for this purpose. Do not exceed eight pounds of torque when tightening down the serverboard.
5. Install the expansion card associated with the serverboard if the chassis is a hot-swappable version. Refer to the next section for instructions on installing the expansion card

6. Secure the CPU(s), heatsinks, and other components to the serverboard as described in the serverboard documentation.

7. Connect the cables between the serverboard, backplane, chassis, front panel, and power supply, as needed. The fans may be temporarily removed to allow access to the backplane ports.

8. Replace the expansion card bracket and secure the bracket with a screw.
9. Repeat steps 3 - 5 for the remaining nodes.

Technical line drawing of a server rack with multiple drive units and overhead connectors (no text or symbols)

Figure 3-13: Installing the Serverboard in the Serverboard Node Tray (Your node and serverboard may differ from the one shown in this illustration)

Power Adapter Card Replacement

Each of the serverboard nodes for the server includes a power adapter card, which connects it to the chassis. In the unlikely event of a failure of the power adapter card, replacement is simple and requires only a Phillips head screwdriver.

Changing the Power Adapter Card

1. Remove the node from the chassis and place the node on a flat, stable surface. Then remove the cover from the node.
2. Remove the four screws securing the power adapter card to the mounting bracket.
3. Disconnect all cables.
4. Carefully lift the power adapter card up and out of the node. Set the screws aside for later use.
5. Install the replacement power adapter card into the same position on the mounting bracket, aligning the mounting holes of the board with those in the node.
6. Secure the board with the four screws previously set aside. Do not exceed eight pound of torque when tightening the power adapter board.
7. Reconnect all cables.

Technical line drawing of a server rack with internal components and ventilation ducts (no text or symbols)

Figure 3-14: Installing the Adapter Card (Your node and backplane may differ from the one shown in this illustration)

Installing Expansion Cards

F424AS2 PCI-E Slot Configurations

Some F424AS2 chassis models support one or more expansion cards in each node, Refer to the tables below to determine the PCI-E slot configuration for your particular chassis.

F424AS2
Front of Node Rear of Node
Six 3.5" hot-swappable hard drives	One SIOM Module BayOne low-profile expansion cardTwo 3.5" hot-swappable hard drives

PCI-E Slot Shield

Figure 3-15: Rear I/O Shield Configuration

Installing the PCI-E Slot Bracket Assembly Into the Node Installing the PCI-E Slot Bracket Assembly

1. Remove the one screw securing the PCI-E Slot Shield.
2. Make sure the expansion card is low profile. Plug the expansion card into the PCI-E slot on the serverboard..
3. Secure the expansion card into the rear window with the same screw securing the PCI-E slot shield.

Mounting Screw PCI-E Slot Bracket Expansion Card

Figure 3-16: Installing the PCI-E Slot Bracket Assembly

Installing a SIOM Module

Each node in the system has one front mounted SIOM module, which adds various I/O ports to the node, depending upon the module selected. To install a module, use the procedure below. Installing a SIOM module

1. Remove the SIOM bracket by unscrewing two screws, one on the side of the node tray, one underneath.
2. Remove one screw securing the SIOM Slot shield.
3. Install any SIOM into the bracket, and securing the SIOM by tightening the two built-in screws on the SIOM.
4. Install the assembled SIOM bracket into the node tray, and tightening the two screws used in step 1.

Technical line drawing of a server rack with internal components and screw assembly (no text or symbols)

Figure 3-17: Installing the SIOM

Installing Air Shrouds

Air shrouds concentrate airflow to maximize fan efficiency. The F424AS2 chassis requires an air shroud in each node.

Installing an Air Shroud

1. Remove the node from the chassis and remove the cover from the node.
2. Make sure that the serverboard and all components are properly installed in each node.

3. Place the air shroud over the serverboard, as illustrated below. The air shroud sits behind the system fans and goes over the top of the serverboard and its components. It uses one screw to secure it in place.

4. Repeat the procedure for the remaining three nodes.

Technical diagram showing internal components of a server rack with labeled parts and an arrow indicating assembly direction.

Figure 3-18: Installing the Air Shroud

Removing and Installing System Fans

System fans provide cooling for each node. Front I/O nodes have rear external fans and rear I/O nodes have front internal fans. These fans circulate air through the node as a means of lowering the internal temperature. The F424AS2 system fans are easily removed from the fan tray. There is no need to uninstall any other parts when replacing fans, and only a Phillips screwdriver is required for installation.

Replacing a Front Internal System Fan

1. Determine which serverboard node contains the failed fan,.Remove the node from the chassis as described in Section 3-2 and place the node on a flat, stable surface. Remove the cover from the node as described in Section 3-2.
2. Remove the one screw securing the air shroud and lift the air shroud up and out of the node.
3. Disconnect all fan cables from the motherboard.
4. Remove the screws securing the fan housing to the floor of the node and set them aside for later use.
5. Lift the fan housing up and out of the chassis.
6. Simultaneously squeeze both sets of release tabs on each side of the fan housing. This will release the cover plate of the housing which holds the fans inside the housing. Either the front or rear cover plate may be released.
7. Pull the cover plate off the fan housing.
8. Remove the four rubber spacers from the housing.
9. Pull out the failed fan and replace it with a new one.
10. Reinstall the rubber spacers in the fan housing.
11. Reinstall the face cover of the fan housing, by aligning the release tabs with their slots in the housing and gently pushing the face cover onto the housing until it clicks into the locked position.
12. Reconnect the cabling to both fans.
13. Reinstall the fan housing in the serverboard node and secure it to the floor of the node with the four screws which were previously set aside.

Technical line drawing of an internal hard drive chassis showing fan and cooling components (no text or labels)

Figure 3-19: Removing the Fan Tray

Technical line drawings of a multi-chamber electric fan assembly (no text or symbols)

Figure 3-20: Removing the Fan from the Fan Tray

Replacing the Power Supplies

The F424AS2 chassis includes a 1200 Watt power supply. This power supply is auto-switching capable. This enables it to automatically sense and operate at a 100v to 240v input voltage. An amber light will be illuminated on the power supply when the power is off. An illuminated green light indicates that the power supply is operating.

Power Supply Replacement

The F424AS2 chassis utilizes two redundant power supplies (four in total). In the unlikely event that the power supply unit needs to be replaced, one power supply can be removed, without powering down the system. Replacement units can be ordered directly from Supermicro (See the contact information in the Preface of this manual).

Changing the Power Supply

1. Press the release tab on the back of the power supply and pull the power supply out using the handle provided.
2. Push the replacement power supply module into the power bay until it clicks into the locked position.
3. Plug the AC power cord back into the module and return the node to its bay in the chassis.

Release Tab

Figure 3-21: Changing the F424AS2 Chassis Power Supplies

3.3 Motherboard Components

Processor and Heatsink Installation

Warning: When handling the processor package, avoid placing direct pressure on the label area of the fan. Also, improper CPU installation or socket misalignment can cause serious damage to the CPU or the motherboard that will require RMA repairs. Please read and follow all instructions thoroughly before installing your CPU and heatsink.

Notes:

• Always connect the power cord last, and always remove it before adding, removing or changing any hardware components. Make sure that you install the processor into the CPU socket before you install the CPU heatsink.
• If you buy a CPU separately, make sure that you use an Intel-certified multi-directional heatsink only.
• Make sure to install the motherboard into the chassis before you install the CPU heatsink.
• When receiving a motherboard without a processor pre-installed, make sure that the plastic CPU socket cap is in place and none of the socket pins are bent; otherwise, contact your retailer immediately.
  • Refer to the Supermicro website for updates on CPU support.

The Processor

Technical line drawing of a rectangular electronic component or enclosure with mounting holes and internal features (no text or symbols)

(The Intel Xeon 81xx/61xx/51xx/41xx/31xx and 82xx/62xx/52xx/42xx/32xx series Processor)

Note: All graphics, drawings and pictures shown in this manual are for illustration only. The components that came with your machine may or may not look exactly the same as those shown in this manual.

Overview of the Processor Socket Assembly

The processor socket assembly contains 1) the Intel Xeon 81xx/61xx/51xx/41xx/31xx and 82xx/62xx/52xx/42xx/32xx series processor 2) CPU/heatsink carrier, 3) dust cover, and 4) CPU socket.

1. The Intel Xeon 81xx/61xx/51xx/41xx/31xx and 82xx/62xx/52xx/42xx/32xx series Processor

1. CPU/Heatsink Carrier

1. Dust Cover

Line drawing of a microprocessor base with mounting holes and a central slot (no text or symbols)

1. CPU Socket

Diagram of a mechanical component with a downward arrow indicating direction (no text or symbols present)

Line drawing of a CPU socket assembly with mounting holes and internal components (no text or symbols)

Note: Be sure to cover the CPU socket with the dust cover when the CPU is not installed.

Overview of the Processor Heatsink Module

The processor heatsink module (PHM) contains 1) a passive heatsink, 2) a CPU/heatsink carrier, and 3) The Intel Xeon 81xx/61xx/51xx/41xx/31xx and 82xx/62xx/52xx/42xx/32xx series processor.

1. Passive Heatsink
   

Technical line drawing of a mechanical bracket or frame with mounting holes and a triangular cutout (no text or symbols)

1. CPU/Heatsink Carrier

Technical line drawing of a mechanical frame assembly (no text or symbols)

1. 81xx/61xx/51xx/41xx/31xx Processor
   

3D diagram of a rectangular structure with internal patterns and a central hole, no text or symbols present

Processor Heatsink Module

Technical line drawing of a computer cooling fan with heatsink and heat sink (no text or symbols)

(Bottom View)

Preparing the CPU Socket for Installation

This motherboard comes with the CPU socket pre-assembled in the factory. The CPU socket contains 1) a dust cover, 2) a socket bracket, 3) the CPU (LGA3647) socket, and 4) a back plate. These components are pre-installed on the motherboard before shipping.

Technical line drawing of a microprocessor base with mounting holes and a central chip (no text or symbols)

Processor Socket Assembly

Removing the Dust Cover from the CPU Socket

Remove the dust cover from the CPU socket, exposing the LGA3647 socket and socket pins as shown on the illustration below.

Note: Do not touch the socket pins to avoid damaging them, causing the CPU to malfunction.

Socket Cover Socket Pins LGA3647 Socket

Attaching the Processor to the CPU/Heatsink Carrier

To properly install the CPU onto the CPU/heatsink carrier, please follow the steps below. Installing the CPU onto the CPU/heatsink

1. Locate Pin 1 (Notch A), Notch B, and Notch C on the CPU and locate Pin 1 (Notch A), Notch B, and Notch C on the CPU/heatsink carrier.
2. Align Pin 1 (Notch A), Notch B, and Notch C on the CPU with the corresponding notches on the carrier. Once they are aligned, carefully insert the CPU into the carrier until you hear a click. Once the CPU is properly mounted onto the carrier, the CPU/ carrier assembly is made.

Pin 1 CPU (Upside Down) A B Align CPU Pin 1 Align CPU Notch B and Clip B C A B Align CPU Notch C and Clip C C Package Carrier (Upside Down)

Allow Clip B to Latch on to CPU A B C Allow Clip C to Latch on to CPU CPU Mounted on Package Carrier (Upside Down)

CPU Mounted on Package Carrier (Rightside Up)

Attaching the CPU/Carrier Assembly to the Passive Heatsink to Form the Processor Heatsink Module (PHM)

After you have made a CPU/carrier assembly, please follow the steps below to mount the assembly onto the heatsink to create the Processor Heatsink Module (PHM).

1. Place the heatsink upside down with the thermal grease facing up. Locate two larger mounting holes (A, B) at the diagonal corners of the heatsink, and two smaller mounting holes (C, D) on the heatsink.

2. Hold the CPU/carrier at the center edge, and turn it upside down with the CPU pins facing up. Locate the two larger holes (1, 2) at the diagonal corners of the carrier and the smaller holes of the same size (3, 4) on the carrier. Please note the mounting clips located next to every mounting hole on the carrier.

3. Align the larger holes (1, 2) on the carrier against the larger mounting holes (A, B) on the heatsink and smaller holes (3, 4) on the carrier against the smaller mounting holes (C, D) on the heatsink. Insert the mounting clips next to the larger hole on the carrier into the larger mounting hole on the heatsink ( 1 A , 2 B ) and snap the mounting clips next to the smaller holes on the carrier onto the edges of the heatsink next to the smaller holes ( 3 C , 4 D ) making sure that the mounting clips snap into place, and that the CPU/carrier assembly is properly mounted onto the heatsink. By mounting the CPU/carrier assembly to the heatsink, the Processor Heatsink Module (PHM) is assembled.

graph TD
    A["CPU and Carrier Package (Upside Down)"] --> B["Mounting Clips"]
    B --> C["Mounting Clips"]
    C --> D["Heatsink (Upside Down)"]
    D --> E["Thermal paste"]
    E --> F["On Locations (A, B), the clips snap through the heatsink's mounting holes"]
    F --> G["Make sure Mounting Clips snap into place"]
    H["CPU and Carrier Package (Rightside Up)"] --> I["Mounting Clips"]
    I --> J["Mounting Clips"]
    J --> K["Heatsink (Upside Down)"]
    K --> L["Thermal paste"]
    L --> M["On Locations (C, D), the clips snap onto the heatsink's sides"]

Installing the Processor Heatsink Module (PHM)

1. Once you have assembled the processor heatsink module (PHM) by following the instructions listed on the previous page, align the processor heatsink module with the CPU socket on the motherboard.
2. Align the large hole on the heatsink against the large notch on the CPU socket, the small hole on the heatsink against the small notch on the socket. Carefully insert the PHM into the socket, making sure that the large and small notches fit through the corresponding mounting holes on the socket. The PHM will only fit one way. If it does not fit correctly, remove it and try again.
3. Using a T30-size star driver bit, tighten four screws into the mounting holes on the socket to securely install the PHM into the motherboard, starting with the mounting hole marked #1 (in the sequence of 1, 2, 3, and 4).

Note: Do not use excessive force when tightening the screws to avoid damaging the CPU and the socket.

#2 #4 #3 #1 Tighten the screws in the sequence of 1, 2, 3, 4. #2 #4 #3 #1 Use a torque of 8 lbf T30 Torx Driver Small Hole Processor Heatsink Module (Bottom View) Large Hole #3 #1 Large Notch Small Notch #3 #1 Mounting the Processor Heatsink Module into the CPU socket (on the motherboard)

Removing the Processor Heatsink Module (PHM)

Before starting to remove the processor heatsink module (PHM), unplug power cord from the power outlet.

1. Using a T30-size star driver, turn the screws on the PHM counterclockwise to loosen it from the socket, starting with screw marked #4 (in the sequence of 4, 3, 2, 1).
2. After all four screws are removed, wiggle the PHM gently and pull up to remove it from the socket.

Note: To properly remove the processor heatsink module, be sure to loosen and remove the screws on the PHM in the sequence of 4, 3, 2, 1 as shown below.

#2 #4 #3 #1 #2 #4 #3 #1 Removing the screws in the sequence of 4, 3, 2, 1. #2 #4 #3 #1 Starting from here → #4 #2 #3

Memory Support and Installation

Note: Check the Supermicro website for recommended memory modules.

Important: Exercise extreme care when installing or removing DIMM modules to prevent any damage.

ESD Precautions

Electrostatic Discharge (ESD) can damage electronic components including memory modules. To avoid damaging your DIMM modules, it is important to handle it very carefully. The following measures are generally sufficient to protect your equipment from ESD.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.
• Handle the memory module by its edges only.
• Put the memory modules into the antistatic bags when not in use.
• Check the Supermicro website for recommended memory modules

Introduction to Intel® Optane DC Persistent Memory

Intel® 82xx/62xx/52xx/42xx supports new DCPMM (Optane™ DC Persistent Memory Modules) technology. DCPMM offers data persistence with higher capacity at lower latencies than the existing memory modules and provides hyper-speed storage capability for high performance computing platforms with flexible configuration options.

Memory Support

The X11DPFR-S/SNX11DPFR-S/SN supports up to 1536 GB of LRDIMM, Registered DIMM (RDIMM), and Non-Volatile DIMM (NV-DIMM) DDR4 (288-pin) ECC 2933/2666/2400/2133 Mhz modules in 12 slots. Populating these DIMM modules with a pair of memory modules of the same type and size will result in interleaved memory, which will improve memory performance.

Note: 2933 MHz memory is supported by the 82xx/62xx series processors only.

DDR4 Memory Support for 81xx/61xx/51xx/41xx/31xx Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)		Speed (MT/s)
				One Slot per Channel	Two Slots per Channel
		DRAM Density		One DIMM per Channel	One DIMM per Channel	Two DIMMs per Channel
		4 Gb 8 Gb 1.2 Volts 1.2 Volts 1.2 Volts
RDIMM	SRx4 4 GB	8 GB		2666 2666 2666
	SRx8 8 GB	16 GB
	DRx8 8 GB	16 GB
	DRx4 16 GB	32 GB
RDIMM 3Ds	QRX4 N/A	2H-64GB
	8RX4 N/A	4H-128GB
LRDIMM QRx4	32 GB 64 GB
LRDIMM 3Ds	QRx4 N/A	2H-64GB
	8Rx4 N/A	4H-128 GB

DDR4 Memory Support for 82xx/62xx/52xx/42xx/32xx Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)			Speed (MT/s)
					One Slot per Channel	Two Slots per Channel
		DRAM Density			One DIMM per Channel	One DIMM per Channel	Two DIMMs per Channel
		4 Gb 8	Gb 16 Gb 1	2 Volts 1.2	Volts 1.2 Volts
RDIMM	SRx4	4 GB	8 GB	16 GB	2933	2933	2933
	SRx8	8 GB	16 GB	32 GB
	DRx8	8 GB	16 GB	32 GB
	DRx4	16 GB	32 GB	64 GB
RDIMM 3Ds	QRX4	N/A 2H-64GB	2H-128GB
	8RX4	N/A 4H-128GB	4H-256GB
LRDIMM	QRx4	32 GB	64 GB	128 GB
LRDIMM 3Ds	QRx4	N/A 2H-64GB	2H-64GB
	8Rx4	N/A 4H-128 GB	4H-256 GB

Memory Installation Sequence

Memory modules for the X11 UP/DP/MP motherboards are populated using the "Fill First" method. The blue memory slot of each channel is considered the "first DIMM module" of the channel, and the black slot, the second module of the channel. When installing memory modules, be sure to populate the blue memory slots first and then populate the black slots. To maximize memory capacity and performance, please populate all DIMM slots on the motherboard, including all blue slots and black slots.

General Memory Population Requirements

1. Be sure to use the memory modules of the same type and speed on the motherboard. Mixing of memory modules of different types and speeds is not allowed.
2. Using unbalanced memory topology such as populating two DIMMs in one channel while populating one DIMM in another channel on the same motherboard will result in reduced memory performance.
3. Populating memory slots with a pair of DIMM modules of the same type and size will result in interleaved memory, which will improve memory performance.

DIMM Population Guidelines for Optimal Performance

For optimal memory performance, follow the instructions listed in the tables below when populating memory modules.

Key Parameters for DIMM Configuration

Key Parameters for DIMM Configurations
Parameters Possible Values
Number of Channels 1, 2,	3, 4, 5, or 6
Number of DIMMs per Channel	1DPC (1 DIMM Per Channel) or 2DPC (2 DIMMs Per Channel)
DIMM Type RDIMM (w/ECC), 3DS RDIMM, LRDIMM, 3DS LRDIMM
DIMM Construction non-3	DS RDIMM Raw Cards: A/B (2Rx4), C (1Rx4), D (1Rx8), E (2Rx8)3DS RDIMM Raw Cards: A/B (4Rx4)non-3DS LRDIMM Raw Cards: D/E (4Rx4)3DS LRDIMM Raw Cards: A/B (8Rx4)

DIMM Mixing Guidelines

General DIMM Mixing Guidelines

All DIMMs must be all DDR4 DIMMs.x4 and x8 DIMMs can be mixed in the same channel.Mixing of LRDIMMs and RDIMMs is not allowed in the same channel, across different channels, and across different sockets.Mixing of non-3DS and 3DS LRDIMM is not allowed in the same channel, across different channels, and across different sockets.

Mixing of DIMM Types within a Channel
DIMM Types RDIMM	LRDIMM 3DS LRDIMM
RDIMM Allowed Not Allowed	Not Allowed	Allowed	Not Allowed
LRDIMM	Not Allowed	Allowed	Not Allowed
3DS LRDIMM	Not Allowed	Not Allowed	Allowed

X11DP Motherboards with 12 DIMM Slots

Note: Unbalanced memory configuration decreases memory performance and is not recommended for Supermicro motherboards.

Memory Population Tables for X11DP Motherboards w/12 DIMM Slots
CPUs/DIMMs Memory Population Sequence
1 CPU & 1 DIMM CPU1: P1-DIMMA1
1 CPU & 2 DIMMs CPU1: P1-DIMMA1/P1-DIMMD1
1 CPU & 3 DIMMs CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1
1 CPU & 4 DIMMs CPU1: P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1
1 CPU & 5 DIMMs* CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1
1 CPU & 6 DIMM CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1
2 CPUs & 2 DIMMs	CPU1: P1-DIMMA1CPU2: P2-DIMMA1
2 CPUs & 4 DIMMs	CPU1: P1-DIMMA1/P1-DIMMD1CPU2: P2-DIMMA1/P2-DIMMD1
2 CPUs & 6 DIMMs	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1CPU2: P2-DIMMC1/P2-DIMMB1/P2-DIMMA1
2 CPUs & 8 DIMMs	CPU1: P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1CPU2: P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1
2 CPUs & 10 DIMMs	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1CPU2: P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1
2 CPUs & 12 DIMMs	CPU1: P1-DIMMC1/P1-DIMMB1/P1-DIMMA1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1CPU2: P2-DIMMC1/P2-DIMMB1/P2-DIMMA1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1

*Unbalanced, not recommended.

P2-DIMMF1 P2-DIMME1 P2-DIMMD1 Pin 1 P2-DIMMA1 P2-DIMMB1 P2-DIMMC1 P1-DIMMF1 P1-DIMME1 P1-DIMMD1 Pin 1 P1-DIMMA1 P1-DIMMB1 P1-DIMMC1

Note: The drawing above shows DIMM module population for each CPU installed on the motherboard. Please install your processors starting with CPU Socket 1.

DIMM Installation

1. Follow the instructions given in the memory population guidelines listed in the previous sections to install memory modules on your motherboard. For the system to work properly, please use memory modules of the same type and speed on the motherboard. (See the Note below.)
2. Push the release tabs outwards on both ends of the DIMM slot to unlock it.
3. Align the key of the DIMM module with the receptive point on the memory slot.
4. Align the notches on both ends of the module against the receptive points on the ends of the slot.
5. Use two thumbs together to press the DIMM module straight down into the slot until the module snaps into place.
6. Press the release tabs to the lock positions to secure the DIMM module into the slot.

SUPER 12.5V-4.0V DCS-CED IN USA 12.5V-4.0V 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30kV 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30K 30kV

Notches

Release Tabs

Insert the DIMM module into the memory slot.

Illustration of two hands holding a cylindrical object with blue arrows indicating direction (no text or symbols)

DIMM Module Removal

Press the release tabs on both ends of the DIMM socket to release the DIMM module from the socket as shown in the drawing on the right.

Warning! 1. T to avoid damage to the DIMM module or the DIMM socket, do not use excessive force when pressing the release tabs on the ends of the DIMM socket. 2. Handle DIMM modules with care. Carefully follow all the instructions given in Section 1 of this user guide to avoid ESD-related damage to your components or system. 3. All graphics, including the layout drawing above, are for reference only. Your system components may or may not look the same as shown in this user guide.

Motherboard Battery

The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard.

Replacing the Battery

Begin by removing power from the system as described in section 3.1.

1. Push aside the small clamp that covers the edge of the battery. When the battery is released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+) side facing up. Then push the other side down until the clamp snaps over it.

Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

LITHIUM BATTERY BATTERY HOLDER

Figure 3-22. Installing the Onboard Battery

Warning: There is a danger of explosion if the onboard battery is installed upside down (which reverses its polarities). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).

Chapter 4

Motherboard Connections

This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A severboard layout indicating component locations may be found in Chapter 1.

Please review the Safety Precautions in Chapter 3 before installing or removing components.

4.1 Power Connections

Two power connections on the X11DPFR-S must be connected to the power supply. The wiring is included with the power supply.

• 8-pin Processor Power Connectors (JPW9/JPW10)

12V 8-pin GPU Power Connectors

JPW9-JPW10 are the 8-pin 12V DC power input from the Power Adapter Board.

12V 8-pin Power Pin Definitions
Connector Pin# Definition
JPWR9 1-8	12V
JPWR10 1-8	GND

Required Connection

4.2 Headers and Connectors

Fan Headers

This motherboard has three fan headers (FAN1\~3). This is a 4-pin fan header, which is backward compatible with a traditional 3-pin fan. The onboard fan speed is controlled by Thermal Management (via Hardware Monitoring) in the BIOS. When using Thermal Management setting, please use all 3-pin fans or all 4-pin fans.

Fan HeaderPin Definitions

Pin# Definition

1 Ground (Black)

2 +12V (Red)

3 Tachometer

4 PWM Control

TPM Header

The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from a third-party vendor. A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. See the table below for pin definitions.

Trusted Platform Module/Port 80 Header Pin Definitions
Pin#	Definition Pin#	Definition
1 +3.3	V 2 SPI_CS#
3	RESET# 4 SPI_MISO
5	SPI_CLK 6 GND
7	SPI_MOSI 8
9 +3.3	V Stdby 10 SPI_IRQ#

RAID Key Header

A RAID Key header is located at JRK1 on the motherboard. The RAID key is used to support onboard NVMe connections.

Intel RAID KeyPin Definitions
Pins	Definition
1	GND
2	PU 3.3V Stdby
3	GND
4	PCH RAID KEY

Micro SD Card

There is one Micro SD memory card slot located at JSDCARD1 on the motherboard.

I-SATA 3.0 and S-SATA 3.0 Ports

The X11DPFR-S(N) has two MiniSAS-HD connectors (I-SATA0\~3, I-SATA4\~7) and two SATADOM ports (S-SATA0/1). These SATA ports are supported by the Intel C621 chipset.

NVMe I²C Header

JNVI ^2 C1 is a sideband header for NVMe devices connected to CPU1. Please connect the I ^2 C cable to this connector.

NVMe OcuLink Connectors

Use the four NVMe OcuLink Connectors (JNVME1, JNVME2, JNVME3, JNVME4) to attach high-speed PCI-E storage devices.

4.3 Rear I/O Ports

See the figure below for the locations and descriptions of the various I/O ports on the rear of the motherboard.

SUPER X108PATE 6.0 DESIGNED IN USA. PER 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02

Back panel I/O Port Locations and Definitions

Diagram of a USB cable connector showing labeled ports and connectors

Back Panel I/O Ports
No.	Description No. Description
1. VGA port 4. USB0 (3.0)
2. Dedicated IPMI LAN 5. SIOM slot
3. USB1 (3.0)

VGA Port

The onboard VGA port is located next to IPMI LAN port on the I/O back panel. Use this connection for VGA display.

UID LED Indicator

A UID LED Indicator (LE1) is located on the I/O back panel. The UID Indicator provides easy identification of a system unit that may be in need of service.

Note: UID can also be triggered via IPMI on the motherboard. For more information on IPMI, please refer to the IPMI User's Guide posted on our website at http://www.supermicro.com.

UID LEDPin Definitions
Color Status
Blue: On Unit Identified

Universal Serial Bus (USB) Ports

There are two USB 3.0 ports (USB0/1) on the I/O back panel.

Back Panel USB0/1 (3.0)Pin Definitions
Pin#	Definition	Pin#	Definition
1	VBUS	10	Power
2	D-	11	USB 2.0 Differential Pair
3	D+	12
4	Ground	13	Ground of PWR Return
5	StdA	SSRX-	14 SuperSpeed Receiver
6	StdA	SSRX+	15 Differential Pair
7	GND	DRAIN	16 Ground for Signal Return
8	StdA	SSTX-	17 SuperSpeed Transmitter
9	StdA	SSTX+	18 Differential Pair

Ethernet Ports

One dedicated IPMI LAN is located on the I/O back panel. This LAN port is supported by the onboard AST 2500 BMC and accepts an RJ45 type cable. Refer to the LED Indicator Section for the IPMI LAN LED information.

4.4 Front Control Panel

JF1 contains header pins for various control panel connections. See the figure below for the pin locations and definitions of the control panel buttons and LED indicators.

All JF1 wires have been bundled into a single cable to simplify this connection. Make sure the red wire plugs into pin 1 as marked on the motherboard. The other end connects to the control panel PCB board.

Note: Since there are no LAN ports, only an IPMI LAN port, for this system, both NIC pinouts are not used.

Power Button Reset Button 3.3V UID LED 3.3V Stby 3.3V Stby 3.3V Stby 3.3V X NMI 1 2 Ground Ground Power Fail LED OH/PWR Fail/Fan Fail LED NIC2 Active LED NIC1 Active LED HDD LED PWR LED X Ground

Figure 4-1. JF1: Control Panel Pins

Power Button

The Power Button connection is located on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system. This button can also be configured to function as a suspend button (with a setting in the BIOS - see Chapter 4). To turn off the power when the system is in suspend mode, press the button for 4 seconds or longer. Refer to the table below for pin definitions.

Power ButtonPin Definitions (JF1)

Pins Definition

1 Signal

2 Ground

Reset Button

The Reset Button connection is located on pins 3 and 4 of JF1. Attach it to a hardware reset switch on the computer case to reset the system. Refer to the table below for pin definitions.

Reset ButtonPin Definitions (JF1)
Pins	Definition
3	Reset
4	Ground

Power Fail LED

The Power Fail LED connection is located on pins 5 and 6 of JF1. Refer to the table below for pin definitions.

Power Fail LEDPin Definitions (JF1)
Pin#	Definition
5	3.3V
6	PWR Supply Fail

OH/Fan Fail/PWR Fail/UID LED

Connect an LED cable to pins 7 and 8 of the Front Control Panel (JF1) to use UID/Overheat/Fan Fail/Power Fail LED connections. The LED on pin 8 provides warnings of overheat, power failure or fan failure. Refer to the tables below for details.

Informational LED-UID/OH/PWR Fail/Fan Fail LEDPin Definitions (Pin 7 & Pin 8 of JF1)
Status Description
Solid red An overheat condition has occurred. (This may be caused by cable congestion).
Blinking red (1Hz) Fan failure: check for an inoperative fan.
Blinking red (0.25Hz) Power failure: check for a non-operational power supply
Solid blue Local UID is activated. Use this function to locate a unit in a rack mount environment that might be in need of service.
Blinking blue (300 msec)	Remote UID is on. Use this function to identify a unit from a remote location that might be in need of service.

HDD LED

The HDD LED connection is located on pins 13 and 14 of JF1. Attach a cable to pin 14 to show hard drive activity status. Refer to the table below for pin definitions.

HDD LEDPin Definitions (JF1)

Pins Definition

13 3.3V Stdby

14 HDD Active

Power LED

The Power LED connection is located on pins 15 and 16 of JF1. Refer to the table below for pin definitions.

Power LEDPin Definitions (JF1)

Pins Definition

15 3.3V

16 PWR LED

NMI Button

The non-maskable interrupt (NMI) button header is located on pins 19 and 20 of JF1. Refer to the table below for pin definitions.

NMI ButtonPin Definitions (JF1)
Pins	Definition
19	Control
20	Ground

4.5 Jumpers

Explanation of Jumpers

To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

Note: On a two-pin jumper, "Closed" means the jumper is on both pins and "Open" indicates the jumper is either on only one pin or has been completely removed.

Connector Pins Jumper Setting 3 2 1 3 2 1

CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system and unplug the power cord(s).
2. Remove the cover of the chassis to access the motherboard.
3. Remove the onboard battery from the motherboard.
4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
5. Remove the screwdriver (or shorting device).
6. Replace the cover, reconnect the power cord(s) and power on the system.

Notes: Clearing CMOS will also clear all passwords.

Do not use the PW_ON connector to clear CMOS.

JBT1 contact pads

VGA Enable/Disable

JPG1 allows you to enable or disable the VGA port using the onboard graphics controller. The default setting is Enabled.

VGA Enable/DisableJumper Settings
Jumper Setting	Definition
Pins 1-2	Enabled
Pins 2-3	Disabled

Management Engine (ME) Recovery

Use jumper JPME1 to select ME Firmware Recovery mode, which will limit resource allocation for essential system operation only in order to maintain normal power operation and management. In the single operation mode, online upgrade will be available via Recovery mode. See the table below for jumper settings.

ME Recovery ModeJumper Settings
Jumper Setting Definition
Pins 1-2 Normal
Pins 2-3 ME Recovery

I²C Bus for VRM

Jumper JVRM1 allows the BMC or the PCH to access CPU and memory VRM controllers. See the table below for jumper settings.

VRMJumper Settings
Jumper Setting	Definition
Pins 1-2 BMC (Normal)
Pins 2-3 PCH

4.6 LED Indicators

IPMI LAN LEDs

A dedicated IPMI LAN, located on the back panel, has two LED indicators. The amber LED on the right of the IPMI LAN port indicates activity, while the LED on the left indicates the speed of the connection. See the table below for more information.

IPMI LAN

Activity LEDLink LED

IPMI LAN LEDs
	Color/State Definition
Link (left)	Green: Solid	100 Mbps
	Amber: Solid	1Gbps
Activity (Right) Amber: Blinking Active

BMC Heartbeat LED

BMC_HB_LED1 is the BMC heartbeat LED. When the LED is blinking green, BMC is functioning normally. See the table below for the LED status.

Onboard Power LED Indicator
LED Color Definition
Green:Blinking	BMC Normal

Unit ID LED

A rear UID LED indicator at UID_LED1 is located near the UID switch on the back panel. This UID indicator provides easy identification of a system.unit that may need service.

UID LEDLED Indicator
LED Color Definition
Blue: On Unit	Identified

4.7 PCI-E 3.0 Slots

PCI-E 3.0 Slots

There are several PCI-E slots located on the motherboard. Refer to the layout below for their locations.

1. PCI-E 3.0 x16 Right Riser Card (JSXB1)
2. PCI-E 3.0 x16 (x8+x8) SMCI Proprietary slot (JSXB2)
3. PCI-E3.0 x16 SIOM LAN Port (not shown)

1 2 SUPER X11DPER-S(N) DESIGNED IN USA REV: 1.00

Chapter 5

Software

After the hardware has been installed, you can install the Operating System (OS), configure RAID settings and install the drivers.

5.1 Microsoft Windows OS Installation

If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals.

Installing the OS

1. Create a method to access the MS Windows installation ISO file. That might be a DVD, perhaps using an external USB/SATA DVD drive, or a USB flash drive, or the IPMI KVM console.
2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
3. Boot from a bootable device with Windows OS installation. You can see a bootable device list by pressing F11 during the system startup.

Please select boot device: ATEN Virtual CDROM YSOJ → IPMI virtual drive (Legacy) ASUS SDRW-08D2S-U F601 → USB DVD device (Legacy) USB FLASH DRIVE PMAP → USB flash drive with OS installation (Legacy) IBA 40-10G Slot 1900 v1060 → PXE boot (Legacy) UEFI: ATEN Virtual CDROM YSOJ → IPMI virtual drive (UEFI) UEFI: ASUS SDRW-08D2S-U F601 → USB DVD device (UEFI) UEFI: Built-in EFI Shell Enter Setup ↑ and ↓ to move selection ENTER to select boot device ESC to boot using defaults

Figure 5-1. Select Boot Device

1. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on "Load driver" link at the bottom left corner.

Where do you want to install Windows? Name Total size Free space Type Refresh Delete Format New Load driver Extend We couldn't find any drives. To get a storage driver, click Load driver. Next

Figure 5-2. Load Driver Link

To load the driver, browse the USB flash drive for the proper driver files.

• For RAID, choose the SATA/sSATA RAID driver indicated then choose the storage drive on which you want to install it.

• For non-RAID, choose the SATA/sSATA AHCI driver indicated then choose the storage drive on which you want to install it.

• Once all devices are specified, continue with the installation.

• After the Windows OS installation has completed, the system will automatically reboot multiple times.

5.2 Driver Installation

The Supermicro website contains drivers and utilities for your system at https://www.supermicro.com/wftp/driver. Some of these must be installed, such as the chipset driver.

After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash drive or a DVD. (You may also use a utility to extract the ISO file if preferred.)

Another option is to go to the Supermicro website at http://www.supermicro.com/products/. Find the product page for your motherboard, and "Download the Latest Drivers and Utilities".

Insert the flash drive or disk and the screenshot shown below should appear.

SUPERMICRO X11DPFR-SN Motherboard Drivers & Tools (Win7) Intel Chipset C621 X11DPFR-SN SUPERMICRO Computer Inc. Intel Chipset INF files Microsoft .Net Framework 4.5.2 (Optional) ASPEED Graphics Driver Intel Rapid Storage Technology Enterprise Intel USB 3.0 Drivers Intel PRO Network Connections Drivers SUPERMICRO SuperDoctor 5 Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information, please visit SUPERMICRO's web site.

Figure 5-1. Driver & Tool Installation Screen

Note: Click the icons showing a hand writing on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you must re-boot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire contents.

5.3 SuperDoctor® 5

The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server), you can remotely control power on/off and reset chassis intrusion for multiple systems with SuperDoctor 5 or IPMI. SuperDoctor 5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

Note: The default User Name and Password for SuperDoctor 5 is ADMIN / ADMIN.

SuperDoctor 5 Health Info Certificate error: localhost:XXX/SuperDoctor Loading Matherboard: C7B360-CB-ML Voltage CPU Temp 1.2 V 10 V 1.5 V 1.8 V 2.0 V 2.3 V 2.5 V 2.8 V 3.0 V 3.3 V 3.5 V 3.8 V 4.0 V 4.3 V 4.5 V 4.8 V 5.0 V 5.3 V 5.5 V 5.8 V 6.0 V 6.3 V 6.5 V 6.8 V 7.0 V 7.3 V 7.5 V 7.8 V 8.0 V 8.3 V 8.5 V 8.8 V 9.0 V 9.3 V 9.5 V 9.8 V 10.0 V 10.3 V 10.5 V 10.8 V 11.0 V 11.3 V 11.5 V 11.8 V 12.0 V 12.3 V 12.5 V 12.8 V 13.0 V 13.3 V 13.5 V 13.8 V 14.0 V 14.3 V 14.5 V 14.8 V 15.0 V 15.3 V 15.5 V 15.8 V 16.0 V 16.3 V 16.5 V 16.8 V 17.0 V 17.3 V 17.5 V 17.8 V 18.0 V 18.3 V 18.5 V 18.8 V 19.0 V 19.3 V 19.5 V 19.8 V 20.0 V 20.3 V 20.5 V 20.8 V 21.0 V 21.3 V 21.5 V 21.8 V 22.0 V 22.3 V 22.5 V 22.8 V 23.0 V 23.3 V 23.5 V 23.8 V 24.0 V 24.3 V 24.5 V 24.8 V 25.0 V 25.3 V 25.5 V 25.8 V 26.0 V 26.3 V 26.5 V 26.8 V 27.0 V 27.3 V 27.5 V 27.8 V 28.0 V 28.3 V 28.5 V 28.8 V 29.0 V 29.3 V 29.5 V 29.8 V 30.0 V 30.3 V 30.5 V 30.8 V 31.0 V 31.3 V 31.5 V 31.8 V 32.0 V 32.3 V 32.5 V 32.8 V 33.0 V 33.3V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4V 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S 4S

Figure 5-2. SuperDoctor 5 Interface Display Screen (Health Information)

5.4 IPMI

The X11DPFR-S/SN supports the Intelligent Platform Management Interface (IPMI). IPMI is used to provide remote access, monitoring and management. There are several BIOS settings that are related to IPMI.

For general documentation and information on IPMI, please visit our website at: http://www.supermicro.com/products/nfo/IPMI.cfm.

Chapter 6

BIOS

6.1 Introduction

This chapter describes the AMIBIOS™ Setup utility for the X11DPFR-S/SN motherboard(s). The is stored in a flash chip and can be easily upgraded using a floppy disk-based program.

Note: Due to periodic changes to the BIOS, some settings may have been added or deleted and might not yet be recorded in this manual. Please refer to the Manual Download area of our website for any changes to BIOS that may not be reflected in this manual.

Starting the Setup Utility

To enter the BIOS Setup Utility, hit the key while the system is booting-up. (In most cases, the key is used to invoke the BIOS setup screen. There are a few cases when other keys are used, such as , , etc.) Each main BIOS menu option is described in this manual.

The Main BIOS screen has two main frames. The left frame displays all the options that can be configured. "Grayed-out" options cannot be configured. The right frame displays the key legend. Above the key legend is an area reserved for a text message. When an option is selected in the left frame, it is highlighted in white. Often a text message will accompany it. (Note that BIOS has default text messages built in. We retain the option to include, omit, or change any of these text messages.) Settings printed in Bold are the default values.

A "▶" indicates a submenu. Highlighting such an item and pressing the key will open the list of settings within that submenu.

The BIOS setup utility uses a key-based navigation system called hot keys. Most of these hot keys (, , , , keys, etc.) can be used at any time during the setup navigation process.

6.2 Main Menu

When you first enter AMI BIOS Setup Utility, you will see the Main Menu screen. You can always return to the Main Menu by selecting the Main tab on the top of the screen with the arrow keys.

The Main Menu screen provides you with a system overview, which includes the version, built date and ID of the AMIBIOS, the type, speed and number of the processors in the system and the amount of memory installed in the system.

System Date [Mon 07/24/2017] System Time [12:18:02] Supermicro X11DPFR-SN BIOS Version 1.0a Build Date 07/11/2017 CPLD Version 03.B0.07 Memory Information Total Memory 49152 MB	Set the Date. Use Tab to switch between Date elements. Default Ranges: Year: 2005-2099 Months: 1-12 Days: dependent on month
	++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

System Time/System Date

You can edit this field to change the system time and date. Highlight System Time or System Date using the keys. Enter new values through the keyboard. Press the key or the keys to move between fields. The date must be entered in DAY/MM/DD/YYYY format. The time is entered in HH:MM:SS format. Please note that time is in a 24-hour format. For example, 5:30 A.M. appears as 05:30:00 and 5:30 P.M. as 17:30:00.

System Date/System Time

Use this item to change the system date and time. Highlight System Date or System Time using the arrow keys. Enter new values using the keyboard. Press the key or the arrow keys to move between fields. The date must be entered in Day MM/DD/YYYY format. The time is entered in HH:MM:SS format.

Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00. The date's default value is 01/01/2014 after RTC reset.

Supermicro X11DPFR-S(N)

BIOS Version

This item displays the version of the BIOS ROM used in the system.

Build Date

This item displays the date when the version of the BIOS ROM used in the system was built.

CPLD Version

This item displays the version of the CPLD (Complex-Programmable Logical Device) used in the system.

Memory Information

Total Memory

This item displays the total size of memory available in the system.

6.3 Advanced Settings Menu

Use the arrow keys to select the Advanced submenu and press to access the submenu items:

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Boot Feature CPU Configuration Chipset Configuration Server ME Configuration PCH SATA Configuration PCH sSATA Configuration PCIe/PCI/PnP Configuration Super IO Configuration Serial Port Console Redirection ACPI Settings Trusted Computing iSCSI Configuration Intel(R) Virtual RAID on CPU	Boot Feature Configuration Page
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Warning: Take Caution when changing the Advanced settings. An incorrect value, an incorrect DRAM frequency, or an incorrect BIOS timing setting may cause the system to malfunction. When this occurs, restore the setting to the manufacture default setting.

▶Boot Feature

Quiet Boot

Use this feature to select the screen between displaying POST messages or the OEM logo at bootup. Select Disabled to display the POST messages. Select Enabled to display the OEM logo instead of the normal POST messages. The options are Enabled and Disabled.

Note: POST message is always displayed regardless of the item setting.

Option ROM Messages

Use this feature to set the display mode for the Option ROM. Select Keep Current to use the current AddOn ROM display setting. Select Force BIOS to use the Option ROM display mode set by the system BIOS. The options are Force BIOS and Keep Current

Bootup NumLock State

Use this feature to set the Power-on state for the Numlock key. The options are Off and On.

Wait For 'F1' If Error

Select Enabled to force the system to wait until the 'F1' key is pressed if an error occurs. The options are Disabled and Enabled.

Interrupt 19 (INT19) Trap Response

Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Immediate, the ROM BIOS of the host adaptors will "capture" Interrupt 19 at bootup immediately and allow the drives that are attached to these host adaptors to function as bootable disks. If this item is set to Postponed, the ROM BIOS of the host adaptors will not capture Interrupt 19 immediately and allow the drives attached to these adaptors to function as bootable devices at bootup. The options are Immediate and Postponed.

Re-try Boot

When EFI (Expansible Firmware Interface) Boot is selected, the system BIOS will automatically reboot the system from an EFI boot device after an initial boot failure. Select Legacy Boot to allow the BIOS to automatically reboot the system from a Legacy boot device after an initial boot failure. The options are Disabled, Legacy Boot, and EFI Boot.

Install Windows 7 USB Support

Enable this feature to use the USB keyboard and mouse during the Windows 7 installation, since the native XHCI driver support is unavailable. Use a SATA optical drive as a USB drive, and USB CD/DVD drives are not supported. Disable this feature after the XHCI driver has been installed in Windows. The options are Disabled and Enabled.

Port 61h Bit-4 Emulation

Select Enabled to enable the emulation of Port 61h bit-4 toggling in SMM (System Management Mode). The options are Disabled and Enabled.

Power Configuration

Watch Dog Function

Select Enabled to allow the Watch Dog timer to reboot the system when it is inactive for more than 5 minutes. The options are Enabled and Disabled.

Restore on AC Power Loss

Use this feature to set the power state after a power outage. Select Stay Off for the system power to remain off after a power loss. Select Power On for the system power to be turned on after a power loss. Select Last State to allow the system to resume its last power state before a power loss. The options are Stay Off, Power On, and Last State.

Power Button Function

This feature controls how the system shuts down when the power button is pressed. Select 4 Seconds Override for the user to power off the system after pressing and holding the power button for 4 seconds or longer. Select Instant Off to instantly power off the system as soon as the user presses the power button. The options are Instant Off and 4 Seconds Override.

Throttle on Power FailThis feature allows the system to decrease system power requirements by throttling CPU frequency in the event of one power supply failing. The options are Enabled and Disabled.

▶CPU Configuration

Warning: Setting the wrong values in the following sections may cause the system to malfunction.

▶Processor Configuration

The following CPU information will be displayed:

Processor BSP Revision

Processor Socket

Processor ID

Processor Frequency

Processor Max Ratio

Processor Min Ratio

Microcode Revision

L1 Cache RAM

L2 Cache RAM

L3 Cache RAM

Processor 0 Version

Processor 1 Version

Hyper-Threading (ALL)

Select Enable to use Intel Hyper-Threading Technology to enhance CPU performance. The options are Enable and Disable.

Execute Disable Bit (Available if supported by the OS & the CPU)

Select Enable to enable Execute Disable Bit support which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot, thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor, damaging the system during a virus attack. The options are Enable and Disable. (Refer to Intel and Microsoft websites for more information.)

Intel Virtualization Technology

Select Enable to use Intel Virtualization Technology which will allow the I/O device assignments to be directly reported to the VMM (Virtual Memory Management) through the DMAR ACPI tables. This feature offers fully-protected I/O resource-sharing across the Intel platforms, providing the user with greater reliability, security and availability in networking and data-sharing. The settings are Enable and Disable.

PPIN Control

Select Unlock/Enable to use the Protected-Processor Inventory Number (PPIN) in the system. The options are Unlock/Enable and Unlock/Disable.

Hardware Prefetcher (Available when supported by the CPU)

If this feature is set to Enable, the hardware prefetcher will prefetch streams of data and instructions from the main memory to the Level 2 (L2) cache to improve CPU performance. The options are Disable and Enable.

Adjacent Cache Prefetch (Available when supported by the CPU)

Select Enable for the CPU to prefetch both cache lines for 128 bytes as comprised. Select Disable for the CPU to prefetch both cache lines for 64 bytes. The options are Disable and Enable.

Note: Please power off and reboot the system for the changes you've made to take effect. Please refer to Intel's website for detailed information.

DCU Streamer Prefetcher (Available when supported by the CPU)

If this item is set to Enable, the DCU (Data Cache Unit) streamer prefetcher will prefetch data streams from the cache memory to the DCU (Data Cache Unit) to speed up data accessing and processing for CPU performance enhancement. The options are Disable and Enable.

DCU IP Prefetcher

If this item is set to Enable, the IP prefetcher in the DCU (Data Cache Unit) will prefetch IP addresses to improve network connectivity and system performance. The options are Enable and Disable.

LLC Prefetch

If this feature is set to Enable, LLC (hardware cache) prefetching on all threads will be supported. The options are Disable and Enable.

Extended APIC (Extended Advanced Programmable Interrupt Controller)

Based on the Intel Hyper-Threading technology, each logical processor (thread) is assigned 256 APIC IDs (APIDs) in 8-bit bandwidth. When this feature is set to Enable, the APIC ID will be expanded from 8 bits to 16 bits to provide 512 APIDs to each thread to enhance CPU performance. The options are Disable and Enable.

AES-NI

Select Enable to use the Intel Advanced Encryption Standard (AES) New Instructions (NI) to ensure data security. The options are Enable and Disable.

▶Advanced Power Management Configuration

Power Technology

This feature allows the user to select the desired CPU Power Management profile. The options are Disable, Energy Efficient, and Custom.

▶CPU P State Control

SpeedStep (PStates)

EIST (Enhanced Intel SpeedStep Technology) allows the system to automatically adjust processor voltage and core frequency in an effort to reduce power consumption and heat dissipation. Please refer to Intel's website for detailed information. The options are Disable and Enable.

EIST PSD Function (Available when SpeedStep is set to Enable)

Use this item to configure the processor's P-State coordination settings. During a P-State, the voltage and frequency of the processor will be reduced when it is in operation. This makes the processor more energy efficient, resulting in further energy gains. The options are HW_ALL, SW_ALL and SW-ANY.

Turbo Mode (Available when SpeedStep is set to Enable)

Select Enable for processor cores to run faster than the frequency specified by the manufacturer. The options are Disable and Enable.

▶Hardware PM (Power Management) State Control

Hardware P-States

If this feature is set to Disable, hardware will choose a P-state setting for the system based on an OS request. If this feature is set to Native Mode, hardware will choose a P-state setting based on OS guidance. If this feature is set to Native Mode with No Legacy Support, hardware will choose a P-state setting independently without OS guidance. The options are Disable, Native Mode, Out of Band Mode, and Native Mode with No Legacy Support.

▶CPU C State Control

Autonomous Core C-State

Select Enable to support Autonomous Core C-State control which will allow the processor core to control its C-State setting automatically and independently. The options are Enable and Disable.

CPU C6 Report

Select Enable to allow the BIOS to report the CPU C6 state (ACPI C3) to the operating system. During the CPU C6 state, power to all caches is turned off. The options are Auto, Enable, and Disable.

Enhanced Halt State (C1E)

Select Enable to enable "Enhanced Halt State" support, which will significantly reduce the CPU's power consumption by minimizing CPU's clock cycles and reduce voltage during a "Halt State." The options are Disable and Enable.

▶Package C State Control

Package C State

Use this feature to set the limit on the C-State package register. The options are C0/1 state, C2 state, C6 (non-Retention) state, C6 (Retention) state, No Limit, and Auto.

▶CPU T State Control

Software Controlled T-States

Enabling this feature allows the OS to choose a T-State. The options are Enable and Disable.

▶Chipset Configuration

Warning: Setting the wrong values in the following sections may cause the system to malfunction.

▶North Bridge

This feature allows the user to configure the settings for the Intel North Bridge.

▶UPI (Ultra Path Interconnect) Configuration

This section displays the following UPI General Configuration information:

• Number of CPU
• Number of IIO
• Current UPI Link Speed
• Current UPI Link Frequency
• UPI Global MMIO Low Base/Limit
• UPI Global MMIO High Base/Limit
• UPI PCI-E Configuration Base/Size

Degrade Precedence

Use this feature to select the degrading precedence option for Ultra Path Interconnect connections. Select Topology Precedent to degrade UPI features if system options are in conflict. Select Feature Precedent to degrade UPI topology if system options are in conflict. The options are Topology Precedence and Feature Precedence.

Link L0p Enable

Select Enable to enable Link L0p. The options are Disable, Enable, and Auto.

Link L1 Enable

Select Enable to enable Link L1 (Level 1 link). The options are Disable, Enable, and Auto.

IO Directory Cache

Select Enable for the IODC (I/O Directory Cache) to generate snoops instead of generating memory lockups for remote IIO (InvIToM) and/or WCiLF (Cores). Select Auto for the IODC to generate snoops (instead of memory lockups) for WCiLF (Cores). The options are Disable, Auto, Enable for Remote InvItoM Hybrid Push, InvItoM AllocFlow, Enable for Remote InvItoM Hybrid AllocNonAlloc, and Enable for Remote InvItoM and Remote WViLF.

SNC

Sub NUMA Clustering (SNC) is a feature that breaks up the Last Level Cache (LLC) into clusters based on address range. Each cluster is connected to a subset of the memory controller. Enabling SNC improves average latency and reduces memory access congestion to achieve higher performance. Select Auto for 1-cluster or 2-clusters depending on IMC interleave. Select Enable for Full SNC (2-clusters and 1-way IMC interleave). The options are Disable, Enable, and Auto.

XPT Prefetch

XPT Prefetch speculatively makes a copy to the memory controller of a read request being sent to the LLC. If the read request maps to the local memory address and the recent memory reads are likely to miss the LLC, a speculative read is sent to the local memory controller. The options are Disable and Enable.

KTI Prefetch

KTI Pretech enables memory read to start early on a DDR bus, where the KTI Rx path will directly create a Memory Speculative Read command to the memory controller. The options are Disable and Enable.

Local/Remote Threshold

This feature allows the user to set the threshold for the Interrupt Request (IRQ) signal, which handles hardware interruptions. The features are Disable, Enable, Auto, Low, Medium, and High.

Stale AtoS

This feature optimizes A to S directory. When all snoop responses found in directory A are found to be Rspl, then all data is moved to directory S and is returned in S-state. The options are Disable, Enable, and Auto.

LLC dead line alloc

Select Enable to optimally fill dead lines in LLC. Select Disable to never fill dead lines in LLC. The options are Disable, Enable, and Auto.

Isoc Mode

Select Enable to enable Isochronous support to meet QoS (Quality of Service) requirements. This feature is especially important for Virtualization Technology. The options are Disable, Enable, and Auto.

▶Memory Configuration

Enforce POR

Select POR to enforce POR restrictions for DDR4 memory frequency and voltage programming. The options are POR and Disable.

Memory Frequency

Use this feature to set the maximum memory frequency for onboard memory modules. The options are Auto, 1866, 2000, 2133, 2200, 2400, 2600, and 2666.

Data Scrambling for NVDIMM

Select Enable to enable data scrambling for onboard NVDIMM memory to enhance system performance and security. The options are Auto, Disable, and Enable.

Data Scrambling for DDR4

Select Enable to enable data scrambling for DDR4 memory to enhance system performance and security. The options are Auto, Disable, and Enable.

tCCD\_L Relaxation

If this feature is set to Enable, SPD (Serial Presence Detect) will override tCCD_L ("Column to Column Delay-Long", or "Command to Command Delay-Long" on the column side.) If this feature is set to Disable, tCCD_L will be enforced based on the memory frequency. The options are Enable and Disable.

Enable ADR

Select Enable for ADR (Automatic Diagnostic Repository) support to enhance memory performance. The options are Enable and Disable.

2X REFRESH

This option allows the user to select 2X refresh mode. The options are Auto, Enabled, and Disabled.

Page Policy

This feature allows the user to determine the desired page mode for IMC. When Auto is selected, the memory controller will close or open pages based on the current operation. Closed policy closes that page after reading or writing. Adaptive is similar to open page policy, but can be dynamically modified. The default is Auto.

IMC Interleaving

This feature allows the user to configure Integrated Memory Controller (IMC) Interleaving settings. The options are Auto, 1-way Interleave, and 2-way Interleave.

▶Memory Topology

This item displays the information of onboard memory modules as detected by the BIOS (such as P1 DIMMA1, P1 DIMMB1, and so on).

▶Memory RAS (Reliability\_Availability\_Serviceability) Configuration

Use this submenu to configure the following Memory RAS settings.

Static Virtual Lockstep Mode

Select Enable to support Static Virtual Lockstep mode to enhance memory performance. The options are Enable and Disable.

Mirror Mode

Select Enable to set all 1LM/2LM memory installed in the system on the mirror mode, which will create a duplicate copy of data stored in the memory to increase memory security, but it will reduce the memory capacity into half. The options are Enable and Disable.

Memory Rank Sparing

Select Enable to support memory-rank sparing to optimize memory performance. The options are Enable and Disable.

Note: This item will not be available when memory mirror mode is enabled.

Correctable Error Threshold

Use this item to enter the threshold value for correctable memory errors. The default setting is 10.

SDDC Plus One

Select Enable for SDDC (Single Device Data Correction) support, which will increase the reliability and serviceability of your system memory. The options are Enable and Disable.

ADDDC (Adaptive Double Device Data Correction) Sparing

Select Enable for ADDDC sparing support to enhance memory performance. The options are Enable and Disable.

Patrol Scrub

Patrol Scrubbing is a process that allows the CPU to correct correctable memory errors detected in a memory module and send the corrections to the requestor (the original source). When this item is set to Enable, the IO hub will read and write back one cache line every 16K cycles if there is no delay caused by internal processing. By using this method, roughly 64 GB of memory behind the IO hub will be scrubbed every day. The options are Enable and Disable.

Patrol Scrub Interval

Use this item to specify the number of hours (between 0 to 24) required for the system to complete a full patrol scrubbing. Enter 0 for patrol scrubbing to be performed automatically. The default setting is 24.

Note: This item is hidden when Patrol Scrub item is set to Disable.

▶IIO Configuration

▶CPU1 Configuration

IOU0 (II0 PCIe Br1)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU1 (II0 PCIe Br2)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU2 (II0 PCIe Br3)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

MCP0 (II0 PCIe Br4)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

MCP1 (II0 PCIe Br5)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

▶CPU1 PcieBr0D00F0 - Port 0/DMI PcieBr1D00F0 - Port 1A PcieBr2D00F0 - Port 2A PcieBr3D00F0 - Port 3A PcieBr4D00F0 - MCP 0 PcieBr5D00F0 - MCP 1

Link Speed

Use this item to select the link speed for the PCI-E port specified by the user. The options are Auto, Gen 1 (2.5 GT/s), Gen 2 (5 GT/s), and Gen 3 (8 GT/s).

PCI-E Port Max Payload Size

Selecting Auto for this feature will enable the motherboard to automatically detect the maximum Transaction Layer Packet (TLP) size for the connected PCI-E device, allowing for maximum I/O efficiency. Selecting 128B or 256B will designate maximum packet size of 128 or 256. Options are Auto, 128, and 256. Auto is enabled by default.

▶CPU2 Configuration

IOU0 (II0 PCIe Br1)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU1 (II0 PCIe Br2)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU2 (II0 PCIe Br3)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

MCP0 (II0 PCIe Br4)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

MCP1 (II0 PCIe Br5)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

▶CPU2 PcieBr1D00F0 - Port 1A/Socket 1 PcieBr2D00F0 - Port 2A/Socket 1 PcieBr3D00F0 - Port 3A/Socket 1 PcieBr4D00F0 - MCP 0/Socket 1 PcieBr5D00F0 - MCP 1

Link Speed

Use this item to select the link speed for the PCI-E port specified by the user. The options are Auto, Gen 1 (2.5 GT/s), Gen 2 (5 GT/s), and Gen 3 (8 GT/s).

PCI-E Port Max Payload Size

Selecting Auto for this feature will enable the motherboard to automatically detect the maximum Transaction Layer Packet (TLP) size for the connected PCI-E device, allowing for maximum I/O efficiency. Selecting 128B or 256B will designate maximum packet size of 128 or 256. Options are Auto, 128, and 256. Auto is enabled by default.

▶IOAT Configuration

Disable TPH (TLP Processing Hint)

TPH is used for data-tagging with a destination ID and a few important attributes. It can send critical data to a particular cache without writing through to memory. Select No in this item for TLP Processing Hint support, which will allow a "TPL request" to provide "hints" to help optimize the processing of each transaction occurred in the target memory space. The options are Yes and No.

Prioritize TPH (TLP Processing Hint)

Select Yes to prioritize the TPL requests that will allow the "hints" to be sent to help facilitate and optimize the processing of certain transactions in the system memory. The options are Enable and Disable.

Relaxed Ordering

Select Enable to enable Relaxed Ordering support which will allow certain transactions to violate the strict-ordering rules of PCI and to be completed prior to other transactions that have already been enqueued. The options are Disable and Enable.

▶Intel VT for Directed I/O (VT-d)

Intel® VT for Directed I/O (VT-d)

Intel® VT for Directed I/O (VT-d)

Select Enable to use Intel Virtualization Technology support for Direct I/O VT-d by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables. This feature offers fully-protected I/O resource sharing across Intel platforms, providing greater reliability, security and availability in networking and data-sharing. The options are Enable and Disable.

Interrupt Remapping

Select Enable for Interrupt Remapping support to enhance system performance. The options are Enable and Disable.

PassThrough DMA

Select Enable for the Non-Iscoh VT-d engine to pass through DMA (Direct Memory Access) to enhance system performance. The options are Enable and Disable.

ATS

Select Enable to enable ATS (Address Translation Services) support for the Non-Iscoh VT-d engine to enhance system performance. The options are Enable and Disable.

Posted Interrupt

Select Enable to support VT_D Posted Interrupt which will allow external interrupts to be sent directly from a direct-assigned device to a client machine in non-root mode to improve virtualization efficiency by simplifying interrupt migration and lessening the need of physical interrupts. The options are Enable and Disable.

Coherency Support (Non-Isoch)

Select Enable for the Non-Iscoh VT-d engine to pass through DMA (Direct Memory Access) to enhance system performance. The options are Enable and Disable.

Intel® VMD Technology

Intel® VMD for Volume Management Device on CPU1

VMD Config for PStack0

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item "Intel VMD for Volume Management Device" above is set to Enable, the following items will be displayed:

CPU SLOT6 PCI-E 3.0 X8 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

CPU SLOT4 PCI-E 3.0 X8 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Use this feature to enable hot plug support for PCIe root ports 1A\~1D. The options are Disable and Enable.

VMD Config for PStack1

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item "Intel VMD for Volume Management Device" above is set to Enable, the following items will be displayed:

CPU SLOT5 PCI-E 3.0 X16 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Select Enable to enable hot plug support for PCIe root ports 2A\~2D. The options are Disable and Enable.

VMD Config for PStack2

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item "Intel VMD for Volume Management Device" above is set to Enable, the following items will be displayed:

CPU SLOT2 PCI-E 3.0 X8 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

CPU SLOT1 PCI-E 3.0 X4 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Select Enable to enable hot plug support for PCIe root ports 3A\~3D. This will allow the user to replace the components without shutting down the system. The options are Disable and Enable.

Intel® VMD for Volume Management Device on CPU2

VMD Config for PStack2

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item "Intel VMD for Volume Management Device" above is set to Enable, the following items will be displayed:

CPU SLOT3 PCI-E 3.0 X16 VMD (Available when the device is detected by the system)

Select Enable to enable hot plug support for the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Use this feature to enable hot plug support for PCIe root ports 3A\~3D. The options are Disable and Enable.

IIO-PCIE Express Global Options

PCI-E Completion Timeout Disable

Select Enable to enable PCI-E Completion Timeout support for electric tuning. The options are Yes, No, and Per-Port.

▶South Bridge

The following South Bridge information will display:

• USB Module Version
• USB Devices

Legacy USB Support

Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disable to have all USB devices available for EFI applications only. The options are Enabled, Disabled and Auto.

XHCI Hand-Off

This is a work-around solution for operating systems that do not support XHCI (Extensible Host Controller Interface) hand-off. The XHCI ownership change should be claimed by the XHCI driver. The options are Enabled and Disabled.

Port 60/64 Emulation

Select Enabled for I/O port 60h/64h emulation support, which in turn, will provide complete legacy USB keyboard support for the operating systems that do not support legacy USB devices. The options are Enabled and Disabled.

▶Server ME (Management Engine) Configuration

This feature displays the following system ME configuration settings.

Operational Firmware Version

Backup Firmware Version

Recovery Firmware Version

ME Firmware Status #1

ME Firmware Status #2

Current State

Error Code

▶PCH SATA Configuration

When this submenu is selected, the AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the following items:

SATA Controller

This item enables or disables the onboard SATA controller supported by the Intel PCH chip. The options are Enable and Disable.

Configure SATA as (Available when the item above: SATA Controller is set to enabled)

Select AHCI to configure a SATA drive specified by the user as an AHCI drive. Select RAID to configure a SATA drive specified by the user as a RAID drive. The options are AHCI and RAID. (Note: This item is hidden when the SATA Controller item is set to Disabled.)

SATA HDD Unlock

Select Enable to unlock SATA HDD password in the OS. The options are Enable and Disable.

SATA/sSATA RAID Boot Select (Available when the item "Configure SATA as" is set to "RAID")

This feature allows the user to decide which controller should be used for system boot. The options are None, SATA Controller, sSATA Controller, and Both.

Aggressive Link Power Management

When this item is set to Enabled, the SATA AHCI controller manages the power use of the SATA link. The controller will put the link in a low power mode during an extended period of I/O inactivity, and will return the link to an active state when I/O activity resumes. The options are Enable and Disable.

SATA RAID Option ROM/UEFI Driver (Available when the item "Configure SATA as" is set to "RAID")

Select EFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disable, EFI, and Legacy.

SATA Port 0 - SATA Port 7

Hot Plug

Select Enable to support Hot-plugging for the device installed on a selected SATA port which will allow the user to replace the device installed in the slot without shutting down the system. The options are Enable and Disable.

Spin Up Device

On an edge detect from 0 to 1, set this item to allow the SATA device installed on the SATA port specified by the user to start a COMRESET initialization. The options are Enable and Disable.

SATA Device Type

Use this item to specify if the device installed on the SATA port selected by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶PCH sSATA Configuration

When this submenu is selected, AMI BIOS automatically detects the presence of the sSATA devices that are supported by the sSATA controller and displays the following items:

sSATA Controller

This item enables or disables the onboard sSATA controller supported by the Intel SCU. The options are Enable and Disable.

Configure sSATA as

Select AHCI to configure an sSATA drive specified by the user as an AHCI drive. Select RAID to configure an sSATA drive specified by the user as a RAID drive. The options are AHCI and RAID. (Note: This item is hidden when the sSATA Controller item is set to Disabled.)

SATA HDD Unlock

Select Enable to unlock sSATA HDD password in the OS. The options are Enable and Disable.

SATA/sSATA RAID Boot Select (Available when the item "Configure SATA as" is set to "RAID")

This feature allows the user to decide which controller should be used for system boot. The options are None, SATA Controller, sSATA Controller, and Both.

Support Aggressive Link Power Management

When this item is set to Enable, the sSATA AHCI controller manages the power use of the SATA link. The controller will put the link in a low power mode during an extended period of I/O inactivity, and will return the link to an active state when I/O activity resumes. The options are Disable and Enable.

sSATA RAID Option ROM/UEFI Driver (Available when the item "Configure SATA as" is set to "RAID")

Select EFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disable, EFI, and Legacy.

sSATA Port 0 - sSATA Port 5

Hot Plug

Select Enable to support Hot-plugging for the device installed on an sSATA port selected by the user which will allow the user to replace the device installed in the slot without shutting down the system. The options are Disable and Enabled.

Spin Up Device

On an edge detect from 0 to 1, set this item to allow the sSATA device installed on the sSATA port specified by the user to start a COMRESET initialization. The options are Enable and Disable.

sSATA Device Type

Use this item to specify if the device installed on the sSATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶PCIe/PCI/PnP Configuration

The following PCI information will be displayed:

PCI Bus Driver Version

PCI Devices Common Settings:

Above 4G Decoding (Available if the system supports 64-bit PCI decoding)

Select Enabled to decode a PCI device that supports 64-bit in the space above 4G Address.

The options are Enabled and Disabled.

SR-IOV Support (Available if the system supports Single-Root Virtualization)

Select Enabled for Single-Root IO Virtualization support. The options are Enabled and Disabled.

MMIOHBase

Use this item to select the base memory size according to memory-address mapping for the IO hub. The base memory size must be between 4032G to 4078G. The options are 56T, 48T, 24T, 16T, 4T, and 1T.

MMIO High Granularity Size

Use this item to select the high memory size according to memory-address mapping for the IO hub. The options are 1G, 4G, 16G, 64G, 256G, and 1024G.

PCI PERR/SERR Support

Use this feature to enable or disable the runtime event for SERR (System Error)/ PERR (PCI/PCI-E Parity Error). The options are Disabled and Enabled.

Maximum Read Request

Select Auto for the system BIOS to automatically set the maximum size for a read request for a PCI-E device to enhance system performance. The options are Auto, 128 Bytes, 256 Bytes, 512 Bytes, 1024 Bytes, 2048 Bytes, and 4096 Bytes.

MMCFG Base

This feature determines the lowest MMCFG (Memory-Mapped Configuration) base assigned to PCI devices. The options are 1G, 1.5G, 1.75G. 2G, 2.25G, and 3G.

NVMe Firmware Source

Use this item to select the NVMe firmware to support system boot. The options are Vendor

Defined Firmware and AMI Native Support. The default option, Vendor Defined Firmware, is pre-installed on the drive and may resolve errata or enable innovative functions for the drive. The other option, AMI Native Support, is offered by the BIOS with a generic method.

VGA Priority

Use this item to select the graphics device to be used as the primary video display for system boot. The options are Auto, Onboard and Offboard.

M.2 PCI-E 3.0 x4 OPROM

Select Enabled to enable Option ROM support to boot the computer using a de-

vice installed on the slot specified by the user. The options are Disabled, Legacy

and EFI. Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU1 PCI-E 3.0 x16/1U Riser OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot.

The options are Disabled, Legacy, and EFI.

CPU1 JSXB2 PCI-E 3.0 x8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot.

The options are Disabled, Legacy, and EFI.

CPU2 JSXB2 PCI-E 3.0 x8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot.

The options are Disabled, Legacy, and EFI.

SIOM: CPU1 PCI-E 3.0 x16 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot.

The options are Disabled, Legacy, and EFI.

SIOM: CPU1 PCI-E 3.0 x8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot.

The options are Disabled, Legacy, and EFI.

CPU2 JSXB3 PCI-E 3.0 x16 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot.

The options are Disabled, Legacy, and EFI.

Onboard SAS Option ROM

Use this feature to select which firmware function to be loaded for LAN Port1 used for system

boot. The options are Disabled, Legacy, and EFI.

Onboard NVMe1 Option ROM

Use this feature to select which firmware function to be loaded for NVMe1 used for system

boot. The options are Disabled, Legacy, and EFI.

Onboard NVMe2 Option ROM

Use this feature to select which firmware function to be loaded for NVMe2 used for system boot. The options are Disabled, Legacy, and EFI.

Onboard NVMe3 Option ROM

Use this feature to select which firmware function to be loaded for NVMe2 used for system boot. The options are Disabled, Legacy, and EFI.

Onboard NVMe4 Option ROM

Use this feature to select which firmware function to be loaded for NVMe2 used for system boot. The options are Disabled, Legacy, and EFI.

Onboard Video Option ROM

Use this item to select the Onboard Video Option ROM type. The options are Disabled, Legacy, and EFI.

▶Network Stack Configuration

Network Stack

Select Enabled to enable PXE (Preboot Execution Environment) or UEFI (Unified Extensible Firmware Interface) for network stack support. The options are Enabled and Disabled.

*If "Network Stack" is set to Enabled, the following items will display:

Ipv4 PXE Support

Select Enabled to enable lpv4 PXE boot support. If this feature is disabled, it will not create the lpv4 PXE boot option. The options are Disabled and Enabled.

Ipv4 HTTP Support

Select Enabled to enable lpv4 HTTP boot support. If this feature is disabled, it will not create the lpv4 HTTP boot option. The options are Enabled and Disabled.

Ipv6 PXE Support

Select Enabled to enable lpv6 PXE boot support. If this feature is disabled, it will not create the lpv6 PXE boot option. The options are Disabled and Enabled.

Ipv6 HTTP Support

Select Enabled to enable lpv6 HTTP boot support. If this feature is disabled, it will not create the lpv6 HTTP boot option. The options are Enabled and Disabled.

PXE Boot Wait Time

Use this feature to select the wait time to press the key to abort the PXE boot. The default is 0.

Media Detect count

Use this feature to select the wait time in seconds for the BIOS ROM to detect the LAN media (Internet connection or LAN port). The default is 1.

▶Super IO Configuration

Super IO Chip AST2500

▶Serial Port 1 Configuration

Serial Port

Select Enabled to enable the onboard serial port specified by the user. The options are Enabled and Disabled.

Device Settings

This item displays the base I/O port address and the Interrupt Request address of a serial port specified by the user.

Note: This item is hidden when Serial Port 1 is set to Disabled.

Change Settings

This feature specifies the base I/O port address and the Interrupt Request address of Serial Port 1. Select Auto for the BIOS to automatically assign the base I/O and IRQ address to a serial port specified.

The options for Serial Port 1 are Auto, (IO=3F8h; IRQ=4), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12).

▶ Serial Port 2 Configuration

Serial Port

Select Enabled to enable the onboard serial port specified by the user. The options are Enabled and Disabled.

Device Settings

This item displays the base I/O port address and the Interrupt Request address of a serial port specified by the user.

Note: This item is hidden when Serial Port 1 is set to Disabled.

Change Settings

This feature specifies the base I/O port address and the Interrupt Request address of Serial Port 2. Select Auto for the BIOS to automatically assign the base I/O and IRQ address to a serial port specified. The options for Serial Port 2 are Auto, (IO=2F8h; IRQ=3), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12).

Serial Port 2 Attribute

Select SOL to use COM Port 2 as a Serial_Over_LAN (SOL) port for console redirection. The options are COM and SOL.

▶Serial Port Console Redirection

COM 1 Console Redirection

Select Enabled to enable COM Port 1 for Console Redirection, which will allow a client machine to be connected to a host machine at a remote site for networking. The options are Enabled and Disabled.

*If the item above set to Enabled, the following items will become available for configuration:

▶Console Redirection Settings (for COM1)

Terminal Type

Use thid feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 (Bits) and 8 (Bits).

Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start sending data when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Enabled and Disabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

Redirection After BIOS Post

Use this feature to enable or disable legacy Console Redirection after BIOS POST. When the option-Bootloader is selected, legacy Console Redirection is disabled before booting the OS. When the option-Always Enable is selected, legacy Console Redirection remains enabled upon OS bootup. The options are Always Enable and Bootloader.

SOL (Serial-Over-LAN)/COM2

Console Redirection (for SOL/COM2)

Select Enabled to use the SOL port for Console Redirection. The options are Enabled and Disabled.

*If the item above set to Enabled, the following items will become available for user's configuration:

▶Console Redirection Settings (for SOL/COM2)

Use this feature to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 (Bits) and 8 (Bits).

Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Enabled and Disabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

Redirection After BIOS Post

Use this feature to enable or disable legacy Console Redirection after BIOS POST (Power-On Self-Test). When this feature is set to Bootloader, legacy Console Redirection is disabled before booting the OS. When this feature is set to Always Enable, legacy Console Redirection remains enabled upon OS boot. The options are Always Enable and Bootloader.

▶Legacy Console Redirection Settings

Legacy Console Redirection Settings

Use the feature to select the COM port to display redirection of Legacy OS and Legacy OPROM messages. The default setting is COM1.

Serial Port for Out-of-Band Management/Windows Emergency Management Services (EMS)

The submenu allows the user to configure Console Redirection settings to support Out-of-Band Serial Port management.

Console Redirection (for EMS)

Select Enabled to use a COM port selected by the user for EMS Console Redirection. The options are Disabled and Enabled.

*If the item above set to Enabled, the following items will become available for user's configuration:

▶EMS Console Redirection Settings

Out-of-Band Management Port

The feature selects a serial port in a client server to be used by the Windows Emergency Management Services (EMS) to communicate with a remote host server. The options are COM1 (Console Redirection) and COM2/SOL (Console Redirection).

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII character set. Select VT100+ to add color and function key support. Select ANSI to use the extended ASCII character set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per Second

This feature sets the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in both host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 57600, and 115200 (bits per second).

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop data-sending when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty. The options are None, Hardware RTS/CTS, and Software Xon/Xoff.

The setting for each these features is displayed:

Data Bits, Parity, Stop Bits

▶ACPI Settings

Use this feature to configure Advanced Configuration and Power Interface (ACPI) power management settings for your system.

NUMA Support (Available when the OS supports this feature)

Select Enabled to enable Non-Uniform Memory Access support to enhance system performance. The options are Enabled and Disabled.

WHEA Support

Select Enabled to support the Windows Hardware Error Architecture (WHEA) platform and provide a common infrastructure for the system to handle hardware errors within the Windows OS environment to reduce system crashes and to enhance system recovery and health monitoring. The options are Enabled and Disabled.

High Precision Timer

Select Enabled to activate the High Precision Event Timer (HPET) that produces periodic interrupts at a much higher frequency than a Real-time Clock (RTC) does in synchronizing multimedia streams, providing smooth playback and reducing the dependency on other timestamp calculation devices, such as an x86 RDTSC Instruction embedded in the CPU. The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer. The options are Enabled and Disabled.

6.4 Trusted Computing

When a TPM (Trusted-Platform Module) device is detected in your machine, the following information will be displayed.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Trusted Computing
TPM20 Device Found Vendor: IFX Firmware Version: 7.61 Security Device Support [Enable] Active PCR banks SHA-1,SHA256 Available PCR banks SHA-1,SHA256 Pending operation [None] Platform Hierarchy [Enabled] Storage Hierarchy [Enabled] Endorsement Hierarchy [Enabled] PH Randomization [Disabled]		Enables or Disables BIOS support for security device. O.S. will not show Security Device. TCG EFI protocol and INT1A interface will not be available.
TXT Support [Disabled]		+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

• TPM2.0 Device Found
• Vendor
• Firmware Version

Security Device Support

If this feature and the TPM jumper (JPT1) on the motherboard are both enabled, the onboard security (TPM) device will be enabled in the BIOS to enhance data integrity and system security. Please note that the OS will not show the security device. Neither TCG EFI protocol nor INT1A interaction will be made available for use. If you have made changes on the setting on this item, be sure to reboot the system for the change to take effect. The options are Disable and Enable. If this option is set to Enable, the following screen and items will display:

• Active PCR Banks
• Available PCR Banks

Pending Operation

Use this feature to schedule a TPM-related operation to be performed by a security (TPM) device at the next system boot to enhance system data integrity. Your system will reboot to carry out a pending TPM operation. The options are None and TPM Clear.

Note: Your system will reboot to carry out a pending TPM operation.

Platform Hierarchy (for TPM Version 2.0 and above)

Select Enabled for TPM Platform Hierarchy support which will allow the manufacturer to utilize the cryptographic algorithm to define a constant key or a fixed set of keys to be used for initial system boot. This early boot code is shipped with the platform and is included in the list of "public keys". During system boot, the platform firmware uses this trusted public key to verify a digital signature in an attempt to manage and control the security of the platform firmware used in a host system via a TPM device. The options are Enabled and Disabled.

Storage Hierarchy

Select Enabled for TPM Storage Hierarchy support that is intended to be used for non-privacy-sensitive operations by the platform owner such as an IT professional or the end user. Storage Hierarchy has an owner policy and an authorization value, both of which can be set and are held constant (-rarely changed) through reboots. This hierarchy can be cleared or changed independently of the other hierarchies. The options are Enabled and Disabled.

Endorsement Hierarchy

Select Enabled for Endorsement Hierarchy support, which contains separate controls to address the user's privacy concerns because the primary keys in this hierarchy are certified by the TPM or a manufacturer to be constrained to an authentic TPM device that is attached to an authentic platform. A primary key can be an encrypted, and a certificate can be created using TPM2_ActivateCredential. It allows the user to independently enable "flag, policy, and authorization value" without involving other hierarchies. A user with privacy concerns can disable the endorsement hierarchy while still using the storage hierarchy for TPM applications and permitting the platform software to use the TPM. The options are Enabled and Disabled.

PH (Platform Hierarchy) Randomization (for TPM Version 2.0 and above)

Select Enabled for Platform Hierarchy Randomization support, which is used only during the platform developmental stage. This feature cannot be enabled in the production platforms. The options are Disabled and Enabled.

TXT Support

Select Enabled to enable Intel Trusted Execution Technology (TXT) support to enhance system security and data integrity. The options are Disabled and Enabled.

Note 1: If the option for this item (TXT Support) is set to Enabled, be sure to disable EV DFX (Device Function On-Hide) support for the system to work properly. (EV DFX is under "IIO Configuration" in the "Chipset/North Bridge" submenu).

Note 2: For more information on TPM, please refer to the TPM manual at http://www.supermicro.com/manuals/other.

▶iSCSI Configuration

iSCSI Initiator Name

This feature allows the user to enter the unique name of the iSCSI Initiator in IQN format. Once the name of the iSCSI Initiator is entered into the system, configure the proper settings for the following items.

▶ Add an Attempt
▶ Delete Attempts
▶ Change Attempt Order

Intel® Virtual RAID on CPU

When this submenu is selected and the RAID devices are detected, the BIOS screen displays the following items:

Intel® VROC with VMD Technology 5.0.0.1205

6.5 Event Logs

Use this feature to configure Event Log settings.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Change SMBIOS Event Log Settings View SMBIOS Event Log	Press <Enter> to change the SMBIOS Event Log configuration.
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

▶Change SMBIOS Event Log Settings

Enabling/Disabling Options

SMBIOS Event Log

Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot. The options are Enabled and Disabled.

Erasing Settings

Erase Event Log

Select Enabled to erase all error events in the SMBIOS (System Management BIOS) log before an event logging is initialized at bootup. The options are No, Yes, Next Reset, and Yes, Next Reset.

When Log is Full

Select Erase Immediately to immediately erase all errors in the SMBIOS event log when the event log is full. Select Do Nothing for the system to do nothing when the SMBIOS event log is full. The options are Do Nothing and Erase Immediately.

SMBIOS Event Log Standard Settings

Log System Boot Event

Select Enabled to log system boot events. The options are Enabled and Disabled.

MECI (Multiple Event Count Increment)

Enter the increment value for the multiple event counter. Enter a number between 1 to 255. The default setting is 1.

METW (Multiple Event Count Time Window)

This item is used to determine how long (in minutes) should the multiple event counter wait before generating a new event log. Enter a number between 0 to 99. The default setting is 60.

Note: Please reboot the system for the changes to take effect.

▶View System Event Log

This item allows the user to view the event in the system event log. Select this item and press to view the status of an event in the log. The following categories are displayed:

Date/Time/Error Code/Severity

6.6 IPMI

Use this feature to configure Intelligent Platform Management Interface (IPMI) settings.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
BMC Firmware Revision 1.27 IPMI STATUS Working	Press <Enter> to change the SEL event log configuration.
System Event Log BMC Network Configuration
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

When you select this submenu and press the key, the following information will display:

• IPMI Firmware Revision: This item indicates the IPMI firmware revision used in your system.
• Status of BMC: This item indicates the status of the BMC (Baseboard Management Controller) installed in your system.

▶System Event Log

Enabling/Disabling Options

SEL Components

Select Enabled for all system event logging at bootup. The options are Enabled and Disabled.

Erasing Settings

Erase SEL

Select Yes, On next reset to erase all system event logs upon next system reboot. Select Yes, On every reset to erase all system event logs upon each system reboot. Select No to keep all system event logs after each system reboot. The options are No, Yes, On next reset, and Yes, On every reset.

When SEL is Full

This feature allows the user to determine what the BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately.

Custom EFI Logging Options

Log EFI Status Codes

Select EFI (Extensible Firmware Interface) Status Codes to log EFI status codes. Select Error Codes to log EFI error codes. Select Progress Code to log the EFI progress code. Select both to log both EFI error codes and progress codes. The options are Disabled, Both, Error code and Progress code.

Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

▶BMC Network Configuration

BMC Network Configuration

Configure IPV4 Support

This section displays configuration features for IPV4 support.

IPMI LAN Selection

This item displays the IPMI LAN setting. The default setting is Failover.

IPMI Network Link Status

This item displays the IPMI Network Link status. The default setting is Shared LAN.

Update IPMI LAN Configuration

Select Yes for the BIOS to implement all IP/MAC address changes at the next system boot. The options are No and Yes.

*If the item above is set to Yes, the following item will become available for configuration:

Configuration Address Source

This feature allows the user to select the source of the IP address for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the field. If DHCP is selected, the BIOS will search for a DHCP (Dynamic Host Configuration Protocol) server in the network that is attached to and request the next available IP address for this computer. The options are DHCP and Static.

*If the item above is set to Static, the following items will become available for configuration:

Station IP Address

This item displays the Station IP address for this computer. This should be in decimal and in dotted quad form (i.e., 192.168.10.253).

Subnet Mask

This item displays the sub-network that this computer belongs to. The value of each three-digit number separated by dots should not exceed 255.

Station MAC Address

This item displays the Station MAC address for this computer. Mac addresses are 6 two-digit hexadecimal numbers.

Gateway IP Address

This item displays the Gateway IP address for this computer. This should be in decimal and in dotted quad form (i.e., 172.31.0.1).

VLAN

This item displays the virtual LAN settings. The options are Disable and Enable.

Configure IPV6 Support

This section displays configuration features for IPV6 support.

LAN Channel 1

IPV6 Support

Use this feature to enable IPV6 support. The options are Enabled and Disabled.

Configuration Address Source

This feature allows the user to select the source of the IP address for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the field. If DHCP is selected, the BIOS will search for a DHCP (Dynamic Host Configuration Protocol) server in the network that is attached to and request the next available IP address for this computer. The options are Unspecified, Static, and DHCP.

*If the item above is set to Static, the following items will become available for configuration:

• Station IPV6 Address
• Prefix Length
  • IPV6 Router1 IP Address

6.7 Security Settings

This menu allows the user to configure the following security settings for the system.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Administrator Password Not Installed User Password Not Installed	Set Administrator Password
Password Description
If the Administrator's / User's password is set, then this only limits access to Setup and is asked for when entering Setup. Please set Administrator's password first in order to set User's password, if clear Administrator's password, the User's password will be cleared as well.
The password length must be in the following range:
Minimum length 3 Maximum length 20
Administrator Password Password Check [Setup]	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Secure Boot
Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Administrator Password

Use this feature to set the administrator password which is required to enter the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

User Password

Use this feature to set the user password which is required to enter the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

Password Check

Select Setup for the system to check for a password at Setup. Select Always for the system to check for a password at bootup or upon entering the BIOS Setup utility. The options are Setup and Always.

▶Secure Boot

When you select this submenu and press the key, the following items will display:

• System Mode
• Secure Boot
• Vendor Keys

Attempt Secure Boot

If this item is set to Enabled, Secure Boot will be activated when a Platform Key (PK) is entered. A Platform Key is a security key used to manage the security settings of the platform firmware used in your system. The options are Enabled and Disabled.

Secure Boot Mode

Use this feature to select the desired secure boot mode for the system. The options are Standard and Custom.

▶Key Management

Provision Factory Default Keys

Select Enabled to install all manufacturer default keys for the following system security settings. The options are Enabled and Disabled.

▶Install Factor Default Keys

Select Yes to install all manufacturer defaults for the following system security settings. The options are Yes and No.

▶Enroll EFI Image

Select this item and press to select an EFI (Extensible Firmware Interface) image for the system to operate in Secure Boot mode.

▶Save All Secure Boot Variables

This feature allows the user to set and save the secure boot key variables specified by the user.

Secure Boot Variables

Secure Boot Variable/Size/Key#/Key Sources

▶Platform Key (PK)

This feature allows the user to enter and configure a set of values to be used as a platform firmware key for the system. This set of values also indicate the size, the keys numbers, and the key source of the Platform Key. The options are Save to File, Set New, and Erase.

▶Key Exchange Keys

This feature allows the user to enter and configure a set of values to be used as a Key-Exchange-Keys for the system. This set of values also indicate the size, the keys numbers, and the key source of the Key-Exchange-Keys. The options are Save to File, Set New, and Erase.

▶Authorized Signatures

This feature allows the user to enter and configure a set of values to be used as Authorized Signatures for the system. This set of values also indicate the size, the keys numbers, and the key source of the Authorized Signatures. The options are Set New and Append.

Secure Boot Variable/Size/Key#/Key Sources The options are Save to File, Set New, and Erase.

▶Forbidden Signatures

This feature allows the user to enter and configure a set of values to be used as Forbidden Signatures for the system. This set of values also indicate the size, the keys numbers, and the key source of the Forbidden Signatures. The options are Save to File, Set New, and Erase.

▶Authorized TimeStamps

This feature allows the user to set and save the timestamps for Authorized Signatures to indicate when these signatures were entered into the system. The options are Save to File, Set New, and Erase.

▶OsRecovery Signatures

This feature allows the user to set and save the Authorized Signatures used for OS recovery. The options are Save to File, Set New, and Erase.

6.8 Boot Settings

Use this feature to configure Boot Settings:

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit Boot Configuration Boot mode select [DUAL] LEGACY to EFI support [Disabled] FIXED BOOT ORDER Priorities Boot Option #1 [Hard Disk] Boot Option #2 [CD/DVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CD/DVD] Boot Option #5 [USB Key] Boot Option #6 [USB Floppy] Boot Option #7 [USB Lan] Boot Option #8 [Network: IBA 40-10...] Boot Option #9 [UEFI Hard Disk] Boot Option #10 [UEFI CD/DVD] Boot Option #11 [UEFI USB Hard Disk] Boot Option #12 [UEFI USB CD/DVD] Boot Option #13 [UEFI USB Key] Boot Option #14 [UEFI USB Floppy] Boot Option #15 [UEFI USB Lan] Boot Option #16 [UEFI Network] Boot Option #17 [UEFI AP:UEFI: Bui...] ► Delete Boot Option ▲ Select boot mode LEGACY/UEFI ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit

Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Boot Mode Select

Use this feature to select the type of devices that the system is going to boot from. The options are Legacy, UEFI (Unified Extensible Firmware Interface), and Dual.

Legacy to EFI Support

Select Enabled to boot EFI OS support after Legacy boot order has failed. The options are Disabled and Enabled.

Fixed Boot Order Priorities

This feature prioritizes the order of a bootable device from which the system will boot. Press on each entry from top to bottom to select devices.

When the item above - "Boot Mode Select" is set to Dual (default), the following items will be displayed for configuration:

- Boot Option #1 - Boot Option #17

When the item above - "Boot Mode Select" is set to Legacy, the following items will be display for configuration:

- Boot Option #1 - Boot Option #8

When the item above - "Boot Mode Select" is set to UEFI, the following items will be display for configuration:

- Boot Option #1 - Boot Option #9

▶ Delete Boot Option

Use this feature to select a boot device to delete from the boot priority list.

Delete Boot Option

Use this feature to remove an EFI boot option from the boot priority list.

▶UEFI Application Boot Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

▶NETWORK Drive BBS Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

6.9 Save & Exit

Select the Save & Exit tab from the BIOS setup screen to configure the settings below.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Save Options Discard Changes and Exit Save Changes and Reset Save Changes Discard Changes Default Options Restore Optimized Defaults Save as User Defaults Restore User Defaults Boot Override IBA 40-10G Slot 5E00 v1060 IBA 40-10G Slot 5E01 v1060 IBA 40-10G Slot 5E02 v1060 IBA 40-10G Slot 5E03 v1060 UEFI: Built-in EFI Shell	Exit system setup without saving any changes.
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Save Options

Discard Changes and Exit

Select this option to quit the BIOS setup without making any permanent changes to the system configuration and reboot the computer. Select Discard Changes and Exit from the Exit menu and press .

Save Changes and Reset

When you have completed the system configuration changes, select this option to leave the BIOS setup utility and reboot the computer for the new system configuration parameters to take effect. Select Save Changes and Exit from the Exit menu and press .

Save Changes

When you have completed the system configuration changes, select this option to save all changes made. This will not reset (reboot) the system.

Discard Changes

Select this option and press to discard all the changes and return to the AMI BIOS setup utility.

Default Options

Restore Optimized Defaults

To set this feature, select Restore Defaults from the Exit menu and press to load manufacturer default settings which are intended for maximum system performance but not for maximum stability.

Save As User Defaults

To set this feature, select Save as User Defaults from the Exit menu and press . This enables the user to save any changes to the BIOS setup for future use.

To set this feature, select Restore User Defaults from the Exit menu and press . Use this feature to retrieve user-defined settings that were saved previously.

Boot Override

This feature allows the user to override the Boot priorities sequence in the Boot menu, and immediately boot the system with a device specified by the user instead of the one specified in the boot list. This is a one-time override.

Appendix A

BIOS Error Codes

A-1 BIOS Error Beep (POST) Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

These fatal errors are usually communicated through a series of audible beeps. The numbers on the fatal error list (on the following page) correspond to the number of beeps for the corresponding error. All errors listed, with the exception of Beep Code 8, are fatal errors.

BIOS Error Beep (POST) Codes
Beep Code Error	Message Description
1 short Refresh Circuits have been reset (Ready to power up)
5 short, 1 long Memory error No memory detected in system
5 long, 2 short Display memory read/write error Video adapter missing or with faulty memory
1 long continuous System OH System overheat condition

A-2 Additional BIOS POST Codes

The AMI BIOS supplies additional checkpoint codes, which are documented online at http://www.supermicro.com/support/manuals/ ("AMI BIOS POST Codes User's Guide").

When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20).

For information on AMI updates, please refer to http://www.ami.com/products/.

Appendix B

Standardized Warning Statements for AC Systems

B.1 About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源装置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

System Specifications

Processors

Dual Intel Xeon 81xx/61xx/51xx/41xx/31xx and 82xx/62xx/52xx/42xx/32xx series in an Socket P type sockets for each node.

Note: Please refer to the motherboard specifications pages on our website for updates to supported processors.

Chipset

Intel Intel C621 chipset

BIOS

128 Mb AMI® Flash ROM

Memory

Twelve 240-pin DIMM slots that can support up to 1536 GB of 72-bit DDR4 unbuffered ECC 2933/2666/2400/2133 Mhz speed SDRAM

Note: See the memory section in Chapter 3 for details and our website for updates to supported memory.

SATA Controller

On-chip (Intel C621) controller

Drive Bays

Thirty-two 3.5" hot-swap drive bays in four nodes

PCI Expansion Slots

One PCI-Express 3.0 (x16) slot

One PCI-Express 3.0 x16 (x8 + x8) SMCI storage Slot (JSXB2)

One PCI-Express 3.0 x16 SIOM LAN Port

Motherboard

X11DPFR-S/SN Proprietary form factor ((LxW): 9.66" x 8.53" (216.66 mm x 499.36 mm))

Chassis

F424AS2-R1K23BP; 4U Rackmount, (WxHxD) 17.63 x 6.96 x 29 in. (448 x 177 x 737 mm)

System Cooling

Eight 8-cm PWM fans

Power Supply

Model: PWS-1K23A-1R

AC Input Voltages: 100-240 VAC

Rated Input Current: 15-12A (100-127V) to 8.5-7A (200-240V)

Rated Input Frequency: 50-60 Hz

Rated Output Power: 1000W/1200W

Rated Output Voltages: 83A (+12V 100-127Vac), 100A (+12V 200-240Vac), 0-4A (+5Vsb)

Operating Environment

Operating Temperature: 10° to 35° C (50° to 95° F)

Non-operating Temperature: -40^ to 60^ C ( -40^ to 140^ F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

Electromagnetic Emissions: FCC Class A, EN 55032 Class A, EN 61000-3-2/3-3, CISPR 32 Class A
Electromagnetic Immunity: EN 55024/CISPR 24, (EN 61000-4-2, EN 61000-4-3, EN 61000-4-4, EN 61000-4-5, EN 61000-4-6, EN 61000-4-8, EN 61000-4-11), CNS14336-1, CNS13438, GB4943.1-2011, GB9254-2008(Class A) and GB17625.1-2012
Safety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe)
Other: VCCI-CISPR 32 and AS/NZS CISPR 32
Environmental: Directive 2011/65/EU and Delegated Directive (EU) 2015/863 and Directive 2012/19/EU

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate"

Appendix D

UEFI BIOS Recovery

Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you need to update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.

D.1 Overview

The Unified Extensible Firmware Interface (UEFI) provides a software-based interface between the operating system and the platform firmware in the pre-boot environment. The UEFI specification supports an architecture-independent mechanism that will allow the UEFI OS loader stored in an add-on card to boot the system. The UEFI offers clean, hands-off management to a computer during system boot.

D.2 Recovering the UEFI BIOS Image

A UEFI BIOS flash chip consists of a recovery BIOS block and a main BIOS block (a main BIOS image). The recovery block contains critical BIOS codes, including memory detection and recovery codes for the user to flash a healthy BIOS image if the original main BIOS image is corrupted. When the system power is turned on, the recovery block codes execute first. Once this process is complete, the main BIOS code will continue with system initialization and the remaining POST (Power-On Self-Test) routines.

Note 1: Follow the BIOS recovery instructions below for BIOS recovery when the main BIOS block crashes.

Note 2: When the BIOS recovery block crashes, you will need to follow the procedures to make a Returned Merchandise Authorization (RMA) request. (For a RMA request, please see section 3.5 for more information). Also, you may use the Supermicro Update Manager (SUM) Out-of-Band (OOB) (https://www.supermicro.com.tw/products/nfo/SMS_SUM.cfm) to reflash the BIOS.

D.3 Recovering the Main BIOS Block with a USB Device

This feature allows the user to recover the main BIOS image using a USB-attached device without additional utilities used. A USB flash device such as a USB Flash Drive, or a USB CD/DVD ROM/RW device can be used for this purpose. However, a USB Hard Disk drive cannot be used for BIOS recovery at this time.

The file system supported by the recovery block is FAT (including FAT12, FAT16, and FAT32) which is installed on a bootable or non-bootable USB-attached device. However, the BIOS might need several minutes to locate the SUPER.ROM file if the media size becomes too large due to the huge volumes of folders and files stored in the device.

To perform UEFI BIOS recovery using a USB-attached device, follow the instructions below.

1. Using a different machine, copy the "Super.ROM" binary image file into the Root "\" directory of a USB device or a writable CD/DVD.

Note: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.

1. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and reset the system when the following screen appears.

OPEN BMC IP:10.132.160.92 PEI--Could Not Find Recovery Image... 87

1. After locating the healthy BIOS binary image, the system will enter the BIOS Recovery menu as shown below.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING: System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Program new data Write new boot block... 178 +: Select Screen 14: Select Item Enter: Select +/-: Change Dot.. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.12% Copyright (C) 2017 American Megatrends, Inc.

Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below.

1. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update" and press the key. You will see the BIOS recovery progress as shown in the screen below.

Note: Do not interrupt the BIOS flashing process until it has completed.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING! System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Program new data Write new boot block... 178 +: Select Screen T1: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

1. After the BIOS recovery process is complete, press any key to reboot the system.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING! System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Flash update Flash update completed. Press any key to reset the system +: Select Screen T4: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

1. Using a different system, extract the BIOS package into a USB flash drive.
2. Press continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press to save the settings and exit the BIOS Setup utility.

Boot Configuration Boot mode select [DUAL] LESAOY to IFI support [Disabled] FIXED BOOT ORDER PRIOCITIES Boot Option #1 [DEFI API:REFI: BUI...] Boot Option #2 [CD/DVD] Boot Option #3 [USB Hard Disk] Boot Option #4 [USB CD/DVD] Boot Option #5 [USB Key:BanDisk] Boot Option #6 [USB Floppy] Boot Option #7 [USB Lan] Boot Option #8 [Network:JBA GE SI...] Boot Option #9 [DEFI Hard Disk] Boot Option #10 [DEFI CD/DVD] Boot Option #11 [DEFI USB Hard Disk] Boot Option #12 [DEFI USB CD/DVD] Boot Option #13 [DEFI USB Key:DEFI...] Boot Option #14 [DEFI USB Floppy] Boot Option #15 [DEFI USB Lan] Boot Option #16 [DEFI Network] Boot Option #17 [Hard Disk] Add New Boot Option +:- Select Screen F1: Select Item Enter: Select +:- Change Opt. F1: General help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

1. When the UEFI Shell prompt appears, type fs# to change the device directory path. Go to the directory that contains the BIOS package you extracted earlier from Step 6. Enter flash.nsh BIOSname.### at the prompt to start the BIOS update process.

UEFI Interactive Shell v2.1 EDI: 11 UEFI v2.5s (American Megatremos, 0x0005000C) Mapping table F80: Alias(s):HDDv3b::BLK1; Pc:IReset(0x0)/Pci(0x14,0x0).USD(0x11,0x0).HD(1,M8R,0x37901072,0x000,0x1 CAN592) BLK0: Alias(s): Pc:IReset(0x0)/Pci(0x14,0x0).USB(0x11,0x0) Press SBC in 1 seconds to skip startup.nsh or any other key to continue. Shell: f86 F86:\CD:FUDOS F86:\AFUDOS\cd SWJPM2-03162017 F86:\WFUDOS\SWJPM2-03162017\Tilash.nsh.XIIOP67.314

Note: Do not interrupt this process until the BIOS flashing is complete.

[ Access Cross Fort Ex ] 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system. 

Verifying WCB Block ......... done - Update success for FDR - Update success for IC, - - Successful Update Recovery Loader to OPRx!! - Successful Update MFSB11- - Successful update PTPR11- - Successful Update MFS, [001 and IVB21] - Successful Update FLOS and ITOX!! - ML Entire image update success !!! WARNING : System must power-off to have the changes take effect! Moving F501vAFUD005\SWJPMZE_03162017\vdfix64.efi -> F501vAFUD005\SWJPMZE_03162017\vxf dt.smc - (or) Moving F501vAFUD005\SWJPMZE_03162017\vafufix64.efi -> F501vAFUD005\SWJPMZE_03162017\vxf ?taufuefi.smc - (or) ********************************************************************** * • Please ignore this 'Shell' Cannot read from file - Device Error' * warning message due to it does not impact flashing process. * ********************************************************************** * Deleting * Delete successful. F501v

10. Press continuously to enter the BIOS Setup utility. 11. Press to load the default settings. 12. After loading the default settings, press to save the settings and exit the BIOS Setup utility.

Appendix E

CPU-Based RAID for NVMe

Intel® Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCI-E root complex. - A single processor supports up to 12 NVMe SSDs and up to 6 RAID arrays. - A dual processor system supports up to 24 NVMe SSDs and 12 RAID arrays. Strip sizes are 4K, 8K, 16K, 32K, 64K, 128K.

Requirements and Restrictions

- Intel VROC is only available when the system is configured for UEFI boot mode. - To enable the mdadm command and support for RSTe, install the patch from \- Linux: https://downloadcenter.intel.com/download/28158/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Linux- \- Windows: https://downloadcenter.intel.com/download/28108/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Windows- - To enable Intel VROC, a hardware key must be inserted on the motherboard, and the appropriate processor's Virtual Management Devices must be enabled in the BIOS setup. - It is possible to enable Intel VROC without a hardware key installed, but only RAID0 will be enabled. - Intel VROC is not compatible with secure boot. This feature must be disabled. - When creating bootable OS RAID1 devices, you must have both devices on the same CPU, and a VMD on that CPU. - Spanning drives when creating RAID devices is not recommended to due to performance issues, even though it is supported.

Supported SSDs and Operating Systems

To see the latest support information: https://www.intel.com/content/www/us/en/support/articles/000030310/memory-and-storage/ssd-software.html

Additional Information

Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm

E.1 Hardware Key

The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly. The key must be plugged into the Supermicro motherboard (connector JRK1). The key options are:

Intel® VROC Keys
VROC Package Description Part Number Intel MM Number
Standard	RAID 0, 1, 10Supports 3rd party SSDs	AOC-VROCSTNMOD 95	1605
Premium	RAID 0, 1, 5, 10Supports 3rd party SSDs	AOC-VROCPREMOD 95	1606
Intel SSD only	RAID 0, 1, 5, 10Supports Intel SSDs only	AOC-VROCINTMOD 95	822


VROC_HW_KEY PIN 1 GND KEY1 GND KEY2

Figure E-1. Intel® VROC RAID Key and Motherboard Connector JRK1

E.2 Enabling NVMe RAID

RAID for NVMe SSDs must be enabled through the UEFI BIOS. 1. Install the patch as described in the Restrictions and Requirements section on a previous page. 2. Reboot the server. 3. Press [DEL] key to enter BIOS. 4. Switch to Advanced > Chipset Configuration > North Bridge > IIO Configuration > Intel® VMD Technology > CPU1 & CPU2. 5. Enable the VMD according to the following rules. \- For U.2 NVMe, enable all the sub-items under each PStack, based on the your model server:

VMD BIOS Setting for
CPU1 CPU2
VMD Config for PStack0 VMD Config for PStack1

\- For M.2 NVMe or NVMe AIC, enable the VMD according to which AOC card/slot it used. An example U.2 configuration follows. 

VMD Config for PDLack Setup: VMD for Volume Management Device - [Disable] VMD Config for PDLack1 Setup: VMD for volume management device - [Disable] VDD-HDMI-R NOME: VMD - [Disable] HOT Fluid ENADIA - [Disable] VMD Config for PDLack2 Setup: VMD for volume management device - [Disable] Envision/Dissease Enable Volume Management Device Technology in this Stack. +1. Select Diveren +1. Select Time Binary Select +1. Change Opt. +1. General Help +2. Previous Values For Utilized Defaults For Use & Exit ESC1 Exit Version 2.19.1708. Copyright: VDD-2018 American Technologies, Inc.


Auto Setup Utility - Copyright U2 2008 American MegaTrends, Inc. AVOCADO VMD Config for PStack3 [IntrIB VMD for Volume Management Device] [Disabled] VMD Config for PStack1 [IntrIB VMD for Volume Management Device] [Disabled] VMD Config for PStack2 [IntrIB VMD for Volume Management Device] [Disabled] ACC-COUNT-1:EXT NAME1 VMD [Disabled] HOT Flag Capable [Disabled] Enable/Disable IntrIB Volume Management Device Technologies in this state. CPU2 ConfigurationCPU1 Configuration Select Screen Select Item Enter: Delete Information Out Select System F3: Optimized Defaults F4: Save & Exit DCT: Exit

Figure E-2. BIOS VMD Setting Example for 24 Drives 6. Press [F4] to save the configuration and reboot the system. 7. Press [DEL] to enter BIOS. 8. Switch to Advanced > Intel® Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume. 9. Set Name. 10. Set RAID Level. 11. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller as shown in Figure E-4. 

Auto Setup Utility - Copyright (C) 2018 American Markets, Inc. Current MAX Volume Name: Volume MAX Level: [0] (Max/Struck) Select MAX Spreads Over AND Controller: 1.1 Select DLSI: INTEL: SPEDCKSHATTY ENDELPTOSHOPAFIC: [6] INTEL: SPEDCKSHATTY ENDELPTOSHOPAFIC: [5] INTEL: SPEDCKSHATTY ENDELPTOSHOPAFIC: [3] INTEL: SPEDCKSHATTY ENDELPTOSHOPAFIC: [1] Style Filter: [2004E] Capacity: 3075.43 ▶ Create Volume ←: Select Options R4: Select Item Enter Select +/- Design Out. Ftl General Help C2: Previous Values Ftl Defaulted Defaults Fic Save & Exit GDS: Exit Version 6.18.2006, Copyright 1C2 2018 American Markets, Inc.

Figure E-3. Created Volume without enabling RAID spanned over VMD controller 

Auto Setup Utility - Copyright (C) 2008 American Markets, Inc. Advanced Create RAD Volume Name: R&D Level: Enable RAD spanned over MRI Controller Volume: Volume/Off Level Select Tools [NTL SUPLEXCHINITY SIMULPTOSISOPHYS] [NTL SUPLEXCHINITY SIMULPTOSISOPHYS] [NTL SUPLEXCHINITY SIMULPTOSISOPHYS] [NTL SUPLEXCHINITY SIMULPTOSISOPHYS] Style Name: Opacity: 100% Change: 100% Change Volume X - to Select Tools << Select Screen P1: Select Item Enter: Cancel +/- Change On... P1: General Help P2: Previous Value P3: Detected Defaults P4: Save & Exit OK! Exit Version 2.13.2008 Copyright CCI 2008 American Markets, Inc.

Figure E-4. Created Volume with enabling RAID spanned over VMD controller 12. Select specific disks for RAID with an [X]. • RAID0: Select at least two [2 - 24] disks • RAID1: Select only two disks • RAID5: Select at least three [3 - 24] disks • RAID10: Select only four disks 13. Select Strip Size (Default 64KB). 14. Select Create Volume. 15. If another RAID is needed, start again at step 6. 16. Press [F4] to save and reboot.

E.3 Status Indications

An LED indicator on the drive carrier shows the RAID status of the drive.

Drive Carrier Status LED Indicator
Status State (red)
Normal function Off
Locating 4 Hz blink
Fault Solid on
Rebuilding 1 Hz Blink

IBPI SFF 8489 Defined Status LED States

E.4 Hot Swap Drives

Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other manufacturers. Under vSphere ESXi, several steps are necessary to avoid potential stability issues. See the information at link [1] below.

Hot-unplug

1. Prevent devices from being re-detected during rescan: esxcli storage core claiming autoclaim --enabled=false 2. Unmount the VMFS volumes on the device. Check [2] for details. 3. Detach the device. Check [3] for details. 4. Physically remove the device.

Hot-plug

• Physically install the device. ESXi will automatically discover NVMe SSDs, but a manual scan may be required in some cases.

Related Information Links

[1] https://kb.vmware.com/s/article/2151404 [2] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-1B56EF97-F60E-4F21-82A7-8F2A7294604D.html [3] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-F2E75F67-740B-4406-9F0C-A2D99A698F2A.html