SuperStorage 5049P-E1CR45L - NAS Supermicro - Free user manual and instructions

USER MANUAL SuperStorage 5049P-E1CR45L Supermicro

Front view of a server rack with hexagonal mesh pattern and control buttons (no readable text or symbols)

USER'S MANUAL

Revision 1.0b

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.0b

Release Date: April 18, 2019

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2019 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the server. Installation and maintenance should be performed by experienced technicians only.

Please refer to the SuperStorage Server 5049P-E1CR45L/5049P-E1CR45H specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
- Product drivers and utilities: https://www.supermicro.com/wftp
- Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at:

[e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Chapter 1 Introduction

1.1 Overview....8
1.2 Unpacking the System 8
1.3 System Features 9
1.4 Server Chassis Features....10

Control Panel 10

Front Features....11

Rear Features ....12

1.5 Motherboard Layout....14

Quick Reference Table....15

System Block Diagram....16

Chapter 2 Server Installation

2.1 Overview....17
2.2 Preparing for Setup....17

Choosing a Setup Location....17

Rack Precautions....17

Server Precautions....18

Rack Mounting Considerations....18

Ambient Operating Temperature....18
Airflow....18
Mechanical Loading....18
Circuit Overloading....19
Reliable Ground....19

2.3 Installing the Rails....20

Identifying the Rails 20

Releasing the Inner Rail....21

Installing the Inner Rails 22

Installing the Outer Rails onto the Rack 23

Adapters for Round and Threaded Hole Racks....24

2.4 Installing the Chassis into a Rack....25
Removing the Chassis from the Rack 26
2.5 Optional Quick Installation Method 26
2.6 Installing the Cable Management Arm....27

Chapter 3 Maintenance and Component Installation

3.1 Removing Power 32
3.2 Accessing the System....32

Accessing the Motherboard ....32

Accessing the Storage Drives....33

Removing the Small Top Cover/Air Shroud Assembly....34

3.3 Motherboard Components....35

Processor and Heatsink Installation....35
Memory 35

Memory Support ....35
Memory Population Guidelines....36
Memory Population Sequence ....37
Memory Module Installation....37

Installing Expansion Cards....40

Motherboard Battery 41

3.4 Chassis Components 42

Storage Drives 42

Drive Carrier Indicators 42

Adding or Replacing Main Storage Drives 43

Hot-Swap for NVMe Drives 45

Checking the Temperature of an NVMe Drive ....46

Storage Drives at the Chassis Rear....47

Fans 48

Power Supply Modules ....50

Chapter 4 Motherboard Connections

4.1 Power Connections ....51
4.2 Headers and Connectors ....52

Control Panel 57

4.3 Input/Output Ports 60
4.4 Jumpers....61
4.5 LED Indicators....63

Chapter 5 Software

5.1 Microsoft Windows OS Installation....65
5.2 Driver Installation....67
5.3 SuperDoctor® 5....68
5.4 IPMI 69

Chapter 6 BIOS

6.1 Introduction....70
Starting BIOS Setup Utility....70
6.2 Main Setup....71
6.3 Advanced Setup Configurations....72
6.4 Event Logs 98
6.5 IPMI....100
6.6 Security....103
6.7 Boot....107
6.8 Save & Exit....110

Appendix A BIOS Error Codes

Appendix B Standardized Warning Statements for AC Systems

Appendix C System Specifications

Appendix D UEFI BIOS Recovery

Appendix E Crash Dump Using IPMI

Appendix F CPU-Based RAID for NVMe

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides an outline of the functions and features of the 5049P-E1CR45L/5049P-E1CR45H SuperStorage Server. It is based on the X11SPL-F motherboard and the SC946LTS-R1K66P1 chassis.

Models:

• 5049P-E1CR45L with AOC-S3008L-L8E IT Mode
• 5049P-E1CR45H with AOC-S3108L-H8IR-P hardware RAID

Several other important components are listed below.

Main Parts List
Description Part Number Quantity
Power supply PWR-1K66A-1R 2
Backplane (for 45 drives) BPN-SAS3-946LEL1 1
Backplane (for two rear drives) BPN-SAS3-826TQ-B2B 1
Fans FAN-0184L4 5
Heatsink SNK-P0068PS 1
Drive trays (tool-less 3.5"/2.5") MCP-220-94601-0N 45
Mounting rails	MCP-290-00150-0N	1 set
Cable management arm	MCP-290-00133-0N	1

1.2 Unpacking the System

Inspect the box in which the system was shipped and note if it was damaged in any way. If any equipment appears damaged, please file a damage claim with the carrier who delivered it. Decide on a suitable location for the rack unit that will hold the server. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. It will also require a grounded AC power outlet nearby. Be sure to read the precautions and considerations noted in Appendix B.

1.3 System Features

The following table provides an overview of the main features of the system.

System Features

Motherboard

X11SPL-F

Chassis

SC946LTS-R1K66P1

CPU

Single Intel Xeon 82xx/62xx/52xx/42xx/32xx or 81xx/61xx/51xx/41xx/31xx processor (socket P (LGA3647)) with up to 28 cores and a thermal design power (TDP) of up to 165WNote: Does not support FPGA or Fabric processors

Chipset

Intel C621

Memory

Up to 512GB of RDIMM, 1TB of LRDIMM, and 2TB of 3DS LRDIMM DDR4 (288-pin) ECC memory with speeds of up to 2933MHz in eight memory slots. Note: Memory speed depends on the processors; 2933MHz memory speed is supported by 82xx/62xx processors only.

Expansion Slots

One PCI-Express 3.0 x4 (in x8)Three PCI-Express 3.0 x8 (An additional x8 slot is occupied by S3108/S3008 HBA card.)Two PCI-Express 3.0 x8 (in x16)

Storage Drives

Forty-five top-loaded hot-swap SAS/SATA 3.5" drivesTwo hot-swap 2.5" SATA drives (rear)(Optional) Two NVMe drives with rear kitOne M.2Two SATA-DOM

Power

Redundant 1600 W; 80 Plus Platinum level

Input/Output

LAN: Two 1 Gb (Intel Ethernet Controller i210 + i210 for Dual 1G Base-T Ports); one dedicated IPMIUSB: Two USB 3.0, two USB 2.0Serial port (COM1), an additional motherboard serial port header (COM2)VGA port

Form Factor

4U rackmount, width: 17.2" (437mm), height: 7" (178mm), depth: 26" (660mm)

Cooling

Five 8-cm exhaust fans for redundant cooling; air shroud, CPU heatsink

1.4 Server Chassis Features

The SC946LTS-R1K66P1 is a 4U chassis.

Control Panel

The switches and LEDs located on the control panel are described below.

1 2 RESET 3 4 5 6 7 8

Figure 1-1. Control Panel View

Control Panel Features
Item Feature	Description
1 Power button		The main power switch applies or removes primary power from the power supply to the server but maintains standby power.
2 Reset button	Reboots the system.
3 Disk LED	Indicates disk activity when flashing.
4	Network 1 LED	Indicates network activity on the LAN1 when flashing.
5 Information	LED Alerts operator to several states, as noted in the table below.
6 Power LED		Indicates power is being supplied to the system by the power supply units.
7	Network 2 LED	Indicates network activity on the LAN2 when flashing.
8 Power Fail	LED Indicates a power supply module has failed.

Information LED
Status Description
Continuously on and red	An overheat condition has occurred. (This may be caused by cable congestion.)
Blinking red (1Hz) Fan failure, check for an inoperative fan.
Blinking red (0.25Hz)	Power failure, check for a non-operational power supply.
Solid blue	UID has been activated locally to locate the server in a rack environment.
Blinking blue	UID has been activated using IPMI to locate the server in a rack environment.

Front Features

Front view of a server rack with hexagonal mesh partition and labeled ports (no readable text or symbols)

1

Figure 1-2. Chassis Front View

Front Chassis Features
Item Feature	Description
1 Control Panel	Described on the previous page
2 Chassis Release	Levers To slide the system out of the rack

Rear Features

Diagram of a server rack with labeled components including drive bays, connectors, and ports

Figure 1-3. Chassis Rear View

Rear Chassis Features
Item Feature	Description
1 Power supply modules	Two hot-swap modules
2 Fans Five exhaust fans
3 I/O panel See the following page
4	Drive bays	(Optional) Two 2.5" hot swap NVMe storage drives
5 Drive bays	Two 2.5" hot swap SATA storage drives
6 PCI slots Six half-height (seventh is occupied by the SAS/SATA card)

Diagram showing 10 labeled network device ports including VGA, Ethernet, and USB connectors

Figure 1-4. Rear I/O Ports

# Description # Description
1 COM Port 1 6 USB8 (3.0)
2 Dedicated IPMI LAN 7 LAN1
3 USB1 (2.0) 8 LAN2
4 USB0 (2.0) 9 VGA Port
5 USB9 (3.0) 10 UID Switch/LED

1.5 Motherboard Layout

Below is a layout of the X11SPL-F with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4.

SLOT1 COM2 JWD1 JPG1 JD1 MH10 USB10/11 (3.0) SP1 USB2/3 MH11 USB4/5 JOH1 JRK1 JIPMB1 S-SGPIO1 S-SGPIO2 I-SATA2 I-SATA3 I-SATA4 I-SATA5 I-SATA6 I-SATA7 JL1 I-SATA0 I-SATA1 JSD1 FANB JSD2 JBT1 JPME2 FANA LE3 MTM PCI-E 3.0 X4 JPMIE2 JPMIE1 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 CPU SLOTE7 PCLE 3.3 X8 ASpeed AST/2000 SLOT2 SLOT3 SLOT4 SLOT5 SLOT6 SLOT7 UID-LED UID-SW VGA LAN2 LAN1 IPMI_LAN USB0/1 COM1 FAN5 JVRM1 DIMMC1 DIMMB1 DIMMA1 DIMMA2 DIMMD2 DIMMD1 DIMME1 DIMMF1 CPU BAR CODE MAC CODEC IPMI CODE JPN2C1 JNVI2C1 JNVI2C2 JPWR2 JSTBY1 FAN1 JPWR1 JPI2C1

Figure 1-5. Motherboard Layout

Notes:

• "■" indicates the location of pin 1.
• Jumpers/LED indicators not indicated are used for testing only.

Quick Reference Table

Jumper Description Default Setting

JBT1 CMOS Clear Open (Normal)

JPG1 VGA Enable/Disable Pins 1-2 (Enabled)

JPL1 LAN1 Enable/Disable Pins 1-2 (Enabled)

JPL2 LAN2 Enable/Disable Pins 1-2 (Enabled)

JPME2 ME Manufacturing Mode Pins 1-2 (Normal)

JWD1 Watch Dog Timer Pins 1-2 (Reset)

Connector Description

BT1	Onboard Battery
COM1, COM2	COM Port, COM Header
FAN1 ~ FAN5, FANA/FANB	CPU/System Fan Headers
IPMI_LAN	Dedicated IPMI LAN Port
I-SATA0 ~ I-SATA7	Intel® PCH SATA 3.0 Ports (with RAID 0, 1, 5, 10)
I-SGPIO1, I-SGPIO2	Serial Link General Purpose I/O Connection Headers
JD1	Speaker/Power LED Indicator (Pins 1-3: Power LED, Pins 4-7: Speaker)
JF1	Front Control Panel Header
JIPMB1	4-pin BMC External I^2C Header (for an IPMI Card)
JL1	Chassis Intrusion Header
JNV1^2C1	NVMe I^2C Header
JOH1	Overheat LED Indicator
JPI^2C1	Power System Management Bus (SMB) I^2C Header
JPWR1	8-pin 12V CPU Power Connector
JPWR2	24-pin ATX Power Connector
JRK1	Intel RAID Key Header
JSD1, JSD2	SATA DOM Power Connectors
JSTBY1	Standby Power Header
JTPM1	Trusted Platform Module/Port 80 Connector
JVRM1	VRM SMBus Header (for programming use)
LAN1, LAN2	Dual 1G Base-T Ports
M.2	M.2 PCI-E 3.0 x4 or SATA 3.0 Slot (Supports M-Key 2280 and 22110)
MH10, MH11	M.2 Mounting Holes
SLOT1	PCH PCI-E 3.0 x4 (in x8) Slot
SLOT2, SLOT3,SLOT5, SLOT7	CPU PCI-E 3.0 x8 Slot
SLOT4, SLOT6	CPU PCI-E 3.0 x8 (in x16) Slot
SP1	Internal Speaker/Buzzer
UID-SW	Unit Identifier (UID) Switch
USB0/1	Back Panel Universal Serial Bus (USB) 2.0 Ports
USB8/9	Back Panel USB 3.0 Ports

Connector Description

USB10/11 Front Accessible USB 3.0 Header

USB12 USB 3.0 Type-A Header

VGA VGA Port

LED Description State: Status

LE3 M.2 LED Blinking Green: Device Working

LEDBMC BMC Heartbeat LED Blinking Green: BMC Normal

LEDPWR Onboard Power LED Solid Green: Power On

UID-LED Unit Identifier (UID) LED

Solid Blue: Unit Identified

System Block Diagram

graph TD
    A["BMC AST2500"] -->|SPI| B["PCI-E X1 G2"]
    A -->|SPI(Reserved)| C["PCI-E X4 G3"]
    A -->|SPI| D["PCI-E X8 G3"]
    A -->|SPI| E["PCI-E X10AT"]
    A -->|SPI| F["PCI-E X1G2"]
    A -->|SPI| G["PCI-E X4G3"]
    A -->|SPI| H["PCI-E X8G3"]
    A -->|SPI| I["PCI-E X16"]
    A -->|SPI| J["PCI-E X8"]
    A -->|SPI| K["PCI-E X16"]
    A -->|SPI| L["PCI-E X8"]
    A -->|SPI| M["PCI-E X8G3"]
    A -->|SPI| N["PCI-E X8G3"]
    A -->|SPI| O["PCI-E X8G3"]
    A -->|SPI| P["PCI-E X8G3"]
    A -->|SPI| Q["PCI-E X8G3"]
    A -->|SPI| R["PCI-E X8G3"]
    A -->|SPI| S["PCI-E X8G3"]
    A -->|SPI| T["PCI-E X8G3"]
    A -->|SPI| U["PCI-E X8G3"]
    A -->|SPI| V["PCI-E X8G3"]
    A -->|SPI| W["PCI-E X8G3"]
    A -->|SPI| X["PCI-E X8G3"]
    A -->|SPI| Y["PCI-E X8G3"]
    A -->|SPI| Z["PCI-E X8G3"]
    A -->|SPI| AA["PCI-E X8G3"]
    A -->|SPI| AB["PCI-E X8G3"]
    A -->|SPI| AC["PCI-E X8G3"]
    A -->|SPI| AD["PCI-E X8G3"]
    A -->|SPI| AE["PCI-E X8G3"]
    A -->|SPI| AF["PCI-E X8G3"]
    A -->|SPI| AG["PCI-E X8G3"]
    A -->|SPI| AH["PCI-E X8G3"]
    A -->|SPI| AI["PCI-E X8G3"]
    A -->|SPI| AJ["PCI-E X8G3"]
    A -->|SPI| AK["PCI-E X8G3"]
    A -->|SPI| AL["PCI-E X8G3"]
    A -->|SPI| AM["PCI-E X8G3"]
    A -->|SPI| AN["PCI-E X8G3"]
    A -->|SPI| AO["PCI-E X8G3"]
    A -->|SPI| AP["PCI-E X8G3"]
    A -->|SPI| AQ["PCI-E X8G3"]
    A -->|SPI| AR["PCI-E X8G3"]
    A -->|SPI| AS["PCI-E X8G3"]
    A -->|SPI| AT["PCI-E X8G3"]
    A -->|SPI| AU["PCI-E X8G3"]
    A -->|SPI| AV["PCI-E X8G3"]
    A -->|SPI| AW["PCI-E X8G3"]
    A -->|SPI| AX["PCI-E X8G3"]
    A -->|SPI| AY["PCI-E X8G3"]
    A -->|SPI| AZ["PCI-E X8G3"]
    A -->|SPI| BA["PCI-E X8G3"]
    A -->|SPI| BB["PCI-E X8G3"]
    A -->|SPI| BC["PCI-E X8G3"]
    A -->|SPI| BD["PCI-E X8G3"]
    A -->|SPI| BE["PCI-E X8G3"]
    A -->|SPI| BF["PCI-E X8G3"]
    A -->|SPI| BG["PCI-E X8G3"]
    A -->|SPI| BH["PCI-E X8G3"]
    A -->|SPI| BI["PCI-E X8G3"]
    A -->|SPI| BJ["PCI-E X8G3"]
    A -->|SPI| BK["PCI-E X8G3"]
    A -->|SPI| BL["PCI-E X8G3"]
    A -->|SPI| BM["PCI-E X8G3"]
    A -->|SPI| BN["PCI-E X8G3"]
    A -->|SPI| BO["PCI-E X8G3"]
    A -->|SPI| BP["PCI-E X8G3"]
    A -->|SPI| BQ["PCI-E X8G3"]
    A -->|SPI| BR["PCI-E X8G3"]
    A -->|SPI| BS["PCI-E X8G3"]
    A -->|SPI| BT["PCI-E X8G3"]
    A -->|SPI| BU["PCI-E X8G3"]
    A -->|SPI| BV["PCI-E X8G3"]
    A -->|SPI| BW["PCI-E X8G3"]
    A -->|SPI| BX["PCI-E X8G3"]
    A -->|SPI| BY["PCI-E X8G3"]
    A -->|SPI| BZ["PCI-E X8G3"]
    A -->|SPI| CA["PCI-E X8G3"]
    A -->|SPI| CB["PCI-E X8G3"]
    A -->|SPI| CC["PCI-E X8G3"]
    A -->|SPI| CD["PCI-E X8G3"]
    A -->|SPI| CE["PCI-E X8G3"]
    A -->|SPI| CF["PCI-E X8G3"]
    A -->|SPI| CG["PCI-E X8G3"]
    A -->|SPI| BH
    A -->|SPI| BI["PCI-E X8G3"]
    A -->|SPI| BJ
    A -->|SPI| BK
    A -->|SPI| BL
    A -->|SPI| BM
    A -->|SPI/RSI 1 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 0

Figure 1-6. Intel C621 Chipset: System Block Diagram
(General diagram--your system may be slightly different)

Chapter 2

Server Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 4 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).
• This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

- Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.

• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time - extending two or more simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Appendix B.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the servers closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.
• Slide rail mounted equipment is not to be used as a shelf or a work space.
• In any instance of pulling the system from the rack, always use a rack lift and follow all associated safety precautions.

2.3 Installing the Rails

There are a variety of rack units on the market, which may require a slightly different assembly procedure. Do not use a two post "telco" type rack. This rail set fits a rack between 26.5" and 36.4" deep.

The following is a basic guideline for installing the system into a rack with the rack mounting hardware provided. You should also refer to the installation instructions that came with the specific rack you are using.

Identifying the Rails

The chassis package includes two rail assemblies. Each assembly consists of three sections: An inner rail that secures directly to the chassis, an outer rail that secures to the rack, and a middle rail which extends from the outer rail. These assemblies are specifically designed for the left and right side of the chassis and labeled.

Rail Assembly (Shown with Rails Retracted) Outer Rail Middle Rail Locking Tab Inner Rail This Side Faces Outward

Figure 2-1. Identifying the Outer Rail, Middle Rail and Inner Rail (Left Rail Assembly Shown)

Releasing the Inner Rail

Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing.

To mount the rail onto the chassis, first release the inner rail from the outer rails.

1. Pull the inner rail out of the outer rail until it is fully extended as illustrated below.
2. Press the locking tab down to release the inner rail.
3. Pull the inner rail all the way out.

Diagram illustrating three-step assembly of a mechanical component with labeled parts and directional arrows

Figure 2-2. Extending and Releasing the Inner Rail

Installing the Inner Rails

Begin the rack mounting procedure by installing the inner rails to the chassis.

1. Identify the left and right inner rails. They are labeled.
2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
3. Slide the inner rail forward toward the front of the chassis and under the hooks until the quick release bracket snaps into place, securing the rail to the chassis.
4. If desired, secure the rail with a locking screw.

Inner Rails 2 3 Quick Release Locking Bracket

Figure 2-3. Installing the Rails

Installing the Outer Rails onto the Rack

1. Press upward on the locking tab at the rear end of the middle rail.
2. Push the middle rail back into the outer rail.
3. Hang the hooks on the front of the outer rail onto the square holes on the front of the rack. If desired, use screws to secure the outer rails to the rack.
4. Pull out the rear of the outer rail, adjusting the length until it just fits within the posts of the rack.
5. Hang the hooks of the rear section of the outer rail onto the square holes on the rear of the rack. Take care that the proper holes are used so the rails are level. If desired, use screws to secure the rear of the outer rail to the rear of the rack.
6. Repeat for the other outer rail.

Technical diagram illustrating four stages of a mechanical assembly with labeled components and directional arrows indicating motion or movement.

Figure 2-4. Extending and Mounting the Outer Rails

Warning: Do not pick up the server with the front handles. They are designed to pull the system from a rack only.

Adapters for Round and Threaded Hole Racks

The chassis includes adapter brackets for those customers using round hole racks or racks with threaded holes size M5 or larger.

Installing the Outer Rails with Adapter Brackets

1. Place the hooks of the front of the outer rail into the square holes of one of the adapter brackets.
2. Place the hooks of the rear of the outer rail into the square holes of a second adapter bracket.
3. Adjust the length of the outer rail to fit within the rack uprights.
4. Secure the front adapter bracket to the front of the rack using the screws recommended by the rack manufacturer.
5. Secure the rear adapter bracket to the rear of the rack in the same manner.

2.4 Installing the Chassis into a Rack

After the rails are installed on the chassis and on the rack, the server can be installed in the rack. It is heavy and requires two to three people or a lift.

Installing the Chassis into a Rack

1. Pull both middle rails out the front of the outer rail until each clicks to a stop.
2. Align the inner rails on the chassis with the front of the middle rails.
3. Slide the inner rails on the chassis into the middle rails, keeping the pressure even on both sides. When partially in, the locking levers will stop further progress.
4. Press down the locking levers on the inside of the inner rails and push the chassis all the way into the rear of the rack. The front latches will click into place.

Ball-Bearing Shuttle, pull to front Note: F purpose may dif into rac

Note: Figures are for illustrative purposes only. Your actual chassis may differ. Always install servers into racks from the bottom up.

Figure 2-5. Installing the Chassis into the Rack

Warning: When initially installing the server to a rack, test that the rail locking tabs engage to prevent the server from being overextended. Have a rack lift in place as a precaution in case the test fails.

Removing the Chassis from the Rack

Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack. Use a lift.

1. Lift the release levers and pull the chassis out the front of the rack until it stops.
2. Press the release latches on each of the inner rails downward simultaneously and continue to pull the chassis completely out of the rack.

1 Release Levers 2

Figure 2-6. Removing the Chassis From the Rack

Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

Slide rail mounted equipment is not to be used as a shelf or a work space.

2.5 Optional Quick Installation Method

The following quick installation method may be used to install the chassis to a rack. Installing the Chassis into a Rack

1. Install the whole rail assembly into the rack in a manner similar to that described in the previous section, "Installing the Outer Rails onto the Rack."
2. Fully extend the inner rails.
3. Using a lift, carefully align the chassis between the inner rails.
4. Install the inner rails on the chassis in a manner similar to that described in the previous section, "Installing the Inner Rails."

2.6 Installing the Cable Management Arm

The SC946L chassis supports a cable management arm (CMA) that keeps the rear cables organized and clear of the rail mechanisms when the system is extended out the front of the rack for maintenance. The kit includes six fabric Velcro cable ties.

The CMA attaches to the rack mounting rails by means of four connectors. They are labeled on the connectors 1, 2, 3, and 4.

1 2 3 4 Six Velcro Straps

Figure 2-7. Cable Management Arm and Velcro Straps

Installing the Cable Management Arm

1. Slide CMA connector #1 forward onto the two posts on the rear of the right inner rail (right side when viewed from the front). It snaps into place.
2. Slide CMA connector #2 forward onto the two posts on the rear of the right middle rail. It snaps into place.

Chassis Front 1 2

Figure 2-8. Installing the Connectors 1 and 2

1. Slide CMA connector #3 forward onto the two posts on the rear of the left middle rail. It snaps into place.

2. For CMA connector #4, align the metal tabs with the slots on the rear of the left outer rail and push it forward. It snaps into place.

Chassis Front ③ ④

Figure 2-9. Intalling the Connectors 3 and 4

Chassis Front ⑤

Figure 2-10. Routing the Cables

1. Open the four red plastic caps and route the cables into the wire carrier.
2. If necessary, adjust the U-brackets to clear chassis components.

Chassis Front 6

Figure 2-11. Adjusting the U-Brackets

1. Use the six Velcro straps to secure the cables to the CMA. Use a strap on either side of each joint and one on each U-bracket, inserting it through the slot on the bracket.
2. Slide the chassis forward and backward in the rack to confirm that the cable management arm is operating smoothly. If necessary, loosen the straps for smoother movement.

If at some time you must remove the cable management arm, follow this procedure. Removing the Cable Management Arm

1. Remove cables from the CMA, releasing the Velcro straps and the red plastic caps.
2. For CMA connector #4, pull the metal release tab toward the center of the rack and slide the connector toward the rear to release it.
3. For CMA connectors #3, #2, and #1, depress the front edge of the yellow plastic rocker lock, and slide the connector toward the rear to release it.

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components require that power first be removed from the system. Please follow the procedures given in each section.

3.1 Removing Power

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non hot-swap components or when replacing a non-redundant power supply.

1. Use the operating system to power down the system.
2. After the system has completely shut-down, disconnect the AC power cord(s) from the power strip or outlet. (If your system has more than one power supply, remove the AC power cords from all power supply modules.)
3. Disconnect the power cord(s) from the power supply module(s).

3.2 Accessing the System

Accessing the Motherboard

After the system is assembled by the manufacturer, the motherboard tray can be extended no more than two inches, due to the internal cabling. Only approved Supermicro technicians should remove the tray.

To install or replace components, such as PCI expansion cards or memory, open the storage compartment cover, remove any fans that are in the way, and possibly remove the small top cover/air shroud assembly. Fan removal is described later in this chapter.

Accessing the Storage Drives

To access the storage drives, pull the system out of the rack, remove the two thumb screws on the right side of the chassis and lift. The cover is designed to open about 100 degrees and support itself in that position.

Caution: Except for short periods of time, do not operate the server without the cover in place. The chassis cover must be in place to allow for proper airflow and to prevent overheating.

Thumb Screws

Figure 3-1. Opening the Storage Compartment Cover

Removing the Small Top Cover/Air Shroud Assembly

1. Open the storage compartment cover.
2. Remove both power supply modules.
3. Remove the thumb screw midway on the right side of the chassis.
4. Lift off the cover.

Small Top Cover/ Air Shroud Thumb Screw

Figure 3-2. Removing the Small Top Cover/Air Shroud Assembly

3.3 Motherboard Components

Processor and Heatsink Installation

This server is sold with the CPU and heatsink installed. Only approved Supermicro technicians should perform maintenance.

Memory

Memory Support

The storage server supports up to 512GB of RDIMM, 1TB of LRDIMM, and 2TB of 3DS LRDIMM DDR4 (288-pin) ECC memory with speeds of up to 2933MHz in eight memory slots. Memory speed is dependent on the processor model. Note: 2933MHz memory speed is supported by 82xx/62xx processors only.

• Only populate DIMMA2 and DIMMD2 if the extra memory support is needed.
  • Always use DDR4 DIMM modules of the same type, size and speed.
• Mixed DIMM speeds can be installed. However, all DIMMs will run at the speed of the slowest DIMM.

DDR4 Memory Support for 81xx/61xx/51xx/41xx/31xx Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)		Speed (MT/s)
				One Slot per Channel	Two Slots per Channel
		DRAM Density		One DIMM per Channel	One DIMM per Channel	Two DIMMs per Channel
		4 Gb 8 Gb 1.2 Volts 1.2 Volts 1.2 Volts
RDIMM	SRx4 4 GB	8 GB		2666 2666 2666
	SRx8 8 GB	16 GB
	DRx8 8 GB	16 GB
	DRx4 16 GB	32 GB
RDIMM 3Ds	QRX4 N/A	2H-64GB
	8RX4 N/A	4H-128GB
LRDIMM QRx4	32 GB 64 GB
LRDIMM 3Ds	QRx4 N/A	2H-64GB
	8Rx4 N/A	4H-128 GB

DDR4 Memory Support for 82xx/62xx/52xx/42xx/32xx Processors
Type	Ranks Per DIMM and Data Width	DIMM Capacity (GB)			Speed (MT/s)
					One Slot per Channel	Two Slots per Channel
		DRAM Density			One DIMM per Channel	One DIMM per Channel	Two DIMMs per Channel
		4 Gb 8	Gb 16 Gb 1	2 Volts 1.2 Volts	Volts 1.2 Volts
RDIMM	SRx4 4 GB	8 GB 16 GB			2933* 2933* 2666
	SRx8 8 GB	16 GB	32 GB
	DRx8 8 GB	16 GB	32 GB
	DRx4 16 GB	32 GB	64 GB
RDIMM 3Ds	QRX4 N/A	2H-64GB	2H-128GB
	8RX4 N/A	4H-128GB	4H-256GB
LRDIMM QRx4	32 GB	64 GB	128 GB
LRDIMM 3Ds	QRx4	N/A 2H-	64GB 2H-64GB
	8Rx4	N/A 4H-	128 GB	4H-256 GB

* Only the 82xx and 62xx series support 2933 MT/s

Check the Supermicro website for possible updates to memory support.

Memory Population Guidelines

• All DIMMs must be DDR4.
• Balance memory. Using unbalanced memory topology, such as populating two DIMMs in one channel while populating one DIMM in another channel, reduces performance. It is not recommended for Supermicro systems.
  Guidelines Regarding Mixing DIMMs
• Populating slots with a pair of DIMM modules of the same type and size results in interleaved memory, which improves memory performance.
• Use memory modules of the same type and speed, as mixing is not allowed.
• x4 and x8 DIMMs can be mixed in the same channel.
• Mixing of LRDIMMs and RDIMMs is not allowed in the same channel, across different channels, and across different sockets.
• Mixing of non-3DS and 3DS LRDIMM is not allowed in the same channel, across different channels, and across different sockets.

DIMM Construction

• RDIMM (non-3DS) Raw Cards: A/B (2Rx4), C (1Rx4), D (1Rx8), E (2Rx8)
  • 3DS RDIMM Raw Cards: A/B (4Rx4)
  • LRDIMM (non-3DS) Raw Cards: D/E (4Rx4)
  • 3DS LRDIMM Raw Cards: A/B (8Rx4)

Memory Population Sequence

Blue slots versus black slots: Install the first DIMM in the blue memory slot, which is the first of a memory channel. Then, if using two DIMMs per channel, install the second DIMM in the black slot.

The following memory population sequence table was created based on guidelines provided by Intel to support Supermicro motherboards. The diagram is for illustrative purposes; your motherboard may look different.

Memory Module Installation

When installing memory modules, the DIMM slots should be populated in the following order:

Memory Population for up to Eight DIMM Slots
Number of DIMMs Memory Population Sequence
1 DIMMA1
2 DIMMA1/DIMMD1
3 DIMMC1/DIMMB1/DIMMA1
4 DIMMB1/DIMMA1/DIMMD1/DIMME1
5* DIMMC1/DIMMB1/DIMMA1/DIMMD1/DIMME1
6 DIMMC1/DIMMB1/DIMMA1/DIMMD1/DIMME1/DIMMF1
7* DIMMC1/DIMMB1/DIMMA1/DIMMA2/DIMMD1/DIMME1/DIMMF1
8 DIMMC1/DIMMB1/DIMMA1/DIMMA2/DIMMD2/DIMMD1/DIMME1/DIMMF1

*Unbalanced, not recommended.

Note: The motherboard supports installing an odd number of DIMM modules (1, 3, etc.). However, installing modules in pairs provides best memory performance.

ASpeed AST2500 LED8MC CPU SLOT2 PC1E 3.0 X(IN X6) CPU SLOT4 PC1E 3.0 X(IN X6) CPU SLOT7 PC1E 3.0 X8 CPU SLOT5 PC1E 3.0 X8 CPU SLOT6 PC1E 3.0 X8(NX16) CPU SLOT7 PC1E 3.0 X8(NX16) CPU SLOT8 PC1E 3.0 X8(NX16) CPU SLOT9 PC1E 3.0 X8(NX16) CPU SLOT10 PC1E 3.0 X8(NX16) CPU SLOT11 PC1E 3.0 X8(NX16) CPU SLOT12 PC1E 3.0 X8(NX16) CPU SLOT13 PC1E 3.0 X8(NX16) CPU SLOT14 PC1E 3.0 X8(NX16) CPU SLOT15 PC1E 3.0 X8(NX16) CPU SLOT16 PC1E 3.0 X8(NX16) CPU SLOT17 PC1E 3.0 X8(NX16) CPU SLOT18 PC1E 3.0 X8(NX16) CPU SLOT19 PC1E 3.0 X8(NX16) CPU SLOT20 PC1E 3.0 X8(NX16) CPU SLOT21 PC1E 3.0 X8(NX16) CPU SLOT22 PC1E 3.0 X8(NX16) CPU SLOT23 PC1E 3.0 X8(NX16) CPU SLOT24 PC1E 3.0 X8(NX16) CPU SLOT25 PC1E 3.0 X8(NX16) CPU SLOT26 PC1E 3.0 X8(NX16) CPU SLOT27 PC1E 3.0 X8(NX16) CPU SLOT28 PC1E 3.0 X8(NX16) CPU SLOT29 PC1E 3.0 X8(NX16) CPU SLOT30 PC1E 3.0 X8(NX16) CPU SLOT31 PC1E 3.0 X8(NX16) CPU SLOT32 PC1E 3.0 X8(NX16) CPU SLOT33 PC1E 3.0 X8(NX16) CPU SLOT34 PC1E 3.0 X8(NX16) CPU SLOT35 PC1E 3.0 X8(NX16) CPU SLOT36 PC1E 3.0 X8(NX16) CPU SLOT37 PC1E 3.0 X8(NX16) CPU SLOT38 PC1E 3.0 X8(NX16) CPU SLOT39 PC1E 3.0 X8(NX16) CPU SLOT40 PC1E 3.0 X8(NX16) CPU SLOT41 PC1E 3.0 X8(NX16) CPU SLOT42 PC1E 3.0 X8(NX16) CPU SLOT43 PC1E 3.0 X8(NX16) CPU SLOT44 PC1E 3.0 X8(NX16) CPU SLOT45 PC1E 3.0 X8(NX16) CPU SLOT46 PC1E 3.0 X8(NX16) CPU SLOT47 PC1E 3.0 X8(NX16) CPU SLOT48 PC1E 3.0 X8(NX16) CPU SLOT49 PC1E 3.0 X8(NX16) CPU SLOT50 PC1E 3.0 X8(NX16) CPU SLOT51 PC1E 3.0 X8(NX16) CPU SLOT52 PC1E 3.0 X8(NX16) CPU SLOT53 PC1E 3.0 X8(NX16) CPU SLOT54 PC1E 3.0 X8(NX16) CPU SLOT55 PC1E 3.0 X8(NX16) CPU SLOT56 PC1E 3.0 X8(NX16) CPU SLOT57 PC1E 3.0 X8(NX16) CPU SLOT58 PC1E 3.0 X8(NX16) CPU SLOT59 PC1E 3.0 X8(NX16) CPU SLOT60 PC1E 3.0 X8(NX16) CPU SLOT61 PC1E 3.0 X8(NX16) CPU SLOT62 PC1E 3.0 X8(NX16) CPU SLOT63 PC1E 3.0 X8(NX16) CPU SLOT64 PC1E 3.0 X8(NX16) CPU SLOT65 PC1E 3.0 X8(NX16) CPU SLOT66 PC1E 3.0 X8(NX16) CPU SLOT67 PC1E 3.0 X8(NX16) CPU SLOT68 PC1E 3.0 X8(NX16) CPU SLOT69 PC1E 3.0 X8(NX16) CPU SLOT70 PC1E 3.0 X8(NX16) CPU SLOT71 PC1E 3.0 X8(NX16) CPU SLOT72 PC1E 3.0 X8(NX16) CPU SLOT73 PC1E 3.0 X8(NX16) CPU SLOT74 PC1E 3.0 X8(NX16) CPU SLOT75 PC1E 3.0 X8(NX16) CPU SLOT76 PC1E 3.0 X8(NX16) CPU SLOT77 PC1E 3.0 X8(NX16) CPU SLOT78 PC1E 3.0 X8(NX16) CPU SLOT79 PC1E 3.0 X8(NX16) CPU SLOT80 PC1E 3.0 X8(NX16) CPU SLOT81 PC1E 3.0 X8(NX16) CPU SLOT82 PC1E 3.0 X8(NX16) CPU SLOT83 PC1E 3.0 X8(NX16) CPU SLOT84 PC1E 3.0 X8(NX16) CPU SLOT85 PC1E 3.0 X8(NX16) CPU SLOT86 PC1E 3.0 X8(NX16) CPU SLOT87 PC1E 3.0 X8(NX16) CPU SLOT88 PC1E 3.0 X8(NX16) CPU SLOT89 PC1E 3.0 X8(NX16) CPU SLOT90 PC1E 3.0 X8(NX16) CPU SLOT91 PC1E 3.0 X8(NX16) CPU SLOT92 PC1E 3.0 X8(NX16) CPU SLOT93 PC1E 3.0 X8(NX16) CPU SLOT94 PC1E 3.0 X8(NX16) CPU SLOT95 PC1E 3.0 X8(NX16) CPU SLOT96 PC1E 3.0 X8(NX16) CPU SLOT97 PC1E 3.0 X8(NX16) CPU SLOT98 PC1E 3.0 X8(NX16) CPU SLOT99 PC1E 3.0 X8(NX16) CPU SLOT9A USB2/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/2/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/4 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 USB4/4/2 SBIMC-PC SBIMB-PC DIMMA-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMMD-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMME-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMI-PC DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI- DIMMCFI-I

Figure 3-3. DIMM Slots on the Motherboard

Caution: Exercise caution when installing or removing memory modules to prevent damage to the DIMMs or slots.

Installing Memory

1. Remove power from the system as described in Section 3.1.

2. Access the motherboard by opening the top storage coompartment cover, remove the small top cover/air shroud assembly, and remove two fans (center fan and one to the right). Fan removal is described later in this chapter.

3. Starting with the slot in the order described previously, push the release tabs outwards on both ends of the DIMM slot to unlock it. You can reach one end from the top through the storage compartment, and the other end through the rear fan openings.

Notches Release Tabs

1. Align the key of the DIMM with the receptive point on the memory slot and with your thumbs on both ends of the module, press it straight down into the slot until the module snaps into place.

Technical illustration of a heat exchanger with cooling fins and a circular arrow indicating airflow direction (no text or symbols)

Press both sides straight down into the memory slot.

1. Press the release tabs to the locked position to secure the DIMM module into the slot.

2. Repeat the procedure for the remaining DIMM modules in the order detailed in the previous section.

To remove a DIMM module, unlock the release tabs then pull the module from the slot.

Installing Expansion Cards

The system can accommodate six PCI-E 3.0 expansion cards.

• One x4 (in x8) in slot 1
• Three x8 in slots 2, 3, and 5
- Two x8 (in x16) in slots 4 and 6

Slot 7 is taken by AOC-S3108-H8IR or AOC-S3008-S3008L-L8E SAS HBA card.

Installing an Expansion Card

1. Power down the system as described in Section 3.1.
2. Open the storage compartment top cover.
3. Remove the two-fan housing from the chassis rear (described in later section).
4. Remove the blank PCI shield from the chassis rear.
5. Plug the expansion card into the PCI slot on the motherboard while fitting card bracket into the rear chassis slot.
6. Secure the expansion card bracket into the chassis slot with a screw.
7. Replace the fans and covers.

Technical line drawing of an internal computer drive bay with visible circuit boards, RAM slots, and ventilation ducts (no text or labels)

Figure 3-4. Motherboard Tray (shown without chassis for illustration only)

Motherboard Battery

The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard.

Replacing the Battery

Begin by removing power from the system as described in section 3.1.

1. Push aside the small clamp that covers the edge of the battery. When the battery is released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+) side facing up. Then push the other side down until the clamp snaps over it.

Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

LITHIUM BATTERY BATTERY HOLDER

Figure 3-5. Installing the Onboard Battery

Warning: There is a danger of explosion if the onboard battery is installed upside down (which reverses its polarities). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).

3.4 Chassis Components

Storage Drives

The storage server supports forty-five 3.5" hot-swap drives as main storage. Optionally, 2.5" drives can be used with adapters (included). In addition, it supports two sets of two 2.5" hot-swap drives at the chassis rear—two SATA and an option for two NVMe. All drives are mounted in tool-less carriers to simplify their removal. These carriers also help promote proper airflow.

Drive Carrier Indicators

Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare. For VROC configurations, refer to the VROC appendix in this manual.

Drive Carrier LED Indicators
	Color Blinking Pattern Behavior for Device
Activity LED	Blue Solid On SAS/NVMe drive installed
	Blue Blinking I/O activity
Status LED	Red Solid On Failure of drive with RSTe support
	Red Blinking at 1 Hz Rebuild drive with RSTe support
	Red Blinking with two blinks and one stop at 1 Hz		Hot spare for drive with RSTe support (not supported in VMD mode)
	Red On for five seconds, then off		Power on for drive with RSTe support
	Red Blinking at 4 Hz Identify drive with RSTe support
	Green Solid On Safe to remove NVMe device (not supported in VMD mode)
	Amber Blinking at 1 Hz		Attention state—do not remove NVMe device (not supported in VMD mode)

Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, see the Supermicro website, http://www.supermicro.com/products/nfo/files/storage/SBB-HDDCompList.pdf.

Caution: When shipping the system, remove the drives from the chassis for travel, whether the chassis is shipped alone or in a rack. The original Supermicro packaging includes boxes for the drives in carriers.

Adding or Replacing Main Storage Drives

Removing a Hard Drive Carrier from the Storage Compartment

1. Open the storage compartment cover.
2. Begin removing hard drives from the center, working out to the outer drives. Slide the release button on the drive carrier, which opens the carrier handle.
3. Use the handle to pull the drive carrier up and out.

Caution: Except for short periods of time, such as while swapping hard drives, do not operate the server with the drive carriers removed from the bays. Even empty carriers help promote airflow.

3 Drive Carrier Handle Release Button

Figure 3-6. Removing a Hard Drive Carrier

Installing a 3.5" Storage Drive

With the drive carrier removed from the storage compartment:

1. Under the main carrier handle, find and the lift the breakout lever and pull out the side of the carrier.

Carrier Breakout Lever release Pull Out Side of Carrier Alignment Pins Notch for Connectors

Figure 3-7. Opening the Drive Carrier

1. Remove the dummy drive from the carrier.
2. Insert the hard drive into the drive carrier. Orient the drive by matching the two alignment pins on the side and by noting the notch in the carrier for the drive connectors. Close the side of the carrier until it snaps in place.
3. Slide the carrier assembly into its spot in the chassis until it clicks into locked position.

Hot-Swap for NVMe Drives

Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using IPMI.

Note: If you are using VROC, see the VROC appendix in this manual instead.

Ejecting a Drive

1. IPMI > Server Health > NVMe SSD
2. Select Device, Group and Slot, and click Eject. After ejecting, the drive Status LED indicator turns green.
3. Remove the drive.

Note that Device and Group are categorized by the CPLD design architecture. The 5049P-E1CR45(L/H) server has one Device and one Group, except the 2029U-TN24 server which has one Device and two Groups.

Slot is the slot number on which the NVMe drives are mounted.

Host Identification Server: 172.031.048.114 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Health Event Log Power Consumption Power Source NVMe SSD NVMe SSD This page displays NVMe SSD information. Locate / Stop Locate SSD Devices:0 Groucp0 Slot:9 Locate Stop Locate Eard CPLD / BPN ID: EF Rev: 10 Slot:0 Status Present Temperature 35 degrees C Vendor ID 80.86 Serial Number BTLF7270687N4P0IGN Model Number INTEL SSDPE2X040T7 Slot:1 Status Present Temperature 33 degrees C Vendor ID 80.86 Serial Number PHLF729690684P0IGN Model Number INTEL SSDPE2X040T7 Slot:2 Copyright © 2016 Topo Micro Computer, Inc.

Figure 3-7a. IPMI Screenshot

Replacing the Drive

1. Insert the replacement drive.
2. IPMI > Server Health > NVMe SSD
3. Select Device, Group and slot and click Insert. The drive Status LED indicator flashes red, then turns off. The Activity LED turns blue.

Checking the Temperature of an NVMe Drive

There are two ways to check using IPMI.

Checking a Drive

• IPMI > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives, as in Figure 3-4.
• IPMI > Server Health > Sensor Reading > NVME_SSD – Shows the single highest temperature among all the NVMe drives.

Storage Drives at the Chassis Rear

There is room for two sets of two hot-swap 2.5" drives in the rear of the chassis. The pair at the top of the chassis supports SATA; the optional pair at the bottom supports NVMe.

SATA Rear Bays NVMe Rear Bays

Figure 3-8. Drives at Chassis Rear

Installing 2.5" Drives at the Chassis Rear

1. Press the release button and the carrier lever pops out. Pull out the carrier by the lever.
2. Remove the dummy drive and insert drive into the carrier.
3. Push the carrier assembly into the bay until it clicks into place.

Dummy Drive Carrier Lever Release Button Hard Drive Carrier

Figure 3-9. Removing the Carrier and Dummy Drive

Fans

The system has five hot-swap 8-cm exhaust fans accessible from the rear of the chassis. They can be removed or replaces individually by pinching the top and bottom release tabs. One or two fans should be removed to install or replace memory or PCI expansion cards.

Fan speed is controlled by a system temperature setting in IPMI. If a fan fails, the remaining fans will ramp up to full speed, and the system can continue to operate. Replace any failed fan at your earliest convenience with the same type and model.

Removing or Replacing a System Fan

1. While the system is running, examine the fans to determine which fan has failed.
2. Pinch together the upper and lower release tabs and pull the fan out of the bay.

Release Tabs

Figure 3-10. Fan Release Tabs

Caution: Fans will continue to rotate for a brief time after removing them from the chassis. To avoid injury, keep fingers clear of the rotating fan blades.

1. Slide the new fan into the vacant bay. Confirm that the fan is fully seated in the bay and functioning.

Removing the Dual Fan Housing

The housing should be removed to install PCI expansion cards. Remove the two thumb screws and pull the housing.

Thumb Screws

Figure 3-11. Removing the Dual Fan Housing

Checking the Server Air Flow

• Make sure there are no objects to obstruct airflow in and out of the server.
- Do not operate the server for long without drive carriers in the drive bays.
• Use only recommended server parts.
- Make sure no wires or foreign objects obstruct air flow through the chassis. Pull all excess cabling out of the airflow path or use shorter cables.

The control panel LEDs display system heat status. See "Control Panel" in Chapter 1 for details.

Power Supply Modules

The chassis features redundant power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors.

The power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 100-120v or 180-240v. An amber light will be illuminated on the power supply when the power is off. An illuminated green light indicates that the power supply is operating.

Replacing the Power Supply

1. Unplug the AC cord from the module to be replaced.

2. Push the release tab on the back of the power module as illustrated.

Release Tab

Figure 3-12. Replacing the Power Supply Module

1. Pull the power module out using the handle provided.

2. Push the new power module into the bay until it clicks into place.

3. Plug the AC power cord back into the module.

Chapter 4

Motherboard Connections

This section describes the connections on the motherboard and provides pinout definitions.

Note that depending on how the system is configured, not all connections are required.

The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.

Please review the Safety Precautions in Appendix B before installing or removing components.

4.1 Power Connections

Two power connections on the X11SPL-F must be connected to the power supply. The wiring is included with the power supply.

• 24-pin Primary ATX Power (JPWR2)
• 8-pin Processor Power (JPWR1)

Main ATX Power Connector

The primary power connector (JPWR2) meets the ATX SSI EPS 24-pin specification. You must also connect the 8-pin (JPWR1) processor power connector to your power supply (see below).

ATX Power 24-pin Connector Pin Definitions
Pin# Definition Pin# Definition
13 +3.3V 1 +3.3V
14 -12V 2 +3.3V
15 COM 3 COM
16 PS_ON 4 +5V
17 COM 5 COM
18 COM 6 +5V
19 COM 7 COM
20 Res (NC) 8 PWR_OK
21 +5V 9 5 VSB
22 +5V 10 +12V
23 +5V 11 +12V
24 COM 12 +3.3V

Required Connection

Important: To provide adequate power to the motherboard, connect the 24-pin and the 8-pin power connectors to the power supply. Failure to do so may void the manufacturer's warranty on your power supply and motherboard.

Processor Power Connector

JPW1 must also be connected to the power supply. This connector is used to power the processor(s).

Required Connection

4.2 Headers and Connectors

Fan Headers

There are 4-pin fan headers (FAN1–FAN5, FANA,FANB) on the motherboard. These are 4-pin fan headers; pins 1-3 are backward compatible with traditional 3-pin fans. The onboard fan speeds are controlled by Thermal Management via IPMI. When using Thermal Management setting, please use all 3-pin fans or all 4-pin fans.

Fan Header Pin Definitions
Pin#	Definition
1 Ground (Black)
2 +12V (Red)
3 Tachometer
4 PWM Control

SGPIO Headers

The two SGPIO (Serial General Purpose Input/Output) headers are used to communicate with the enclosure management chip on the backplane.

SGPIO HeaderPin Definitions
Pin# Definition Pin# Definition
1 NC 2 NC
3 Ground 4 DATA	Out
5 Load 6 Ground
7 Clock 8 No connection

Disk-On-Module Power Connector

Two power connectors for SATA DOM (Disk-On-Module) devices are located at JSD1/JSD2. Connect appropriate cables here to provide power support for your Serial Link DOM devices.

DOM Power Pin Definitions
Pin# Definition
1 5V
2 Ground
3 Ground

TPM/Port 80 Header

A Trusted Platform Module (TPM)/Port 80 header is located at JTPM1 to provide TPM support and Port 80 connection. Use this header to enhance system performance and data security. Use the following link for more information on the TPM: http://www.supermicro.com/manuals/other/TPM.pdf.

Trusted Platform Module HeaderPin Definitions
Pin# Definition Pin# Definition
1 +3.3V 2 SPI_CS#
3 RESET# 4 SPI_MISO
5 SPI_CLK 6 GND
7 SPI_MOSI 8
9 +3.3V Stdby 10 SPI_IRQ#

M.2 Slot

M.2 is formerly known as Next Generation Form Factor (NGFF). The M.2 slot is designed for internal mounting devices. The X11SPL-F motherboard deploys an M key dedicated for SSD devices with the ultimate performance capability in a PCI-Express 3.0 x4 interface for native PCI-E SSD support. It can also support SATA devices.

Standby Power

The Standby Power header is located at JSTBY1 on the motherboard. You must have a card with a Standby Power connector and a cable to use this feature.

Standby Power Pin Definitions
Pin# Definition
1 +5V	Standby
2 Ground
3 No Connection

Internal Speaker/Buzzer

The Internal Speaker/Buzzer (SP1) is used to provide audible indications for various beep codes.

Internal BuzzerPin Definitions
Pin# Definition
1 Pos	(+) Beep In
2 Neg	(-) Alarm Speaker

Power SMBus (I²C) Header

The Power System Management Bus (I²C) connector (JPI²C1) monitors the power supply, fan, and system temperatures.

Power SMB HeaderPin Definitions

Pin# Definition

1 Clock

2 Data

3 PMBUS_Alert

4 Ground

5 +3.3V

4-pin BMC External I²C Header

A System Management Bus header for IPMI 2.0 is located at JIPMB1. Connect the appropriate cable here to use the IPMB I ^2 C connection on your system.

External I2C Header Pin Definitions
Pin#	Definition
1	Data
2	Ground
3	Clock
4	No Connection

Chassis Intrusion

A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable from the chassis to inform you of a chassis intrusion when the chassis is opened.

Chassis Intrusion Pin Definitions

Pin# Definition

1 Intrusion Input

2 Ground

NVMe I²C Header

Connector JNVI ^2 C1 is a management header for the Supermicro AOC NVMe PCI-E peripheral cards. Connect the I ^2 C cable to this header.

VRM SMBus Header

JVRM1 is a voltage regulator module (VRM) SMBus header. Use this header to program the CPU and memory VRM controllers.

Power LED/Speaker

Pins 1-3 of JD1 are used for power LED indication, and pins 4-7 are for the speaker. Please note that the speaker connector pins (4-7) are used with an external speaker. If you wish to use the onboard speaker, you should close pins 6-7 with a cap. Refer to the tables below for pin definitions.

PWR LED Connector Pin Definitions

Pin# Signal

1 JD1_PIN1

2 FP_PWR_LED

3 FP_PWR_LED

Speaker Connector Pin Definitions
Pin# Signal
4 P5V
5 Key
6 R_SP	KPIN_N
7 R_SP	KPIN

Overheat/Fan Fail LED Header

The JOH1 header is used to connect an LED indicator to provide warnings of chassis overheating and fan failure. This LED will blink when a fan failure occurs. Refer to the tables below for pin definitions.

Overheat LED header Status

State Definition

Solid Overheat

Blinking Fan Fail

Overheat LEDPin Definitions
Pin# Signal
1	Pull high to +3.3Vpower through 330-ohm resistor
2 OH Active

SATA Ports

The X11SPL-F has eight SATA 3.0 ports (I-SATA0 \~ I-SATA7) supported by the Intel PCH C621 chipset. These SATA ports support RAID 0, 1, 5, and 10. SATA ports provide serial-link signal connections, which are faster than the connections of Parallel ATA. Refer to the table below for pin definitions.

Note: Supermicro SuperDOMs are yellow SATADOM connectors with power pins built in and do not require separate external power cables. These connectors are backwards compatible with non-Supermicro SATADOMS that require an external power supply.

Intel RAID Key Header

A RAID Key header is located at JRK1 on the motherboard. It supports VMD used in creating optional advanced NVMe RAID configurations.

Intel RAID KeyPin Definitions
Pin#	Definition
1	Ground
2 +3.3	V Standby
3	Ground
4	PCH RAID key

Control Panel

JF1 contains header pins for various control panel connections. See the figure below for the pin locations and definitions of the control panel buttons and LED indicators.

All JF1 wires have been bundled into a single cable to simplify this connection. The red wire plugs into pin 1 as marked on the motherboard. The other end connects to the control panel PCB board.

(Ground) Key Power On LED (Control signal) HDD LED (Activity signal) NIC1 LED (Ground) NIC2 LED (Ground) OH/Fan Fail LED (Ground) Power Fail LED (Ground) (Ground) (Ground) NMI (Control signal) Key (5V standby) (Vcc) (Vcc) (Vcc) (Vcc) Reset Button (Data signal) Power Button (Data signal)

Figure 4-1. JF1 Control Panel Pins

Power Button

The Power Button connection is located on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system. This button can also be configured to function as a suspend button (with a setting in the BIOS - see Chapter 7). To turn off the power when the system is in suspend mode, press the button for 4 seconds or longer.

Power Button Pin Definitions (JF1) Pin# Definition 1 Signal 2 Ground

Reset Button

The Reset Button connection is located on pins 3 and 4 of JF1. Attach it to a hardware reset switch on the computer case.

Reset Button Pin Definitions (JF1)

Pin# Definition

3 Reset

4 Ground

Power Fail LED

The Power Fail LED connection is located on pins 5 and 6 of JF1.

Power Fail LEDPin Definitions (JF1)
Pin# Definition
5 3.3V
6 PWR Supply Fail

Overheat (OH)/Fan Fail

Connect an LED cable to pins 7 and 8 of JF1 to use the Overheat/Fan Fail LED connections. The LED on pin 8 provides warnings of overheat or fan failure.

OH/Fan Fail Indicator Status
Status Definition
Off	Normal
On	Overheat
Flashing	Fan Fail

OH/Fan Fail LEDPin Definitions (JF1)
Pin# Definition
7 Blue	LED
8 OH/Fan Fail LED

The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11 and 12 of JF1, and the LED connection for LAN Port 2 is on Pins 9 and 10. Attach the NIC LED cables here to display network activity.

LAN1/LAN2 LEDPin Definitions (JF1)
Pin#	Definition
9	NIC2 Activity LED
10	NIC2 Link LED
11	NIC1 Activity LED
12	NIC1 Link LED

HDD LED/UID Switch

The HDD LED/UID Switch connection is located on pins 13 and 14 of JF1. Attach a cable to Pin 14 to show hard drive activity status. Attach a cable to Pin 13 to use UID switch. Refer to the table below for pin definitions.

HDD LEDPin Definitions (JF1)

Pin# Definition

13 3.3V Standby/UID Switch

14 HDD Active

Power LED

The Power LED connection is located on pins 15 and 16 of JF1.

Power LEDPin Definitions (JF1)

Pin# Definition

15 3.3V

16 Power LED

NMI Button

The non-maskable interrupt button header is located on pins 19 and 20 of JF1.

NMI ButtonPin Definitions (JF1)

Pin# Definition

19 Control

20 Ground

4.3 Input/Output Ports

Diagram showing 10 labeled network device ports and connectors, including VGA, Ethernet, and GNDs with numbered labels.

Figure 4-2. Rear I/O Ports

# Description # Description
1 COM Port 1 6 USB8 (3.0)
2 Dedicated IPMI LAN 7 LAN1
3 USB1 (2.0) 8 LAN2
4 USB0 (2.0) 9 VGA Port
5 USB9 (3.0) 10 UID Switch/LED

LAN Ports

There are two LAN ports and a dedicated IPMI LAN port. See the LED Indicator section for more information.

Universal Serial Bus (USB) Ports

There are two USB 2.0 ports (USB0/1) and two USB 3.0 ports (USB8/9) located on the I/O back panel.

Unit Identifier Switch/LED Indicator

The UID switch/LED is described in the LED Indicator section of this chapter.

4.4 Jumpers

Explanation of Jumpers

To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

Note: On a two-pin jumper, "Closed" means the jumper is on both pins and "Open" indicates the jumper is either on only one pin or has been completely removed.

Connector Pins Jumper Setting 3 2 1 ● ● ■ 3 2 1

CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system and unplug the power cord(s).
2. Remove the cover of the chassis to access the motherboard.
3. Remove the onboard battery from the motherboard.
4. Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds.
5. Remove the screwdriver (or shorting device).
6. Replace the cover, reconnect the power cord(s) and power on the system.

Notes: Clearing CMOS will also clear all passwords.

Do not use the PW_ON connector to clear CMOS.

JBT1 contact pads

Watch Dog

Watch Dog (JWD1) is a system monitor that can reboot the system when a software application hangs. Close pins 1-2 to reset the system if an application hangs. Close pins 2-3 to generate a non-maskable interrupt (NMI) signal for the application that hangs. The Watch Dog must also be enabled in the BIOS.

Watch DogJumper Settings
Jumper Setting Definition
Pins 1-2 Reset
Pins 2-3 NMI
Open Disabled

VGA Enable/Disable

Jumper JPG1 allows the user to enable the onboard VGA connector. The default setting is pins 1-2 to enable the connection.

VGA Enable/Disable Jumper Settings
Jumper Setting Definition
Pins 1-2 Enabled
Pins 2-3 Disabled

ME Manufacturing Mode

Close pins 2-3 of jumper JPME2 to bypass SPI flash security and force the system to operate in the manufacturing mode, which will allow the user to flash the system firmware from a host server for system setting modifications. Refer to the table below for jumper settings. The default setting is Normal.

Manufacturing ModeJumper Settings
Jumper Setting Definition
Pins 1-2 Normal
Pins 2-3 Manufacturing Mode

LAN1/LAN2 Enable/Disable

Jumpers JPL1 and JPL2 enables or disables LAN ports 1 and 2 on the motherboard. See the table below for jumper settings. The default setting is enabled.

LAN EnableJumper Settings
Jumper Setting	Definition
Pins 1-2 Enabled (default)
Piins 2-3 Disabled

4.5 LED Indicators

LAN LEDs

The LAN ports are located on the I/O back panel on the motherboard. Each Ethernet LAN port has two LEDs. The yellow LED indicates activity. Link LED, located on the left side of the LAN port, may be green, amber or off indicating the speed of the connection.

Link LED LAN 1/2 Activity LED

LAN1 Link IndicatorLED Settings
LED Color	Definition
Off No Connection, 10 or 100 Mbps
Green 10 Gbps
Amber 1 Gbps

IPMI LAN LEDs

In addition to LAN1 and LAN2, an IPMI LAN is also located on the I/O back panel. The amber LED on the right indicates activity, while the LED on the left indicates the speed of the connection.

IPMI LAN Activity LEDLink LED

LAN1 Link IndicatorLED Settings
LED Color	Definition
Green 100	Mbps
Amber 1 Gbps

M.2 LED

An M.2 indicator (LE3) blinks green when M.2 is functioning normally.

BMC Heartbeat LED

A BMC Heartbeat LED (LEDBMC) blinks green when the BMC is functioning normally.

Onboard Power LED

The Onboard Power LED (LEDPWR) shows solid green when the system is on and blinks green in suspend mode.

Unit Identifier Switch/Rear LED Indicator

A Unit Identifier (UID) switch and the included LED Indicator are located on the I/O back panel. The UID switch toggles the LED indicator on the rear panel and on the front control panel. This provides easy identification of a unit in a rack of many.

Note: The UID indicator can also be triggered using IPMI. For more information on IPMI, please refer to the IPMI User's Guide posted on our website at http://www.supermicro.com.

Chapter 5

Software

After the hardware has been installed, you can install the Operating System (OS), configure RAID settings and install the drivers.

5.1 Microsoft Windows OS Installation

If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals.

Installing the OS

1. Create a method to access the MS Windows installation ISO file. That might be a DVD, perhaps using an external USB/SATA DVD drive, or a USB flash drive, or the IPMI KVM console.
2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
3. Boot from a bootable device with Windows OS installation. You can see a bootable device list by clicking F11 during the system startup.

Please select boot device: ATEN Virtual CDROM YSOJ → IPMI virtual drive (Legacy) ASUS SDRW-08D2S-U F601 → USB DVD device (Legacy) USB FLASH DRIVE PMAP → USB flash drive with OS installation (Legacy) IBA 40-10G Slot 1900 v1060 → PXE boot (Legacy) UEFI: ATEN Virtual CDROM YSOJ → IPMI virtual drive (UEFI) UEFI: ASUS SDRW-08D2S-U F601 → USB DVD device (UEFI) UEFI: Built-in EFI Shell Enter Setup ↑ and ↓ to move selection ENTER to select boot device ESC to boot using defaults

Figure 5-1. Select Boot Device

1. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on "Load driver" link at the bottom left corner.

Where do you want to install Windows? Name Total size Free space Type Refresh Delete Format New Load driver Extend We couldn't find any drives. To get a storage driver, click Load driver. Next

Figure 5-2. Load Driver Link

To load the driver, browse the USB flash drive for the proper driver files.

• For RAID, choose the SATA/sSATA RAID driver indicated then choose the storage drive on which you want to install it.

• For non-RAID, choose the SATA/sSATA AHCI driver indicated then choose the storage drive on which you want to install it.

• Once all devices are specified, continue with the installation.

• After the Windows OS installation has completed, the system will automatically reboot multiple times.

5.2 Driver Installation

The Supermicro website contains drivers and utilities for your system at https://www.supermicro.com/wftp/driver. Some of these must be installed, such as the chipset driver.

After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash drive or a DVD. (You may also use a utility to extract the ISO file if preferred.)

Another option is to go to the Supermicro website at http://www.supermicro.com/products/. Find the product page for your motherboard, and "Download the Latest Drivers and Utilities". Insert the flash drive or disk and the screenshot shown below should appear.

SUPERMICRO X11SPL-F Motherboard Drivers & Tools (Win7) Intel Chipset INF Files Microsoft .Net Framework 4.5.2 (Optional) ASPEED Graphics Driver Intel Rapid Storage Technology Enterprise Intel USB 3.0 Drivers Intel PRO Network Connections Drivers SUPERMICRO Computer Inc. SUPERMICRO SuperDoctor 5 Build driver diskatics and manuals Browse CO Auto Start Up Next Time For more information, please visit SUPERMICRO's web site

Figure 5-3. Driver & Tool Installation Screen

Note: Click the icons showing a hand writing on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you must re-boot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire contents.

5.3 SuperDoctor® 5

The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server), you can remotely control power on/off and reset chassis intrusion for multiple systems with SuperDoctor 5 or IPMI. SuperDoctor 5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

Note: The default User Name and Password for SuperDoctor 5 is ADMIN / ADMIN.

SuperDoctor 5 Matherboard: C7B366-CB-ML Voltage 10V 12V 14V 16V 18V 20V 22V 24V 26V 28V 30V 32V 34V 36V 38V 40V 42V 44V 46V 48V 50V 52V 54V 56V 58V 60V 62V 64V 66V 68V 70V 72V 74V 76V 78V 80V 82V 84V 86V 88V 90V 92V 94V 96V 98V 100V 102V 104V 106V 108V 110V 112V 114V 116V 118V 120V 122V 124V 126V 128V 130V 132V 134V 136V 138V 140V 142V 144V 146V 148V 150V 152V 154V 156V 158V 160V 162V 164V 166V 168V 170V 172V 174V 176V 178V 180V 182V 184V 186V 188V 190V 192V 194V 196V 198V 200V 202V 204V 206V 208V 210V 212V 214V 216V 218V 220V 222V 224V 226V 228V 230V 232V 234V 236V 238V 240V 242V 244V 246V 248V 250V 252V 254V 256V 258V 260V 262V 264V 266V 268V 270V 272V 274V 276V 278V 280V 282V 284V 286V 288V 290V 292V 294V 296V 298V 300V

Figure 5-4. SuperDoctor 5 Interface Display Screen (Health Information)

5.4 IPMI

The X11SPL-F supports the Intelligent Platform Management Interface (IPMI). IPMI is used to provide remote access, monitoring and management. There are several BIOS settings that are related to IPMI.

For general documentation and information on IPMI, please visit our website at: http://www.supermicro.com/products/nfo/IPMI.cfm.

Chapter 6

BIOS

6.1 Introduction

This chapter describes the AMI BIOS setup utility for the X11SPL-F and provides the instructions on navigating the setup screens. The BIOS is stored in a Flash EEPROM and can be updated.

Note: Due to periodic changes to the BIOS, some settings may have been added or deleted since this manual was published.

Starting BIOS Setup Utility

To enter the AMI BIOS setup utility screens, press the key while the system is booting up. (There are a few cases when other keys are used, such as , , etc.)

The BIOS screens have three main frames. The large left frame displays options can be configured by the user. These are blue. When an option is selected, it is highlighted in white. Settings printed in Bold are the default values.

In the left frame, a "▶" indicates a submenu. Highlighting such an item and pressing the key opens the list of settings in that submenu.

The upper right frame displays helpful information for the user. The AMI BIOS has default informational messages built in. The manufacturer retains the option to include, omit, or change any of these informational messages.

The lower right frame lists navigational methods. The AMI BIOS setup utility uses a key-based navigation system called hot keys. Most of these hot keys can be used at any time during setup navigation. These keys include , , , , arrow keys, etc.

Some system parameters may be changed.

6.2 Main Setup

When running the AMI BIOS setup utility, it starts with the Main screen. You can always return to it by selecting the Main tab on the top of the screen.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit System Date [Tue 05/16/2017] System Time [09:07:25] Supermicro K11SPL-F BIOS Version 1.0 Build Date 05/04/2017 CPLD Version 02.B1.03 Memory Information Total Memory 32768 MB Set the Date. Use Tab to switch between Date elements. Default Ranges: Year: 2005-2009 Months: 1-12 Days: dependent on month ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

The Main tab page allows you to set the date and time, and it displays system information.

System Date/System Time

Use this option to change the system date and time. Highlight System Date or System Time using the arrow keys. Enter new values using the keyboard. Press the key or the arrow keys to move between fields. The date must be entered in MM/DD/YYYY format. The time is entered in HH:MM:SS format.

Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00. The date's default value is 01/01/2016 after RTC reset.

Supermicro X11SPL-F (Motherboard model)

BIOS Version

Build Date (of the BIOS)

CPLD (Complex Programmable Logic Device) Version: This item displays the CPLD version used in the system.

Memory Information

Total Memory (for the system)

6.3 Advanced Setup Configurations

Use the arrow keys to select the Advanced tab and press to access the submenu items.

Aotio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit ▶ Boot Features ▶ CPU Configuration ▶ Chipset Configuration ▶ Server ME Configuration ▶ PCH SATA Configuration ▶ PCH sSATA Configuration ▶ PCIe/PCI/PnP Configuration ▶ Super IO Configuration ▶ Serial Port Console Redirection ▶ ACPI Settings ▶ Trusted Computing ▶ iSCSI Configuration ▶ Intel(R) Virtual RAID on CFU Boot Feature Configuration Page +: Select Screen I: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit E5G: Exit Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Caution: Take caution when changing the Advanced settings. An incorrect value, a very high DRAM frequency, or an incorrect DRAM timing setting may make the system unstable. If this occurs, revert to the manufacture default settings.

▶Boot Feature

Quiet Boot

Use this feature to select the screen display between the POST messages and the OEM logo upon bootup. Select Disabled to display the POST messages. Select Enabled to display the OEM logo instead of the normal POST messages. The options are Disabled and Enabled.

Option ROM Messages

Use this feature to set the display mode for the Option ROM. Select Keep Current to display the current AddOn ROM setting. Select Force BIOS to use the Option ROM display set by the system BIOS. The options are Force BIOS and Keep Current.

Bootup NumLock State

Use this feature to set the Power-on state for the key. The options are On and Off.

Wait For "F1" If Error

Use this feature to force the system to wait until the "F1" key is pressed if an error occurs. The options are Disabled and Enabled.

INT19 (Interrupt 19) Trap Response

Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Immediate, the ROM BIOS of the host adaptors will "capture" Interrupt 19 at bootup immediately and allow the drives that are attached to these host adaptors to function as bootable disks. If this item is set to Postponed, the ROM BIOS of the host adaptors will not capture Interrupt 19 immediately and allow the drives attached to these adaptors to function as bootable devices at bootup. The options are Immediate and Postponed.

Re-try Boot

If this item is enabled, the BIOS will automatically reboot the system from a specified boot device after its initial boot failure. The options are Disabled, Legacy Boot, and EFI Boot.

Install Windows 7 USB Support

Enable this feature to use the USB keyboard and mouse during the Windows 7 installation since the native XHCI driver support is unavailable. Use a SATA optical drive as a USB drive, and USB CD/DVD drives are not supported. Disable this feature after the XHCI driver has been installed in Windows. The options are Disabled and Enabled.

Port 61h Bit-4 Emulation

Select Enabled to enable the emulation of Port 61h bit-4 toggling in SMM (System Management Mode). The options are Disabled and Enabled.

Power Configuration

Watch Dog Function

If enabled, the Watch Dog Timer will allow the system to reset or generate NMI based on jumper settings when it is expired for more than five minutes. The options are Disabled and Enabled.

Restore on AC Power Loss

Use this feature to set the power state after a power outage. Select Stay Off for the system power to remain off after a power loss. Select Power On for the system power to be turned on after a power loss. Select Last State to allow the system to resume its last power state before a power loss. The options are Stay Off, Power On, and Last State.

Power Button Function

This feature controls how the system shuts down when the power button is pressed. Select 4 Seconds Override for the user to power off the system after pressing and holding the power button for 4 seconds or longer. Select Instant Off to instantly power off the system as soon as the user presses the power button. The options are Instant Off and 4 Seconds Override.

Throttle on Power Fail

Use this feature to decrease system power by throttling CPU frequency when one power supply has failed. The options are Disabled and Enabled.

▶CPU Configuration

The following CPU information will display:

• Processor BSP Revision
• Processor Socket
• Processor ID
• Processor Frequency
• Processor Max Ratio
• Processor Min Ratio
• Microcode Revision
• L1 Cache RAM
• L2 Cache RAM
• L3 Cache RAM
• Processor 0 Version

Hyper-Threading (ALL) (Available when supported by the CPU)

Select Enable to support Intel Hyper-threading Technology to enhance CPU performance. The options are Disable and Enable.

Execute Disable Bit (Available if supported by the OS & the CPU)

Select Enable to enable the Execute-Disable Bit, which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot, thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor or damage the system during an attack. The options are Disable and Enable. (Refer to the Intel® and Microsoft® websites for more information.)

Intel Virtualization Technology

Use feature to enable the Vanderpool Technology. This technology allows the system to run several operating systems simultaneously. The options are Disable and Enable.

PPIN Control

Select Unlock/Enable to use the Protected-Processor Inventory Number (PPIN) in the system. The options are Unlock/Disable and Unlock/Enable.

Hardware Prefetcher (Available when supported by the CPU)

If set to Enable, the hardware prefetcher will prefetch streams of data and instructions from the main memory to the L2 cache to improve CPU performance. The options are Disable and Enable.

Adjacent Cache Prefetch (Available when supported by the CPU)

The CPU prefetches the cache line for 64 bytes if this feature is set to Disabled. The CPU prefetches both cache lines for 128 bytes as comprised if this feature is set to Enable. The options are Enable and Disable.

DCU Streamer Prefetcher (Available when supported by the CPU)

Select Enable to enable the DCU (Data Cache Unit) Streamer Prefetcher which will stream and prefetch data and send it to the Level 1 data cache to improve data processing and system performance. The options are Disable and Enable.

DCU IP Prefetcher (Available when supported by the CPU)

Select Enable for DCU (Data Cache Unit) IP Prefetcher support, which will prefetch IP addresses to improve network connectivity and system performance. The options are Enable and Disable.

LLC Prefetch

If set to Enable, the hardware prefetcher will prefetch streams of data and instructions from the main memory to the L3 cache to improve CPU performance. The options are Disable and Enable.

Extended APIC

Select Enable to activate APIC (Advanced Programmable Interrupt Controller) support. The options are Disable and Enable.

AES-NI

Select Enable to use the Intel Advanced Encryption Standard (AES) New Instructions (NI) to ensure data security. The options are Disable and Enable.

▶Advanced Power Management Configuration

▶CPU P State Control

This feature allows the user to configure the following CPU power settings:

SpeedStep (Pstates)

Intel SpeedStep Technology allows the system to automatically adjust processor voltage and core frequency to reduce power consumption and heat dissipation. The options are Disable and Enable.

EIST PSD Funtion

This feature allows the user to choose between Hardware and Software to control the processor's frequency and performance (P-state). In HW_ALL mode, the processor hardware is responsible for coordinating the P-state, and the OS is responsible for keeping the P-state request up to date on all Logical Processors. In SW_ALL mode, the OS Power Manager is responsible for coordinating the P-state, and must initiate the transition on all Logical Processors. In SW_ANY mode, the OS Power Manager is responsible for coordinating the P-state and may initiate the transition on any Logical Processors. The options are HW_ALL, SW_ALL, and SW_ANY.

Turbo Mode

This feature will enable dynamic control of the processor, allowing it to run above stock frequency. The options are Disable and Enable.

▶Hardware PM State Control

Hardware P-States

This setting allows the user to select between OS and hardware-controlled P-states. Selecting Native Mode allows the OS to choose a P-state. Selecting Out of Band Mode allows the hardware to autonomously choose a P-state without OS guidance. Selecting Native Mode with No Legacy Support functions as Native Mode with no support for older hardware. The options are Disable, Native Mode, Out of Band Mode, and Native Mode with No Legacy Support.

▶CPU C State Control

Autonomous Core C-State

Enabling this setting allows the hardware to autonomously choose to enter a C-state based on power consumption and clock speed. The options are Disable and Enable.

CPU C6 Report

Select Enable to allow the BIOS to report the CPU C6 State (ACPI C3) to the operating system. During the CPU C6 State, the power to all cache is turned off. The options are Disable, Enable, and Auto.

Enhanced Halt State (C1E)

Select Enable to use Enhanced Halt State technology, which will significantly reduce the CPU's power consumption by reducing its clock cycle and voltage during a Halt-state. The options are Disable and Enable.

▶Package C State Control

Package C State

This feature allows the user to set the limit on the C State package register. The options are C0/C1 State, C2 State, C6 (Non Retention) State, C6 (Retention) State, No Limit, and Auto.

▶CPU T State Control

Software Controlled T-States

Use this feature to enable Software Controlled T-States. The options are Disable and Enable.

▶Chipset Configuration

Warning: Setting the wrong values in the following features may cause the system to malfunction.

▶North Bridge

This feature allows the user to configure the following North Bridge settings.

▶UPI Configuration

The following UPI information will display:

• Number of CPU
• Number of IIO
• Current UPI Link Speed
• Current UPI Link Frequency

• UPI Global MMIO Low Base / Limit
• UPI Global MMIO High Base / Limit
• UPI Pci-e Configuration Base / Size

Degrade Precedence

Use this feature to set degrade precedence when system settings are in conflict. Select Topology Precedence to degrade Features. Select Feature Precedence to degrade Topology. The options are Topology Precedence and Feature Precedence.

Link L0p Enable

Select Enable for the QPI to enter the L0p state for power saving. The options are Disable, Enable, and Auto.

Link L1 Enable

Select Enable for the QPI to enter the L1 state for power saving. The options are Disable, Enable, and Auto.

IO Directory Cache (IODC)

IO Directory Cache is an 8-entry cache that stores the directory state of remote IIO writes and memory lookups, and saves directory updates. Use this feature to lower cache to cache (C2C) transfer latencies. The options are Disable, Auto, Enable for Remote InvItoM Hybrid Push, InvItoM AllocFlow, Enable for Remote InvItoM Hybrid AllocNonAlloc, and Enable for Remote InvItoM and Remote WViLF.

Isoc Mode

Isochronous (Isoc) mode allows time-sensitive processes to be given priority. The options are Disable, Enable, and Auto.

▶ Memory Configuration

Enforce POR

Select POR (Plan of Record) to enforce POR restrictions on DDR4 frequency and voltage programming. The options are POR and Disable.

Memory Frequency

Use this feature to set the maximum memory frequency for onboard memory modules. The options are Auto, 1866, 2000, 2133, 2200, 2400, 2600, and 2666.

Data Scrambling for NVDIMM

Use this feature to enable or disable data scrambling for non-volatile DIMM (NVDIMM) memory. The options are Auto, Disable, and Enable.

Data Scrambling for DDR4

Use this feature to enable or disable data scrambling for DDR4 memory. The options are Auto, Disable, and Enable.

tCCD\_L Relaxation

Select Enable to get TCDD settings from SPD (Serial Presence Detect) and implement into memory RC code to improve system reliability. Select Disable for TCCD to follow Intel POR. The options are Disable and Enable.

Enable ADR

Select Enable for ADR (Automatic Diagnostic Repository) support to enhance memory performance. The options are Disable and Enable.

2X REFRESH

Use this feature to select the memory controller refresh rate to 2x refresh mode. The options are Auto and Enable.

▶Memory Topology

This item displays the information of onboard memory modules as detected by the BIOS.

▶ Memory RAS Configuration

Static Virtual Lockstep Mode

Select Enable to run the system's memory channels in lockstep mode to minimize memory access latency. The options are Disable and Enable.

Mirror Mode

This feature allows memory to be mirrored between two channels, providing 100% redundancy. The options are Disable, Mirror Mode 1LM, and Mirror Mode 2LM.

UEFI ARM Mirror

Select Enable to support the UEFI-based address range mirroring with setup option. The options are Disable and Enable.

Memory Rank Sparing

Select Enable to enable memory-sparing support for memory ranks to improve memory performance. The options are Disable and Enable.

Correctable Error Threshold

Use this item to specify the threshold value for correctable memory-error logging, which sets a limit on the maximum number of events that can be logged in the memory-error log at a given time. The default setting is 100.

SDDC Plus One

Single device data correction +1 (SDDC Plus One) organizes data in a single bundle (x4/x8 DRAM). If any or all the bits become corrupted, corrections occur. The x4 condition is corrected on all cases. The x8 condition is corrected only if the system is in Lockstep Mode. The options are Disable and Enable.

ADDDC Sparing

Adaptive Double Device Data Correction (ADDDC) Sparing detects when the predetermined threshold for correctable errors is reached, copying the contents of the failing DIMM to spare memory. The failing DIMM or memory rank will then be disabled. The options are Disable and Enable.

Patrol Scrub

Patrol Scrubbing is a process that allows the CPU to correct correctable memory errors detected on a memory module and send the correction to the requestor (the original source). When this item is set to Enable, the IO hub will read and write back one cache line every 16K cycles if there is no delay caused by internal processing. By using this method, roughly 64 GB of memory behind the IO hub will be scrubbed every day. The options are Disable and Enable.

Patrol Scrub Interval

This feature allows you to decide how many hours the system should wait before the next complete patrol scrub is performed. Use the keyboard to enter a value from 0-24. The default setting is 24.

▶IIO Configuration

EV DFX Features

When this feature is set to Enable, the EV_DFX Lock Bits that are located on a processor will always remain clear during electric tuning. The options are Disable and Enable.

▶CPU1 Configuration

IOU0 (II0 PCIe Br1)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU1 (II0 PCIe Br2)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

IOU2 (II0 PCIe Br3)

This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto.

▶CPU SLOT5 PCI-E 3.0 X8 / CPU SLOT4 PCI-E 3.0 X8 (IN X16) / CPU SLOT6 PCI-E 3.0 X8 (IN X16) / CPU SLOT7 PCI-E 3.0 X8 / CPU SLOT2 PCI-E 3.0 X8 / CPU SLOT3 PCI-E 3.0 X8

Link Speed

Use this item to select the link speed for the PCI-E port specified by the user. The options are Auto, Gen 1 (2.5 GT/s), Gen 2 (5 GT/s), and Gen 3 (8 GT/s).

The following information will also be displayed:

• PCI-E Port Link Status
• PCI-E Port Link Max
- PCI-E Port Link Speed

PCI-E Port Max Payload Size

Selecting Auto for this feature will enable the motherboard to automatically detect the maximum Transaction Layer Packet (TLP) size for the connected PCI-E device, allowing for maximum I/O efficiency. Selecting 128B or 256B will designate maximum packet size of 128 or 256. The options are 128B, 256B, and Auto.

▶IOAT Configuration

Disable TPH

Transparent Huge Pages (TPH) is a Linux memory management system that enables communication in larger blocks (pages). Enabling this feature will increase performance. The options are No and Yes.

Prioritize TPH

Use this feature to enable Prioritize TPH support. The options are Enable and Disable.

Relaxed Ordering

Select Enable to enable Relaxed Ordering support which will allow certain transactions to violate the strict-ordering rules of PCI bus for a transaction to be completed prior

to other transactions that have already been enqueued. The options are Disable and Enable.

▶Intel® VT for Directed I/O (VT-d)

Intel® VT for Directed I/O (VT-d)

Select Enable to use Intel Virtualization Technology for Direct I/O VT-d support by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables. This feature offers fully-protected I/O resource sharing across Intel platforms, providing greater reliability, security and availability in networking and data-sharing. The options are Enable and Disable.

Interrupt Remapping

Use this feature to enable Interrupt Remapping support, which detects and controls external interrupt requests. The options are Enable and Disable.

PassThrough DMA

Use this feature to allow devices such as network cards to access the system memory without using a processor. Select Enable to use the Non-Isoch VT_D Engine Pass Through Direct Memory Access (DMA) support. The options are Enable and Disable.

ATS

Use this feature to enable Non-Isoch VT-d Engine Address Translation Services (ATS) support. ATS translates virtual addresses to physical addresses. The options are Enable and Disable.

Posted Interrupt

Use this feature to enable VT_D Posted Interrupt. The options are Enable and Disable.

Coherency Support (Non-Isoch)

Use this feature to maintain setting coherency between processors or other devices. Select Enable for the Non-Iscoh VT-d engine to pass through DMA to enhance system performance. The options are Enable and Disable.

Intel® VMD Technology

Intel® VMD for Volume Management Device on CPU1

VMD Config for PStack0

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item above is set to Enable, the following items will be displayed:

CPU SLOT5 PCI-E 3.0 X8 VMD / CPU SLOT4 PCI-E 3.0 X8 (IN X16) VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Use this feature to enable hot plug support for PCIe root ports 1A\~1D. The options are Disable and Enable.

VMD Config for PStack1

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item above is set to Enable, the following items will be displayed:

CPU SLOT6 PCI-E 3.0 X8 (IN X16) VMD / CPU SLOT7 PCI-E 3.0 X8 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Use this feature to enable hot plug support for PCIe root ports 2A\~2D. The options are Disable and Enable.

VMD Config for PStack2

Intel® VMD for Volume Management Device

Select Enable to use the Intel Volume Management Device Technology for this stack. The options are Disable and Enable.

*If the item above is set to Enable, the following items will be displayed:

CPU SLOT2 PCI-E 3.0 X8 VMD / CPU SLOT3 PCI-E 3.0 X8 VMD (Available when the device is detected by the system)

Select Enable to use the Intel Volume Management Device Technology for this specific root port. The options are Disable and Enable.

Hot Plug Capable (Available when the device is detected by the system)

Use this feature to enable hot plug support for PCIe root ports 3A\~3D. The options are Disable and Enable.

PCI-E Completion Timeout Disable

Use this feature to enable PCI-E Completion Timeout support for electric tuning. The options are Yes, No, and Per-Port.

▶ South Bridge

The following USB information will display:

• USB Module Version
• USB Devices

Legacy USB Support

This feature enables support for USB 2.0 and older. The options are Enabled, Disabled, and Auto.

XHCI Hand-off

When disabled, the motherboard will not support USB 3.0. The options are Enabled and Disabled.

Port 60/64 Emulation

This feature allows legacy I/O support for USB devices like mice and keyboards. The options are Enabled and Disabled.

▶Server ME Configuration

The following General ME Configuration will display:

• Oper. Firmware Version
• Backup Firmware Version
• Recovery Firmware Version
• ME Firmware Status #1
• ME Firmware Status #2
- Current State
- Error Code

▶PCH SATA Configuration

When this submenu is selected, the AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the following items:

SATA Controller

This item enables or disables the onboard SATA controller supported by the Intel PCH chip. The options are Disable and Enable.

Configure SATA as

Select AHCI to configure a SATA drive specified by the user as an AHCI drive. Select RAID to configure a SATA drive specified by the user as a RAID drive. The options are AHCI and RAID.

SATA HDD Unlock

This feature allows the user to remove any password-protected SATA disk drives. The options are Enable and Disable.

Aggressive Link Power Management

When this item is set to Enable, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link in a low power mode during extended periods of I/O inactivity, and will return the link to an active state when I/O activity resumes. The options are Disable and Enable.

*If the item "Configure SATA as" above is set to RAID, the following items will display:

SATA RSTe Boot Info

Select Enable to provide full int13h support for the devices attached to SATA controller The options are Disable and Enable.

SATA RAID Option ROM/UEFI Driver

Select UEFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disable, EFI, and Legacy.

SATA Port 0 \~ Port 7

This item displays the information detected on the installed SATA drive on the particular SATA port.

• Model number of drive and capacity
- Software Preserve Support

Port 0 \~ Port 7 Hot Plug

Set this item to Enable for hot plug support, which will allow the user to replace a SATA drive without shutting down the system. The options are Disable and Enable.

Port 0 \~ Port 7 Spin Up Device

On an edge detect from 0 to 1, set this item to allow the PCH to initialize the device. The options are Disable and Enable.

Port 0 \~ Port 7 SATA Device Type

Use this item to specify if the SATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶PCH sSATA Configuration

When this submenu is selected, the AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the following items:

sSATA Controller

This item enables or disables the onboard sSATA controller supported by the Intel PCH chip. The options are Enable and Disable.

Configure sSATA as

Select AHCI to configure an sSATA drive specified by the user as an AHCI drive. Select RAID to configure an sSATA drive specified by the user as a RAID drive. The options are AHCI and RAID.

SATA HDD Unlock

This feature allows the user to remove any password-protected SATA disk drives. The options are Disable and Enable.

Aggressive Link Power Management

When this item is set to Enable, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link in a low power mode during extended periods of I/O inactivity, and will return the link to an active state when I/O activity resumes. The options are Disable and Enable.

*If the item "Configure sSATA as" above is set to RAID, the following items will display:

sSATA RSTe Boot Info

Select Enable to provide full int13h support for the devices attached to sSATA controller. The options are Disable and Enable.

sSATA RAID Option ROM/UEFI Driver

Select UEFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disable, EFI, and Legacy.

sSATA Port 2

This item displays the information detected on the installed sSATA drive on the particular sSATA port.

• Model number of drive and capacity
- Software Preserve Support

Hot Plug

Set this item to Enable for hot plug support, which will allow the user to replace a SATA drive without shutting down the system. The options are Disable and Enable.

Spin Up Device

On an edge detect from 0 to 1, set this item to allow the PCH to initialize the device. The options are Disable and Enable.

sSATA Device Type

Use this item to specify if the SATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶PCIe/PCI/PnP Configuration

The following information will display:

• PCI Bus Driver Version
• PCI Devices Common Settings:

Above 4G Decoding (Available if the system supports 64-bit PCI decoding)

Select Enabled to decode a PCI device that supports 64-bit in the space above 4G Address. The options are Disabled and Enabled.

SR-IOV Support

Use this feature to enable or disable Single Root IO Virtualization Support. The options are Disabled and Enabled.

MMIO High Base

Use this item to select the base memory size according to memory-address mapping for the IO hub. The options are 56T, 40T, 24T, 16T, 4T, and 1T.

MMIO High Granularity Size

Use this item to select the high memory size according to memory-address mapping for the IO hub. The options are 1G, 4G, 16G, 64G, 256G, and 1024B.

PCI PERR/SERR Support

Select Enabled to allow a PCI device to generate a PERR/SERR number for a PCI Bus Signal Error Event. The options are Disabled and Enabled.

Maximum Read Request

Use this item to select the Maximum Read Request size of the PCI-Express device, or select Auto to allow the System BIOS to determine the value. The options are Auto, 128 Bytes, 256 Bytes, 512 Bytes, 1024 Bytes, 2048 Bytes, and 4096 Bytes.

MMCFG Base

Use this item to select the low base address for PCIE adapters to increase base memory. The options are 1G, 1.5G, 1.75G, 2G, 2.25G, and 3G.

NVMe Firmware Source

Use this item to select the NVMe firmware to support booting. The options are Vendor Defined Firmware and AMI Native Support. The default option, Vendor Defined Firmware, is pre-installed on the drive and may resolve errata or enable innovative functions for the drive. The other option, AMI Native Support, is offered by the BIOS with a generic method.

VGA Priority

Use this feature to select VGA priority when multiple VGA devices are detected. Select On-board to give priority to your onboard video device. Select Offboard to give priority to your graphics card. The options are Onboard and Offboard.

PCH SLOT1 PCI-E 3.0 X4 (IN X8) OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU SLOT2 PCI-E 3.0 X8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU SLOT3 PCI-E 3.0 X8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU SLOT4 PCI-E 3.0 X8 (IN X16) OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU SLOT5 PCI-E 3.0 X8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU SLOT6 PCI-E 3.0 X8 (IN X16) OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

CPU SLOT7 PCI-E 3.0 X8 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

M.2 PCI-E 3.0 X4 OPROM

Use this feature to select which firmware type to be loaded for the add-on card in this slot. The options are Disabled, Legacy, and EFI.

Onboard LAN Option ROM Type

Use to feature to enable Option ROM support to boot the computer using a network device specified by the user. The options are Legacy and EFI.

Onboard LAN1 Option ROM

Use this feature to select which firmware function to be loaded for LAN Port1 used for system boot. The options are Disabled, PXE, and iSCSI.

Onboard LAN2 Option ROM

Use this feature to select which firmware function to be loaded for LAN Port2 used for system boot. The options are Disabled and PXE.

Onboard Video Option ROM

Use this item to select the Onboard Video Option ROM type. The options are Disabled, Legacy, and EFI.

▶Network Stack Configuration

Network Stack

Select Enabled to enable PXE (Preboot Execution Environment) or UEFI (Unified Extensible Firmware Interface) for network stack support. The options are Enabled and Disabled.

Ipv4 PXE Support

Select Enabled to enable IPv4 PXE boot support. The options are Disabled and Enabled.

Ipv4 HTTP Support

Select Enabled to enable IPv4 HTTP boot support. The options are Disabled and Enabled.

Ipv6 PXE Support

Select Enabled to enable IPv6 PXE boot support. The options are Disabled and Enabled.

Ipv6 HTTP Support

Select Enabled to enable IPv6 HTTP boot support. The options are Disabled and Enabled.

PXE Boot Wait Time

Use this option to specify the wait time to press the ESC key to abort the PXE boot. Press "+" or "-" on your keyboard to change the value. The default setting is 0.

Media Detect Count

Use this option to specify the number of times media will be checked. Press "+" or "-" on your keyboard to change the value. The default setting is 1.

▶Super IO Configuration

The following Super IO information will display:

• Super IO Chip AST2500

▶ Serial Port 1 Configuration

This submenu allows the user to configure the settings of Serial Port 1.

Serial Port 1

Select Enabled to enable the selected onboard serial port. The options are Disabled and Enabled.

Device Settings

This item displays the status of a serial part specified by the user.

Change Settings

This feature specifies the base I/O port address and the Interrupt Request address of a serial port specified by the user. Select Auto to allow the BIOS to automatically assign the base I/O and IRQ address.

The options for Serial Port 1 are Auto, (IO=3F8h; IRQ=4;), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;), (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;).

▶ Serial Port 2 Configuration

This submenu allows the user to configure the settings of Serial Port 2.

Serial Port 2

Select Enabled to enable the selected onboard serial port. The options are Disabled and Enabled.

Device Settings

This item displays the status of a serial part specified by the user.

Change Settings

This feature specifies the base I/O port address and the Interrupt Request address of a serial port specified by the user. Select Auto to allow the BIOS to automatically assign the base I/O and IRQ address.

The options for Serial Port 2 are Auto, (IO=2F8h; IRQ=3;), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;), (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12;).

Serial Port 2 Attribute (Available for Serial Port 2 only)

Select SOL to use COM Port 2 as a Serial Over LAN (SOL) port for console redirection. The options are SOL and COM.

▶Serial Port Console Redirection

COM1 Console Redirection

Select Enabled to enable console redirection support for a serial port specified by the user. The options are Enabled and Disabled.

*If the item above is set to Enabled, the following items will become available for configuration:

▶COM1 Console Redirection Settings

Use this feature to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

COM1 Terminal Type

This feature allows the user to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are VT100, VT100+, VT-UTF8, and ANSI.

COM1 Bits Per Second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

COM1 Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 Bits and 8 Bits.

COM1 Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark

as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark, and Space.

COM1 Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

COM1 Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start sending data when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

COM1 VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Disabled and Enabled.

COM1 Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

COM1 Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

COM1 Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

COM1 Putty KeyPad

This feature selects the settings for Function Keys and KeyPad used for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SC0, ESCN, and VT400.

COM1 Redirection After BIOS POST

Use this feature to enable or disable legacy console redirection after BIOS POST. When set to Bootloader, legacy console redirection is disabled before booting the OS. When set to Always Enable, legacy console redirection remains enabled when booting the OS. The options are Always Enable and Bootloader.

SOL/COM2 Console Redirection

Select Enabled to use the SOL port for Console Redirection. The options are Disabled and Enabled.

*If the item above is set to Enabled, the following items will become available for configuration:

▶SOL/COM2 Console Redirection Settings

Use this feature to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

COM2 Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

COM2 Bits Per Second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

COM2 Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 Bits and 8 Bits.

COM2 Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

COM2 Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

COM2 Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start sending data when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

COM2 VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Disabled and Enabled.

COM2 Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

COM2 Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

COM2 Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

COM2 Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

COM2 Redirection After BIOS POST

Use this feature to enable or disable legacy Console Redirection after BIOS POST. When set to Bootloader, legacy Console Redirection is disabled before booting the OS. When set to Always Enable, legacy Console Redirection remains enabled when booting the OS. The options are Always Enable and Bootloader.

Legacy Console Redirection

Legacy Serial Redirection Port

Use this feature to select a COM port to display redirection of Legacy OS and Legacy OPROM messages. The options are COM1 and SOL/COM2.

EMS (Emergency Management Services) Console Redirection

Select Enabled to use a COM port selected by the user for EMS Console Redirection. The options are Enabled and Disabled.

*If the item above is set to Enabled, the following items will become available for configuration:

▶EMS Console Redirection Settings

This feature allows the user to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

Out-of-Band Mgmt Port

The feature selects a serial port in a client server to be used by the Microsoft Windows Emergency Management Services (EMS) to communicate with a remote host server. The options are COM1 and SOL/COM2.

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII character set. Select VT100+ to add color and function key support. Select ANSI to use the extended ASCII character set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are VT100, VT100+, VT-UTF8, and ANSI.

Bits Per Second

This item sets the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 57600, and 115200 (bits per second).

Flow Control

Use this item to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start sending data when the receiving buffer is empty. The options are None, Hardware RTS/CTS, and Software Xon/Xoff.

Data Bits, Parity, Stop Bits

▶ACPI Settings

WHEA Support

Select Enabled to support the Windows Hardware Error Architecture (WHEA) platform and provide a common infrastructure for the system to handle hardware errors within the Windows OS environment to reduce system crashes and to enhance system recovery and health monitoring. The options are Disabled and Enabled.

High Precision Event Timer

Select Enabled to activate the High Precision Event Timer (HPET) that produces periodic interrupts at a much higher frequency than a Real-time Clock (RTC) does in synchronizing multimedia streams, providing smooth playback and reducing the dependency on other timestamp calculation devices, such as an x86 RDTSC Instruction embedded in the CPU. The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer. The options are Disabled and Enabled.

▶Trusted Computing

The X11SPL-F supports TPM 1.2 and 2.0. The following Trusted Platform Module (TPM) information will display if a TPM 2.0 module is detected:

• Vendor Name
• Firmware Version

Security Device Support

If this feature and the TPM jumper on the motherboard are both set to Enabled, onboard security devices will be enabled for TPM (Trusted Platform Module) support to enhance data integrity and network security. Please reboot the system for a change on this setting to take effect. The options are Disable and Enable.

• Active PCR Bank
- SHA256 PCR Bank

*If the item above is set to Enable, "SHA-1 PCR Bank" and "SHA256 PCR Bank" will become available for configuration:

SHA-1 PCR Bank

Use this item to disable or enable the SHA-1 Platform Configuration Register (PCR) bank for the installed TPM device. The options are Disabled and Enabled.

SHA256 PCR Bank

Use this item to disable or enable the SHA256 Platform Configuration Register (PCR) bank for the installed TPM device. The options are Disabled and Enabled.

Pending Operation

Use this item to schedule a TPM-related operation to be performed by a security device for system data integrity. Your system will reboot to carry out a pending TPM operation. The options are None and TPM Clear.

Platform Hierarchy

Use this item to disable or enable platform hierarchy for platform protection. The options are Disabled and Enabled.

Storage Hierarchy

Use this item to disable or enable storage hierarchy for cryptographic protection. The options are Disabled and Enabled.

Endorsement Hierarchy

Use this item to disable or enable endorsement hierarchy for privacy control. The options are Disabled and Enabled.

PH Randomization

Use this item to disable or enable Platform Hierarchy (PH) Randomization. The options are Disabled and Enabled.

TXT Support

Intel Trusted Execution Technology (TXT) helps protect against software-based attacks and ensures protection, confidentiality, and integrity of data stored or created on the system. Use this feature to enable or disable TXT Support. The options are Disable and Enable.

▶iSCSI Configuration

iSCSI Initiator Name

This feature allows the user to enter the unique name of the iSCSI Initiator in IQN format. Once the name of the iSCSI Initiator is entered into the system, configure the proper settings for the following items.

▶ Add an Attempt
▶ Delete Attempts
▶ Change Attempt Order

▶iSCSI Configuration

iSCSI Initiator Name

This feature allows the user to enter the unique name of the iSCSI Initiator in IQN format. Once the name of the iSCSI Initiator is entered into the system, configure the proper settings for the following items.

▶ Add an Attempt
▶ Delete Attempts
▶ Change Attempt Order

▶Intel(R) Virtual RAID on CPU

Intel(R) VROC with VMD Technology 5.1.0.1007

RAID volumes and Intel VMD Controllers information will be displayed if they are detected by the system.

6.4 Event Logs

Use this tab page to configure Event Log settings.

Antio Setup Utility - Copyright (C) 2017 American Hegatrends, Inc. Main Advanced Event Logs JPMI Security Boot Save & Exit Change SMBIOS Event Log Settings View SMBIOS Event Log Press to change the SMBIOS Event Log configuration. +: Select Screen T4: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1250. Copyright (C) 2017 American Hegatrends, Inc.

▶Change SMBIOS Event Log Settings

Enabling/Disabling Options

SMBIOS Event Log

Change this item to enable or disable all features of the SMBIOS Event Logging during system boot. The options are Enabled and Disabled.

Erasing Settings

Erase Event Log

If No is selected, data stored in the event log will not be erased. Select Yes, Next Reset, data in the event log will be erased upon next system reboot. Select Yes, Every Reset, data in the event log will be erased upon every system reboot. The options are No, Yes, Next reset, and Yes, Every reset.

When Log is Full

Select Erase Immediately for all messages to be automatically erased from the event log when the event log memory is full. The options are Do Nothing and Erase Immediately.

SMBIOS Event Log Standard Settings

Log System Boot Event

This option toggles the System Boot Event logging to enabled or disabled. The options are Disabled and Enabled.

MECI

The Multiple Event Count Increment (MECI) counter counts the number of occurrences that a duplicate event must happen before the MECI counter is incremented. This is a numeric value. The default value is 1.

METW

The Multiple Event Time Window (METW) defines the number of minutes that must pass between duplicate log events before MECI is incremented. This is in minutes, from 0 to 99. The default value is 60.

Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

▶View SMBIOS Event Log

Select this submenu and press enter to see the contents of the SMBIOS event log. The following categories will be displayed: Date/Time/Error Codes/Severity.

6.5 IPMI

Use this tab page to configure Intelligent Platform Management Interface (IPMI) settings.

Antio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit BMC Firmware Revision 1.13 IPMI STATUS Working ► System Event Log ► BKC Network Configuration Press to change the SEL event log configuration. +: Select Screen T1: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

BMC Firmware Revision

This item indicates the IPMI firmware revision used in your system.

IPMI Status (Baseboard Management Controller)

This item indicates the status of the IPMI firmware installed in your system.

▶System Event Log

Enabling/Disabling Options

SEL Components

Select Enabled for all system event logging at bootup. The options are Enabled and Disabled.

Erasing Settings

Erase SEL

Select Yes, On next reset to erase all system event logs upon next system reboot. Select Yes, On every reset to erase all system event logs upon each system reboot. Select No to keep all system event logs after each system reboot. The options are No, Yes, On next reset, and Yes, On every reset.

When SEL is Full

This feature allows the user to decide what the BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately.

Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

▶BMC Network Configuration

BMC Network Configuration

Configure IPV4 Support

This section displays configuration features for IPV4 support.

IPMI LAN Selection

This item displays the IPMI LAN setting. The default setting is Failover.

IPMI Network Link Status

This item displays the IPMI Network Link status. The default setting is Shared LAN.

Update IPMI LAN Configuration

Select Yes for the BIOS to implement all IP/MAC address changes at the next system boot. The options are No and Yes.

*If the item above is set to Yes, the following item will become available for configuration:

Configuration Address Source

This feature allows the user to select the source of the IP address for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the field. If DHCP is selected, the BIOS will search for a DHCP (Dynamic Host Configuration Protocol) server in the network that is attached to and request the next available IP address for this computer. The options are DHCP and Static.

*If the item above is set to Static, the following items will become available for configuration:

Station IP Address

This item displays the Station IP address for this computer. This should be in decimal and in dotted quad form (i.e., 192.168.10.253).

Subnet Mask

This item displays the sub-network that this computer belongs to. The value of each three-digit number separated by dots should not exceed 255.

Station MAC Address

This item displays the Station MAC address for this computer. Mac addresses are 6 two-digit hexadecimal numbers.

Gateway IP Address

This item displays the Gateway IP address for this computer. This should be in decimal and in dotted quad form (i.e., 172.31.0.1).

VLAN

This item displays the virtual LAN settings. The options are Disable and Enable.

Configure IPV6 Support

This section displays configuration features for IPV6 support.

LAN Channel 1

IPV6 Support

Use this feature to enable IPV6 support. The options are Enabled and Disabled.

Configuration Address Source

This feature allows the user to select the source of the IP address for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the field. If DHCP is selected, the BIOS will search for a DHCP (Dynamic Host Configuration Protocol) server in the network that is attached to and request the next available IP address for this computer. The options are Unspecified, Static, and DHCP.

*If the item above is set to Static, the following items will become available for configuration:

• Station IPV6 Address
- Prefix Length
• IPV6 Router1 IP Address

6.6 Security

Use this tab page to configure Security settings.

Aptio Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save 8 Exit Password Description If ONLY the Administrator's password is set, then this only limits access to Setup and is only asked for when entering Setup. If ONLY the User's password is set, then this is a power on password and must be entered to boot or enter Setup. In Setup the User will have Administrator rights. The password length must be in the following range: Minimum length 3 Maximum length 20 Administrator Password User Password Password Check [Setup] ▶ Secure Boot Set Administrator Password +: Select Screen T4: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save 8 Exit ESC: Exit Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Administrator Password

Press Enter to create a new, or change an existing, Administrator password.

User Password

Press Enter to create a new, or change an existing, User password.

Password Check

Select Setup for the system to check for a password at Setup. Select Always for the system to check for a password at bootup or upon entering the BIOS Setup utility. The options are Setup and Always.

▶Secure Boot

This section displays the contents of the following secure boot features:

• System Mode
• Secure Boot
• Vendor Keys

Secure Boot

Use this item to enable secure boot. The options are Disabled and Enabled.

Secure Boot Mode

Use this item to configure Secure Boot variables without authentication. The options are Standard and Custom.

CSM Support

Select Enabled to support the EFI Compatibility Support Module (CSM), which provides compatibility support for traditional legacy BIOS for system boot. The options are Enabled and Disabled.

▶Key Management

This submenu allows the user to configure the following Key Management settings.

Provision Factory Default Keys

Select Enabled to install the default Secure-Boot keys set by the manufacturer. The options are Disabled and Enabled.

▶Enroll All Factory Default Keys

Select Yes to install all default secure keys set by the manufacturer. The options are Yes and No.

▶Enroll EFI Image

This feature allows the image to run in Secure Boot Mode. Enroll SHA256 Hash Certificate of the image into the Authorized Signature Database.

▶ Save All Secure Boot Variables

This feature allows the user to decide if all secure boot variables should be saved.

▶ Platform Key (PK)

This feature allows the user to configure the settings of the platform keys.

Set New

Select Yes to load the new platform keys (PK) from the manufacturer's defaults. Select No to load the platform keys from a file. The options are Yes and No.

▶Key Exchange Keys

Set New

Select Yes to load the KEK from the manufacturer's defaults. Select No to load the KEK from a file. The options are Yes and No.

Append

Select Yes to add the KEK from the manufacturer's defaults list to the existing KEK. Select No to load the KEK from a file. The options are Yes and No.

▶ Authorized Signatures

Set New

Select Yes to load the database from the manufacturer's defaults. Select No to load the DB from a file. The options are Yes and No.

Append

Select Yes to add the database from the manufacturer's defaults to the existing DB. Select No to load the DB from a file. The options are Yes and No.

▶Forbidden Signatures

Set New

Select Yes to load the DBX from the manufacturer's defaults. Select No to load the DBX from a file. The options are Yes and No.

Append

Select Yes to add the DBX from the manufacturer's defaults to the existing DBX. Select No to load the DBX from a file. The options are Yes and No.

▶ Authorized TimeStamps

Set New

Select Yes to load the DBT from the manufacturer's defaults. Select No to load the DBT from a file. The options are Yes and No.

Append

Select Yes to add the DBT from the manufacturer's defaults list to the existing DBT. Select No to load the DBT from a file. The options are Yes and No.

▶OsRecovery Signature

This item uploads and installs an OSRecovery Signature. You may insert a factory default key or load from a file. The file formats accepted are:

1) Public Key Certificate

a. EFI Signature List
b. EFI CERT X509 (DER Encoded)
c. EFI CERT RSA2048 (bin)
d. EFI SERT SHA256 (bin)

2) EFI Time Based Authenticated Variable

When prompted, select "Yes" to load Factory Defaults or "No" to load from a file.

Set New

Select Yes to load the DBR from the manufacturer's defaults. Select No to load the DBR from a file. The options are Yes and No.

Append

This item uploads and adds an OSRecovery Signature into the Key Management. You may insert a factory default key or load from a file. When prompted, select "Yes" to load Factory Defaults or "No" to load from a file.

6.7 Boot

Use this tab page to configure Boot Settings.

Aptlo Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPME Security Boot Save & Exit Boot Configuration Boot mode select LEGACY to EFI support FIXED BOOT ORDER Priorities Boot Option #1 Boot Option #2 Boot Option #3 Boot Option #4 Boot Option #5 Boot Option #6 Boot Option #7 Boot Option #8 Boot Option #9 Boot Option #10 Boot Option #11 Boot Option #12 Boot Option #13 Boot Option #14 Boot Option #15 Boot Option #16 Boot Option #17 Add New Boot Option [ORAL] [Disabled] [Hard Disk] [CD/DVD] [USB Hard Disk] [USB CD/DVD] [USB Key:UFD USB F...] [USB Flopy] [USB Lan] [Network:IBA GE SI...] [UEFI Hard Disk] [UEFI CD/DVD] [UEFI USB Hard Disk] [UEFI USB CD/DVD] [UEFI USB Key:UEFI...] [UEFI USB Flopy] [UEFI USB Lan] [UEFI Network] [UEFI AP:UEFI: BUI...] Select boot mode LEGACY/UEFI +: Select Screen T4: Select Item Enter: Select +/-: Change Opt. F1: Genersl Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: ExIt Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Boot Mode Select

Use this item to select the type of device that the system is going to boot from. The options are Legacy, UEFI, and Dual.

Legacy to EFI Support

Select Enabled to boot EFI OS support after Legacy boot order has failed. The options are Disabled and Enabled.

Fixed Boot Order Priorities

This option prioritizes the order of bootable devices that the system boots from. Press on each entry from top to bottom to select devices.

*If the item "Boot Mode Select" above is set to Legacy, UEFI, or Dual, the following items will be displayed:

• Legacy/UEFI/Dual Boot Option #1
• Legacy/UEFI/Dual Boot Option #2
• Legacy/UEFI/Dual Boot Option #3
• Legacy/UEFI/Dual Boot Option #4
• Legacy/UEFI/Dual Boot Option #5
• Legacy/UEFI/Dual Boot Option #6

• Legacy/UEFI/Dual Boot Option #7
• Legacy/UEFI/Dual Boot Option #8
• UEFI/Dual Boot Option #9
• Dual Boot Option #10
• Dual Boot Option #11
• Dual Boot Option #12
• Dual Boot Option #13
• Dual Boot Option #14
• Dual Boot Option #15
• Dual Boot Option #16
• Dual Boot Option #17

▶ Delete Boot Option

This feature allows the user to select a boot device to delete from the boot priority list.

Delete Boot Option

Use this item to remove an EFI boot option from the boot priority list.

▶NETWORK Drive BBS Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

▶UEFI Application Boot Priorities

This feature allows the user to specify which UEFI devices are boot devices.

- UEFI Boot Option #1

*If any storage media is detected, the following items will become available for configuration:

▶ Add New Boot Option

This feature allows the user to add a new boot option to the boot priority features for your system.

Add Boot Option

Use this item to specify the name for the new boot option.

Path for Boot Option

Use this item to enter the path for the new boot option in the format fsx:\path\filename.efi.

Boot Option File Path

Use this item to specify the file path for the new boot option.

Create

Use this item to set the name and the file path of the new boot option.

▶UEFI Hard Disk Drive BBS Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

▶Hard Disk Drive BBS Priorities

This feature sets the system boot order of detected devices.

- Boot Option #1

6.8 Save & Exit

Use this tab page to configure Save & Exit settings.

Aptlo Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPME Security Boot Save & Exit Save Options Discard Charges and Exit Save Changes and Reset Save Changes Discard Changes Default Options Restore Optimized Defaults Save as User Defaults Restore User Defaults Boot Override UFD USB Flash Drive 1100 IEA 40S Slot 6700 v1050 UEFI: UFD USB Flash Drive 1100, Partition 1 UEFI: Built-in EFI Shell Exit system setup without saving any changes. +: Select Screen T4: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1268. Copyright (C) 2017 American Megatrends, Inc.

Save Options

Discard Changes and Exit

Select this option to quit the BIOS Setup without making any permanent changes to the system configuration and reboot the computer. Select Discard Changes and Exit from the Save & Exit menu and press .

Save Changes and Reset

After completing the system configuration changes, select this option to save the changes you have made. This will not reset (reboot) the system.

Save Changes

When you have completed the system configuration changes, select this option to leave the BIOS setup utility and reboot the computer for the new system configuration parameters to take effect. Select Save Changes from the Save & Exit menu and press .

Discard Changes

Select this option and press to discard all the changes and return to the AMI BIOS utility program.

Default Options

Restore Optimized Defaults

To set this feature, select Restore Defaults from the Save & Exit menu and press . These are factory settings designed for maximum system stability, but not for maximum performance.

Save As User Defaults

To set this feature, select Save as User Defaults from the Save & Exit menu and press . This enables the user to save any changes to the BIOS setup for future use.

To set this feature, select Restore User Defaults from the Save & Exit menu and press . Use this feature to retrieve user-defined settings that were saved previously.

Boot Override

Listed in this section are other boot options for the system (i.e., Built-in EFI shell). Select an option and press . Your system will boot to the selected boot option.

Appendix A

BIOS Error Codes

A.1 BIOS Error Beep (POST) Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

These fatal errors are usually communicated through a series of audible beeps. The table below lists some common errors and their corresponding beep codes encountered by users.

BIOS Error Beep (POST) Codes
Beep Code Error	Message Description
1 short Refresh Circuits have been reset (Ready to power up)
5 short, 1 long Memory error No memory detected in system
5 long, 2 short Display memory read/write error Video adapter missing or with faulty memory
1 long continuous System OH System overheat condition

A.2 Additional BIOS POST Codes

The AMI BIOS supplies additional checkpoint codes, which are documented online at http://www.supermicro.com/support/manuals/ ("AMI BIOS POST Codes User's Guide").

When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20).

For information on AMI updates, please refer to http://www.ami.com/products/.

Appendix B

Standardized Warning Statements for AC Systems

About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源装置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

System Specifications

Processors

Intel Xeon 82xx/62xx/52xx/42xx/32xx or 81xx/61xx/51xx/41xx/31xx processor (socket P (LGA3647)) with up to 28 cores and a thermal design power (TDP) of up to 165W

Note: The X11SPL-F motherboard does not support FPGA or Fabric processors

Note: Please refer to the motherboard specifications pages on our website for updates to supported processors.

Chipset

Intel C621

BIOS

256 Mb AMI BIOS® SPI Flash ROM

Memory

Up to 512GB of RDIMM, 1TB of LRDIMM, and 2TB of 3DS LRDIMM DDR4 (288-pin) ECC memory with speeds of up to 2933MHz in eight memory slots

See the memory section in Chapter 3 for details and our website for updates to supported memory.

Storage

Forty-five top-loaded hot-swap 3.5" drives, with 2.5" option

Two hot-swap 2.5" SATA drives (rear)

(Optional) Two hot-swap 2.5" NVMe drives (rear)

PCI Expansion Slots

One PCI-Express 3.0 x4 (in x8) Slot (PCH SLOT1)

Three PCI-Express 3.0 x8 Slots (CPU SLOT2, SLOT3, SLOT5); (SLOT7 used by AOC-S3108-H8IR/AOC-S3008-S3008L-L8E SAS HBA card.)

Two PCI-Express 3.0 x8 (in x16) Slot (CPU SLOT4, SLOT6)

Motherboard

X11SPL-F; ATX 12" (W) x 9.6" (L) (305 mm x 244 mm)

Chassis

SC946LTS-R1K66P1; 4U Rackmount, 17.2 x 7.0 x 26 in. / 437 x 178 x 660 mm. (W x H x D)

System Cooling

Five 8-cm 14.4K RPM PWM fans, one CPU heatsink

Power Supply

Model: Dual PWR-1K66A-1R, 80Plus Titanium level

Total Output Power: 1000 W/1600 W

Input:

100-127 Vac / 12.9 A Max / 50-60 Hz

200-240 Vac / 9.5 A Max / 50-60 Hz

Rated Output Power:

+12 V

Max: 82 A / Min: 0.1 A (100-127 Vac)

Max: 132 A / Min: 0.1 A (200-240 Vac)

1 2 V SB Max: 2 A / Min: 0.2 A

Operating Environment

Operating Temperature: 10° to 35° C (50° to 95° F)

Non-operating Temperature: -40^ to 60^ C ( -40^ to 140^ F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

Electromagnetic Emissions: FCC Class A, EN 55032 Class A, EN 61000-3-2/3-3, CISPR 32 Class A

Electromagnetic Immunity: EN 55024/CISPR 24, (EN 61000-4-2, EN 61000-4-3, EN 61000-4-4, EN 61000-4-5, EN 61000-4-6, EN 61000-4-8, EN 61000-4-11)

Other: VCCI-CISPR 32 and AS/NZS CISPR 32

Environmental: Directive 2011/65/EU and Delegated Directive (EU) 2015/863 and Directive 2012/19/EU

Safety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe))

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate"

Appendix D

UEFI BIOS Recovery

Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you do update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.

D.1 Overview

The Unified Extensible Firmware Interface (UEFI) provides a software-based interface between the operating system and the platform firmware in the pre-boot environment. The UEFI specification supports an architecture-independent mechanism that will allow the UEFI OS loader stored in an add-on card to boot the system. The UEFI offers clean, hands-off management to a computer during system boot.

D.2 Recovering the UEFI BIOS Image

A UEFI BIOS flash chip consists of a recovery BIOS block and a main BIOS block (a main BIOS image). The recovery block contains critical BIOS codes, including memory detection and recovery codes for the user to flash a healthy BIOS image if the original main BIOS image is corrupted. When the system power is turned on, the recovery block codes execute first.

Once this process is complete, the main BIOS code will continue with system initialization and the remaining POST (Power-On Self-Test) routines.

Note 1: Follow the BIOS recovery instructions below for BIOS recovery when the main BIOS block crashes.

Note 2: When the BIOS recovery block crashes, you will need to follow the procedures to make a Returned Merchandise Authorization (RMA) request. (For a RMA request, please see section 3.5 for more information). Also, you may use the Supermicro Update Manager (SUM) Out-of-Band (OOB) (https://www.supermicro.com.tw/products/nfo/SMS_SUM.cfm) to reflash the BIOS.

D.3 Recovering the Main BIOS Block with a USB Device

This feature allows the user to recover the main BIOS image using a USB-attached device without additional utilities used. A USB flash device such as a USB Flash Drive, or a USB CD/DVD ROM/RW device can be used for this purpose. However, a USB Hard Disk drive cannot be used for BIOS recovery at this time.

The file system supported by the recovery block is FAT (including FAT12, FAT16, and FAT32) which is installed on a bootable or non-bootable USB-attached device. However, the BIOS might need several minutes to locate the SUPER.ROM file if the media size becomes too large due to the huge volumes of folders and files stored in the device.

To perform UEFI BIOS recovery using a USB-attached device, follow the instructions below.

1. Using a different machine, copy the "Super.ROM" binary image file into the Root "\" directory of a USB device or a writable CD/DVD.

Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.

Note 2: Before recovering the main BIOS image, confirm that the "Super.ROM" binary image file you download is the same version or a close version meant for your motherboard.

1. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and reset the system when the following screen appears.

BMC IP:10.132.168.92 PEI--Could Not Find Recovery Image... 87

1. After locating the healthy BIOS binary image, the system will enter the BIOS Recovery menu as shown below.

Optin Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Log (DW) Recovery Security Boot Save & Exit Please select blocks you want to update Reset OK Boot Block Update [Enabled] ▶ Proceed with flash update Set this option to reset NWSM to default values +: Select Screen T4: Select Item Enter: Select +/- Change Out. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.19.1766. Copyright (C) 2017 American Megatrends, Inc.

Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below.

1. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update" and press the key. You will see the BIOS recovery progress as shown in the screen below.

Note: Do not interrupt the BIOS flashing process until it has completed.

Aotia Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Recovery WARNING System firmware is being updated. Keyboard is locked. DO NOT TURN THE POWER OFF III Drive firmware update is completed press any key to reboot the system Program new data Write new boot block... 178 +: Select Screen F4: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save a Exit E9C: Exit Version 2.19.1266. Copyright (C) 2017 American Megatrends, Inc.

1. After the BIOS recovery process is complete, press any key to reboot the system.

RATIO Setup Utility - Copyright (CI 2017 American Megatrends, Inc. Recovery) HAWKNGI System firmware is being updated. Keyboard is locked: DO NOT TURN THE POWER OFF !!! Once firmware update is completed press any key to reboot the system Flash update Flash update completed, Press any key to reset the system +: Select Screen T#: Select Item Enter: Select +/-= Change Opt. Fit: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESG: Exit Version 2.15.1266. Copyright (CI 2017 American Megatrends, Inc.

1. Using a different system, extract the BIOS package into a USB flash drive.

2. Press continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press to save the settings and exit the BIOS Setup utility.

Auto Setup Utility - Copyright (C) 2017 American Megatrends, Inc. Main Advanced Event Logs IPM Security BOOT Save & Exit Boot Configuration Boot mode select [DUAL] LEGACY to EFI support [Disabled] FIXED BOOT ORDER Priorities Boot Option #1 [DEFI AP:DEFI: No...] Boot Option #2 [OVI/DVD] Boot Option #3 [UBS Hard Disk] Boot Option #4 [UBS CD/OVA] Boot Option #5 [UBS key:SanOJak] Boot Option #6 [UBS Floppy] Boot Option #7 [UBS Lan] Boot Option #8 [Network:IDA GE SI...] Boot Option #9 [UEFI Hard Disk] Boot Option #10 [UEFI CD/OVA] Boot Option #11 [UEFI USB Hard Disk] Boot Option #12 [UEFI USB CD/OVA] Boot Option #13 [UEFI USB Key:UEFI...] Boot Option #14 [UEFI USB Floppy] Boot Option #15 [UEFI USB Lan] Boot Option #16 [UEFI Network] Boot Option #17 [Hard Disk] ▶ Pick New Boot Option Sets the system boot order <<: Select Screen T4: Select Item Enters Select +/-: Change Opt. F3: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit E00: Exit Version 2.19.1286. Copyright (C) 2017 American Megatrends, Inc.

1. When the UEFI Shell prompt appears, type fs# to change the device directory path. Go to the directory that contains the BIOS package you extracted earlier from Step 6. Enter flash.nsh BIOSname.### at the prompt to start the BIOS update process.

LEFI Interactive Shell v2.1 ESK 11 LEFI v2.50 (American Regatrends, 0x0089XXC) Mapping table: F50: A106(0):H0D(F0):BLK1; PcJW01(0x0)/PcI(0x14,0x0)/US$(0x11,0x0)/M01_MER_0xG7901072_0x806_0x1 OR3532) BLK0: A106(0): PcJW01(0x0)/PcI(0x14,0x0)/US$(0x11,0x0) Press ESCR is 1 seconds to skip startup.moh or any other key to continue. Shell (f50) F50: CD BLKOS F50:VAPLOOS> CD SKAPME2.0362017 F50:VAPLOOS/SKAPME2.0362017 flash.nsh X13P07.5X

Note: Do not interrupt this process until the BIOS flashing is complete.

Done. [Access Oms Port Ex] Index 0x51: 0x18 Done. ********************************************************************** * Program BIOS and ME (including RDT) regions... ********************************************************************** AMI Firmware Update Utility v5.09.01.1317 Copyright ©2017 American Registrends Inc. All Rights Reserved. OPUD = 50652 Reading Flash ....... done - ME Data Size checking . ok - FFS checksums ....... ok - Check BookLayout ....... ok, Erasing Boot Block ....... done Updating Boot Block ....... done Verifying Boot Block ....... done Zrading Main Block ....... 0x00132000 (00)

1. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

Verifying NCR Block ....... done - Update success for PCR - Update success for EE - - Successful Update Recovery Loader to (PRx1) - Successful Update MFSB11- - Successful Update FRTM11- - Successful Update NFx, [081 and 19021] - Successful Update FLOD and UTOX1 - ML entire image update success 11 WALVNDK : System must power-off to have the changes take effect! Moving FS01:AFUD00S/SKPME2_03162017/40x64.efi -> FS01:AFUD00S/SKPME2_03162017/f df.sac - [c4] Moving FS01:AFUD00S/SKPME2_03162017/aufemfix4.efi -> FS01:AFUD00S/SKPME2_0316201 ?afuefu1.sac - [c4] ****************************************************************************************** * * Please ignore this 'Shell cannot read from file - device error' * Warning message due to it does not impact flashing process. * ****************************************************************************************** Routing * Delete successful. FSb-> _

1. Press continuously to enter the BIOS Setup utility.
2. Press to load the default settings.
3. After loading the default settings, press to save the settings and exit the BIOS Setup utility.

Appendix E

Crash Dump Using IPMI

In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. For this purpose you can download a crash dump of status information using IPMI. The IPMI manual is available at https://www.supermicro.com/solutions/IPMI.cfm.

Check IPMI Error Log

1. Access the IPMI web interface.
2. Click the Server Health tab, then Event Log to verify an IERR error has occurred.

Host Identification Server: 172.031.040.125 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Server Health Sensor Readings Event Log Event Log For more special event log settings, please click here. This page displays events from the system's event log. You can choose a category from the pull-drive box to filter the events and also sort them by clicking on a column header. Clear Event Log Save Select an event log category: All Events Event ID Time Stamp Sensor Name Sensor Type Description 1 2017/10/19 15:38:37 Processor IERR - Assertion 2 2017/10/19 15:59:20 Processor IERR - Assertion

Figure E-1. IPMI Event Log

In the event of an IERR, the BMC executes a crash dump. You must download the crash dump and save it.

Downloading the Crash Dump File

1. In the IPMI interface, click the Miscellaneous tab, then the Trouble Shooting option.
2. Click the Dump button and wait five minutes for the file to be created. (No confirmation message will appear.)
3. Click the Download button and a Save As dialog appears.
4. Save the zipped dump file, noting the name and location.

SUPERMICRO Host Identification Server: 172.031.040.125 User: ADMIN (Administrator) System Server Health Configuration Remote Control Virtual Media Maintenance Miscellaneous Help Miscellaneous Activate License Post Snooping SMC RAKP Trouble Shooting UID Control Trouble Shooting This page provides trouble shooting file download. System auto reset Dump Download

Figure E-2. IPMI Crash Dump Download

Note: The System auto reset check box dictates behavior after an IERR. If checked, the system will restart automatically, and the dump file will be erased. If not, the system remains in a failed state. Do not check this box until after the dump file has been sent to Support.

Appendix F

CPU-Based RAID for NVMe

Intel® Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCI-E root complex.

• A single processor supports up to 12 NVMe SSDs and up to 6 RAID arrays.
• A dual processor system supports up to 24 NVMe SSDs and 12 RAID arrays.

Strip sizes are 4K, 8K, 16K, 32K, 64K, 128K.

Requirements and Restrictions

• Intel VROC is only available when the system is configured for UEFI boot mode.
• To enable the mdadm command and support for RSTe, install the patch from

- Linux: https://downloadcenter.intel.com/download/28158/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Linux-

- Windows: https://downloadcenter.intel.com/download/28108/Intel-Virtual-RAID-on-CPU-Intel-VROC-and-Intel-Rapid-Storage-Technology-enterprise-Intel-RSTe-Driver-for-Windows-

• To enable Intel VROC, a hardware key must be inserted on the motherboard, and the appropriate processor's Virtual Management Devices must be enabled in the BIOS setup.
• It is possible to enable Intel VROC without a hardware key installed, but only RAID0 will be enabled.
• Intel VROC is not compatible with secure boot. This feature must be disabled.
• When creating bootable OS RAID1 devices, you must have both devices on the same CPU, and a VMD on that CPU.
• Spanning drives when creating RAID devices is not recommended to due to performance issues, even though it is supported.

Supported SSDs and Operating Systems

To see the latest support information: https://www.intel.com/content/www/us/en/support/articles/000030310/memory-and-storage/ssd-software.html

Additional Information

Additional information is available on the product page for the Supermicro add-on card and the linked manuals.

www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm

F.1 Hardware Key

The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly. The key must be plugged into the Supermicro motherboard (connector JRK1). The key options are:

Intel® VROC Keys
VROC Package Description Part Number Intel MM Number
Standard	RAID 0, 1, 10Supports 3rd party SSDs	AOC-VROCSTNMOD 95	1605
Premium	RAID 0, 1, 5, 10Supports 3rd party SSDs	AOC-VROCPREMOD 95	1606
Intel SSD only	RAID 0, 1, 5, 10Supports Intel SSDs only	AOC-VROCINTMOD 95	822

VROC_HW_KEY PIN 1 GND KEY1 GND KEY2

Figure F-1. Intel® VROC RAID Key and Motherboard Connector JRK1

F.2 Enabling NVMe RAID

RAID for NVMe SSDs must be enabled through the UEFI BIOS.

1. Install the patch as described in the Restrictions and Requirements section on a previous page.
2. Reboot the server.
3. Press [DEL] key to enter BIOS.
4. Switch to Advanced > Chipset Configuration > North Bridge > IIO Configuration > Intel® VMD Technology > CPU1.
5. Enable the VMD according to the following rules.

- For M.2 NVMe or NVMe AIC, enable the VMD according to which AOC card/slot it used.

- For U.2 NVMe, enable all the sub-items under each PStack, based on the your model server:

An example U.2 configuration follows.

VAS Config for Pitack1 InteLB VAS for Volume Management Device Disable VAS Config for Pitack1 VAS/LOM-0 Name: VAS Disable Not Play Console Disable VAS Config for Pitack2 InteLB VAS for Volume Management Device Disable Enable/Disable InteLB Volume Management Device Technology in this block. + Select Screen F1: Select Disk Robert Select +/- Change Out. F1: General Help F2: Previous Values F3: Optimal Defaults F4: Save & Exit ECC: Exit Version 3.15.1958, Copyright: VSI 2018 American Apprentech, Inc.

Figure F-2. BIOS VMD Setting Example

1. Press [F4] to save the configuration and reboot the system.
2. Press [DEL] to enter BIOS.
3. Switch to Advanced > Intel® Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume.
4. Set Name.
5. Set RAID Level.
6. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller as shown in Figure F-4.

Auto Setup Utility - Copyright (C) 2018 American Markets, Inc. Created Create MDD Volume Name: MDD Levels: [0] Enable MDD approved over VMS Controller: 1.1 Select SIMI INTL SUPERCIALHITT SUPERCIALHITT INTL SUPERCIALHITT SUPERCIALHITT INTL SUPERCIALHITT SUPERCIALHITT INTL SUPERCIALHITT SUPERCIALHITT Output Size: [120W]0 Capacity: 100% 43 Create Volume x < 1 to secret Data → Select Screen Mtl: Select Item Enter: Select +/- Change Rate P1: General Rate P2: Previous Value P3: Optimized Defaults P4: Save & Fail P5: Exit

Figure F-3. Created Volume without enabling RAID spanned over VMD controller

Auto Setup Utility - Copyright (C) 2nd American Megatrends, Inc. Advanced Create RMS Volume Name: RMS Level Volume: (RMDS-01-04) Create RMS volume over RMS Controller X - to Select Item Select Display: [100%] Capacity: RMS 14VSS.CN -> Create Volume -> Select Screen Ttl: Select Item Options: Select +/- Change Dt. Ftl: Several Hds. Ftl: Previous Values Pfs: Options/Defaults Pfs: Save & Exit BSC1 Exit Version 2.17.2004 Copyright C12 2028 American Megatrends, Inc.

Figure F-4. Created Volume with enabling RAID spanned over VMD controller

1. Select specific disks for RAID with an [X].

• RAID0: Select at least two [2 - 24] disks
• RAID1: Select only two disks
• RAID5: Select at least three [3 - 24] disks
• RAID10: Select only four disks

1. Select Strip Size (Default 64KB).
2. Select Create Volume.
3. If another RAID is needed, start again at step 6.
4. Press [F4] to save and reboot.

F.3 Status Indications

An LED indicator on the drive carrier shows the RAID status of the drive.

Drive Carrier Status LED Indicator
Status State (red)
Normal function Off
Locating 4 Hz blink
Fault Solid on
Rebuilding 1 Hz Blink

IBPI SFF 8489 Defined Status LED States

F.4 Hot Swap Drives

Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other manufacturers. Under vSphere ESXi, several steps are necessary to avoid potential stability issues. See the information at link [1] below.

Hot-unplug

1. Prevent devices from being re-detected during rescan:

esxcli storage core claiming autoclaim --enabled=false

1. Unmount the VMFS volumes on the device. Check [2] for details.
2. Detach the device. Check [3] for details.
3. Physically remove the device.

Hot-plug

• Physically install the device.

ESXi will automatically discover NVMe SSDs, but a manual scan may be required in some cases.

Related Information Links

[1] https://kb.vmware.com/s/article/2151404
[2] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-1B56EF97-F60E-4F21-82A7-8F2A7294604D.html
[3] https://docs.vmware.com/en/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-F2E75F67-740B-4406-9F0C-A2D99A698F2A.html