SuperServer 6018TR-TF - Server Supermicro - Free user manual and instructions

USER MANUAL SuperServer 6018TR-TF Supermicro

Front panel of a rack-mounted server rack with indicator lights, function buttons, and control buttons visible.

USER'S MANUAL

Revision 1.0

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our web site at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate"

WARNING: Handling of lead solder materials used in this product may expose you to lead, a chemical known to the State of California to cause birth defects and other reproductive harm.

Manual Revision 1.0

Release Date: February 26, 2015

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document.

Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2015 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About This Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the SuperServer 6018TR-T/TF. Installation and maintenance should be performed by experienced technicians only.

The SuperServer 6018TR-T/TF is a high-end server based on the SC808BTS-1K03BP 1U rackmount chassis and the dual processor X10DRT-L/LIBF serverboard. All models have an IPMI LAN port and two serverboard nodes with two hot-swap 3.5" SATA3 Hard Disk Drives (HDD) each per node.

Each of the various models of the SuperServer 6018TR-T/TF servers and their associated serverboards for each of their unique options are listed in the table below:

SUPERSERVER 6018TR-T/TF Model Variations
Server Model	X10DRT Serverboard	Inf niBand FDR Connector
6018TR-T X10DRT-L NO
6018TR-TF X10DRT-LIBF YES

Manual Organization

Chapter 1: Introduction

The first chapter provides a checklist of the main components included with the server system and describes the main features of the X10DRT-L/LIBF serverboard and the SC808BTS-1K03BP chassis.

Chapter 2: Server Installation

This chapter describes the steps necessary to install the SuperServer 6018TR-T/TF into a rack and check out the server configuration prior to powering up the system. If your server was ordered without processor and memory components, this chapter will refer you to the appropriate sections of the manual for their installation.

Chapter 3: System Interface

Refer here for details on the system interface, which includes the functions and information provided by the control panel on the chassis as well as other LEDs located throughout the system.

Chapter 4: System Safety

You should thoroughly familiarize yourself with this chapter for a general overview of safety precautions that should be followed when installing and servicing the SUPERSERVER 6018TR-T/TF.

Chapter 5: Advanced Serverboard Setup

Chapter 5 provides detailed information on the X10DRT-L/LIBF serverboard, including the locations and functions of connections, headers and jumpers. Refer to this chapter when adding or removing processors or main memory and when reconfi guring the serverboard.

Chapter 6: Advanced Chassis Setup

Refer to Chapter 6 for detailed information on the SC808BTS-1K03BP server chassis. You should follow the procedures given in this chapter when installing, removing or reconfiguring SATA or peripheral drives and when replacing system power supply units and cooling fans.

Chapter 7: BIOS

The BIOS chapter includes an introduction to BIOS and provides detailed information on running the CMOS Setup Utility.

Appendix A: BIOS Error Beep Codes

Appendix B: System Specifications

Notes

Table of Contents

Chapter 1 Introduction

1-1 Overview 1-1
1-2 Serverboard Features 1-2
Processors 1-2
Memory 1-2
Serial ATA 1-2
PCI Expansion Slots 1-2
Onboard Controllers/Ports 1-3
Graphics Controller 1-3
InfiniBand 1-3
Other Features 1-3

1-3 Server Chassis Features 1-3

System Power 1-3

SATA Subsystem 1-4

Front Control Panel 1-4

I/O Ports 1-4

Cooling System 1-4

Air Shrouds 1-4

Mounting Rails 1-5

1-4 Advanced Power Management 1-5

Intel® Intelligent Power Node Manager (NM) 1-5

Manageability Engine (ME) 1-5

1-5 Contacting Supermicro 1-7

1-6 2U TwiSystem Notes 1-8

Nodes 1-8

System Power 1-8

SATA Backplane/Drives 1-8

Chapter 2 Server Installation

2-1 Overview 2-1

2-2 Unpacking the System 2-1

2-3 Preparing for Setup 2-1

2-4 Warnings and Cautions! 2-2

Choosing a Setup Location 2-2

Rack Precautions 2-2

Server Precautions....2-2

Rack Mounting Considerations 2-3

Ambient Operating Temperature 2-3

Reduced Airflow 2-3

Mechanical Loading 2-3

Circuit Overloading 2-3

Reliable Ground 2-4

2-5 Installing the System into a Rack 2-4

Identifying the Sections of the Rack Rails 2-4

Installing the Inner Rail Extension 2-6

Outer Rack Rails 2-7

2-6 Checking the Serverboard Setup 2-9

2-7 Checking the Drive Bay Setup 2-10

Chapter 3 System Interface

3-1 Overview 3-1

3-2 Control Panel Button 3-2

3-3 Control Panel LEDs 3-2

3-4 Drive Carrier LEDs 3-4

Chapter 4 Standardized Warning Statements for AC Systems

4-1 About Standardized Warning Statements 4-1

Warning Definition 4-1

Installation Instructions.... 4-4

Circuit Breaker 4-5

Power Disconnection Warning 4-6

Equipment Installation 4-8

Restricted Area....4-9

Battery Handling....4-10

Redundant Power Supplies 4-12

Backplane Voltage 4-13

Comply with Local and National Electrical Codes 4-14

Product Disposal 4-15

Easy Swap Fan Warning 4-16

Power Cable and AC Adapter 4-18

Chapter 5 Advanced Motherboard Setup

5-1 Handling the Motherboard 5-1

Precautions 5-1

Unpacking 5-1

5-2 Connecting Cables 5-2

Connecting Data Cables 5-2

5-3 Control Panel Connectors and I/O Ports 5-2

Connecting the Control Panel 5-3

5-4 Processor and Heatsink Installation.... 5-4

Installing a Passive CPU Heatsink 5-8

Removing the Heatsink 5-9

5-5 Installing Memory 5-10

Removing Memory Modules 5-10

Memory Support....5-11

Maximum Memory 5-11

Processor & Memory Module Population Configuration....5-11

5-6 Adding PCI Expansion Cards 5-12

5-7 Motherboard Details 5-13

5-8 Connector Definitions.... 5-16

5-9 Jumper Settings 5-23

Explanation of Jumpers 5-23

5-10 Onboard Indicators.... 5-25

5-11 PCI-Express and Serial ATA Connections 5-27

5-12 Installing Drivers.... 5-28

SuperDoctor 5 5-29

5-13 Serverboard Battery 5-31

Chapter 6 Advanced Chassis Setup

6-1 Static-Sensitive Devices.... 6-1

Precautions 6-1

Unpacking 6-1

6-2 Control Panel 6-2

6-3 Chassis Cover 6-3

6-4 Air Shrouds 6-4

6-5 Checking the Airflow 6-4

6-6 System Fans 6-5

6-7 Installing and Removing Hard Drives 6-6

Accessing the Drive Bays 6-6

6-8 Installing the Motherboard 6-9

Permanent and Optional Standoffs 6-9

6-9 Expansion Slot Setup 6-11

6-10 Power Supply 6-13

Power Supply Replacement 6-13

Chapter 7 BIOS

7-1 Introduction.... 7-1
Starting BIOS Setup Utility 7-1
How To Change the Configuration Data.... 7-1
Starting the Setup Utility 7-2
7-2 Main Setup....7-2
7-3 Advanced Settings Menu 7-4
4-4 Event Logs 7-30
4-5 IPMI 7-32
4-6 Security Settings 7-34
4-7 Boot Settings 7-37
4-8 Save & Exit 7-39

Appendix A BIOS Error Beep Codes

Appendix B System Specifications

Notes

Chapter 1

Introduction

1-1 Overview

The SuperServer 6018TR-T/TF is a high-end server comprised of two main subsystems: the SC808BTS-1K03BP 2U server chassis and the X10DRT-L/LIBF dual processor serverboard in four hot-swap nodes. Please refer to our web site for information on operating systems that have been certified for use with the system (www.supermicro.com).

In addition to the serverboard and chassis, various hardware components have been included with the SuperServer 6018TR-T/TF server, as listed below:

• Heat Sinks
  Two (2) 1U passive CPU heat sinks for rear CPU (SNK-P0047PW)
  Two (2) 1U passive CPU heat sinks w/narrow ILM (SNK-P0047PS)
  • Two (2) Mylar air shroud (MCP-310-80803-0B)
  • Six (6) 40x56-mm 4-pin PWM cooling fans (FAN-0085L4)
  • Two (2) Round 50-cm 16-to-16-pin ribbon front control cables (CBL-0087)
• SATA Backplane
  One (1) SATA Backplane for four (4) 3.5" HDD (BPN-SAS-808-O-P)
  Four (4) hot-swap 3.5" HDD trays (MCP-220-00075-0B)
  One (1) Set of SATA 4-51/47/41/37-cm round S-RA cables (CBL-0201L)
  Two (2) 4-pin 20-cm power cables, ST to RA (CBL-0212L)
  • Two (2) Riser cards (RSC-R1UTP-E16R-O-P)
  • One (1) Rail set (MCP-290-00042-0V)

Note: For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: ftp://ftp.supermicro.com
- Product safety information: http://super-dev/about/policies/safety_information.cfm
- If you have any questions, please contact our support team at: [e-mail]

1-2 Serverboard Features

At the heart of the SuperServer 6018TR-T/TF lies the X10DRT-L/LIBF, a dual processor serverboard based on the Intel® C612 chipset and designed to provide maximum performance. Two of these serverboards can be mounted in the SC808BTS-1K03BP chassis.

The sections below cover the main features of the X10DRT-L/LIBF serverboard (see Figure 1-1 for a block diagram of the chipset).

Processors

The X10DRT-L/LIBF supports single or dual Intel® Xeon® E5-2600 v3 Series processors (Socket R3-LGA 2011). Please refer to the serverboard description pages on our web site for a complete listing of supported processors (www.supermicro.com).

Memory

The X10DRT-L/LIBF has eight (8) DIMM slots supporting up to 256 GB of RDIMM registered ECC or 512 GB of LRDIMM DDR4 (288-pin) ECC 2133/1866/1600 MHz speed SDRAM in 512 MB, 1 GB, 2 GB, 4 GB, 8 GB, 16 GB, 32 GB or 64 GB sizes at 1.2V voltages. See Chapter 5 for details.

Note: Check the Supermicro website (www.supermicro.com) for the latest memory support information.

Serial ATA

A Serial ATA controller is integrated into the C612 to provide up to twelve SATA3 ports, (six SATA 3 (6 Gb/s) (I-SATA 0-5) and four S-SATA 3 (6 Gb/s) (S-SATA 0-3), RAID 0, 1, 5 and 10 supported. The SATA drives are hot-swappable units.

Note: The operating system you use must have RAID support to enable the hot-swap capability and RAID function of the SATA drives.

Note: S-SATA2/S-SATA3: can be used as Supermicro SuperDOM (Disk-on-Module) with built-in power connectors.

PCI Expansion Slots

The SuperServer 6018TR-T/TF has for each node One (1) PCI-Express 3.0 x16 slot available for use with a riser card.

Onboard Controllers/Ports

One Fast UART 16550 port, a single InfiniBand connector with FDR/QDR support 6018TR-TF only), a VGA (monitor) port, an IPMI dedicated LAN port and two Ethernet ports, and two USB 2.0 ports (additional one internal USB Type-A connector is included on the serverboard) are all available on the IO back panel.

Note: For IPMI Configuration Instructions, please refer to the Embedded BMC Configuration User's Guide available @ http://www.supermicro.com/support/manuals/.

Graphics Controller

The X10DRT-L/LIBF features an integrated ASpeed 2400 BMC Video Controller.

Infi niBand

The server include an FDR (fourteen data rate) speed InfiniBand QSFP connector. InfiniBand is a scalable serial communications link intended for connecting processors with high-speed peripherals.

Other Features

Other onboard features that promote system health include onboard voltage monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and CPU overheat sensors, virus protection, node manager software and BIOS rescue.

1-3 Server Chassis Features

The following is a general outline of the main features of the SC808 server chassis.

System Power

Each SC808 chassis model includes a high-efficiency 80-plus Titanium level certified power supply, rated at 1000 Watts plus one redundant backup power supply. In the unlikely event your power supply fails, replacement is simple and can be accomplished without tools.

Note: The power supplies are hot-plug.

SATA Subsystem

The SC808 supports up to four (4) 3.5" hot-swap SATA drives in trays (two for each node). These drives are hot-swappable units and are connected to a backplane that provides power and control.

Note: The operating system you use must have RAID support to enable the hot-swap capability of the drives.

Front Control Panel

SC808BTS-1K03BP chassis includes two front panels on the handles of the chassis which control each of the systems. Each control panel on the SUPERSERVER 6018TR-T/TF provides you with system monitoring and control for one server node. LEDs indicate system power, HDD activity, network activity, system overheat and power supply failure. A main power button and a system reset button are also included.

I/O Ports

The SC808 is an proprietary form factor chassis designed to be used in a 1U rackmount configuration. The SC808 chassis provides a low-profile add-on card slot, a COM port, a VGA port, two USB 2.0 ports, one IPMI Ethernet port and two gigabit Ethernet ports per node.

Cooling System

The SC808 chassis accepts six (6) 4-cm system fans powered from either backpane or the serverboards. If not powered from the backpane, the SC808BTS-1K03BP model chassis powers three fans from each of the two motherboards, so that when one of the motherboard drawers is removed, the other motherboards will continue running its fans.

Note: The fans in this system are NOT redundant, hot-plug.

Air Shrouds

The SC808 chassis includes two plastic air shrouds that direct the airflow where cooling is needed on each serverboard. Always use the air shroud included with your chassis on each serverboard.

Mounting Rails

The SC808 includes a set of rails, and can be placed in a rack for secure storage and use. To setup your rack, follow the step-by-step instructions included in this manual.

1-4 Advanced Power Management

Intel® Intelligent Power Node Manager (NM)

The Intel® Intelligent Power Node Manager (IPNM) provides your system with real-time thermal control and power management for maximum energy efficiency. Although IPNM Specification Version 1.5 is supported by the BMC (Baseboard Management Controller), your system must also have IPNM-compatible Manageability Engine (ME) firmware installed to use this feature.

Manageability Engine (ME)

The Manageability Engine, which is an ARC controller embedded in the IOH (I/O Hub), provides Server Platform Services (SPS) to your system. The services provided by SPS are different from those proved by the ME on client platforms.

Figure 1-1. AMD C612 Chipset: System Block Diagram

graph TD
    subgraph X10DRT-L/LIBQ/LIBF
        CPU1["CPU1"] -->|P1 P2 QPI 9.6G| CPU2["CPU2"]
        CPU1 -->|PCI-E X8 G3| MellanoxCX3["MMellanox CX3 IB QDR/FDR"]
        CPU1 -->|PCI-E X16 G3| PCI-EX16["PCI-E X16 SLOTT"]
        CPU1 -->|PCI-E X4 G3| LAN1["LAN1 i350"]
        CPU1 -->|PCI-E X8 G3| PCI-EX16
        CPU1 -->|PCI-E X4 G3| PAC["PCH"]
        PAC -->|I-SATA 6.0 Gb/S| SATA["SATA"]
        PAC -->|I-SATA 6.0 Gb/S| SATA["SATA"]
        PAC -->|I-SATA 6.0 Gb/S| USB["X2 rear port"]
        PAC -->|I-SATA 6.0 Gb/S| USBTypeA["USB TYPE A"]
        PAC -->|I-SATA 6.0 Gb/S| USB2["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB3["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB4["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB5["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB6["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB7["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB8["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB9["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB10["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB11["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB12["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB13["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB14["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB15["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB16["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB17["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB18["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB19["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB20["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB21["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB22["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB23["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB24["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB25["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB26["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB27["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB28["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB29["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB30["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB31["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB32["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB33["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB34["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB35["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB36["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB37["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB38["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB39["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB40["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB41["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB42["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB43["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB44["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB45["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB46["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB47["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB48["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB49["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB50["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB51["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB52["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB53["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB54["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB55["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB56["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB57["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB58["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB59["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB60["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB61["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB62["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB63["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB64["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB65["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB66["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB67["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB68["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB69["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB70["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB71["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB72["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB73["USB 2.0 USB 3.0"]
        PAC -->|I-SATA 6.0 Gb/S| USB74["USB 2.0 USB"] 
    end

Note 1: This is a general block diagram and may not exactly represent the features on your motherboard. See the Motherboard Features pages for the actual specifications of each motherboard.

Note 2: Both CPUs need to be installed for full access to the PCI-E slots, DIMM slots, and onboard controllers. Refer to the block diagram above to determine which slots or devices may be affected.

1-5 Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

1-6 2U Twin System Notes

As a 2U Twin ^2 configuration, the SuperServer 6018TR-T/TF is a unique server system. With two system boards incorporated into a single chassis acting as two separate nodes, there are several points you should keep in mind.

Nodes

Each of the two serverboards act as a separate node in the system. As independent nodes, each may be powered off and on without affecting the others. In addition, each node is a hot-swappable unit that may be removed from the rear of the chassis. The nodes are connected to the server backplane by means of an adapter card.

Note: A guide pin is located between the upper and lower nodes on the inner chassis wall. This guide pin also acts as a "stop" when a node is fully installed. If too much force is used when inserting a node this pin may break off. Take care to slowly slide a node in until you hear the "click" of the locking tab seating itself.

System Power

Dual 1000 Watt power supplies are used to provide the power for all serverboards. Each serverboard however, can be shut down independently of the other with the power button on its own control panel.

SATA Backplane/Drives

As a system, the SuperServer 6018TR-T/TF supports the use of four SATA drives. A single SATA backplane works to apply system-based control for power and fan speed functions, yet at the same time logically connects a set of two SATA drives to each serverboard. Consequently, RAID setup is limited to a two-drive scheme (RAID cannot be spread across all drives). See the Drive Bay Installation/Removal section in Chapter 6 for the logical hard drive and node configuration.

Chapter 2

Server Installation

2-1 Overview

This chapter provides a quick setup checklist to get your SuperServer 6018TR-T/TF up and running. Following these steps in the order given should enable you to have the system operational within a minimum amount of time. This quick setup assumes that your system has come to you with the processors and memory preinstalled. If your system is not already fully integrated with a serverboard, processors, system memory etc., please turn to the chapter or section noted in each step for details on installing specific components.

2-2 Unpacking the System

You should inspect the box the SuperServer 6018TR-T/TF was shipped in and note if it was damaged in any way. If the server itself shows damage you should file a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the SuperServer 6018TR-T/TF. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. You will also need it placed near a grounded power outlet. Read the Rack and Server Precautions in the next section.

2-3 Preparing for Setup

The box the SuperServer 6018TR-T/TF was shipped in should include two sets of rail assemblies, two rail mounting brackets and the mounting screws you will need to install the system into the rack. Follow the steps in the order given to complete the installation process in a minimum amount of time. Please read this section in its entirety before you begin the installation procedure outlined in the sections that follow.

2-4 Warnings and Cautions!

Choosing a Setup Location

• Leave enough clearance in front of the rack to enable you to open the front door completely (\~25 inches) and approximately 30 inches of clearance in the back of the rack to allow for sufficient airflow and ease in servicing.
• This product is for installation only in a Restricted Access Location (dedicated equipment rooms, service closets and the like).
• This product is not suitable for use with visual display work place devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them.
• In single rack installation, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a component from the rack.
• You should extend only one component at a time - extending two or more simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Chapter 4.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components on the bottom of the rack first, and then work up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power surges, voltage spikes and to keep your system operating in case of a power failure.
• Allow any hot plug drives and power supply modules to cool before touching them.
• Always keep the rack's front door and all panels and components on the servers closed when not servicing to maintain proper cooling.

Rack Mounting Considerations

Warning! To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the room. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (Tmra).

Reduced Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

2-5 Installing the System into a Rack

This section provides information on installing the SC808 chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean the assembly procedure will differ slightly. You should also refer to the installation instructions that came with the rack unit you are using.

NOTE: This rail will fit a rack between 26" and 33.5" deep.

Warning: Do not pick up the server with the front handles. They are designed the system from a rack only.

Stability Hazard: The rack stabilizing mechanism must be in place, or the must be bolted to the floor before you slide the unit out for servicing. Failure to the rack can cause the rack to tip over.

Warning: Slide rail mounted equipment is not to be used as a shelf or a work

Identifying the Sections of the Rack Rails

The chassis package includes two rack rail assemblies in the rack mounting kit. Each assembly consists of two sections: an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself (Figure 2-1).

Figure 2-1: Identifying the Sections of the Rack Rails (Right side rail shown)

Rail Extension (Inner Rail is preinstalled to the chassis) Outer Rails

Installing the Inner Rail Extension

The SC808 chassis includes a set of inner rails in two sections: Inner rails and inner rail extensions. The inner rails are preattached and do not interfere with normal use of the chassis if you decide not to use a server rack. Attach the inner rail extension to stabilize the chassis within the rack.

Installing the Inner Rails (Figure 2-2)

1. Place the inner rack extensions on the side of the chassis aligning the hooks of the chassis with the rail extension holes. Make sure the extension faces "outward" just like the preattached inner rail.
2. Slide the extension toward the front of the chassis.
3. Secure the chassis with two screws as illustrated.
4. Repeat steps 1-3 for the other inner rail extension.

Figure 2-2: Installing the Inner Rail Extensions

Technical diagram of server rack components with numbered annotations indicating assembly steps

Outer Rack Rails

Outer rails attach to the rack and hold the chassis in place.

Installing the Outer Rails to the Rack (Figure 2-3)

1. Attach the short bracket to the outside of the long bracket. You must align the pins with the slides. Also, both bracket ends must face the same direction.
2. Adjust both the short and long brackets to the proper distance so that the rail fi ts snugly into the rack.
3. Secure the long bracket to the front side of the outer rail with two M5 screws and the short bracket to the rear side of the outer rail with three M5 screws.
4. Repeat steps 1-4 for the left outer rail.

Figure 2-3. Assembling the Outer Rails

Secure to the Front of the Rack Attach Outer Racks together Secure to the Rear of the Rack

Installing the Chassis into a Rack (Figure 2-4)

1. Confirm that chassis includes the inner rails (A) and rail extensions (B). Also, confirm that the outer rails (C) are installed on the rack.

2. Line chassis rails (A and B) with the front of the rack rails (C).

3. Slide the chassis rails into the rack rails, keeping the pressure even on both sides (you may have to depress the locking tabs when inserting). When the server has been pushed completely into the rack, you should hear the locking tabs "click".

4. (Optional) Insert and tightening the thumbscrews that hold the front of the server to the rack.

Figure 2-4: Installing the Rack Rails

A B C FRONTAGE

Note: The figure above is for illustration purposes only. Always install servers to the bottom of the rack first.

2-6 Checking the Serverboard Setup

After you install the SuperServer 6018TR-T/TF in the rack, you will need to open the unit to make sure the serverboard is properly installed and all the connections have been made.

Accessing the inside of the System

Before operating the server for the first time, it is important to remove the protective fi lm covering the top of the chassis, in order to allow for proper ventilation and cooling.

Removing the Chassis Cover and Protective Film (Figure 2-5)

1. Disconnect the chassis from any power source and remove all four screws.
2. Gently push down on the chassis cover in the areas indicated in the illustration.
3. Push the cover toward the rear of the chassis and lift the cover upwards and off the chassis.
4. Peel off the protective film covering the top cover and the top of the chassis
5. Check that all ventilation openings on the top cover and the top of the chassis are clear and unobstructed.

Figure 2-5. Accessing the Inside of the System

Technical diagram of a server rack with labeled components and directional arrows indicating assembly or movement.

Checking the Components and Setup

1. You may have one or two processors already installed into the serverboard. Each processor needs its own heat sink. See Chapter 5 for instructions on processor and heat sink installation.
2. Your SuperServer 6018TR-T/TF server system may have come with system memory already installed. Make sure all DIMMs are fully seated in their slots. For details on adding system memory, refer to Chapter 5.
3. If desired, you can install add-on cards to the system. See Chapter 5 for details on installing PCI add-on cards.
4. Make sure all power and data cables are properly connected and not blocking the chassis airflow. Also make sure that no cables are positioned in front of the fans. See Chapter 5 for details on cable connections.

2-7 Checking the Drive Bay Setup

Next, you should check to make sure the peripheral drives and the SATA drives have been properly installed and all connections have been made.

Checking the Drives

1. All drives are accessible from the front of the server. A hard drive can be installed and removed from the front of the chassis without removing the top chassis cover.
2. Depending upon your system's configuration, your system may have one or more drives already installed. If you need to install hard drives, please refer to Chapter 6.

Checking the Airflow

1. Airflow is provided by six hot-swappable 4-cm chassis cooling fans in two housings. The system component layout was carefully designed to direct sufficient cooling airflow to the components that generate the most heat.

2. Note that all power and data cables have been routed in such a way that they do not block the airflow generated by the fans.

Providing Power

1. Plug the power cord(s) from the power supply unit(s) into a high-quality power strip that offers protection from electrical noise and power surges. It is recommended that you use an uninterruptible power supply (UPS).

2. Depress the power on button on the front of the chassis.

Caution: Except for short periods of time, do NOT operate the server without the cover in place. The chassis cover must be in place to allow proper airflow and prevent overheating.

Chapter 3

System Interface

3- 1 Overview

There are several LEDs on the control panel and on the drive carriers to keep you constantly informed of the overall status of the system. SC808 models include four front panels on the handles of the chassis which control each of the systems.

This chapter explains the meanings of all LED indicators and the appropriate response you may need to take.

Figure 3-1: Control Panel

Diagram of a server rack with labeled buttons and a 'RESET' button, showing top-down view of internal network topology.

3-2 Control Panel Button

There are two push-buttons located on the front of the chassis. These are (in order from left to right) a reset button and a power on/off button.

Reset: The reset button is used to reboot the system.

Power: The main power switch is used to apply or remove power from the power supply to the server system. Turning off system power with this button removes the main power but keeps standby power supplied to the system. Therefore, you must unplug system before servicing.

3-3 Control Panel LEDs

The control panel located on the front of the SC808 chassis has five LEDs. These LEDs provide you with critical information related to different parts of the system. This section explains what each LED indicates when illuminated and any corrective action you may need to take.

Information LED: See the following table for the status shown by this LED.

Information LED
Status Description
Continuously on and red An overheat ocondition has occurred. (This may be caused by cable congestion.)
Blinking red (1 Hz) Fan failure: check for an inoperative fan.
Blinking red (0.25 Hz) Power failure: check for an inoperative power supply.
Solid blue Local UID has been activated. Use this function to locate the server in a rack environment.
Blinking blue (300 msec) Remote UID has been activated. Use this function to locate the server from a remote location.

NIC2: Indicates network activity on GLAN2 when flashing

NIC1: Indicates network activity on GLAN1 when flashing

HDD: Indicates IDE channel activity. SAS/SATA drive, and/or DVD-ROM drive activity when flashing.

Power: Indicates power is being supplied to the system's power supply units. This LED should normally be illuminated when the system is operating.

3-4 Drive Carrier LEDs

The chassis includes externally accessible SAS/SATA drives. Each drive carrier displays two status LEDs on the front of the carrier.

	LED Color State Status
Activity LED	Green Solid On SAS drive installed
	Green Blinking I/O activity
Status LED	Red Solid On Failed drive for SAS/SATA with RSTe support
	Red Blinking at 1 Hz Rebuild drive for SAS/SATA with RSTe support
	Red Blinking with two blinks and one stop at 1 Hz		Hot spare for SAS/SATA with RSTe support
	Red On for five seconds, then off		Power on for SAS/SATA with RSTe support
	Red Blinking at 4 Hz Identify drive for SAS/SATA with RSTe support

Chapter 4

Standardized Warning Statements for AC Systems

4-1 About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our web site at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning!

This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning!

Read the installation instructions before connecting the system to the power source.

設置手順書

This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning!

The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

電源切断の警告

Equipment Installation

Warning!

Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning!

This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源裝置

Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning!

Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Easy Swap Fan Warning

Warning!

The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning!

When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the code) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

This chapter covers the steps required to install the X10DRT-L/LIBF motherboard into the chassis, connect the data and power cables and install add-on cards. All motherboard jumpers and connections are also described. A layout and quick reference chart are included in this chapter for your reference. Remember to completely close the chassis when you have finished working with the motherboard to better cool and protect the system.

5-1 Handling the Motherboard

Electrostatic Discharge (ESD) can damage electronic components. To prevent damage to any printed circuit boards (PCBs), it is important to handle them very carefully (see previous chapter). To prevent the motherboard from bending, keep one hand under the center of the board to support it when handling. The following measures are generally sufficient to protect your equipment from electric static discharge.

Precautions

• Use a grounded wrist strap designed to prevent Electrostatic Discharge (ESD).
- Touch a grounded metal object before removing any board from its antistatic bag.
- Handle a board by its edges only; do not touch its components, peripheral chips, memory modules or gold contacts.
- When handling chips or modules, avoid touching their pins.
- Put the motherboard, add-on cards and peripherals back into their antistatic bags when not in use.
- For grounding purposes, make sure your computer chassis provides excellent conductivity between the power supply, the case, the mounting fasteners and the motherboard.

Unpacking

The motherboard is shipped in antistatic packaging to avoid electrical static discharge. When unpacking the board, make sure the person handling it is static protected.

5-2 Connecting Cables

Now that the processors are installed, the next step is to connect the cables to the serverboard.

Connecting Data Cables

The cables used to transfer data from the peripheral devices have been carefully routed in preconfigured systems to prevent them from blocking the flow of cooling air that moves through the system from front to back. If you need to disconnect any of these cables, you should take care to reroute them as they were originally after reconnecting them (make sure the red wires connect to the pin 1 locations). If you are configuring the system, keep the airflow in mind when routing the cables.

The following cables need to be connected for the SuperServer 6018TR-T/TF system:

• Two round 50-cm 16-to-16-pin ribbon front control cables (CBL-0087)
  • One set of SATA 4-51/47/41/37-cm round cables (CBL-0201L)
  • Two 4-pin 20-cm power cables (CBL-0212L)

5-3 Control Panel Connectors and I/O Ports

The rear I/O ports are color coded in conformance with the PC 99 specification. See Figure 5-1 below for the colors and locations of the various I/O ports.

Figure 5-1. Rear I/O Ports

Diagram showing nine labeled network device components including Ethernet, USB port, and network switch.

Back Panel I/O Port Locations and Definitions

1. Back Panel USB Port 0

2. Back Panel USB Port 1

3. IPMI_Dedicated LAN

4. Gigabit LAN 1

5. Gigabit LAN 2

6. COM1

7. VGA (Blue)

8. Infi niBand FDR/QDR (Optional for X10DRT-LIBF/LIBQ)

9. UID Button/UID LED (LE1)

Connecting the Control Panel

JF1 contains header pins for various front control panel connectors. See Figure 5-1 for the pin locations of the various front control panel buttons and LED indicators. Even and odd numbered pins are on opposite sides of each header.

All JF1 wires have been bundled into single keyed ribbon cable to simplify their connection. The red wire in the ribbon cable plugs into pin 1 of JF1. Connect the other end of the cable to the Control Panel printed circuit board, located just behind the system status LEDs in the chassis.

See the Connector Definitions section in this chapter for details and pin descriptions of JF1.

Figure 5-2. Front Control Panel Header Pins (JF1)

Power Button Reset Button 3.3V UID LED NIC2 Activity LED NIC1 Activity LED UID Switch 3.3 V X X Ground Ground Power Fail LED OH/Fan Fail/ PWR Fail LED) NIC2 Link LED NIC1 Link LED HDD LED FP PWRLED Ground 19 20

5-4 Processor and Heatsink Installation

Caution! When handling the processor package, avoid placing direct pressure on the label area.

Note: Always connect the power cord last, and always remove it before adding, removing or changing any hardware components. Make sure that you install the processor into the CPU socket before you install the CPU heatsink.

Caution! If you buy a CPU separately, make sure that you use an Intel-certified multi-directional heatsink only.

Note: Make sure to install the system board into the chassis before you install the CPU heatsink.

Note: When receiving a server board without a processor pre-installed, make sure that the plastic CPU socket cap is in place and none of the socket pins are bent; otherwise, contact your retailer immediately.

Note: Refer to the Supermicro website for updates on CPU support.

Note: When one CPU is installed, be sure to installed on CPU Socket 1 first.

Installing the LGA2011 Processor

1. There are two load levers on the LGA2011 socket. To open the socket cover, first press and release the load lever labeled 'Open 1st'.

Open 1st Press down on Load Lever labeled 'Open 1st'.

Note: Graphics and drawings shown in this manual are for illustration only. Your components may or may not look the same as the graphics shown in the manual.

1. Press the second load lever labeled 'Close 1st' to release the load plate that covers the CPU socket from its locking position.

1. With the lever labeled 'Close 1st' fully retracted, gently push down on the 'Open 1st' lever to open the load plate. Lift the load plate to open it completely.

1. Using your thumb and the index finger, remove the 'WARNING' plastic cap from the socket.

Technical line drawing of a mechanical component with an arrow indicating direction (no text or symbols present)

1. Use your thumb and index finger to hold the CPU on its edges. Align the CPU keys, which are semi-circle cutouts, against the socket keys.

Socket Keys CPU Keys

1. Once they are aligned, carefully lower the CPU straight down into the socket. (Do not drop the CPU on the socket. Do not move the CPU horizontally or vertically. Do not rub the CPU against the surface or against any pins of the socket to avoid damaging the CPU or the socket.)

Technical line drawing of a mechanical component with mounting holes and mounting brackets (no text or symbols)

Caution: You can only install the CPU inside the socket in one direction. Make sure that it is properly inserted into the CPU socket before closing the load plate. If it doesn't close properly, do not force it as it may damage your CPU. Instead, open the load plate again and double-check that the CPU is aligned properly.

1. With the CPU inside the socket, inspect the four corners of the CPU to make sure that the CPU is properly installed.
2. Close the load plate with the CPU inside the socket. Lock the lever labeled 'Close 1st' first, then lock the lever labeled 'Open 1st' second. Use your thumb to gently push the load levers down to the lever locks.

Gently close the load plate.

Push down and lock the level labeled 'Close 1st'. Close 1st OPEN 1st

Lever Lock Push down the lever 'Open OPEN In

and lock labeled 1st' Open 1st Lever Lock

Installing a Passive CPU Heatsink

1. Do not apply any thermal grease to the heatsink or the CPU die -- the required amount has already been applied.
2. Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the motherboard and the heatsink bracket underneath.
3. Screw in two diagonal screws (e.g., the #1 and the #2 screws) until just snug. Do not over-tighten the screws to avoid damaging the CPU and the motherboard.
4. Finish the installation by fully tightening all four screws.

Direction of the Air ow Screw#1 Screw#2 Mounting Holes

Note: For optimal airflow, please follow your chassis airflow direction to correctly install the CPU heatsink. Graphic drawings included in this manual are for reference only. They might look different from the components installed in your system.

Removing the Heatsink

Caution: We do not recommend that the CPU or the heatsink be removed. However, if you do need to uninstall the CPU or the heatsink, please follow the instructions below to uninstall the heatsink to avoid damaging the CPU or the motherboard.

1. Unscrew the heatsink screws from the motherboard in the sequence as shown in the illustration below.
2. Gently wriggle the heatsink to loosen it from the CPU. Do not use excessive force when loosening the heatsink!
3. Once the heatsink is loosened from the socket, remove the heatsink from the CPU socket. Once the heatsink is removed, remove the CPU from the socket as needed.
4. Remove the used thermal grease and clean the surface of the CPU and the heatsink. Reapply the proper amount of thermal grease on the surface before reinstalling the CPU and the heatsink as needed.

Loosen screws in the sequence as shown Screw#1 Screw#2 Direction of the airf1 ow Screw#3 Screw#4 Motherboard

Notes:

1.) For optimized airflow, please follow your chassis airflow direction to properly install the heatsink.
2.) Graphics shown in this manual are for reference only. They may or may not look the same as the components installed in your system.

5-5 Installing Memory

Caution: Exercise extreme care when installing or removing DIMM m prevent any possible damage.

Installing Memory

1. Insert the desired number of DIMMs into the memory slots, starting with P1-DIMMA1. For best performance, please use DIMM modules of the same type and speed in the same bank.
2. Push the release tabs outwards on both ends of the DIMM slot to unlock it.
3. Align the key of the DIMM module with the receptive point on the memory slot.
4. Align the notches on both ends of the module against the receptive points at each side of the slot.
5. With your thumbs, press the notches on both ends of the module straight down into the slot until the module snaps into place.
6. Press the release tabs to their locking positions to secure the DIMM into the slot.

Figure 5-3. Installing DIMMs

Release Notches Release Lock/Release Tabs

Note: 512 MB, 1 GB, 2 GB, 4 GB, 8 GB, 16 GB, 32 GB or 64 GB size memory modules are supported. It is highly recommended that you remove the power cord from the system before installing or changing memory modules. Please refer to our web site for memory that has been tested on the X10DRT-L/LIBF serverboard.

Removing Memory Modules

Press both release tabs on the ends of the DIMM to unlock it. Once the DIMM is loosened, remove it from the memory slot.

Memory Support

The X10DRT-L/LIBF has eight (8) DIMM slots supporting up to 256 GB of RDIMM registered ECC or 512 GB of LRDIMM DDR4 (288-pin) ECC 2133/1866/1600 MHz speed SDRAM in 512 MB, 1 GB, 2 GB, 4 GB, 8 GB, 16 GB, 32 GB or 64 GB sizes at 1.2V voltages. See Chapter 5 for details.

Note: Check the Supermicro website (www.supermicro.com) for the latest memory support information.

Maximum Memory

The X10DRT-L/LIBF serverboard supports up to 256 GB of ECC 240-pin Registered (RDIMM) or 512 GB of Load Reduced (LRDIMM) ECC memory in eight (8) DIMM slots.

Processor & Memory Module Population Configuration

For the memory to work properly, follow the tables below for memory installation.

Processors and their Corresponding Memory Modules
CPU#	Corresponding DIMM Modules
CPU 1 P1	-DIMMA1 P1-DI	MMB1 P1-DIMMC1	P1-DIMMD1
CPU2 P2	-DIMME1 P2-DI	MMF1 P2-DIMMG1	P2-DIMMH1

Processor and Memory Module Population for Optimal Performance
Number of CPUs+DIMMs	CPU and Memory Population Configuration Table(For memory to work properly, please follow this table.)
1 CPU &2 DIMMs	CPU1P1-DIMMA1/P1-DIMMB1
1 CPU &4 DIMMs	CPU1P1-DIMMA1/P1-DIMMB1, P1-DIMMC1/P1-DIMMD1
2 CPUs &4 DIMMs	CPU1 + CPU2P1-DIMMA1/P1-DIMMB1, P2-DIMME1/P2-DIMMF1
2 CPUs &6 DIMMs	CPU1 + CPU2P1-DIMMA1/P1-DIMMB1/P1-DIMMC1/P1-DIMMD1, P2-DIMME1/P2-DIMMF1
2 CPUs &8 DIMMs	CPU1 + CPU2P1-DIMMA1/P1-DIMMB1/P1-DIMMC1/P1-DIMMD1, P2-DIMME1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1

Populating RDIMM/LRDIMM ECC Memory Modules

RDIMM/LRDIMM DDR4 ECC
Type Ranks	Per DIMM & Data Width	Memory DIMM Capacity (GB) (See the Note Below)		Max Speed (Ghz); Voltage (V) Slots per Channel (SPC) and DIMM per Channel (DPC)
				1 Slots Per Channel
				1DPC
		4GB 8GB	1.2V
RDIMM SRx4	8GB 16GB 2133
RDIMM SRx8	4GB 8GB 2133
RDIMM QRx8	8GB 16GB 2133
RDIMM QRx4	16GB 32GB 2133
LRDIMM (RM) QRx4	32GB 64GB	2133
Note: For detailed information on memory support and updates, please refer to the SMC Recommended Memory List posted on our website at http://www.supermicro.com/support/resources/mem.cfm.

5-6 Adding PCI Expansion Cards

The 6018TR-T/TF includes one preinstalled riser cards designed specifically for use in the SC808BTS-1K03BP 1U rackmount chassis. These riser cards support one low-profile PCI Express x16 cards to fit inside the chassis for each node.

Installing an Expansion Card

1. After powering down the system, remove the PCI slot shield.
2. Fully seat the card into the slot, pushing down with your thumbs evenly on both sides of the card.
3. Finish by using a screw to secure the top of the card shield to the chassis. The PCI slot shield protects the motherboard and its components from EMI and aid in proper ventilation, so make sure it is always in place.

5-7 Motherboard Details

Figure 5-4. X10DRT-L/LIBF Motherboard Layout (not drawn to scale)

UD J2C1 J2C2 CPU1 SLOT1 PCI-E 3.0 X16 I-SATA4I-SATA5 I-SATA2I-SATA3 I-SATA0I-SATA1 LEInfiniBand VGA COM1 LAN2 LAN1 USB0/1(2.0) JIB1 JPME2 JWD1 InfiniBand Chip JSTBY1 LEDPWR E8 LEDBMC BIOS PCH S-SATA0S SATA1 LAN CTRL IPMI_LAN JPG1 USB2 (3.0) PB1 I-SGPIO2 BMC S-SATA2 JDT1 JSP101 JPMB-1VRM2 JS-D2 USD1 JS-D3 S-SATA3 JSP101 JPM1 IPMB-1VRM2 SUPERO X10DRT-L Rev. 1.00 CPU1 MAC CODE CE FC P1-DIMMD1 P1-DIMMC1 BAR CODE IB GUID IPMI CODE CLOSEF 1st CPU2 OPEN 1st P2-DIMMH1 P2-DIMMF1 FAN3 JPI2C1

Notes:

1. For the latest CPU/Memory updates, please refer to our website at http://www.supermicro.com/products/motherboard/ for details.
2. Use only the correct type of onboard CMOS battery as specified by the manufacturer. Do not install the onboard battery upside down to avoid possible explosion.
3. Jumpers not indicated are for test purposes only.
4. All graphics shown in this manual were based upon the latest PCB Revision available at the time of publishing of the manual. The motherboard you've received may or may not look exactly the same as the graphics shown in this manual.

X10DRT-L/LIBF Quick Reference
Jumper Description Default Setting
JBT1 Reset BIOS Conf guration See Chapter 2
JIB1 Infi ni-Band (IB) Enable (For X10DRT-LIBQ/LIBF) Pins 1-2 (Enabled)
JI2C1/JI2C2 SMB to PCI-E Slots Pins 2-3 (Disabled)
JPB1 BMC Enable Pins 1-2 (Enabled)
JPG1 VGA Enable	Pins 1-2 (Enabled)
JPL1	GLAN1/GLAN2 Enable	Pins 1-2 (Enabled)
JPME2	Manufacture (ME) Mode Select	Pins 1-2 (Normal)
JWD1	Watch Dog Timer Enable	Pins 1-2 (Reset)

LED	Description	State	Status
LE1	UID LED	Blue: On	Unit Identified
LE8 HDD LED	On	HDD Active
LEDBMC	BMC Heartbeat LED	Green: Blinking BMC Normal
LEDPWR Standby Power LED	On	Power On

Connector Description
BT1 (Battery) Onboard	CMOS battery (See Chapter 3 for Used Battery Disposal.)
COM1	Backplane COM Port1
FAN1,3,4 CPU/system	fan headers (Fan 1, Fan 3, Fan 4)
InfiniBand Port	InfiniBand FDR connector on the IO backpanel (Optional for the X10DRT-LIBF)
J4/J6 20-pin main power connectors (required)
JF1 Front panel control header
JIPMB1 4-pin external	BMC I ^2C header (for an IPMI card)
JP3 4-pin power connector for the HDD panel on Chassis 808/809 (required)
JPFC1 Power supply SMBbus I ^2C header
JSD1/JSD2 SATA DOM (Disk-on-Module) power connectors 1/2
JSTBY1 Standby power connector
JTPM1 TPM (Trusted Platform Module)/Port 80 header
LAN1/LAN2 G-bit Ethernet (GLAN) ports 1/2
IPMI_LAN IPMI_dedicated LAN support by the ASpeed controller
I-SATA 0-5	SATA 3.0 connections supported by Intel PCH (I-SATA 0-5)
S-SATA0-3	SATA 3.0 connections (S-SATA0-3) supported by Intel SCU (Note: S-SATA2/S-SATA3: can be used as Supermicro SuperDOMs (-Disks-on-Module) with built-in power connectors)
I-SGPIO1/2 Serial General-Purpose Input/Out connector headers for I-SATA 0-5 (I-SGPIO1: I-SATA0-3, I-SGPIO2: I-SATA4/5)
S-SPGIO1	Serial General-Purpose Input/Out connector header for S-SATA 0-3
(CPU1) Slot1	PCI-Express 3.0 x16 slot from CPU1 (JPICE1)
UID UID (Unit Identification) switch
(BP) USB 0/1 (2.0)	Backpanel USB 2.0 ports 0/1 (USB 0/1)
USB 2 (3.0)	Type A USB 3.0 connector (USB 2)
VGA	Backpanel VGA port

5-8 Connector Definitions

Power Connectors

Two 20-pin power supply connectors and a 4-pin power connector are located on the motherboard. The two 20-pin power connectors (J4/J6) are used as main power supply to the system, while the 4-pin power connector (JP3) provides power to the HDD panel for Chassis 808/809. These power connectors meet the SSI EPS 12V specification and must be connected to your power supply to provide adequate power to the system. See the tables below for pin definitions.

Warning! To avoid damaging the power supply or the motherboard, please connect the power supply to a 20-pin power connector located at J4 or J6, and connect the 4-pin power connector (JP3) to the backplane or the HDD to provide adequate power to your system. Failure to do so may void the manufacturer warranty on your power supply and motherboard.

20-pin Main ConnectorPin Definitions (J4/J6)
Pin#	Definition	Pin#	Definition
11	PS_ON# 1 Ground
12	P5V_STBY 2 Ground
13	Ground 3 Ground
14	Ground 4 Ground
15	Ground 5 Ground
16	No Connections 6 No Connections
17	P1 2V 7 P12V
18	P1 2V 8 P12V
19	P1 2V 9 P12V
20	P1 2V 10 P12V

4-pin HDD-Panel PWR Pin Definitions (JP3)
Pin#	Definition
1 P12V
2 Ground
3 Ground
4 P5V

PW\_ON Connector

The Power Button connection is located on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system. To turn on or off the system power, press the button for 4 seconds or longer. Refer to the table on the right for pin definitions.

Reset Connector

The Reset Button connection is located on pins 3 and 4 of JF1. Attach it to a hardware reset switch on the computer chassis to support system reset. Refer to the table on the right for pin definitions.

Power Fail LED

The Power Fail LED connection is located on pins 5 and 6 of JF1. Refer to the table on the right for pin definitions.

Overheat (OH)/Fan Fail/PWR Fail/ UID LED

Connect an LED cable to pins 7 and 8 of the front control panel to use the Overheat/Fan Fail/Power Fail and UID LED connections. The red LED on pin 8 provides warnings of overheat, fan failure, or power failure. The blue LED on pin 7 works as the front-panel UID LED indicator. Refer to the table on the right for pin definitions.

Power ButtonPin Defi nitions(JF1)
Pin#	Defi nition
1 Signal
2 Ground

Reset ButtonPin Definitions(JF1)
Pin#	Definition
3 Reset
4 Ground

PWR Fail LEDPin Definitions (JF1)
Pin#	Definition
5	3.3V
6	PWR Supply Fail

OH/Fan Fail/ PWR Fail/Blue_UID LED Pin Definitions (JF1)
Pin#	Definition
7	Blue UID LED
8	OH/Fan Fail/Power Fail

OH/Fan Fail/PWRFail LED Status (Red LED)
State	Definition
Off Normal
On Overheat
Flashing Fan	Fail

NIC1/NIC2 LED Indicators

The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11 and 12 of JF1, and the LED connection for LAN port 2 is on pins 9 and 10. Attach the NIC LED cables here to display network activity. Refer to the table on the right for pin definitions.

NIC1 LEDPin Definitions (JF1)
Pin#	Definition
9	NIC 2 Activity LED
10	NIC 2 Link LED
11	NIC 1 Activity LED
12	NIC 1 Link LED

HDD/UID LED

The HDD LED connection is located on pins 13 and 14 of JF1. Attach a cable to pin 14 to show the HDD activity status. Attach a cable to pin 13 to use the UID switch. See the table on the right for pin definitions.

HDD LEDPin Defi nitions(JF1)
Pin#	Defi nition
13	3.8V Standby
14	HD Active

Power On LED

The Power LED connection is located on pins 15 and 16 of JF1. Refer to the table on the right for pin definitions.

Power LEDPin Defi nitions(JF1)
Pin#	Defi nition
15	3.3V
16	PWR LED

NMI Button

The non-maskable interrupt button header is located on pins 19 and 20 of JF1. Refer to the table on the right for pin definitions.

NMI ButtonPin Defi nitions(JF1)
Pin#	Defi nition
19	Control
20	Ground

Serial Ports

A COM port (COM1) is located on the I/O back panel to provide serial link connections for the system. Refer to the table on the right for pin-out definitions.

Video Connection

A Video (VGA) port is located next to COM1 on the I/O back panel. Refer to the board layout below for its location.

Universal Serial Bus (USB)

Two USB 2.0 ports (USB 0/1) are located on the I/O back panel. In addition, a Type-A connector is also located on the motherboard to provide front USB 3.0 support (USB 2). (Cables are not included.) See the tables on the right and below for pin definitions.

Back Panel USB 0/1 (2.0)Pin Definitions
Pin#	Definition	Pin#	Definition
1 +5V	5 +5V
2 USB_PN1 6 USB	PN0
3 USB_PP1 7 USB	PP0
4 Ground 8 Ground

Type A USB 2 (3.0)Pin Defi nitions
Pin#	Description
1 VBUS
2 SSRX-
3 SSRX+
4 Ground
5 SSTX-
6 SSTX+
7 GND_DRAIN
8	D-
9	D+

Ethernet Ports

Two Gigabit Ethernet ports (LAN1 and LAN2) are located on the I/O back panel on the motherboard. These Ethernet ports support 1GbE LANs on the motherboard. In addition, an IPMI-dedicated LAN is located above USB 0/1 ports on the back panel. All of these ports accept RJ45 cables. Please refer to the LED Indicator section for LAN LED information.

Infi niBand Connector (Optional for X10DRT-LIBF)

An optional InfiniBand connector with FDR support is located on the I/O back panel on the X10DRT-LIBF. This connector provides data interconnectivity within the same computer and among different computers. It is used in High-Performance Computing (HPC) platforms featuring very high throughput with very low latency. See the layout below for the location.

Unit Identifier Switches/UID LED Indicators

A rear Unit Identifier (UID) switch and rear UID LED (LE1) are located next to the InfiniBand connector on the motherboard. The front UID switch and UID LED are both located on the front panel control (JF1) with the front UID switch on pin 13 of JF1, and the front LED on pin 7. When you press either the front or rear UID switch, both front and rear UID LEDs will be turned on. Press the UID switch again to turn off the LED indicators. The UID indicators provide easy identification of a system unit that may be in need of service.

Note: UID can also be triggered via IPMI on the motherboard. For more information on IPMI, please refer to the IPMI user's guide posted on our website @ http://www.supermicro.com.

Fan Headers

This motherboard has three system/CPU fan headers (Fan 1, Fan 3, and Fan 4) on the motherboard. All these 4-pin fans headers are backward-compatible with the traditional 3-pin fans. However, fan speed control is available for 4-pin fans only by Thermal Management via the IPMI 2.0 interface. See the table on the right for pin definitions.

UID Switch
Pin#	Definition
1	Ground
2	Ground
3	Button In
4	Ground

UID LEDStatus
Color/State	Status
Blue: On Unit	Identified

Fan HeaderPin Defi nitions
Pin#	Defi nition
1 Ground
2 +12V
3 Tachometer
4 PWR Modulation

DOM Power Connectors

Two power connectors for SATA DOM (Disk_On_Module) devices are located at JSD1/JSD2. Connect appropriate cables here to provide power support for your Serial Link DOM devices.

DOM PWR(JSD1/2)Pin Definitions
Pin#	Definition
1 +5V
2 Ground
3 Ground

Standby Power Header

The +5V Standby Power header is located at JSTBY1 on the motherboard. See the table on the right for pin definitions. (You must also have a card with a Standby Power connector and a cable to use this feature.)

Standby PWR(JSTBY1)Pin Definitions
Pin#	Definition
1 +5V	Standby
2 Ground
3 No	Connection

TPM Header/Port 80

A Trusted Platform Module (TPM)/Port 80 header is located at JTPM1 to provide TPM support and a Port 80 connection. Use this header to enhance system performance and data security. See the table on the right for pin definitions.

TPM/Port 80 HeaderPin Definitions
Pin # Definition	Pin # Definition
1 LCLK 2 GND
3 LFRAME# 4 < (KEY)>
5 LRESET# 6 No Connection
7 LAD 3 8 LAD 2
9 +3.3V 10 LAD1
11 LAD0 12 GND
13 No Connection 14 No Connection
15 +3V STBY 16 SERIFQ
17 GND 18	CLKRUN#
19 LPCPD# 20	No Connection

IPMB

A System Management Bus header for IPMI 2.0 is located at JIPMB1. Connect the appropriate cable here to use the IPMB I²C connection on your system.

SMB Header (JIPMB1) Pin Definitions
Pin#	Definition
1 Data
2 Ground
3 Clock
4 No Connection

I-SGPIO1/2 & S-SGPIO1 Headers

Three SGPIO (Serial Link General Purpose Input/Output) headers are located on the motherboard. I-SGPIO1/2 support onboard I-SATA ports 0-5, while S-SGPIO1 supports S-SATA0-3 connections. See the table on the right for pin definitions.

SGPIO Header Pin Definitions(T-SGPIO1/T-SGPIO2)
Pin#	Definition	Pin #	Definition
1 NC	2 Data
3 Ground 4 Data
5 Load 6 Ground
7 CLK 8 NC

Note: NC indicates no connection.

I-SGPIO1/2 & S-SGPIO1

I-SGPIO1 I-SATA Ports 0-3 Supported

I-SGPIO2 I-SATA Ports 4/5 Supported

S-SGPIO1 S-SATA 0-3 Supported

Power SMB (I²C) Connector

The Power System Management Bus (I²C) connector (JPI²C1) monitors power supply, fan, and system temperatures. See the table on the right for pin definitions.

PWR SMB (JPFC1)Pin Defi nitions
Pin#	Defi nition
1 Clock
2 Data
3 PMBUS_Alert
4 Ground
5 +3	3V

5-9 Jumper Settings

Explanation of Jumpers

To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board. See the diagram at right for an example of jumping pins 1 and 2. Refer to the motherboard layout page for jumper locations.

Note: On two-pin jumpers, "Closed" means the jumper is on and "Open" means the jumper is off the pins.

Connector Pins Jumper Setting 3 2 1 ● ● ■ 3 2 1

JBT1 contact pads

CMOS Clear

JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS.

To Clear CMOS

1. First power down the system and unplug the power cord(s). It is also recommended that you remove the onboard battery from the serverboard.
2. With the power disconnected, short the CMOS pads with a metal object such as a small screwdriver.
3. Remove the screwdriver (or shorting device).
4. Reconnect the power cord(s) and power on the system.

Note: Do not use the PW_ON connector to clear CMOS.

BMC Enable

Jumper JPB1 allows you to enable the embedded ASpeed AST2400 Baseboard Management Controller (BMC) to provide IPMI 2.0/KVM support on the motherboard. See the table on the right for jumper settings.

BMC Enable (JPB1)Jumper Settings
Jumper Setting	Definition
Pins 1-2 BMC Enable (Default)
Pins 2-3 Disable

Watch Dog Enable/Disable

The Watch Dog (JWD1) is a system monitor that will reboot the system when a software application hangs. Close pins 1-2 to reset the system if an application hangs. Close pins 2-3 to generate a non-maskable interrupt signal for the application that hangs. See the table on the right for jumper settings. The Watch Dog must also be enabled in the BIOS.

VGA Enable

Jumper JPG1 allows the user to enable the onboard VGA controller. The default setting is 1-2 to enable the connection. See the table on the right for jumper settings.

GLAN Enable/Disable

JPL1 enables or disables the GLAN 1/2 ports on the motherboard. See the table on the right for jumper settings. The default setting is Enabled.

I²C Bus to PCI-Express Slots

Use Jumpers JI ^2 C1 and JI ^2 C2 to connect the System Management Bus (I ^2 C) to PCI-Express slots. These two jumpers should be set at the same time. See the table on the right for jumper settings.

Inf niBand Enable (Optional for the X10DRT-LIBF/LIBQ)

Jumper JIB1 allows the user to enable the InfiniBand controller for High-Performance Computing (HPC) support on the X10DRT-LIBF/LIBQ. The default setting is 1-2 (Enabled). See the table on the right for jumper settings.

Watch Dog (JWD1)Jumper Settings
Jumper Setting	Definition
Pins 1-2 Reset (default)
Pins 2-3 NMI
Open Disabled

VGA Enable (JPG1)Jumper Settings
Jumper Setting	Definition
Pins 1-2 Enabled	(Default)
Pins 2-3 Disabled

GLAN EnableJumper Settings
Jumper Setting	Definition
Pins 1-2 Enabled	(default)
Pins 2-3 Disabled

I2C to PCI-E (JI2C1/JI2C2)Jumper Settings
Jumper Setting	Definition
Pins 1-2 Enabled
Pins 2-3 Disabled	(Default)

Inf niBand Enable (JIB1) Jumper Settings
Jumper Setting	Definition
1-2 Enabled (Default)
2-3 Disabled

Manufacturer Mode Select

Close pin 2 and pin 3 of Jumper JPME2 to bypass SPI flash security and force the system to operate in the manufacturer mode, which will allow the user to flash the system firmware from a host server for system setting modifications. See the table on the right for jumper settings.

ME Mode SelectJumper Settings
Jumper Setting	Definition
Pins 1-2 Normal	(Default)
Pins 2-3 Manufacture	Mode

5-10 Onboard Indicators

LAN LEDs

The Ethernet LAN port is located on the IO Backplane on the motherboard. Each LAN port has two LEDs. The Yellow LED indicates activity. The Link LED on the left side of the LAN port may be green, amber or off to indicate the speed of the connection. See the tables on the right for more information.

GLAN LED Link Speed LED Activity LED

LAN Port Activity LED (Left)LED State
Color	Status	Definition
Orange	Flashing Active

1Gbps LAN LinkLED Settings(For X##xxx-MB)
Color	Definition
Off No Connection,10 Mbps
Green 100 Mbps
Amber 1	Gbps

10Gbps LAN LinkLED Settings(For X##xxx-MB)
Color	Definition
Off No Connection,10 or 100 Mbps
Green 10 Gbps
Amber 1 Gbps

IPMI Dedicated LAN LEDs

In addition to the LAN Port 1, an IPMI Dedicated LAN is also located on the I/O Backplane. The amber LED on the right indicates connection and activity; while the green LED on the left indicates the speed of the connection. See the tables at right for more information.

IPMI LAN

-Activity LEDLink LED

IPMI LANLink/Speed LED (Left)& Activity LED (Right)
LED	Color/Status	Definition
Link (Left)	Green: Solid 100 Mbps
	Amber: Solid 1 Gbps
Activity (Right)	Orange: Blinking Active

Onboard Power LED

The Onboard Power LED is located at LEDPWR on the motherboard. When this LED is on, the system is on. Be sure to turn off the system and unplug the power cord before removing or installing components. See the tables at right for more information.

Onboard PWR LED IndicatorLED States
LED Color	Definition
Off System Off	(PWR cable not connected)
Green System	On

BMC Heartbeat LED

A BMC Heartbeat LED is located at LEDBMC on the motherboard. When LEDBMC is blinking, the BMC is functioning normally. See the table at right for more information.

BMC Heartbeat LED Status
Color/State	Definition
Green: Blinking	BMC:Normal

HDD LED

An HDD LED is located at LE8 on the motherboard. When LE8 is on, the HDD is active. See the table at right for more information.

HDD LED IndicatorLED States
LED Color	Definition
Off HDD is	Inactive
On HDD Active/Normal

Note: Refer to Page 2-20 for information on the rear UID LED (LE1).

5-11 PCI-Express and Serial ATA Connections

SATA 3.0 and S-SATA 3.0 Connections

Ten SATA 3.0 connections are located on the motherboard. Six SATA 3.0 ports (I-SATA 0-5) are supported by the Intel PCH C612, and four S-SATA 3.0 connections (S-SATA0-3) are supported by the Intel SCU. Please note that S-SATA2/S-SATA3 can be used as Supermicro SuperDOMs (Disks-on-Module) with built-in power connectors. These SATA ports provide serial-link signal connections, which are faster than the connections of Parallel ATA.

Note 1: Supermicro SuperDOMs are yellow SATADOM connectors with power pins built in. These connectors do not require separate external power cables and are backward-compatible with non-Supermicro SATADOMs that require external power supplies.

Note 2: For more information on the SATA HostRAID configuration, please refer to the Intel SATA HostRAID user's guide posted on our website @ http://www.supermicro.com.

5-12 Installing Drivers

The CD that came bundled with the system contains drivers, some of which must be installed, such as the chipset driver. After inserting this CD into your CD-ROM drive, the display shown in Figure 5-5 should appear. (If this display does not appear, click on the My Computer icon and then on the icon representing your CD-ROM drive. Finally, double click on the S "Setup" icon.)

Click the icons showing a hand writing on paper to view the readme files for each item. Click the computer icons to the right of these items to install each item (from top to the bottom) one at a time. After installing each item, you should reboot the system before moving on to the next item on the list. The bottom icon with a CD on it allows you to view the entire contents of the CD.

Figure 5-5. Driver/Tool Installation Display Screen

SUPERMICRO X10DRT-L Motherboard Drivers & Tools (Win7) SupersMCRO Drivers & Tools Intel C612 Chipset X10DRT-L (IBQ/IBF) SUPERSMCRO Computer Inc. Intel Chipset INF files Microsoft .Net Framework (Optional) ASPEED Graphics Driver Intel Rapid Storage Technology Enterprise Intel USB 3.0 Drivers Mellanox InfiniBand Driver Intel PRO Network Connections Drivers Intel Management Engine SUPERMICRO SuperDoctor 5 Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information, please visit SUPERMICRO's web site.

SuperDoctor 5

The Supermicro SuperDoctor® 5 is a hardware and operating system services monitoring program that functions in a command-line or web-based interface in Windows and Linux operating systems. The program monitors system health information such as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM Server), you can remotely control power on/off and reset chassis intrusion for multiple systems with SuperDoctor 5 or IPMI. SD5 Management Server monitors HTTP, FTP, and SMTP services to optimize the efficiency of your operation.

Note: The default User Name and Password for SuperDoctor 5 is admin / admin.

Figure 5-6. SuperDoctor 5 Interface Display Screen (Health Information)

Power Supply1 PDS-0045F-08 REV 1 (PDS4) PDS Tool: 6000.2 TTPM PDS LIME: 30000.0 4000 PDS Temporal: 30.8-100.0 TC-CTF PDS ACInputCurrent: 1.07% A PDS DCIT2DCInputCurrent: 8.5 A

Figure 5-7. SuperDoctor 5 Interface Display Screen (Remote Control)

Note: The SuperDoctor 5 program and User's Manual can be downloaded from the Supermicro web site at http://www.supermicro.com/products/nfo/sms_sd5.cfm. For Linux, we recommend that you use the SuperDoctor II application instead.

5-13 Serverboard Battery

Caution: There is a danger of explosion if the onboard battery is installed upside down, which will reverse its polarites (see Figure 5-8). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032). Dispose of used batteries according to the manufacturer's instructions.

Figure 5-8. Installing the Onboard Battery

LITHIUM BATTERY BATTERY HOLDER

Please handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.

Notes

Chapter 6

Advanced Chassis Setup

This chapter covers the steps required to install components and perform maintenance on the SC808BTS-1K03BP chassis. For component installation, follow the steps in the order given to eliminate the most common problems encountered. If some steps are unnecessary, skip ahead to the step that follows.

Tools Required: The only tool you will need to install components and perform maintenance is a Philips screwdriver.

6-1 Static-Sensitive Devices

Electrostatic discharge (ESD) can damage electronic components. To prevent damage to any printed circuit boards (PCBs), it is important to handle them very carefully. The following measures are generally sufficient to protect your equipment from ESD damage.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing any board from its antistatic bag.
• Handle a board by its edges only; do not touch its components, peripheral chips, memory modules or gold contacts.
• When handling chips or modules, avoid touching their pins.
• Put the serverboard, add-on cards and peripherals back into their antistatic bags when not in use.
• For grounding purposes, make sure your computer chassis provides excellent conductivity between the power supply, the case, the mounting fasteners and the serverboard.

Unpacking

The serverboard is shipped in antistatic packaging to avoid static damage. When unpacking the board, make sure the person handling it is static protected.

Figure 6-1. Front and Rear Chassis Views

Control Panel Control Panel SATA Drives (4) VGA Port USB Ports COM In Band Port UID IPMI LAN Port Ethernet Ports

6-2 Control Panel

The control panel is located on the front of the chassis. The LEDs inform you of system status.

See Chapter 3 for details on the LEDs and the control panel buttons.

6-3 Chassis Cover

Before operating the SC808 chassis for the first time, it is important to remove the protective film covering the top of the chassis, in order to allow for proper ventilation and cooling.

Opening the Chassis Cover (Figure 6-2))

1. Disconnect the chassis from any power source and remove all four screws.
2. Gently push down on the chassis cover in the areas indicated in the illustration.
3. Push the cover toward the rear of the chassis
4. Lift the cover upwards and off the chassis.

Figure 6-2. Opening the Chassis Cover

Technical diagram showing a server rack with labeled components and directional arrows indicating movement or flow.

Caution: Except for short periods of time, do NOT operate the server without the cover in place. The chassis cover must be in place to allow proper airflow and prevent overheating.

6-4 Air Shrouds

Air shrouds concentrate airflow to maximize fan efficiency. The SC808 chassis air shroud does not require screws to set up. The SC808 chassis requires two identical air shrouds.

Installing an Air Shroud (Figure 6-3)

1. Confirm that all six fans are in place and working properly
2. Place the first air shroud into the chassis. The air shroud sits behind the system fans. Each air shroud covers three fans.
3. Install the second air shroud in the same manner as the first.

Figure 6-3: Installing the Air Shroud

Isometric technical diagram of a server rack with internal components and mounting brackets (no text or labels)

6-5 Checking the Airflow

Checking Airflow

1. Make sure there are no objects obstructing airflow in and out of the server. In addition, if you are using a front bezel, make sure the bezel's filter is replaced periodically.
2. Do not operate the server without drives or drive carriers in the drive bays. Use only recommended server parts.
3. Make sure no wires or foreign objects obstruct air flow through the chassis. Pull all excess cabling out of the airflow path or use shorter cables.
4. The control panel LEDs inform you of system status. See "Chapter 3: System Interface" for details on the LEDs and the control panel buttons.

6-6 System Fans

Six fans provide cooling for the chassis (Figure 6-4). These fans circulate air through the chassis as a means of lowering the chassis internal temperature. The SC808 system fans are hot-swappable. There is no need to power-down the system when switching fans.

Figure 6-4: System Fan

Rubber Feet

Changing a System Fan (Figure 6-5)

1. If necessary, open the chassis while the power is running to determine which fan has failed. (Never run the server for an extended period of time with the chassis open.)
2. Remove the failed fan's power cord from the serverboard.
3. Lift the fan from the chassis.
4. Place the new fan into the vacant space in the housing while making sure the arrows on the top of the fan (indicating air direction) point in the same direction as the arrows on the other fans. Make sure all four of the fan's rubber feet are in place.
5. Confirm that the fan is working properly before replacing the chassis cover.

Figure 6-5: System Fan Placement

Isometric technical diagram of a server rack with internal components and a highlighted connection point (no text or labels)

6-7 Installing and Removing Hard Drives

Accessing the Drive Bays

SATA Drives: You do not need to access the inside of the chassis or remove power to replace or swap SATA drives. Each hard disk drive is in a separate carrier that may be removed to access its hard drive. Proceed to the next step for instructions. You must use standard 1" high, SATA drives in the system.

Caution: Except for short periods of time (swapping hard drives), do not operate the server with the carriers absent.

Removing Hard Drive Carriers from the Chassis (Figure 6-6)

1. Press the release button on the drive carrier. This extends the drive handle.
2. Use the handle to pull the drive out of the chassis.

Figure 6-6: Removing Hard Drive

Technical diagram showing server rack and drive components with labeled parts and directional arrows

The drives are mounted in drive carriers to simplify their installation and removal from the chassis. These carriers also help promote proper airflow in the drive bays (Figure 6-7).

Figure 6-7: Chassis Drive Carrier

Drive Tray Dummy Drive

Installing a Drive into the Hard Drive Carrier

1. Remove the two screws securing the dummy drive to the drive carrier (Figure 6-8).

Figure 6-8: Removing Dummy Drive from Carrier

Technical diagram of a computer chassis with labeled components and directional arrows indicating assembly steps.

1. Lift the dummy drive up and out of the carrier.
2. Install a new drive into the carrier with the printed circuit board side facing downward so that the mounting holes align with those in the carrier.
3. Secure the hard drive by tightening all six screws (Figure 6-9).

Figure 6-9: Removing Hard Drive

SAS or SATA Hard Drive Drive Tray

1. Use the open handle to slide the drive carrier into the chassis.
2. Close the drive carrier handle.

Warning: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro Web site at http://www.supermicro.com/products/nfo/files/storage/SAS-CompList.pdf

6-8 Installing the Motherboard

I/O Shield

The I/O shield holds the motherboard ports in place. The I/O shield does not require installation, however, the motherboard must match up with the I/O shield (Figure 6-10).

Figure 6-10: I/O Shield Placement

I/O Shields

Permanent and Optional Standoffs

Standoffs prevent short circuits by securing space between the motherboard and the chassis surface. The SC808 chassis includes permanent standoffs in locations used by the motherboards. These standoffs accept the rounded Phillips head screws included in the SC808 accessories packaging.

Some motherboards require additional screws for heatsinks, general components and for stability. Optional standoffs are used for these motherboards.

To use an optional standoff, you must place a hexagonal screw through the bottom the chassis and secure the screw with the hexagonal nut (rounded side up).

Depending upon the configuration of the motherboard being used, it is also possible that some of the optional standoffs which are pre-installed in the chassis, may need to be removed.

Installing the Motherboard (Figure 6-11)

1. Review the documentation that came with your motherboard. Become familiar with component placement, requirements, precautions, and cable connections.
2. Disconnect the chassis from any power source and open the chassis cover.

3. Remove the expansion card brackets. To do this:
   A. Remove screw securing the expansion card bracket to the chassis.
   B. Lift the bracket out of the chassis.
   C. Repeat this process for the second riser card.

4. Lay the first motherboard in the chassis aligning the standoffs

5. Secure the motherboard to the chassis using the rounded, Phillips head screws. Each motherboard requires five screws. Do not exceed eight pounds of torque when tightening down the motherboard.

6. Repeat steps 3 - 5 for the second side of the chassis.
7. Secure the CPU(s), heatsinks, and other components to the motherboard as described in the motherboard documentation.
8. Connect the cables between the motherboard, backplane, chassis, front panel, and power supply, as needed. Also, fans may be temporarily removed to allow access to the backplane ports.
9. Replace the expansion card bracket and secure the bracket with a screw.

Figure 6-11: Installing the Motherboard

Isometric technical diagram of a server rack with multiple internal components and ventilation ducts (no text or labels)

6-9 Expansion Slot Setup

SC808 chassis includes I/O slots for expansion cards. Each side supports one low profile, half-length expansion card for a total of two per system (Figure 6-12).

Figure 6-12: Expansion Card Placement

Expansion Card Slot Clip Temporary "L" Bracket

Installing Expansion Cards (Figure 6-13)

1. Disconnect the chassis from any power source, lay the chassis on a flat surface, and open the chassis cover.
2. Pull open the expansion card slot clip in the rear of the chassis.
3. Slide the temporary expansion card "L" bracket toward the slot clip and remove the temporary bracket from the chassis.
4. Connect the expansion card to the riser card and slide the expansion card "L" bracket in to the rear expansion card slot.
5. Close the expansion card slot clip.
6. Close the chassis cover and reconnect the chassis to the power source.

Note: Under normal circumstances, the riser card and expansion card bracket are not separated.

Figure 6-13: Installing Expansion Cards

Expansion Card Bracket Riser Card Expansion Card Bracket Screw PCI Slot Cover Expansion Card

6-10 Power Supply

The SC808 Chassis uses a 1000 Watt power supply. This power supply is auto-switching capable. This enables it to automatically sense and operate at a 100v to 240v input voltage. An amber light will be illuminated on the power supply when the power is off. An illuminated green light indicates that the power supply is operating. The SC808 chassis utilizes redundant, hot-plug power supplies. This power supply is hot-plug.

Power Supply Replacement

The SC808 chassis utilizes one power supply. In the unlikely event that the power supply unit must be replaced, the system will shut down. Replacement units can be ordered directly from Supermicro (see contact information in the Preface).

Changing the Power Supply (Figure 6-14)

1. Power down the chassis and unplug the AC power cord.
2. Push the release tab (on the back of the power supply) as illustrated.
3. Pull the power supply out using the handle provided.
4. Push the new power supply module into the power bay until you hear a click.
5. Plug the AC power cord back into the module and power up the server.

Figure 6-14: Changing the Power Supply

Release Tab

Chapter 7

BIOS

7-1 Introduction

This chapter describes the AMI BIOS Setup Utility for the X10DRT-L/LIBF serverboard. The 16 MB SPI AMI BIOS® SM Flash UEFI BIOS is stored in a Flash EEPROM and can be easily updated. This chapter describes the basic navigation of the AMI BIOS Setup Utility setup screens.

Starting BIOS Setup Utility

To enter the AMI BIOS Setup Utility screens, press the key while the system is booting up.

Note: In most cases, the key is used to invoke the AMI BIOS setup screen. There are a few cases when other keys are used, such as , , etc.

Each main BIOS menu option is described in this manual. The Main BIOS setup menu screen has two main frames. The left frame displays all the options that can be configured. Grayed-out options cannot be configured. Options in blue can be configured by the user. The right frame displays the key legend. Above the key legend is an area reserved for a text message. When an option is selected in the left frame, it is highlighted in white. Often a text message will accompany it. (Note: the AMI BIOS has default text messages built in. Supermicro retains the option to include, omit, or change any of these text messages.)

The AMI BIOS Setup Utility uses a key-based navigation system called "hot keys". Most of the AMI BIOS setup utility "hot keys" can be used at any time during the setup navigation process. These keys include , , , , arrow keys, etc.

Note: Options printed in Bold are default settings.

How To Change the Configuration Data

The configuration data that determines the system parameters may be changed by entering the AMI BIOS Setup utility. This Setup utility can be accessed by pressing at the appropriate time during system boot.

Starting the Setup Utility

Normally, the only visible Power-On Self-Test (POST) routine is the memory test. As the memory is being tested, press the key to enter the main menu of the AMI BIOS Setup Utility. From the main menu, you can access the other setup screens. An AMI BIOS identification string is displayed at the left bottom corner of the screen below the copyright message.

Caution! Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you have to update the BIOS, do not shut down or reset the system while the BIOS is updating. This is to avoid possible boot failure.

7-2 Main Setup

When you first enter the AMI BIOS setup utility, you will enter the Main setup screen. You can always return to the Main setup screen by selecting the Main tab on the top of the screen. The Main BIOS setup screen is shown below.

System Date System Time Supermicro X10DRT-LIBQ BIOS Version Build Date Memory Information Total Memory Memory Speed	[Fri 01/23/2015] [D6:37:17] 1.0 01/22/2015	Set the Date. Use Tab to switch between Date elements.
		**: Select Screen T↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit

Version 2.17.1245. Copyright (C) 2015 American Megatrends, Inc.

The following Main menu items will be displayed:

System Date/System Time

Use this option to change the system date and time. Highlight System Date or System Time using the arrow keys. Enter new values using the keyboard. Press the key or the arrow keys to move between fields. The date must be entered in Day MM/DD/YYYY format. The time is entered in HH:MM:SS format.

Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00.

Supermicro X10DRT-L Series

BIOS Version: This item displays the version of the BIOS ROM used in the system.

Build Date: This item displays the date when the version of the BIOS ROM used in the system was built.

Memory Information

Total Memory: This item displays the total size of memory available in the system.

Memory Speed: This item displays the default speed of the memory modules installed in the system.

7-3 Advanced Settings Menu

Use the arrow keys to select Advanced setup and press to access the submenu items:

Aptio Setup Utility - Copyright (C) 2015 American Magatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit Boot Feature CPU Configuration Chipset Configuration SATA Configuration SSATA Configuration Server ME Configuration PCIe/PCI/PnP Configuration Super IO Configuration Serial Port Console Redirection ACPI Settings Boot Feature Configuration Page ++: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit

Warning: Take Caution when changing the Advanced settings. An incorrect value, a very high DRAM frequency or an incorrect BIOS timing setting may cause the system to malfunction. When this occurs, restore the setting to the manufacture default setting.

▶ Boot Feature

Quiet Boot

Use this feature to select the screen display between POST messages or the OEM logo at bootup. Select Disabled to display the POST messages. Select Enabled to display the OEM logo instead of the normal POST messages. The options are Enabled and Disabled.

AddOn ROM Display Mode

Use this item to set the display mode for the Option ROM. Select Keep Current to use the current AddOn ROM display setting. Select Force BIOS to use the Option ROM display mode set by the system BIOS. The options are Force BIOS and Keep Current.

Bootup Num-Lock State

Use this feature to set the Power-on state for the Numlock key. The options are Off and On.

Wait For 'F1' If Error

Select Enabled to force the system to wait until the 'F1' key is pressed if an error occurs. The options are Disabled and Enabled.

INT19 (Interrupt 19) Trap Response

Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Immediate, the ROM BIOS of the host adaptors will "capture" Interrupt 19 at bootup immediately and allow the drives that are attached to these host adaptors to function as bootable disks. If this item is set to Postponed, the ROM BIOS of the host adaptors will not capture Interrupt 19 immediately and allow the drives attached to these adaptors to function as bootable devices at bootup. The options are Immediate and Postponed.

Re-try Boot

When EFI Boot is selected, the system BIOS will automatically reboot the system from an EFI boot device after its initial boot failure. Select Legacy Boot to allow the BIOS to automatically reboot the system from a Legacy boot device after its initial boot failure. The options are Disabled, Legacy Boot, and EFI Boot.

Power Configuration

Watch Dog Function

Select Enabled to allow the Watch Dog timer to reboot the system when it is inactive for more than 5 minutes. The options are Enabled and Disabled.

Power Button Function

This feature controls how the system shuts down when the power button is pressed. Select 4 Seconds Override for the user to power off the system after pressing and holding the power button for 4 seconds or longer. Select Instant Off to instantly power off the system as soon as the user presses the power button. The options are 4 Seconds Override and Instant Off.

Restore on AC Power Loss

Use this feature to set the power state after a power outage. Select Power-Off for the system power to remain off after a power loss. Select Power-On for the system power to be turned on after a power loss. Select Last State to allow the system to resume its last power state before a power loss. The options are Power-On, Stay-Off and Last State.

▶CPU Configuration

This submenu displays the following CPU information as detected by the BIOS. It also allows the user to configure CPU settings.

• Processor Socket
• Processor ID
• Processor Frequency
• Processor Max Ratio
• Processor Min Ratio
• Microcode Revision
• L1 Cache RAM
  • L2 Cache RAM
  • L3 Cache RAM
• CPU 1 Version
• CPU 2 Version

Clock Spread Spectrum

Select Enabled to allow the BIOS to monitor and attempt to reduce the level of Electromagnetic Interference caused by the components whenever needed. The options are Disabled and Enabled.

Hyper-Threading (ALL)

Select Enable to support Intel's Hyper-threading Technology to enhance CPU performance. The options are Enable and Disable.

Cores Enabled

This feature allows the user to determine the number of CPU cores to enable. Enter "0" to enable all cores. There are 14 cores available in the system. The default setting is 0.

Execute Disable Bit (Available if supported by the OS & the CPU)

Select Enable for Execute Disable Bit Technology support, which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot, thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor to damage the system during an attack. This feature is used in conjunction with the items: "Clear MCA," "VMX," "Enable SMX," and "Lock Chipset" for Virtualization media support. The options are Enable and Disable. (Refer to Intel and Microsoft websites for more information.)

PPIN Control

Select Unlock/Enable to use the Protected-Processor Inventory Number (PPIN) in the system. The options are Unlock/Enable and Unlock/Disable.

Hardware Prefetcher (Available when supported by the CPU)

If set to Enable, the hardware prefetcher will prefetch streams of data and instructions from the main memory to the L2 cache to improve CPU performance. The options are Disable and Enable.

Adjacent Cache Line Prefetch (Available when supported by the CPU)

Select Enable for the CPU to prefetch both cache lines for 128 bytes as comprised. Select Disable for the CPU to prefetch both cache lines for 64 bytes. The options are Disable and Enable.

Note: Please reboot the system for changes on this setting to take effect. Please refer to Intel's website for detailed information.

DCU (Data Cache Unit) Streamer Prefetcher (Available when supported by the CPU)

If set to Enable, the DCU Streamer Prefetcher will prefetch data streams from the cache memory to the DCU (Data Cache Unit) to speed up data accessing and processing to enhance CPU performance. The options are Disable and Enable.

DCU IP Prefetcher

If set to Enable, the IP prefetcher in the DCU (Data Cache Unit) will prefetch IP addresses to improve network connectivity and system performance. The options are Enable and Disable.

Direct Cache Access (DCA)

Select Enable to use Intel DCA (Direct Cache Access) Technology to improve the efficiency of data transferring and accessing. The options are Auto, Enable, and Disable.

X2APIC (Advanced Programmable Interrupt Controller)

Based on Intel's Hyper-Threading architecture, each logical processor (thread) is assigned 256 APIC IDs (APIDs) in 8-bit bandwidth. When this feature is set to Enable, the APIC ID will be expanded (X2) from 8 bits to 16 bits to provide 512 APIDs to each thread to enhance CPU performance. The options are Disable and Enable.

AES-NI

Select Enable to use the Intel Advanced Encryption Standard (AES) New Instructions (NI) to ensure data security. The options are Enable and Disable.

Intel Virtualization Technology

Select Enable to use Intel Virtualization Technology support for Direct I/O VT-d support by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables. This feature offers fully-protected I/O resource sharing across Intel platforms, providing greater reliability, security and availability in networking and data-sharing. The options are Enable and Disable.

▶ Advanced Power Management Configuration

Advanced Power Management Configuration

Power Technology

Select Energy Efficient to support power-saving mode. Select Custom to customize system power settings. Select Disabled to disable power-saving settings. The options are Disable, Energy Efficient, and Custom.

Energy Performance Tuning

When enabled, this item selects whether the BIOS or Operating System can turn on the energy performance bias tuning. The options are Enable and Disable.

Energy Performance BIAS Setting.

This feature allows balancing Power Efficiency vs Performance. This will override whatever setting is in the Operating System. The options are Performance, Balanced Performance, Balanced Power, and Power.

Energy Efficient Turbo

Use this item to configure the frequency of the processor to be energy efficient. Select Enable to maximize performance. The options are Enable and Disable.

▶ CPU P State Control (Available when Power Technology is set to Custom)

EIST (P-states)

EIST (Enhanced Intel SpeedStep Technology) allows the system to automatically adjust processor voltage and core frequency to reduce power consumption and heat dissipation. The options are Disable and Enable.

Turbo Mode

Select Enabled to use the Turbo Mode to boost system performance. The options are Enable and Disable.

P-state Coordination

This feature is used to change the P-state (Power-Performance State) coordination type. P-state is also known as "SpeedStep" for Intel processors. Select HW_ALL to change the P-state coordination type for hardware components only. Select SW_ALL to change the P-state coordination type for all software installed in the system. Select SW_ANY to change the P-state coordination type for a software program in the system. The options are HW_All, SW_ALL, and SW_ANY.

▶ CPU C State Control (Available when Power Technology is set to Custom)

Package C State limit

Use this item to set the limit on the C-State package register. The options are C0/1 state, C2 state, C6 (non-Retention) state, and C6 (Retention) state.

CPU C3 Report

Select Enable to allow the BIOS to report the CPU C3 State (ACPI C2) to the operating system. During the CPU C3 State, the CPU clock generator is turned off. The options are Enable and Disable.

CPU C6 Report (Available when Power Technology is set to Custom)

Select Enable to allow the BIOS to report the CPU C6 state (ACPI C3) to the operating system. During the CPU C6 state, power to all cache is turned off. The options are Enable and Disable.

Enhanced Halt State (C1E)

Select Enabled to use Enhanced Halt-State technology, which will significantly reduce the CPU's power consumption by reducing the CPU's clock cycle and voltage during a Halt-state. The options are Disable and Enable.

▶ CPU T State Control (Available when Power Technology is set to Custom)

ACPI (Advanced Configuration Power Interface) T-States

Select Enable to support CPU throttling by the operating system to reduce power consumption. The options are Enable and Disable.

▶Chipset Configuration

Warning: Please set the correct settings for the items below. A wrong configuration setting may cause the system to malfunction.

▶ North Bridge

This feature allows the user to configure the settings for the Intel North Bridge.

▶IIO Configuration

EV DFX (Device Function On-Hide) Features

When this feature is set to Enable, the EV_DFX Lock Bits that are located on a processor will always remain clear during electric tuning. The options are Disable and Enable.

▶IIO1 Configuration

CPU1 SLOT1 PCI-E 3.0 X16 Link Speed

This item configures the link speed of a PCI-E port specified by the user. The options are Gen 1 (Generation 1) (2.5 GT/s), Gen 2 (Generation 2) (5 GT/s), and Gen 3 (Generation 3) (8 GT/s).

▶IOAT (Intel® IO Acceleration) Configuration

Enable IOAT

Select Enable to enable Intel I/OAT (I/O Acceleration Technology) support, which significantly reduces CPU overhead by leveraging CPU architectural improvements and freeing the system resource for other tasks. The options are Enable and Disable.

No Snoop

Select Enable to support no-snoop mode for each CB device. The options are Disable and Enable.

Relaxed Ordering

Select Enable to enable Relaxed Ordering support which will allow certain transactions to violate the strict-ordering rules of PCI bus for a transaction to be completed prior to other transactions that have already been enqueued. The options are Disable and Enable.

▶ Intel VT for Directed I/O (VT-d)

Intel VT for Direct I/O (VT-d)

Intel® VT for Directed I/O (VT-d)

Select Enable to use Intel Virtualization Technology support for Direct I/O VT-d support by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables. This feature offers fully-protected I/O resource sharing across Intel platforms, providing greater reliability, security and availability in networking and data-sharing. The options are Enable and Disable.

Interrupt Remapping

Select Enable for Interrupt Remapping support to enhance system performance. The options are Enable and Disable.

▶QPI (Quick Path Interconnect) Configuration

QPI Status

The following information will display:

• Number of CPU
• Number of 110
• Current QPI Link Speed
• Current QPI Link Frequency
• QPI Global MMIO Low Base/Limit
• QPI Global MMIO High Base/Limit
• QPI PCIe Configuration Base/Size

Link Frequency Select

Use this item to select the desired frequency for QPI Link connections. The options are 6.4GB/s, 8.0GB/s, 9.6GB/s, Auto, and Auto Limited.

Link L0p Enable

Select Enable for Link L0p support. The options are Enable and Disable.

Link L1 Enable

Select Enable for Link L1 support. The options are Enable and Disable.

COD Enable (Available when the OS and the CPU support this feature)

Select Enable for Cluster-On-Die support to enhance system performance in cloud computing. The options are Enable, Disable, and Auto.

Early Snoop (Available when the OS and the CPU support this feature)

Select Enable for Early Snoop support to enhance system performance. The options are Enable, Disable, and Auto.

Isoc Mode

Select Enable for Isochronous support to meet QoS (Quality of Service) requirements. This feature is especially important for Virtualization Technology. The options are Enable and Disable.

▶Memory Configuration

Enforce POR

Select Enabled to enforce POR restrictions on DDR4 frequency and voltage programming. The options are Enabled and Disabled.

Memory Frequency

Use this feature to set the maximum memory frequency for onboard memory modules. The options are Auto, 1333, 1400, 1600, 1800, 1867, 2000, 2133, 2200, 2400, 2600, 2667, and Reserved (Do not select Reserved).

Data Scrambling

Select Enabled to enable data scrambling to enhance system performance and data integrity. The options are Auto, Disabled and Enabled.

DRAM RAPL (Running Average Power Limit) Baseline

Use this feature to set the run-time power-limit baseline for DRAM modules. The options are Disable, DRAM RAPL Mode 0, and DRAM RAPL Mode 1.

Set Throttling Mode

Throttling improves reliability and reduces power consumption in the processor via automatic voltage control during processor idle states. The options are Disabled and CLTT (Closed Loop Thermal Throttling).

A7 Mode

Select Enable to support the A7 (Addressing) mode to improve memory performance. The options are Enable and Disable.

▶DIMM Information

This item displays the status of a DIMM module as detected by the AMI BIOS.

▶Memory RAS (Reliability\_Availability\_Serviceability) Configuration

Use this submenu to configure the following Memory RAS settings.

RAS Mode

When Disable is selected, RAS is not supported. When Mirror is selected, the motherboard maintains two identical copies of all data in memory for data backup. When Lockstep is selected, the motherboard uses two areas of memory to run the same set of operations in parallel to boost performance. The options are Disable, Mirror, and Lockstep Mode.

Memory Rank Sparing

Select Enable to enable memory-sparing support for memory ranks to improve memory performance. The options are Disabled and Enabled.

Patrol Scrub

Patrol Scrubbing is a process that allows the CPU to correct correctable memory errors detected on a memory module and send the correction to the requestor (the original source). When this item is set to Enable, the IO hub will read and write back one cache line every 16K cycles, if there is no delay caused by internal processing. By using this method, roughly 64 GB of memory behind the IO hub will be scrubbed every day. The options are Enable and Disable.

Patrol Scrub Interval

This feature allows you to decide how many hours the system should wait before the next complete patrol scrub is performed. Use the keyboard to enter a value from 0-24. The Default setting is 24.

Demand Scrub

Demand Scrubbing is a process that allows the CPU to correct correctable memory errors found on a memory module. When the CPU or I/O issues a demand-read command, and the read data from memory turns out to be a correctable error, the error is corrected and sent to the requestor (the original source). Memory is updated as well. Select Enable to use Demand Scrubbing for ECC memory correction. The options are Enable and Disable.

Device Tagging

Select Enable to support device tagging. The options are Disable and Enable.

▶ South Bridge

The following South Bridge information will display:

▶USB Configuration

• USB Module Version
• USB Devices

Legacy USB Support

Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disabled to have all USB devices available for EFI applications only. The options are Enabled, Disabled and Auto.

XHCI Hand-Off

This is a work-around solution for operating systems that do not support XHCI (Extensible Host Controller Interface) hand-off. The XHCI ownership change should be claimed by the XHCI driver. The settings are Enabled and Disabled.

EHCI Hand-Off

This item is for operating systems that do not support Enhanced Host Controller Interface (EHCI) hand-off. When this item is enabled, EHCI ownership change will be claimed by the EHCI driver. The settings are Enabled and Disabled.

Port 60/64 Emulation

Select Enabled to support I/O port 60h/64h emulation, which will provide complete legacy USB keyboard support for the operating systems that do not support legacy USB devices. The options are Disabled and Enabled.

USB 3.0 Support

Select Enabled for USB 3.0 support. The options are Smart Auto, Auto, Enabled, Disabled, and Manual.

EHCI1

Select Enabled to enable EHCI (Enhanced Host Controller Interface) support on USB 2.0 connector #1 (-at least one USB 2.0 connector should be enabled for EHCI support.) The options are Disabled and Enabled.

EHCI2

Select Enabled to enable EHCI (Enhanced Host Controller Interface) support on USB 2.0 connector #2 (-at least one USB 2.0 connector should be enabled for EHCI support.) The options are Disabled and Enabled.

XHCI Pre-Boot Driver

Select Enabled to enable XHCI (Extensible Host Controller Interface) support on a pre-boot drive specified by the user. The options are Enabled and Disabled.

▶SATA Configuration

When this submenu is selected, AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the following items:

SATA Controller

This item enables or disables the onboard SATA controller supported by the Intel PCH chip. The options are Enabled and Disabled.

Configure SATA as

Select IDE to configure a SATA drive specified by the user as an IDE drive. Select AHCI to configure a SATA drive specified by the user as an AHCI drive. Select RAID to configure a SATA drive specified by the user as a RAID drive. The options are IDE, AHCI, and RAID.

*If the item above "Configure SATA as" is set to AHCI, the following items will display:

Support Aggressive Link Power Management

When this item is set to Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link to a low power state when the I/O is inactive for an extended period of time, and the power state will return to normal when the I/O becomes active. The options are Enabled and Disabled.

SATA Port 0\~ Port 5

This item displays the information detected on the installed SATA drive on the particular SATA port.

• Model number of drive and capacity
• Software Preserve Support

Port 0\~ Port 5

Select Enabled to enable a SATA port specified by the user. The options are Disabled and Enabled.

Port 0 \~ Port 5 Hot Plug

Select Enabled to enable hot-plugging support for a port specified by the user, which will allow the user to replace a SATA disk drive installed on this port without shutting down the system. The options are Enabled and Disabled.

Port 0 \~ Port 5 Spin Up Device

On an edge detect from 0 to 1, set this item to allow the PCH to initialize the device. The options are Enabled and Disabled.

Port 0 \~ Port 5 SATA Device Type

Use this item to specify if the SATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

*If the item above "Configure SATA as" is set to IDE, the following items will display:

Serial ATA Port 0\~ Port 5

This item indicates that a SATA port specified by the user is installed (present) or not.

Port 0 \~ Port 5 SATA Device Type (Available when a SATA port is detected)

Use this item to specify if the SATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

*If the item above "Configure SATA as" is set to RAID, the following items will display:

Support Aggressive Link Power Management

When this item is set to Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link to a low power state when the I/O is inactive for an extended period of time, and the power state will return to normal when the I/O becomes active. The options are Enabled and Disabled.

SATA RAID Option ROM/UEFI Driver

Select EFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disabled, EFI, and Legacy.

Serial ATA Port 0\~ Port 5

This item displays the information detected on the installed SATA drives on the particular SATA port.

• Model number of drive and capacity
• Software Preserve Support

Port 0\~ Port 5

Select Enabled to enable a SATA port specified by the user. The options are Disabled and Enabled.

Port 0 \~ Port 5 Hot Plug

Select Enabled to enable hot-plugging support for a port specified by the user, which will allow the user to replace a SATA disk drive installed on this port without shutting down the system. The options are Enabled and Disabled.

Port 0 \~ Port 5 Spin Up Device

On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRESET initialization to the device. The options are Enabled and Disabled.

Port 0 \~ Port 5 SATA Device Type

Use this item to specify if the SATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶ sSATA Configuration

When this submenu is selected, AMI BIOS automatically detects the presence of the SATA devices that are supported by the PCH-sSATA controller and displays the following items:

sSATA Controller

This item enables or disables the onboard SATA controller supported by the Intel PCH-sSATA controller. The options are Enabled and Disabled.

Configure sSATA as

Select IDE to configure an sSATA drive specified by the user as an IDE drive. Select AHCI to configure an sSATA drive specified by the user as an AHCI drive. Select RAID to configure an sSATA drive specified by the user as a RAID drive. The options are IDE, AHCI, and RAID.

*If the item above "Configure sSATA as" is set to AHCI, the following items will display:

Support Aggressive Link Power Management

When this item is set to Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link to a low power state when the I/O is inactive for an extended period of time, and the power state will return to normal when the I/O becomes active. The options are Enabled and Disabled.

sSATA Port 0\~ Port 3

This item displays the information detected on the installed on the sSATA port. specified by the user.

• Model number of drive and capacity
• Software Preserve Support

sSATA Port 0\~ Port 3

Select Enabled to enable an sSATA port specified by the user. The options are Disabled and Enabled.

sSATA Port 0 \~ Port 3 Hot Plug

Select Enabled to enable hot-plugging support for a port specified by the user, which will allow the user to replace a sSATA disk drive installed on this port without shutting down the system. The options are Enabled and Disabled.

sSATA Port 0 \~ Port 3 Spin Up Device

On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRESET initialization to the device. The options are Enabled and Disabled.

Port 0 \~ Port 3 sSATA Device Type

Use this item to specify if the sSATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

*If the item above "Configure sSATA as" is set to IDE, the following items will display:

sSATA Port 0\~ Port 3

This item indicates that an sSATA port specified by the user is installed (present) or not.

Port 0 \~ Port 3 sSATA Device Type (Available when a SATA port is detected)

Use this item to specify if the sSATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

*If the item above "Configure sSATA as" is set to RAID, the following items will display:

Support Aggressive Link Power Management

When this item is set to Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link to a low power state when the I/O is inactive for an extended period of time, and the power state will return to normal when the I/O becomes active. The options are Enabled and Disabled.

sSATA RAID Option ROM/UEFI Driver

Select EFI to load the EFI driver for system boot. Select Legacy to load a legacy driver for system boot. The options are Disabled, EFI, and Legacy.

sSATA RAID Boot Select

Select SATA Controller to boot the system from a SATA RAID device. Select sSATA Controller to boot the system from a S-SATA RAID device. Select Both to boot the system either from a SATA RAID device or from an sSATA RAID device. Please note that the option "Both" is not supported by the Windows Server 2012/R2 OS. The options are Both, SATA Controller, and sSATA Controller.

sSATA Port 0\~ Port 3

This item displays the information detected on the installed sSATA drives on the particular sSATA port.

• Model number of drive and capacity
• Software Preserve Support

sSATA Port 0\~ Port 3

Select Enabled to enable an sSATA port specified by the user. The options are Disabled and Enabled.

sSATA Port 0 \~ Port 3 Hot Plug

This feature designates this port for hot plugging. Set this item to Enabled for hot-plugging support, which will allow the user to replace an sSATA drive without shutting down the system. The options are Enabled and Disabled.

sSATA Port 0 \~ Port 3 Spin Up Device

On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRESET initialization to the device. The options are Enabled and Disabled.

Port 0 \~ Port 3 sSATA Device Type

Use this item to specify if the sSATA port specified by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.

▶Server ME (Management Engine) Configuration

This feature displays the following system ME configuration settings.

• General ME Configuration
  • Operational Firmware Version
  • Recovery Firmware Version
  • ME Firmware Features
  • ME Firmware Status #1
  • ME Firmware Status #2

• Current State

• Error Code

▶PCIe/PCI/PnP Configuration

The following PCI information will be displayed:

• PCI Bus Driver Version
• PCI Device Common Settings

Above 4G Decoding (Available if the system supports 64-bit PCI decoding)

Select Enabled to decode a PCI device that supports 64-bit in the space above 4G Address. The options are Enabled and Disabled.

SR-IOV (Available if the system supports Single-Root Virtualization)

Select Enabled for Single-Root IO Virtualization support. The options are Enabled and Disabled.

Maximum Payload

Select Auto for the system BIOS to automatically set the maximum payload value for a PCI-E device to enhance system performance. The options are Auto, 128 Bytes, and 256 Bytes.

Maximum Read Request

Select Auto for the system BIOS to automatically set the maximum size for a read request for a PCI-E device to enhance system performance. The options are Auto, 128 Bytes, 256 Bytes, 512 Bytes, 1024 Bytes, 2048 Bytes, and 4096 Bytes.

ASPM Support

Use this item to set the Active State Power Management (ASPM) level for a PCI-E device. Select Auto for the system BIOS to automatically set the ASPM level based on the system configuration. Select Disabled to disable ASPM support. The options are Disabled, and Auto.

Warning: Enabling ASPM support may cause some PCI-E devices to fail!

MMIOHBase

Use this item to select the I/O base memory size according to memory-address mapping for the PCH chip. The base memory size must be between 4032G to 4078G. The options are 56T, 48T, 24T, 512G, and 256G.

MMIO High Size

Use this item to select the high I/O memory size according to memory-address mapping for the PCH chip. The options are 256G, 128G, 512G, and 1024G.

CPU1 SLOT1 PCI-E 3.0 X16 SLOT OPROM/

Select Enabled to enable Option ROM support to boot the computer using a device installed on the slot specified by the user. The options are Disabled, Legacy and EFI.

Onboard LAN Option ROM Type

Select Enabled to enable Option ROM support to boot the computer using a device installed on the slot specified by the user. The options are Legacy and EFI.

Onboard LAN1 Option ROM/Onboard LAN2 Option ROM/Onboard Video Option ROM

Use this option to select the type of device installed in LAN Port1, LAN Port2 or the onboard video device used for system boot. The default setting for LAN1 Option ROM is PXE, for LAN2 Option ROM is Disabled and for Onboard Video Option ROM is Legacy.

VGA Priority

Use this item to select the graphics device to be used as the primary video display for system boot. The options are Onboard and Offboard.

Network Stack

Select Enabled to enable PXE (Preboot Execution Environment) or UEFI (Unified Extensible Firmware Interface) for network stack support. The options are Enabled and Disabled.

▶ Super IO Configuration

Super IO Chip AST2400

▶ Serial Port 1 Configuration/Serial Port 2 Configuration

Serial Port 1/Serial Port 2

Select Enabled to enable the onboard serial port specified by the user. The options are Enabled and Disabled.

Device Settings

This item displays the base I/O port address and the Interrupt Request address of a serial port specified by the user.

Change Port 1 Settings/Change Port 2 Settings

This feature specifies the base I/O port address and the Interrupt Request address of Serial Port 1 or Serial Port 2. Select Auto for the BIOS to automatically assign the base I/O and IRQ address to a serial port specified.

The options for Serial Port 1 are Auto, (IO=3F8h; IRQ=4), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12).

The options for Serial Port 2 are Auto, (IO=3F8h; IRQ=4), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12).

Serial Port 2 Attribute

Select SOL to use COM Port 2 as a Serial_Over_LAN (SOL) port for console redirection. The options are COM and SOL.

▶Serial Port Console Redirection

COM 1

COM 1 Console Redirection

Select Enabled to enable COM Port 1 Console Redirection, which will allow a client machine to be connected to a host machine at a remote site for networking. The options are Disabled and Enabled.

*If the item above set to Enabled, the following items will become available for configuration:

▶COM1 Console Redirection Settings

Terminal Type

This feature allows the user to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per second

Use this item to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 (Bits) and 8 (Bits).

Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

Flow Control

Use this item to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start sending data when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Enabled and Disabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

Legacy OS Redirection Resolution

Use this item to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

Redirection After BIOS Post

Use this feature to enable or disable legacy Console Redirection after BIOS POST. When the option-Bootloader is selected, legacy Console Redirection is disabled before booting the OS. When the option- Always Enable is selected, legacy Console Redirection remains enabled upon OS bootup. The options are Always Enable and Bootloader.

SOL/COM2

SOL/COM2 Console Redirection

Select Enabled to use the SOL port for Console Redirection. The options are Enabled and Disabled.

*If the item above set to Enabled, the following items will become available for user's configuration:

▶SOL/COM2 Console Redirection Settings

Use this feature to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per second

Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The options are 7 (Bits) and 8 (Bits).

Parity

A parity bit can be sent along with regular data bits to detect data transmission errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2.

Flow Control

Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty. The options are None and Hardware RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Enabled and Disabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Disabled and Enabled.

Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.

Redirection After BIOS Post

Use this feature to enable or disable legacy Console Redirection after BIOS POST (Power-On Self-Test). When this feature is set to Bootloader, legacy Console Redirection is disabled before booting the OS. When this feature is set to Always Enable, legacy Console Redirection remains enabled upon OS boot. The options are Always Enable and Bootloader.

Serial Port for Out-of-Band Management/Windows Emergency Management Services (EMS)

The submenu allows the user to configure Console Redirection settings to support Out-of-Band Serial Port management.

EMS Console Redirection

Select Enabled to use a COM port selected by the user for EMS Console Redirection. The options are Enabled and Disabled.

*If the item above set to Enabled, the following items will become available for user's configuration:

▶EMS Console Redirection Settings (Available when EMS Console Redirection is enabled)

Use this feature to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user.

Out-of-Band Management Port

The feature selects a serial port in a client server to be used by the Windows Emergency Management Services (EMS) to communicate with a remote host server. The options are COM1 (Console Redirection) and COM2/SOL (Console Redirection).

Terminal Type

Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII character set. Select VT100+ to add color and function key support. Select ANSI to use the extended ASCII character set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per Second

This item sets the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in both host computer and the client computer. A lower transmission speed may be required for long and busy lines. The options are 9600, 19200, 57600, and 115200 (bits per second).

Flow Control

Use this item to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop data-sending when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty. The options are None, Hardware RTS/CTS, and Software Xon/Xoff.

The setting for each these features is displayed:

Data Bits, Parity, Stop Bits

▶Trusted Computing (Available when a TPM device is installed and detected by the BIOS)

Configuration

Security Device Support

If this feature and the TPM jumper on the motherboard are both set to Enabled, onboard security devices will be enabled for TPM (Trusted Platform Module) support to enhance data integrity and network security. Please reboot the system for a change on this setting to take effect. The options are Enabled and Disabled.

TPM State

Select Enabled to use TPM (Trusted Platform Module) settings to enhance system data security. Please reboot your system for any change on the TPM state to take effect. The options are Disabled and Enabled.

Pending Operation

Use this item to schedule a TPM-related operation to be performed by a security device for system data integrity. Your system will reboot to carry out a pending TPM operation. The options are 0, Enable Take Ownership, Disable Take Ownership, and TPM Clear.

Note: Your system will reboot to carry out a pending TPM operation.

Current Status Information

This item displays the status of the TPM support on this motherboard.

▶ACPI Settings

WHEA Support

Select Enabled to support the Windows Hardware Error Architecture (WHEA) platform and provide a common infrastructure for the system to handle hardware errors within the Windows OS environment to reduce system crashes and to enhance system recovery and health monitoring. The options are Enabled and Disabled.

High Precision Timer

Select Enabled to activate the High Precision Event Timer (HPET) that produces periodic interrupts at a much higher frequency than a Real-time Clock (RTC) does in synchronizing multimedia streams, providing smooth playback and reducing the dependency on other timestamp calculation devices, such as an x86 RDTSC Instruction embedded in the CPU. The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer. The options are Enabled and Disabled.

NUMA (Available when the OS supports this feature)

Select Enabled to enable Non-Uniform Memory Access support to enhance system performance. The options are Enabled and Disabled.

4-4 Event Logs

Use this feature to configure Event Log settings.

Aptio Setup Utility - Copyright (C) 2015 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit Change SMBIOS Event Log Settings View SMBIOS Event Log Press to change the SMBIOS Event Log configuration. +: Select Screen T#: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.17.1245, Copyright (C) 2015 American Megatrends, Inc.

▶Change SMBIOS Event Log Settings

This feature allows the user to configure SMBIOS Event settings.

Enabling/Disabling Options

SMBIOS Event Log

Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot. The options are Enabled and Disabled.

Runtime Error Logging Support

Select Enable to support Runtime Error Logging. The options are Enable and Disable. If this item is set to Enable, the following item will be available for configuration:

Erasing Settings

Erase Event Log

Select Yes to erase all error events in the SMBIOS (System Management BIOS) log before an event logging is initialized at bootup. The options are No and Yes.

When Log is Full

Select Erase Immediately to immediately erase all errors in the SMBIOS event log when the event log is full. Select Do Nothing for the system to do nothing when the SMBIOS event log is full. The options are Do Nothing and Erase Immediately.

SMBIOS Event Log Standard Settings

Log System Boot Event

Select Enabled to log system boot events. The options are Disabled and Enabled.

MECI (Multiple Event Count Increment)

Enter the increment value for the multiple event counter. Enter a number between 1 to 255. The default setting is 1.

METW (Multiple Event Count Time Window)

This item is used to determine how long (in minutes) the multiple event counter should wait before generating a new event log. Enter a number between 0 to 99. The default setting is 60.

Note: Please reboot the system for the changes to take effect.

▶View SMBIOS Event Log

This item allows the user to view the event in the SMBIOS event log. Select this item and press to view the status of an event in the log. The following categories are displayed:

Date/Time/Error Code/Severity

4-5 IPMI

Use this feature to configure Intelligent Platform Management Interface (IPMI) settings.

Aptio Setup Utility - Copyright (C) 2015 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit EMC Firmware Revision 1.01 IPMI STATUS Working ► System Event Log ► EMC Network Configuration Press to change the SEL event log configuration. ++: Select Screen T↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.17.1245, Copyright (C) 2015 American Megatrends, Inc.

BMC (BaseBoard Management Controller) Firmware Revision

This item indicates the BMC firmware revision used in your system.

IPMI Status

This item indicates the status of the IPMI firmware installed in your system.

▶System Event Log

Enabling/Disabling Options

SEL Components

Select Enabled to enable all system event logging support at bootup. The options are Enabled and Disabled.

Erasing Settings

Erase SEL

Select Yes, On next reset to erase all system event logs upon next system reboot. Select Yes, On every reset to erase all system event logs upon each system reboot. Select No to keep all system event logs after each system reboot. The options are No, Yes, On next reset, and Yes, On every reset.

When SEL is Full

This feature allows the user to determine what the AMI BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately.

Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

▶BMC Network Configuration

The following items will be displayed:

• IPMI LAN Selection
• IPMI Network Link Status

Update IPMI LAN Configuration

Select Yes for the system BIOS to automatically reset the following IPMI settings at next system boot. The options are Yes and No.

Configuration Address Source (Available when the item above - Update IPMI LAN Configuration is set to Yes)

Use this item to select the IP address source for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the field. If DHCP is selected, AMI BIOS will search for a DHCP (Dynamic Host Configuration Protocol) server attached to the network and request the next available IP address for this computer. The options are DHCP and Static.

Station IP Address

This item displays the Station IP address for this computer. This should be in decimal and in dotted quad form (i.e., 192.168.10.253).

Subnet Mask

This item displays the sub-network that this computer belongs to. The value of each three-digit number is separated by dots and it should not exceed 255.

Station MAC Address

This item displays the Station MAC address for this computer. Mac addresses are 6 two-digit hexadecimal numbers.

Gateway IP Address

This item displays the Gateway IP address for this computer. This should be in decimal and in dotted quad form (i.e., 192.168.10.253).

4-6 Security Settings

This menu allows the user to configure the following security settings for the system.

Aptio Setup Utility - Copyright (C) 2015 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit
Password Description If ONLY the Administrator's password is set, then this only limits access to Setup and is only asked for when entering Setup. If ONLY the User's password is set, then this is a power on password and must be entered to boot or enter Setup. In Setup the User will have Administrator rights. The password length must be in the following range: Minimum length 3 Maximum length 20 Password Check [setup] Administrator Password Secure Boot Menu	Setup: Check password while invoking setup. Always: Check password while Invoking setup as well as on each boot.
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit
Version 2.17.1245. Copyright (C) 2015 American Megatrends, Inc.

Password Check

Select Setup for the system to prompt for a password upon entering the BIOS setup utility. Select Always for the system to prompt for a password at bootup and upon entering the BIOS Setup utility. The options are Setup and Always.

Administrator Password

Use this feature to set the administrator password which is required before entering the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

User Password

Use this feature to set the user password which is required to enter the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

▶ Secure Boot Menu

The following items will be displayed:

• System Mode
• Secure Boot

Secure Boot

Select Enabled for Secure Boot flow control. This feature is available when the platform key (PK) is pre-registered, the platform operates in the user mode, and CSM is disabled in the setup utility. The options are Disabled and Enabled.

Secure Boot Mode

This item allows the user to change the Image Execution policy and manage Secure Boot Keys. The options are Standard and Custom.

▶Key Management

This item displays Secure Boot Keys configuration information:.

Default Key Provision

Use this item to install the factory default secure boot keys when the system is in setup mode. The options are Disabled and Enabled.

▶Enroll All Factory Default Keys

Use this item to install all factory default keys: PK, KEK, db, dbt, and dbx. Selecting this item will prompt a "Load Default Secure Variables" message box that allows the user to select Yes or No.

Platform Key

▶ Delete PK

▶Set New PK

Press "Yes" to load "PK" from factory defaults or select "No" to load from a file.

Key Exchange Key

▶ Delete KEK
▶ Set New KEK

Press "Yes" to load "KEK" from factory defaults or select "No" to load from a file.

▶ Append KEK

Press "Yes" to load "KEK" from factory defaults or select "No" to load from a file.

Authorized Signatures

▶ Delete DB

▶ Set New DB

Press "Yes" to load "db" from factory defaults or select "No" to load from a file.

▶ Append DB

Press "Yes" to load "db" from factory defaults or select "No" to load from a file.

Authorized TimeStamps

▶ Delete DBT

▶ Set New DBT

Press "Yes" to load "dbt" from factory defaults or select "No" to load from a file.

▶ Append DBT

Press "Yes" to load "dbt" from factory defaults or select "No" to load from a file.

Forbidden Signatures

▶ Delete DBX

▶ Set New DBX

Press "Yes" to load "dbx" from factory defaults or select "No" to load from a file.

▶ Append DBX

Press "Yes" to load "dbx" from factory defaults or select "No" to load from a file.

4-7 Boot Settings

Use this feature to configure Boot Settings:

Optio Setup Utility - Copyright (C) 2015 American Megatrends, Inc. Main Advanced Event Logs IPMI Security Boot Save & Exit Boot Configuration Setup Prompt Timeout 1 Boot Mode Select [DUAL] FIXED BOOT ORDER Priorities Dual Boot Order #1 [Hard Disk] Dual Boot Order #2 [CD/DVD] Dual Boot Order #3 [USB Hard Disk] Dual Boot Order #4 [USB CD/DVD] Dual Boot Order #5 [USB Key] Dual Boot Order #6 [USB Floppy] Dual Boot Order #7 [Network: IBA GE S1...] Dual Boot Order #8 [UEFI Hard Disk] Dual Boot Order #9 [UEFI CD/DVD] Dual Boot Order #10 [UEFI USB Hard Disk] Dual Boot Order #11 [UEFI USB CD/DVD] Dual Boot Order #12 [UEFI USB Key] Dual Boot Order #13 [UEFI USB Floppy] Dual Boot Order #14 [UEFI Network] Dual Boot Order #15 [UEFI AP:UEFI: Bui...] ► Delete Boot Option Number of seconds to wait for setup activation key. 65535(0xFFFF) means indefinite waiting. +: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit Version 2.17.1245, Copyright (C) 2015 American Megatrends, Inc.

Boot Configuration

Setup Prompt Timeout

Use this item to indicate how many seconds the system shall wait for the BIOS setup activation key to respond before the system starts to boot. The default setting is 1.

Boot Mode Select

Use this item to select the type of device to be used for system boot. The options are Legacy, UEFI, and Dual.

Fixed Boot Order Priorities

This option prioritizes the order of bootable devices from which the system will boot. Press on each entry from top to bottom to select devices.

• Dual Boot Order #1
• Dual Boot Order #2
• Dual Boot Order #3
• Dual Boot Order #4
• Dual Boot Order #5
• Dual Boot Order #6
• Dual Boot Order #7
• Dual Boot Order #8
• Dual Boot Order #9
• Dual Boot Order #10
• Dual Boot Order #11
• Dual Boot Order #12
• Dual Boot Order #13
• Dual Boot Order #14
• Dual Boot Order #15

▶ Delete Boot Option

Use this item to select a boot device to delete from the boot priority list.

Delete Boot Option

Select the target boot device to delete.

▶ Hard Disk Drive BBS Priorities

• Legacy Boot Order #1

▶ Network Drive BBS Priorities

• Legacy Boot Order #1

▶ UEFI Application Boot Priorities

• UEFI Boot Order #1

4-8 Save & Exit

Select the Save & Exit tab from the BIOS setup screen to configure the settings below.

Discard Changes and Exit Save Changes and Reset Save Options Save Changes Discard Changes Restore Optimized Defaults Save as User Defaults Restore User Defaults Boot Override IBA GE Slot 0100 v1513 MLNX FlexBoot 3.4.306 (PCI 04:00.0) UEFI: Built-In EFI Shell	Exit system setup without saving any changes.
	+: Select Screen ↑↓: Select Item Enter: Select +/-: Change Opt. F1: General Help F2: Previous Values F3: Optimized Defaults F4: Save & Exit ESC: Exit

Discard Changes and Exit

Select this option to quit the BIOS setup without making any permanent changes to the system configuration, and reboot the computer. Select Discard Changes and Exit from the Exit menu and press .

Save Changes and Reset

When you have completed the system configuration changes, select this option to leave the BIOS setup utility and reboot the computer for the new system configuration parameters to take effect. Select Save Changes and Exit from the Exit menu and press .

Save Options

Save Changes

When you have completed the system configuration changes, select this option to save all changes made. This will not reset (reboot) the system.

Discard Changes

Select this option and press to discard all the changes and return to the AMI BIOS setup utility.

Restore Optimized Defaults

To set this feature, select Restore Optimized Defaults from the Exit menu and press . These are manufacture default settings designed for maximum system performance but not for maximum stability.

Save As User Defaults

Select this item and press to save the current BIOS settings as user's default settings for future use.

Select this item and press to retrieve user-defined settings that were previously saved for future use.

Boot Override

This feature allows the user to override the Boot priorities sequence in the Boot menu and immediately boot the system with another device specified by the user. This is a one-time override.

Appendix A

BIOS Error Beep Codes

During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur.

Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen.

Fatal errors are those which will not allow the system to continue the boot-up procedure. If a fatal error occurs, you should consult with your system manufacturer for possible repairs.

These fatal errors are usually communicated through a series of audible beeps. The numbers on the fatal error list (on the following page) correspond to the number of beeps for the corresponding error. All errors listed, with the exception of Beep Code 8, are fatal errors.

A-1 AMIBIOS Error Beep Codes

Beep Code Error Message Description
1 beep Refresh Circuits have been reset (Ready to power up)
5 short beeps and 1 long beep	Memory error No memory detected in the system
5 long and 2 short beeps	Display memory read/write error	Video adapter missing or with faulty memory
1 continuous beep System overheat System overheat

Notes

Appendix B

System Specifications

Note: Unless noted specifications apply to a complete system (all serverboards).

Processors

Two E5-2600 v3 Series processors per node in Socket R3-LGA 2011 type sockets

Note: please refer to our website for details on supported processors.

Chipset

One C612 chipset per node

BIOS

16 MB SPI AMI BIOS® SM Flash UEFI BIOS per node

Memory Capacity

The X10DRT-L/LIBF has eight (8) DIMM slots supporting up to 256 GB of DDR4 (288-pin) ECC 2133/1866/1600 MHz speed RDIMM registered ECC or 512 GB of DDR4 (288-pin) ECC 2133/1866/1600 MHz speed LRDIMM SDRAM in 512 MB, 1 GB, 2 GB, 4 GB, 8 GB, 16 GB, 32 GB or 64 GB sizes at 1.2V voltages.

Note: refer to Section 5-6 for details on installation.

Note: Check the Supermicro website (www.supermicro.com) for the latest memory support information.

SATA Drive Bays

The SuperServer 6018TR-T/TF contains four (4) hot-swap drive bays to house four standard SATA drives, two per node.

PCI Expansion

The SuperServer 6018TR-T/TF has one (1) PCI-Express 3.0 x16 slot available per node.

Serverboard

X10DRT-L/LIBF serverboard (proprietary form factor)

Dimensions: (LxW) 6.50" (L) x 16.64" (W) (165.10 mm x 422.66 mm)

Chassis

SC808BTS-1K03BP (1U rackmount)

Dimensions: (WxHxD) 17.2 x 1.7 x 27.75 in. (437 x 43 x 705 mm)

Weight

Gross (Bare Bone): 39 lbs. (17.7 kg.)

System Cooling

The system has six (6) 4-cm PWM system cooling fans

Note: The system cooling fans are NOT redundant, hot-plug.

System Input Requirements

AC Input Voltage: 100-240V AC auto-range

Rated Input Current: 11 - 4.5A

Rated Input Frequency: 50 to 60 Hz

Efficiency: 96+ (Titaniam Level)

Power Supply

Rated Output Power: 1000 Watt (Part# PWS-1K03A-1R)

Rated Output Voltages: +12V (75A), +5Vsb (4A)

Note: The system power supply is hot-plug.

Operating Environment

Operating Temperature: 5° to 35° C (41° to 95° F)

Non-operating Temperature: -40° to 70° C (-40° to 158° F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5 to 95% (non-condensing)

Regulatory Compliance

Electromagnetic Emissions: FCC Class A, EN 55022 Class A, EN 61000-3-2/-3-3, CISPR 22 Class A

Electromagnetic Immunity: EN 55024/CISPR 24, (EN 61000-4-2, EN 61000-4-3, EN 61000-4-4, EN 61000-4-5, EN 61000-4-6, EN 61000-4-8, EN 61000-4-11)

Safety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe)

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate” for further details.

(continued from front)

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.