SuperStorage SSG-136R-N32JBF - Computer Server Supermicro - Free user manual and instructions

Product Type	JBOF (Just a Bunch Of Flash) System for NVMe Storage
Brand	Supermicro
Model	SuperStorage SSG-136R-N32JBF
Form Factor	1U Rackmount
Dimensions (WxHxD)	17.26 x 1.71 x 31.95 in (438.4 x 43.6 x 811.7 mm)
Chassis	CSE-136TS-R1K04JP-U2
Controller Board	BPN-NVME3-136PL-J
Drive Bays	32 x 2.5" NVMe SSDs in hot-swap drive carriers (16 per sled)
Storage Support	NVMe SSDs only (Supermicro qualified recommended)
Expansion Slots	2 x PCIe 3.0 x16 internal slots
External PCIe Ports	4 x PCIe 3.0 x16 (can be split into 8 x8 ports for up to 8 hosts)
Power Supply	Dual (redundant) 1000W hot-plug modules (PWS-1K04A-1R)
Power Input	100-240 VAC, 50-60 Hz
Cooling	8 x 4cm hot-swap fans
Management	IPMI 2.0 with dedicated LAN, BMC (AST2500)
Network Interfaces	2 x 1GbE IPMI LAN ports (LAN1 active, LAN2 redundant)
Operating Temperature	10° to 35°C (50° to 95°F)
Non-operating Temperature	-40° to 60°C (-40° to 140°F)
Regulatory Compliance	FCC, ICES, CE, VCCI, RCM, UKCA, NRTL, CB
Key Features	Hot-swap drives, redundant power, IPMI remote management, PCIe 3.0 connectivity for high-speed NVMe storage pooling

Frequently Asked Questions - SuperStorage SSG-136R-N32JBF Supermicro

What is the SuperStorage SSG-136R-N32JBF?

It is a 1U rackmount JBOF (Just a Bunch Of Flash) system from Supermicro designed to house up to 32 NVMe SSDs and provide high-speed storage via PCIe 3.0 connections to multiple host servers.

How many NVMe drives can be installed?

Up to 32 hot-swappable 2.5-inch NVMe SSDs, with 16 drives in each of the two front sleds.

What power supply configuration does it use?

It uses dual redundant 1000W hot-plug power supply modules (model PWS-1K04A-1R) for reliable operation.

How do I connect host servers to the JBOF?

Using PCIe cables from host interface cards (e.g., AOC-SLG3-4X4P) to the four external PCIe 3.0 x16 ports on the rear. Ports can be split into eight x8 connections for up to eight hosts.

How do I power on the system?

Connect PCIe cabling and power cable, wait two minutes for BMC service, then press the front power button or use IPMI. Wait three minutes before powering on attached hosts. Refer to the Information LED for BMC status.

How do I assign drives to hosts?

After initial boot, assign NVMe drives to hosts via the Web GUI or CLI using Redfish API. Mapping involves assigning drive endpoints to zones representing hosts. See Appendix C in the manual for detailed procedures.

What cooling does the system have?

Eight hot-swap 4cm fans provide cooling. The top cover must be installed for proper airflow; do not run without cover for extended periods.

How do I replace a failed power supply?

The power supplies are hot-swappable. Unplug the AC cord, push the release tab, pull out the failed module, insert a new one, and reconnect power. The system continues operating on the remaining PSU.

Can I manage the system remotely?

Yes, via IPMI 2.0 with a dedicated management LAN port. You can access the web interface for monitoring, firmware updates, and configuring drive assignment.

What is the default IPMI login?

The default username and password are both ADMIN (uppercase). It is recommended to change the password after initial setup.

USER MANUAL SuperStorage SSG-136R-N32JBF Supermicro

Front view of a dual-chamber industrial control unit with multiple ports and indicator lights (no visible text or labels)

USER'S MANUAL

Revision 1.2a

The information in this User's Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A or Class B digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in industrial environment for Class A device or in residential environment for Class B device. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer's instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate".

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproductive harm. For more information, go to www.P65Warnings.ca.gov.

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.

Manual Revision 1.2a

Release Date: June 02, 2022

Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.

Copyright © 2022 by Super Micro Computer, Inc.

All rights reserved.

Printed in the United States of America

Preface

About this Manual

This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the SuperStorage SSG-136R-N32JBF. Installation and maintenance should be performed by experienced technicians only.

Please refer to the SSG-136R-N32JBF system specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).

Notes

For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user's manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/
- Product drivers and utilities: https://www.supermicro.com/wdl/driver
- Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm

If you have any questions, please contact our support team at: [e-mail]

This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level.

Secure Data Deletion

A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/Lot9_Secure_Data_Deletion_Utility/

Warnings

Special attention should be given to the following symbols used in this manual.

Warning! Indicates important information given to prevent equipment/property damage or personal injury.

Warning! Indicates high voltage may be encountered when performing a procedure.

Contents

Chapter 1 Introduction

1.1 Overview....7
1.2 Unpacking the System 7
1.3 System Features 8
1.4 System Chassis Features 9

Control Panels....9
Front Features....10
Rear Features ....11
Sled Features....12

1.5 Controller Board Layout ....13

Quick Reference Table....13

1.6 Ports....14

Unit Identifier Button....14
External PCIe Ports....14

Chapter 2 System Installation

2.1 Overview....15
2.2 Preparing for Setup....15

Choosing a Setup Location....15
Rack Precautions....15
System Precautions....16
Rack Mounting Considerations....16

Ambient Operating Temperature....16
Airflow 16
Mechanical Loading....16
Circuit Overloading....17
Reliable Ground....17

2.3 Installing the System into a Rack....18

Identifying the Sections of the Rack Rails....18
Releasing the Inner Rails....19
Installing The Inner Rails on the Chassis....20
Installing the Outer Rails on the Rack....21
Installing the Chassis onto the Rack 23

2.4 Powering On the System 24
2.5 Assigning Drives to Host Servers ....24

Chapter 3 Maintenance and Component Installation

3.1 Removing Power....25
3.2 Accessing the System....25
3.3 Chassis Components .....27

Drives 27

System Cooling ....30

Power Supply 31

Power Supply Failure ....31
PCIe Cables....32
PCIe Expansion Cards....35

Appendix A Standardized Warning Statements for AC Systems

Appendix B System Specifications

Appendix C Drive Assignment

Appendix D Firmware Updates

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacific

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

Chapter 1

Introduction

1.1 Overview

This chapter provides a brief outline of the functions and features of the SSG-136R-N32JBF. The SSG-136R-N32JBF is a JBOF system based on the 136TS-R1K04JP-U2 chassis and the BPN-NVME3-136PL-J controller board.

In addition to the controller board and chassis, several important parts that are included with the system are listed below.

Main Parts List
Description Part Number Quantity
Controller Board BPN-NVME3-136PL-J 1
Drive Backplane BPN-NVME3-136NB-L / BPN-NVME3-136NB-R 2 each
JBOF Switch Board BPN-NVME3-136PL 2
Hot-swap SSD Carriers MCP-220-00149-06	32
System Fans FAN-0188L4	8
Rack Rail Mounting Kit	MCP-290-11809-0N	1
Optional Riser Card	RSC-X-6-JBOF	2

The following safety models associated with the SSG-136R-N32JBF have been certified as compliant with UL or CSA: 136U2JBOF-10, 136-10.

1.2 Unpacking the System

Inspect the box the SuperStorage SSG-136R-N32JBF was shipped in and note if it was damaged in any way. If any equipment appears damaged, please file a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the system. It should be situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and electromagnetic fields are generated. A grounded AC power outlet is also required. Read the precautions and considerations noted in Appendix A.

1.3 System Features

The following table provides you with an overview of the main features of the SSG-136R-N32JBF. Refer to Appendix B for additional specifications.

System Features

Controller Board

BPN-NVME3-136PL-J

Chassis

CSE-136TS-R1K04JP-U2

Expansion Slots

Two PCI Express 3.0 x16 SlotsFour External PCI Express 3.0 x16 Ports

Drives

Thirty-two 2.5" NVMe SSDs in hot-swap drive carriers

Power

Dual (redundant) 1000W power supply modules (p/n PWS-1K04A-1R)

Form Factor

1U rackmount

Dimensions

(WxHxD) 17.26 x 1.71 x 31.95 in. (438.4 x 43.6 x 811.7 mm)

1.4 System Chassis Features

Control Panels

The switches and LEDs located on the control panels are described below. Two control panels are located on the front of the chassis.

Figure 1-1. Control Panel View

Control Panel Features
Item Feature Description
1 Power Button		The main power button is used to apply or remove power from the power supply to the system. Turning off system power with this button removes the main power but maintains standby power. To perform many maintenance tasks, you must also unplug system before servicing.Note: Before applying power to the system, refer to Section 2.4, "Powering On the System."
2 Reset Button	The reset button is used	to reset the system.
3 Power LED		Indicates power is being supplied to the system power supply. This LED should normally be illuminated when the system is operating.
4 Information	LED	Indicates one of multiple possible conditions. (See Information LED table on following page.)
5 UID LED		Illuminates when the UID button is activated. Use this to easily identify the system in a rack.
6 IPMI LED	Indicates activity from the IPMI LAN ports.
7 Sled Activity	LEDs	Indicates the combined activity of the SSDs in this side of the sled. (See Sled Activity/Status LEDs table on the following page.)
8 Sled Status	LEDs	Indicates the combined status of the SSDs in this side of the sled. (See Sled Activity/Status LEDs table on the following page). To see status of a specified drive, extend the sled and view the LEDs on the top of the sled.

Information LED
Status Description
Solid red Power supply failure.
Blinking red (1Hz) Fan failure. Check for an inoperative fan.
Blinking red (4Hz)	BMC service is powering on. Do not power on hosts connected to the system until this is finished. Refer to Section 2.4.

Sled Activity/Status LEDs
Activity LED	Status Description
	Solid blue Idle NVMe drive detected.
	Blinking blue I/O activity.
	Off No drive detected.
Status LED	Solid red	Drive failure. Extend chassis sled to identify failed drive.
	Blinking red (4Hz)	Drive identifier. Use IPMI to activate this status, which allows you to quickly identify a specified drive.

Front Features

The 136TS-R1K04JP-U2 is a two-sled 1U chassis. See the illustration below for the features included on the front of the chassis.

Figure 1-2. Chassis Front View

Front Chassis Features
Item Feature Description
1 Control Panels Front control panels with LEDs and buttons (see preceding page)
2 Drive Bays	Bay that houses eight hot-swappable 2.5" SSDs
3 Sled Latch	Latch for releasing and extending the sled from the chassis

Rear Features

The illustration below shows the features included on the rear of the chassis.

Figure 1-4. Chassis Rear View

Rear Chassis Features
Item Feature Description
1 Power Supply		1000W power supply module with LED. Two modules for power redundancy (PSU1 on left, PSU2 on right).(See Power Supply LED table.)
2 UID Button		Press this button to activate the UID LED, which allows you to quickly identify the system in a rack.
3 Expansion	Card Slots Slots for expansion cards.
4 External PCIe	Ports External x16 PCIe ports (see Section 1.6).
5 IPMI LAN	Ports Rear IPMI LAN ports (see Section 1.6).

Power Supply LED
Status Description
Solid green Power supply is providing power to the system.
Solid amber	Power supply is plugged in and deactivated, or the system is powered off but in an abnormal state.
Blinking amber	Power supply temperature has reached 63 °C. The system automatically powers off if the temperature rises to 70 °C, and automatically resets when the temperature falls below 60 °C.

Sled Features

The chassis contains two sleds that each hold 16 NVMe SSDs. The sleds extend from the front of the chassis to provide access to hot-swap drive carriers located on each side of the sled. Refer to Chapter 3 for instructions on accessing the drive carriers.

The illustration below shows the features included on each side of both chassis sleds.

Figure 1-5. Sled Side View

Sled Features
Item Feature	Description
1 Hot-swap	Drive Carrier Tool-less drive carrier for 2.5" NVMe SSD.
2 Sled Latches	Latches for extending the sled from the chassis.
3 Drive Carrier	LEDs	One LED for each drive carrier in the sled. Each LED indicates the status of the drive. (See following Drive Carrier LED table.)

Drive Carrier LED
	Status Description
Status LED	Solid red Drive failure.
	Blinking red (4Hz)	Drive identifier. Use IPMI to activate this status, which allows you to quickly identify a specified drive.

1.5 Controller Board Layout

Below is a layout of the BPN-NVME3-136PL-J. See the following table for jumper descriptions.

graph TD
    subgraph JBOF / NVMF Controller
        A["PCIe External x16"] -->|x16| B["PCI Express Switch 80 Lane"]
        C["PCIe External x16"] -->|x16| B
        D["PCIe External x16"] -->|x16| E["PCI Express Switch 80 Lane"]
        F["PCIe External x16"] -->|x16| E
        G["Control Processor AST2500"] --> H["PHY"]
        I["JPB1"] -->|x16 PCI-e Slot| J["PCI Express Switch"]
        J --> K["80 Lane"]
        L["PCIe External x16"] -->|x16| M["PCI Express Switch"]
        M --> N["80 Lane"]
        O["PCIe External x16"] -->|x16| P["PCI Express Switch"]
        P --> Q["80 Lane"]
        R["Control Processor AST2500"] --> S["SMBUS"]
    end

    subgraph SSD Sled
        T["PCI Express Switch 96 Lane"] --> U["PCI Express Switch"]
        U --> V["SMBUS"]
        W["16 SSDs"] --> X["SSD"]
        Y["SSD"] --> Z["SSD"]
    end

    subgraph SSD Sled
        AA["PCI Express Switch 96 Lane"] --> AB["PCI Express Switch"]
        AB --> AC["SMBUS"]
        AD["16 SSDs"] --> AE["SSD"]
        AF["SSD"] --> AG["SSD"]
    end

    style JBOF / NVMF Controller fill:#f9f,stroke:#333
    style SSD Sled fill:#bbf,stroke:#333

Figure 1-6. Controller Board Layout

Quick Reference Table

Jumper Description Default Setting

JPB1 BMC Enable Pins 1-2 (Enabled)

JL1 Chassis Intrusion Open

Note: BMC must always be enabled. Do not disable BMC.

1.6 Ports

Figure 1-7. Rear I/O Panel

IPMI LAN Ports

Two 1G IPMI LAN ports (LAN1/2) are located on the I/O back panel. If both ports are plugged in, LAN1 is the active port and LAN2 is redundant. If only one LAN port is used, LAN2 is preferred. LAN2 is the left port and LAN1 is the right port.

Refer to the LED Indicator section for LAN LED information.

Unit Identifier Button

A Unit Identifier (UID) button and a rear LED Indicator (UID-LED) are located on the I/O back panel. When the user presses the UID button, the UID LED indicator will be turned on. Press the UID button again to turn off the UID LED. The UID indicator provides easy identification of a system unit that may be in need of service.

Note: UID can also be triggered via IPMI on the controller board. For more information on IPMI, please refer to the IPMI User's Guide posted on our website at http://www.supermicro.com.

External PCIe Ports

Four x16 external PCIe ports are located on the I/O back panel. These ports can be split into eight x8 ports to support eight hosts.

Chapter 2

System Installation

2.1 Overview

This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with drives, fans etc., refer to Chapter 3 for details on installing those specific components.

Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle all PCBs by their edges and keep them in anti-static bags when not in use.

2.2 Preparing for Setup

The box in which the system was shipped should include the rackmount hardware needed to install it into the rack. Please read this section in its entirety before you begin the installation.

Choosing a Setup Location

• The system should be situated in a clean, dust-free area that is well-ventilated. Avoid areas where heat, electrical noise, and electromagnetic fields are generated.
• Leave at least 25 inches of clearance in front of the rack so that you can open the front door completely. Leave approximately 30 inches of clearance behind the rack to allow sufficient space for airflow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.).
• This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units.

Rack Precautions

- Verify that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.

• In single rack installations, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.
• Always verify that the rack is stable before extending a server or other component from the rack.
• You should extend only one server or component at a time. Extending two or more simultaneously might cause the rack to become unstable.

System Precautions

• Review the electrical and general safety precautions in Appendix A.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest components at the bottom of the rack first. Subsequent components should be installed in decreasing order of weight.
• Use a regulating uninterruptible power supply (UPS) to protect the system from power surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers and panels closed to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer's maximum rated ambient temperature (TMRA).

Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.

Slide rail mounted equipment is not to be used as a shelf or a work space.

Warning: Do not pick up the system with the front handles. They are designed to pull the system from a rack only.

2.3 Installing the System into a Rack

This section provides information on installing the 136TS-R1K04JP-U2 chassis into a rack unit with the rails provided. Due to the variety of rack units on the market, the assembly procedure might differ slightly. You should also refer to the installation instructions that came with the rack unit you are using.

Identifying the Sections of the Rack Rails

The SSG-136R-N32JBF includes two rack rail assemblies in the rack mounting kit. Each assembly consists of three sections: An inner chassis rail which secures directly to the chassis, an outer rail that secures to the rack, and a middle rail which extends from the outer rail. These assemblies are specifically designed for the left and right side of the chassis.

Figure 2-1. Identifying the Rail Sections

Note: Both front chassis rails and the rack rails have a locking tab, which serves two functions. First, it locks the system into place when installed and pushed fully into the rack (its normal operating position). In addition, these tabs lock the system in place when fully extended from the rack. This prevents the system from coming completely out of the rack when pulled out for servicing.

Releasing the Inner Rails

Releasing the Inner Rails from the Outer Rails

1. Pull the inner rail out of the outer rail until it is fully extended as illustrated below.
2. Press the locking tab down to release the inner rail.
3. Fully extend the inner rail.
4. Repeat steps 1-3 for the second outer rail.

graph TD
    A["Step 1: Initial component"] --> B["Step 2: Arrow pointing to component"]
    B --> C["Step 3: Circular component with green arrow indicating direction"]
    C --> D["Step 4: Arrow pointing to component"]

Figure 2-2. Extending and Releasing the Inner Rails

Warning: Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over.

Installing The Inner Rails on the Chassis

Installing the Inner Rails

1. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
2. Slide the inner rail forward toward the back of the chassis until the rail clicks into the locked position, which secures the inner rail to the chassis.
3. Secure the inner rail to the chassis with the screws provided.
4. Repeat steps 1-3 for the second inner rail.

Note: Chassis pictured may vary slightly from the SSG-136R-N32JBF system chassis.

Figure 2-3. Installing the Inner Rails

Warning: In any instance of pulling the system from the rack, always use a rack lift and follow all associated safety precautions.

Warning: When initially installing the system to a rack, test that the rail locking tabs engage to prevent the system from being overextended. Have a rack lift in place as a precaution in case the test fails.

Installing the Outer Rails on the Rack

Installing the Outer Rails

1. If your rack has round mounting holes, adjust the fittings on the outer rails. Press the latch at the end of the rail to change from square fittings to round fittings.

Figure 2-4. Adjusting Outer Rail Fittings

1. Push the middle rail back into the outer rail. An audible click indicates that the rail is fully inserted.

Figure 2-5. Adjusting the Middle Rail

1. Insert the pegs on the rear of the outer rail into the rear rack holes. An audible click indicates that the rail is locked into place.
2. Press upward on the locking tab near the rear end of the middle rail, and extend the outer rail until the length fits within the posts of the rack.
3. On the front end of the outer rail, turn the latch to the open position and push the pegs into the front rack holes.
4. Turn the latch to the locked position.
5. Repeat steps 1-6 for the remaining outer rail.

Figure 2-6. Installing Outer Rails to a Rack

Installing the Chassis onto the Rack

Installing the Chassis onto the Rack

1. Fully extend the outer rails as illustrated in Figure 2-7.

2. Align the inner rails of the chassis with the outer rails on the rack.

3. Slide the inner rails into the outer rails, keeping pressure even on both sides. Hold down the locking lever on the inner rail to push the chassis fully onto the rack. An audible click indicates that the chassis is secured into the rails.

Warning: Mounting the system into the rack requires at least two people to support the chassis during installation. Follow safety recommendations printed on the rails.

Figure 2-7. Installing the System into a Rack

2.4 Powering On the System

Any time you power on the SSG-136R-N32JBF system, first perform the following precautions:

1. Verify that all hosts that will use the SSG-136R-N32JBF are powered off.
2. Connect PCIe cabling from the hosts to the SSG-136R-N32JBF.
3. Connect a power cable from a grounded AC outlet to the SSG-136R-N32JBF. Do not power on the system.
4. Wait two minutes for the BMC service to power on.
5. Press the power button on the SSG-136R-N32JBF, or power on the system using the IPMI command interface.
6. Wait three minutes, then power on the hosts that are connected to the system. Refer to the "Information LED" table in Section 1.4.

2.5 Assigning Drives to Host Servers

When you boot up the system for the first time, you must assign the NVMe drives to attached hosts. You can view and modify drive assignment using the Web GUI or the command line. Refer to your preferred procedure in Appendix C.

Chapter 3

Maintenance and Component Installation

This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.

Installation or replacement of most components require that power first be removed from the system. Please follow the procedures given in each section.

3.1 Removing Power

Use the following procedure to ensure that power has been removed from the system. This step is necessary when removing or installing non hot-swap components or when replacing a non-redundant power supply.

1. Use IPMI to power down the system.
2. After the system has completely shut-down, disconnect the AC power cord(s) from the power strip or outlet. (If your system has more than one power supply, remove the AC power cords from all power supply modules.)
3. Disconnect the power cord(s) from the power supply module(s).

3.2 Accessing the System

The 136TS-R1K04JP-U2 chassis features a removable top cover, which allows easy access to the inside of the chassis.

Removing the Top Cover

1. Remove power from the system as described in Section 3.1.
2. Remove the screws securing the middle panel to the chassis.
3. Lift the middle panel up and off the chassis.
4. Remove the screws securing the second panel to the chassis.
5. Slide the second panel toward the rear of the chassis and lift it off.

Warning: Except for short periods of time, do not operate the system without the cover in place. The chassis cover must be in place to allow for proper airflow and to prevent overheating.

Figure 3-1. Removing the Chassis Cover

3.3 Chassis Components

Drives

Your system may or may not have come with drives installed. Up to thirty-two hot-swappable 2.5" NVMe SSDs are supported by the chassis (16 drives in each sled).

The drives are mounted in drive carriers to simplify their installation and removal from the chassis. (Both procedures may be done without removing power from the system.)

Extending a Sled

1. For one sled, swing both sled latches fully out.
2. Grasp the sled latches and use them to extend the sled out of the chassis.

graph TD
    A["Sled #1"] --> B["Pull"]
    C["Sled #2"] --> D["Pull"]
    style A fill:#f9f,stroke:#333
    style C fill:#f9f,stroke:#333
    style B fill:#ccf,stroke:#333
    style D fill:#ccf,stroke:#333
    note right of A Top View
    note right of C Top View
    note right of D Top View
    note right of B Pull
    note right of D Pull

Figure 3-2. Extending the Sled

Notes: 1. Do not leave a sled extended from the chassis for longer than two minutes. 2. Use Supermicro qualified NVMe SSDs only. For information on recommended SSDs, visit the Supermicro website at http://www.supermicro.com/products/nfo/storage.cfm.

Mounting a Drive in a Drive Carrier

1. Release and swing open the locking latches on the side of the drive carrier.
2. Insert a drive into the carrier with the PCB side facing down and the connector end toward the rear of the carrier. Insert the drive at an angle as shown in Figure 3-3. Verify that the mounting holes on the drive align with the mounting holes on the carrier.
3. Swing both locking latches shut. An audible click indicates that the drive is locked in place.
4. Insert the drive and drive carrier into its bay. When the drive is fully inserted, push the release tab until it clicks shut. Refer to Figure 3-4.

Diagram of a server rack with two ports and a cable, showing red directional arrows indicating rotation (no text or symbols present)

Figure 3-3. Mounting a Drive in a Carrier

Illustration of a hand inserting a component into a server rack with a red arrow indicating the direction (no text or symbols present)

Figure 3-4. Installing a Drive Carrier into the Sled

Removing a Drive

1. Push the release tab on the drive carrier that you want to remove.
2. Use the release tab to retract the drive carrier from its bay, then fully remove the drive carrier and its drive.
3. Release and swing open the locking latches on the side of the drive carrier.
4. Remove the drive from its carrier at an angle as shown in Figure 3-6.

Figure 3-5. Removing a Drive Carrier from a Sled

Figure 3-6. Removing a Drive from a Carrier

System Cooling

Eight 4-cm hot-swap fans provide the cooling for the system. It is very important that the chassis top cover is properly installed and forms a seal in order for the cooling air to circulate properly through the chassis and cool the components.

Replacing a Fan

1. If necessary, open the chassis while the power is running to determine which fan requires changing. (Never run the system for an extended period of time with the chassis open.)

2. Open the chassis cover.

3. Remove the failed fan from the chassis.

4. Place the new fan into the vacant space in the housing while making sure the arrows on the top of the fan (indicating air direction) point in the same direction as the arrows on the other fans.

Technical line drawing of a server rack with internal components and a green arrow indicating a specific component (no text or symbols present)

Figure 3-7. Installing a System Fan

Power Supply

The SSG-136R-N32JBF has a 1000W redundant, hot-plug power supply consisting of two power modules. Each power supply module has an auto-switching capability, which enables it to automatically sense and operate at a 100V - 240VAC input voltage.

Power Supply Failure

If either of the two power supply modules fail, the other will take the full load and allow the system to continue operation without interruption. The Power Fail LED illuminates until the failed module has been replaced. Replacements can be ordered directly from Supermicro (see contact information in the Preface). The power supply modules have a hot-swap capability, so you can replace the failed module without powering down the system.

Replacement units can be ordered directly from Supermicro. The power supply units have a hot-swap capability, meaning you can replace the failed unit without powering down the system.

Removing/Replacing the Power Supply

1. Unplug the power cord from the failed power supply module.
2. Push the release tab on the back of the power supply.
3. Pull the power supply out using the handle provided.
4. Replace the failed power module with another of the same model.
5. Push the new power supply module into the power bay until it clicks into the locked position.
6. Plug the AC power cord back into the module.

Figure 3-8. Removing/Replacing a Power Supply

PCIe Cables

PCIe cabling is required to connect the SSG-136R-N32JBF to the server node's host interface card(s). The chassis has four x16 external PCIe ports, which can be split to eight x8 ports to support up to eight hosts.

Connect the PCIe cable from the server node's host interface card (P/N AOC-SLG3-4X4P) to the first set of ports. For each host, the top cable from the interface card (port A) must be plugged into port A on the system, and the bottom cable from the interface card (port B) must be plugged into port B on the system. To support additional hosts, connect PCIe cables to the subsequent ports. If using only two hosts, connect each host to a different PCIe switch for improved performance (see Figure 3-9).

The following diagrams show three potential configurations for the SSG-136R-N32JBF: A single server with multiple interface cards and dual x8 PCIe cables, four servers with dual x8 PCIe cables, and eight servers with single x8 PCIe cables.

Figure 3-9. Single Server with Multiple Interface Cards (Dual x8 PCIe Cables)

Figure 3-10. Four Servers (Dual x8 PCIe Cables)

graph TD
    Server1["Server #1"] -->|AOC-SLG3-4X4P| Server2["Server #2"]
    Server2 -->|AOC-SLG3-4X4P| Server3["Server #3"]
    Server3 -->|AOC-SLG3-4X4P| Server4["Server #4"]
    Server4 -->|AOC-SLG3-4X4P| Server5["Server #5"]
    Server5 -->|AOC-SLG3-4X4P| Server6["Server #6"]
    Server6 -->|AOC-SLG3-4X4P| Server7["Server #7"]
    Server7 -->|AOC-SLG3-4X4P| Server8["Server #8"]
    Server1 -->|External PCIe Cables| Server5
    Server2 -->|External PCIe Cables| Server6
    Server3 -->|External PCIe Cables| Server7
    Server4 -->|External PCIe Cables| Server8

Figure 3-11. Eight Servers (Single x8 PCIe Cables)

PCIe Expansion Cards

The SSG-136R-N32JBF can accommodate up to two full-height PCIe expansion cards in the rear slots. These are only used for NVMeoF configurations, 6-host configurations, and 12-host configurations.

Installing an Add-on Card

Begin by removing power from the system as described in Section 3.1 and removing the cover as described in Section 3.2.

1. Remove the shield for the PCIe slot that you wish to populate. Verify that the card you are installing is supported by the slot.
2. Seat the card firmly into the slot by pushing down with your thumbs evenly on both sides of the card.
3. Use a screw to secure the top of the card shield to the chassis. The PCIe slot shields protect the motherboard and its components from EMI and aid in proper ventilation, so verify that each unused slot is covered by a shield.

Appendix A

Standardized Warning Statements for AC Systems

A.1 About Standardized Warning Statements

The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.

Read this appendix in its entirety before installing or configuring components in the Supermicro chassis.

These warnings may also be found on our website at http://www.supermicro.com/about/policies/safety_information.cfm.

Warning Definition

Warning! This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents.

警告の定義

この警告サインは危険を意味します。

Installation Instructions

Warning! Read the installation instructions before connecting the system to the power source.

設置手順書

Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A.

サーキット・ブレーカー

Power Disconnection Warning

Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components.

電源切断の警告

Equipment Installation

Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment.

機器の設置

Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations).

アクセス制限区域

Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions

電池の取り扱い

Redundant Power Supplies

Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit.

冗長電源装置

Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing.

バックプレーンの電圧

Comply with Local and National Electrical Codes

Warning! Installation of the equipment must comply with local and national electrical codes.

地方および国の電気規格に準拠

Warning! Ultimate disposal of this product should be handled according to all national laws and regulations.

製品の廃棄

Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing.

ファン・ホットスワップの警告

Power Cable and AC Adapter

Warning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fire. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA-certified cables (that have UL/CSA shown on the code) for any other electrical devices than products designated by Supermicro only.

電源コードとACアダプター

System Specifications

Drive Bays

Thirty-two 2.5" NVMe SSDs in hot-swap drive carriers

PCI Expansion Slots

Two PCIe 3.0 x16 slots

Four External PCIe 3.0 x16 ports

Controller Board

BPN-NVME3-136PL-J

Chassis

136TS-R1K04JP-U2; 1U Rackmount, (WxHxD) 17.26 x 1.71 x 31.95 in. (438.4 x 43.6 x 811.7 mm)

System Cooling

Eight 4-cm fans

Power Supply

Model: PWS-1K04A-1R

AC Input Voltages: 100-240 VAC

Rated Input Current: 15-12A (100-127VAC) / 825-7A (200-240VAC)

Rated Input Frequency: 50-60 Hz

Rated Output Power: 1000W

Rated Output Voltages: +12V (83A at 100-127VAC, 100A at 200-240VAC), +5Vsb (4A)

Operating Environment

Operating Temperature: 10° to 35° C (50° to 95° F)

Non-operating Temperature: -40^ to 60^ C ( -40^ to 140^ F)

Operating Relative Humidity: 8% to 90% (non-condensing)

Non-operating Relative Humidity: 5% to 95% (non-condensing)

Regulatory Compliance

FCC, ICES, CE, VCCI, RCM, UKCA, NRTL, CB

Applied Directives, Standards

EMC/EMI: 2014/30/EU (EMC Directive)

FCC Part 15 Subpart B

ICES-003

VCCI-CISPR 32

AS/NZS CISPR 32

EN/BS EN55024

EN/BS EN55032

EN/BS 61000-3-2

EN/BS 61000-3-3

EN/BS 61000-4-2

EN/BS 61000-4-3

EN/BS 61000-4-4

EN/BS 61000-4-5

EN/BS 61000-4-6

EN/BS 61000-4-8

EN/BS 61000-4-11

Green Environment:

2011/65/EU (RoHS Directive)

EC 1907/2006 (REACH)

2012/19/EU (WEEE Directive)

Product Safety: 2014/35/EU (LVD Directive)

UL/CSA 60950-1 (USA and Canada)

IEC/EN 60950-1

Perchlorate Warning

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. "Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate"

After installing the SSG-136R-N32JBF system, you must assign drives to hosts. This appendix provides information about drive mappings and procedures for reassigning drives to different hosts. Refer to the Web GUI or command line interface sections in this appendix for your preferred procedure.

Physical hosts are represented by "zones" and physical drives are represented by "endpoints." Familiarity with zones and endpoints is necessary to properly assign drives to hosts. Refer to the following diagrams for zone-to-host labeling, and refer to Section C.2 for information about endpoints.

Figure C-1. Zone Labeling (Four Hosts)

Figure C-2. Zone Labeling (Eight Hosts)

You can assign a drive to a new host by mapping the drive's endpoint to a different zone. You can do this from the Web GUI or the command line interface. Refer to your preferred procedure in Section C.3 or Section C.4.

C.2 Drive Slots Endpoint Mapping

Each physical drive is assigned an "endpoint" number that is different from the physical slot number. The following tables provide an overview of endpoint mapping for drive slots in a four-host and eight-host configuration.

When assigning drives to hosts, start with the drives located closest to the front of the system and work your way back. Also, alternate between sleds so that the drives used by each host are spread between both sleds.

The "Slot #" column refers to the physical slot number of an NVMe SSD. The "Endpoint" column refers to the endpoint number assigned to the drive. The "Load Order" column is the recommended sequence in which drives should be assigned to hosts (i.e. assign Load Order 1 first, Load Order 2 second, etc.).

Drive Slots to Endpoint Mapping (Four Hosts)
Tray 1 Tray 2
Slot #	Endpoint	Load Order	Slot #	Endpoint	Load Order
0 30 25	16 14 26
1 29 27	17 13 28
2 32 17	18 16 18
3 31 19	19 15 20
4 34 9	20 18 10
5 33 11	21 17 12
6 36 1	22 20 2
7 35 3	23 19 4
8 28 5	24 12 6
9 27 7	25 11 8
10 26	13 26 10 14
11 25 1	15 27 9 16
12 24 2	21 28 8 22
13 23 2	23 29 7 24
14 22 2	29 30 6 30
15 21 3	31 31 5 32

Drive Slots to Endpoint Mapping (Eight Hosts)
Tray 1 Tray 2
Slot #	Endpoint	Load Order	Slot #	Endpoint	Load Order
0 34 25	16 18 26
1 33 27	17 17 28
2 36 17	18 20 18
3 35 19	19 19 20
4 38 9	20 22 10
5 37 11	21 21 12
6 40 1	22 24 2
7 39 3	23 23 4
8 32 5	24 16 6
9 31 7	25 15 8
10 30	13 26 14 14
11 29 15	27 13 16
12 28 21	28 12 22
13 27 23	29 11 24
14 26 29	30 10 30
15 25 31	31 9 32

C.3 Assigning a Drive from the GUI

Drive assignment from the Web GUI requires a computer with access to the network that contains your SSG-136R-N32JBF system.

When assigning drives to hosts, start with the drives located closest to the front of the system and work your way back. Also, alternate between sleds so that the drives used by each host are spread between both sleds.

Assigning a Drive

1. Access the Web GUI by opening a Web browser and directing it to the IP address of the SSG-136R-N32JBF system. To get the IP address of your system, refer to Section C.5.

1. Log in and click on the Pooled NVMe Storage tab.
2. In the Mode field, click the drop-down bar and select "4 Hosts" or "8 Hosts" depending on your configuration.
3. On the displayed table, find a specified drive by looking at the Slot ID column.
4. Click the drop-down bar in the Zone column, then select the zone to which you want to assign this drive.

1. When finished, click the disk icon on the far right of the row to save changes, or click the cancel icon to discard changes.

C.4 Assigning a Drive from the CLI

Drive assignment from the CLI requires Curl and Python with the json.tools module installed in a Linux environment. (Recommended versions: Curl 7.35.0 or later, Python 2.7.6 or later). When assigning drives to hosts, start with the drives located closest to the front of the system and work your way back. Also, alternate between sleds so that the drives used by each host are spread between both sleds.

Getting Drive Information

1. Access a command line interface connected to the SSG-136R-N32JBF system.
2. To get drive information for a given zone, run the following command:

$ curl -k --user ADMIN:ADMIN -X GET https://<IP Address>/redfish/v1/Fabrics/1/Zones/1 | python -m json.tool 

For use the IP address of the system (see Section C.5). For "Zones/1" replace "1" with the zone number corresponding to the host for which you are getting drive information.

In the output (see next page for example), the first item listed under "Endpoints" is the zone number, and subsequent items are drive endpoint numbers.

In the following example, endpoint 19 (drive 23) represents the only drive assigned to zone 1:

{
    "@odata.context": "/redfish/v1/$metadata#Zone.Zone",
    "@odata.id": "/redfish/v1/Fabrics/1/Zones/1",
    "@odata.type": "#Zone.Zone",
    "Description": "PCIe Zone 1",
    "Id": "1",
    "Links": {
    "Endpoints": [
    {
    "@odata.id": "/redfish/v1/Fabrics/1/Endpoints/1",
    },
    {
    "@odata.id": "/redfish/v1/Fabrics/1/Endpoints/19"
    }
    ],
    "InvolvedSwitches": [
    {
    "@odata.id": "/redfish/v1/Fabrics/1/Switches/1",
    }
    ]
    },
    "Name": "Zone",
    "Oem": {},
    "Status": {
    "Health": "OK",
    "State": "Disabled"
    }
} 

For information about which endpoints correspond to physical drives, refer to Section C.2.

Reassigning a Drive

1. To change drive assignment, you must first create a .txt file that includes your changes in JSON format. For example:

{
    "Endpoints": [
    {
    "@odata.id": "/redfish/v1/Fabrics/1/Endpoints,
    },
    {
    "@odata.id": "/redfish/v1/Fabrics/1/Endpoints,
    },
    {
    "@odata.id": "/redfish/v1/Fabrics/1/Endpoints,
    }
    ]
} 

In the above example, endpoint 19 (drive 23) was removed from zone 1, and endpoints 7 and 5 (drives 29 and 31) were added to zone 1.

1. In the command line interface, run the following command:

$ curl -k --http1.0 --user ADMIN:ADMIN -X PATCH -d @<text.txt> https://<IP Address>/redfish/v1/Fabrics/1/Zones/1

For , use the IP address of the system (see Section C.5). For , use the file name of the text file you saved. For "Zones/1" replace "1" with the zone number corresponding to the host on which you are making drive assignment changes.

The following output indicates success:

{"Success": {"code":"Base.1.0.0.Success","Message":"Successfully Completed Request."}} 

1. To verify your changes, perform the "Getting Drive Information" procedure.

C.5 Obtaining the System IP Address

Drive reassignment requires the IP address of the SSG-136R-N32JBF system. Perform the following procedure to obtain the system IP address.

If DHCP is detected, a dynamic IP address is assigned to the system. If DHCP is not detected, the default IP address is 192.168.1.99.

Obtaining System IP Address

1. Get the MAC address of the SSG-136R-N32JBF. The MAC address is printed on the service tags on the front end of the chassis under the control panels.
2. Consult your network administrator to determine IP address from a MAC address. This IP address is required to access the access the Web GUI and to run CLI commands.

Appendix D

Firmware Updates

D.1 Updating Switch Configuration

Use IPMI to update the configuration of the JBOF switches.

1. Log into the IPMI.

The default Username and Password are ADMIN / ADMIN.

1. Under the Maintenance tab, select JBOF FW Update.

1. Select the targeted switch and click the Update button.

1. Click Choose File to select configuration file, and click the Update button.

1. Click OK to confirm.

1. Click OK to finish.

1. After all intended switches are configured, please reset the system to complete the update.

D.2 Updating the BMC Firmware

Use IPMI to update the BMC firmware.

1. Log into the IPMI.

By default, both Username and Password are ADMIN

1. Under the Maintenance tab, select Firmware Update.

1. Click the Enter Update Mode button.

Read the caution message and click OK.

1. Click Choose File, select the configuration file, then click the Upload Firmware button.

1. Clear all check box options and click the Start Upgrade button.

1. Click OK to confirm and wait.

The JBOF system reboots to complete the update.