Page 1
Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide First Published: 2014-11-05 Last Modified: 2019-03-28 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883...
Page 2
Any products and features described herein as in development or available at a future date remain in varying stages of development and will be offered on a when-and if-available basis. Any such product or feature roadmaps are subject to change at the sole discretion of Cisco and Cisco will have no liability for delay in the delivery or failure to deliver any products or feature roadmap items that may be set forth in this document.
Minimizing Electromagnetic and Radio Frequency Interference Shock and Vibration Requirements Grounding Requirements Planning for Power Requirements Airflow Requirements Rack and Cabinet Requirements Clearance Requirements C H A P T E R 3 Installing the Chassis Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 4
Replacing the Uplink Module Replacing a Fan Module During Operations Replacing a Power Supply Module Removing an AC Power Supply Removing a DC Power Supply Installing an AC Power Supply Installing a DC Power Supply Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 5
Power Supply LEDs A P P E N D I X D Additional Kits Rack Mount Kit N9K-C9300-RMK A P P E N D I X E Site Preparation and Maintenance Records Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 6
Contents Site Preparation Checklist Contact and Site Information Chassis and Module Information Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Braces and a vertical bar within square brackets indicate a required choice within an optional element. Indicates a variable for which you supply values, in context where italics variable cannot be used. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
What's New in Cisco Product Documentation, at: https://www.cisco.com/warp/public/687/Directory/DirTAC.shtml. Subscribe to What's New in Cisco Product Documentation, which lists all new and revised Cisco technical documentation as an RSS feed and delivers content directly to your desktop using a reader application. The RSS feeds are a free service.
Overview, on page 1 Overview The Cisco Nexus 9396TX switch (N9K-C9396TX) is a 2-RU, fixed-port switch designed for spine-leaf-APIC deployment in data centers. This switch has 48 fixed 1- and 10-GBASE-T APIC-facing ports and a choice of 6- or 12-port uplink modules for connections to spine switches. The chassis for this switch includes the following user-replaceable components: •...
Page 12
0.5 A are not supported. Out-of-band management port (RJ-45 port) Screw holes (4) for attaching a center-mount rack bracket for two-post racks (one bracket for each of two sides) Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 13
AC power supply modules have burgundy coloring (DC power supply modules have green coloring). For port-side exhaust airflow, the fan and AC power supplies have blue coloring (DC power supply modules have gray coloring). Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 14
If the switch has port-side exhaust airflow (blue coloring for fan modules), you must locate the ports in the hot aisle. If you locate the air intake in a hot aisle, the switch can overheat and shut down. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
However, if the switch is located in an unusually humid location, use a dehumidifier to maintain the humidity within an acceptable range. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Note To predict and prevent strong EMI, you need to consult experts in radio frequency interference (RFI). Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
The surfaces shall be cleaned and an antioxidant applied before installation. Planning for Power Requirements The switch includes two power supplies (1-to-1 redundancy with current sharing) in one of the following combinations: Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 18
This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective devices are rated not greater than 20A (North America), 16A (Europe), and 13A (UK). Note For DC input application, please refer to the following statement: Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• White coloring on HVAC/HVDC power supplies indicates dual-direction airflow. • Gray coloring on DC power supplies indicates port-side exhaust airflow. • Green coloring on DC power supplies indicates port-side intake airflow. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• No clearance is required between the chassis and the sides of the rack or cabinet (no side airflow). Also, you must have power receptacles that are located within reach of the power cords that are used with the switch. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Width of the front clearance area (equal to the width of the chassis with two rack-mount brackets that are attached to it). 19.0 in (43.3 cm) For the clearances required for a two-post rack installation, see the following figure. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 22
Service clearance that is required for replacing the chassis (equals the length of the chassis). Note Both the front and rear of the chassis must be open to both aisles for airflow. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
You can install the switch using the following rack-mount options: • Rack-mount kit (N9K-C9300-RMK) which you can order from Cisco. For four post racks. The rack or cabinet that you use must meet the requirements listed the in...
The shipment should include the following: • Switch chassis, which includes the following installed components: • One uplink module: • M6PQ uplink module • M6PQ-E uplink module • M12PQ uplink module Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
For port-side intake airflow, the switch must have port-side intake fan and AC power supply modules with one or more of the following colorings: • Burgundy coloring on fan modules and AC power supplies • Green coloring on DC power supplies Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• You must separately order the center-mount brackets if you are installing the chassis in a two-post rack. These brackets do not ship with the chassis unless you specifically order them. • You must have the following tools and equipment: • Manual Phillips-head torque screwdriver • Center-mount bracket kit Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Power supply modules must have the same airflow direction as the fan modules but might have different coloring if they use DC power (green coloring for port-side intake airflow or gray coloring for port-side exhaust airflow). Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 28
If these modules have a blue or gray coloring for port-side exhaust airflow, then you must position the modules by the cold aisle. If the modules have a burgundy or green coloring for port-side intake airflow, you must position the modules by the hot aisle. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• Port-side exhaust (blue coloring for fan modules) airflow requires that the bottom-support rail with the chassis stop be located on the cold aisle side of the rack. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 30
Use two customer-supplied screws (typically M6 x 10 mm screws) to attach the bottom-support rail half to the vertical mounting rails on the rack post. Tighten each screw to the appropriate torque setting for the screws (for M6 x 10 mm screws, use 40 in. lbs [4.5 N·m] of torque). Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
You are ready to install two front-mount brackets on the chassis. Attaching Front-Mount Brackets to the Chassis You need to attach a right-angled bracket to each side of the chassis. This bracket holds the chassis in place on a four-post rack. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Warning Statement 1074 Comply with Local and National Electrical Codes To reduce risk of electric shock or fire, installation of the equipment must comply with local and national electrical codes. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 33
If this happens, press the side rails toward the sides of the chassis so that the chassis stops can go inside the chassis and hold it in place on the rack. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
(for M6 x 10 mm screws, use 40 in-lbs [4.5 N·m] of torque). Grounding the Chassis The switch chassis is automatically grounded when you properly install the switch in a grounded rack with metal-to-metal connections between the switch and rack. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 35
Verify that the ground wire is securely attached to the grounding lug by attempting to pull the wire out of the crimped lug. Chassis grounding pad 2 M4 screws are used to secure the grounding lug to the chassis Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Using the recommended AC power cable for your country or region, connect one end to the AC power supply. b) Connect the other end of the power cable to the AC power source. Step 2 For each HVAC/HVDC power supply, connect it to a power source as follows: Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 37
A setup utility automatically launches the first time that you access the switch and guides you through the basic configuration. For instructions on how to configure the switch and check module connectivity, see the appropriate Cisco Nexus 9000 Series configuration guide.
Page 38
Installing the Chassis Starting the Switch Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
As shown in the following figure, each APIC is connected to one or two leaf switches and each leaf switch should be connected to every spine switch in the same fabric. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Cisco equipment. In situations where long parallel cable runs cannot be separated by at least 3.3 feet (1 meter), we recommend that you shield any potential noise sources by housing them in a grounded metallic conduit.
Connecting Leaf Switches to APICs You must downlink one or two (recommended for redundancy) Cisco Nexus 9300 platform ACI-mode leaf switches to each Application Policy Infrastructure Controller (APIC) in your ACI fabric. The type of virtual interface card (VIC) installed on the APIC determines the types of interface cables that you can use to connect the leaf switches to the APICs.
Page 42
Connect the other end of the interface cable to a downlink port on a leaf switch. • For a Cisco 10GBASE-LR or -SR transceiver and cable, insert the transceiver into a downlink optical port on a leaf switch before connecting the cable to the transceiver.
You cannot include NX-OS line cards in the same chassis when running in ACI mode. Note Multiple uplinks from a leaf switch to a spine switch is supported. A symmetrical topology is recommended so that all devices have equal access to resources. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Migration of Nodes From a First Generation Switch to a Second Generation Switch You have first generation Cisco Nexus 9000 series switches that may or may not be comprising a virtual port channel (vPC). You are migrating to second generation Cisco Nexus 9000 series switches using the same cables.
Page 45
Before you begin • Move any Cisco Application Policy Infrastructure Controllers (APICs) that are connected to the first generation switches that you are migrating to any other switches in the fabric and wait for the Cisco APIC cluster to become "Fully Fit."...
Register the new second generation switch with the Cisco APIC. Register the new node with the same node name and node ID. This switch becomes part of the fabric. The Cisco APIC pushes the policies to the new switch and keeps down the vPC legs because there is a mismatch of the generation of switches.
DB-9 connector on the other end of the cable to the serial port on the console device. What to do next You can now perform the initial configuration for the switch (see the Cisco ACI Getting Started Guide). Setting Up an Optional Management Connection You can optionally set up an out-of-band management connection for monitoring and troubleshooting purposes.
Page 48
• Inspect routinely for dust and damage. If you suspect damage, clean and then inspect fiber ends under a microscope to determine if damage has occurred. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Slide the module all the way into the chassis until its front side comes in contact with the chassis. For the last 0.2 inches (0.5 cm),carefully mount the module onto the chassis connectors by pushing more firmly, but do not force the module if it does not move further (excessive force can damage the connectors). Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
If you are not able to push the module all the way into the slot, carefully slide the module out of the slot Note and check its electrical connectors for damage. If damaged, contact Cisco Technical Assistance for help. If undamaged, repeat Step 6 to reinstall the module.
Page 51
For the last 0.2 inches (0.5 cm), carefully mount the module onto the chassis connectors by pushing more firmly, but do not force the module if it does not move further (excessive force can damage the connectors). Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
If the STS LED does not turn on, slide the module out of the chassis, and visually check the electrical connectors on the back side of the chassis for damage. If damaged, contact Cisco Technical Assistance for help. If undamaged, repeat the previous step to reinstall the module.
• An AC power source must be within reach of the power cable that will be used with the replacement power supply. If you are using n+n power redundancy, there must be a separate power source for each power supply installed in the chassis. Otherwise, only one power source is required. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Typically, the chassis is grounded by its metal-to-metal connection to a grounded rack. If you need to ground this chassis by another means, see Grounding the Chassis, on page • We recommend 8-AWG wire for DC installation in the U.S. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Verify that the circuit breaker for the power feed to the replacement power supply is turned off. Step 2 Remove the DC power connector block from the power supply by doing the following: Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 56
"+ DC". Step 9 Verify that the other ends of the cables are attached to the DC power source and ground. You are then ready to turn on the DC power source. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• Standard 19-inch (48.3 cm) (two- or four-post EIA cabinet or rack, with mounting rails that conform to English universal hole spacing per section 1 of ANSI/EIA-310-D-1992). For more information, see Requirements Specific to Perforated Cabinets, on page Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• The roof should be perforated with at least a 20 percent open area. • The cabinet floor should be open or perforated to enhance cooling. The Cisco R Series rack conforms to these requirements. Cable Management Guidelines To help with cable management, you might want to allow additional space in the rack above and below the chassis to make it easier to route all of the fiber optic or copper cables through the rack.
Some power supplies have capabilities that are greater than the maximum power requirements for a switch. To determine the power consumption characteristics for the switch, use the typical and maximum requirements that are listed in the following table. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
12 VDC Efficiency rating Climate Savers Platinum Efficiency (80Plus Platinum certified) Form factor Power Cable Specifications The following sections specify the power cables that you can order and use with this switch. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
250 VAC, 10 A, MP232 plug, 8.2 feet (2.5 m) United Kingdom CAB-9K10A-UK 250 VAC, 10 A, BS1363 plug (13 A fuse), 8.2 (2.5 All except Argentina, Brazil, NO-POWER-CORD No power cord included with switch and Japan Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
• AS/NZS CISPR22 Class A • CISPR22 Class A • EN55022 Class A • ICES003 Class A • VCCI Class A • EN61000-3-2 • EN61000-3-3 • KN22 Class A • CNS13438 Class A Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 65
System Specifications Specification Description EMC: Immunity • EN55024 • CISPR24 • EN300386 • KN 61000-4 series RoHS The product is RoH-6 compliant with exceptions for leaded-ball grid-array (BGA) balls and lead press-fit connectors. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 66
System Specifications System Specifications Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Amber Port admin state is 'Disabled, or the SFP is absent, or both. Port admin state is 'Enabled' and SFP is present, but interface is not connected. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
The power supply may not be properly installed in the chassis. Either all the installed power supplies are not receiving power or an uninstalled power supply is not receiving power. Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 69
Power supply is installed without a connection to a power source. (10 seconds) then amber Amber Power supply failure—possibly one of the following conditions: • Over voltage • Over current • Over temperature • Power supply fan failure Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Rack Mount Kit N9K-C9300-RMK The following table lists and illustrates the contents for the 2-RU rack-mount kit (N9K-C9300-RMK). Illustration Description Quantity Rack-mount kit • Bottom support rails (2) • Front-mount brackets (2) Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Your completion of each task ensures a successful switch installation. Planning Activity Verification Time and Date Space evaluation: Space and layout Floor covering Impact and vibration Lighting Physical access Maintenance access Environmental evaluation: Ambient temperature Humidity Altitude Atmospheric contamination Airflow Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 74
(transceivers) EMI evaluation: Distance limitations for signaling Site wiring RFI levels Contact and Site Information Use the following worksheet to record contact and site information for the installation. Contact person Contact phone Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 75
Domain name IP broadcast address Gateway/router address DNS address Use the following worksheet to record information about the modules in the switch. Module Slot Module Type Module Serial Number Notes Uplink module Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...
Page 76
Site Preparation and Maintenance Records Site Preparation and Maintenance Records Module Slot Module Type Module Serial Number Notes Fan module 1 Fan module 2 Fan module 3 Power Supply 1 Power Supply 2 Cisco Nexus 9396TX ACI-Mode Switch Hardware Installation Guide...