EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Page 1
Dell EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Dell EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Page 3
Contents 1 About this guide...4 Information symbols...4 Related documents...4 2 ONIE diagnostics...6 ONIE expansion...6 Command-line interface options...6 Boot processes...7 POST...7 EDA, Quick Test Mode...7 Capturing Support Data from ONIE...7 Changing the Default Grub Boot Entry...7 3 Dell EMC diagnostics...9 ONIE expansion...9 S4048-ON or S3048-ON diagnostic package...9 Dell EMC diagnostic test suite...10 System information...14 CPLD versions...15 Factory defaults restore...16 4 Dell EMC support...17 Contents 3
Contents 1 About this guide...4 Information symbols...4 Related documents...4 2 ONIE diagnostics...6 ONIE expansion...6 Command-line interface options...6 Boot processes...7 POST...7 EDA, Quick Test Mode...7 Capturing Support Data from ONIE...7 Changing the Default Grub Boot Entry...7 3 Dell EMC diagnostics...9 ONIE expansion...9 S4048-ON or S3048-ON diagnostic package...9 Dell EMC diagnostic test suite...10 System information...14 CPLD versions...15 Factory defaults restore...16 4 Dell EMC support...17 Contents 3
EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Page 9
... onie-support onie-syseeprom onie-sysinfo onie-uninstaller Topics: • S4048-ON or S3048-ON diagnostic package • Dell EMC diagnostic test suite • System information • CPLD versions • Factory defaults restore S4048-ON or S3048-ON diagnostic package To install the S4048-ON or S3048-ON diagnostic package on your system to...
... onie-support onie-syseeprom onie-sysinfo onie-uninstaller Topics: • S4048-ON or S3048-ON diagnostic package • Dell EMC diagnostic test suite • System information • CPLD versions • Factory defaults restore S4048-ON or S3048-ON diagnostic package To install the S4048-ON or S3048-ON diagnostic package on your system to...
EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Page 11
... back). GNU GRUB version 2.02~beta2+e4a1fe391 |ONIE: Install OS | |ONIE: Rescue | |ONIE: Uninstall OS | |ONIE: Update ONIE | |ONIE: Embed ONIE | |*DELL EMC DIAG | | | | | NOTE: The following commands to run a specific test, use the testall testlevel= command, where n = 0, 1, or 2. Level2 - For.../100/1000Base-T RJ-45 ports. tests the presences of the devices. - Dell EMC diagnostics 11 Runs all the Level tests. • testall - DCLI-> testall Dell EMC Networking OS S4048-ON BOARD DIAGNOSTIC [0] PPId PPId Revision Board Service Tag System Cpld Rev Master...
... back). GNU GRUB version 2.02~beta2+e4a1fe391 |ONIE: Install OS | |ONIE: Rescue | |ONIE: Uninstall OS | |ONIE: Update ONIE | |ONIE: Embed ONIE | |*DELL EMC DIAG | | | | | NOTE: The following commands to run a specific test, use the testall testlevel= command, where n = 0, 1, or 2. Level2 - For.../100/1000Base-T RJ-45 ports. tests the presences of the devices. - Dell EMC diagnostics 11 Runs all the Level tests. • testall - DCLI-> testall Dell EMC Networking OS S4048-ON BOARD DIAGNOSTIC [0] PPId PPId Revision Board Service Tag System Cpld Rev Master...
EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Page 14
... PASS LEVEL 2 DIAGNOSTIC CpuSnake1gMacLpbkTest PASS CpuSnake1gPhyLpbkTest PASS CpuSnakeSfpPlusMacLpbkTest PASS CpuSnakeSfpPlusPhyLpbkTest PASS MgmtPortMacLoopbackTest PASS MgmtPortPhyLoopbackTest PASS --------- System information To view your S4048-ON or S3048-ON system information; ONIE:/ # onie-syseeprom 14 Dell EMC diagnostics for example, the model, part number, serial number, and service tag, follow these steps. 1 Boot into ONIE. 2 Enter...
... PASS LEVEL 2 DIAGNOSTIC CpuSnake1gMacLpbkTest PASS CpuSnake1gPhyLpbkTest PASS CpuSnakeSfpPlusMacLpbkTest PASS CpuSnakeSfpPlusPhyLpbkTest PASS MgmtPortMacLoopbackTest PASS MgmtPortPhyLoopbackTest PASS --------- System information To view your S4048-ON or S3048-ON system information; ONIE:/ # onie-syseeprom 14 Dell EMC diagnostics for example, the model, part number, serial number, and service tag, follow these steps. 1 Boot into ONIE. 2 Enter...
EMC S3048-ON and S4048-ON Troubleshooting Guide March 2019
Page 16
...or enter e to the default ONIE settings. After ONIE Rescue completes, the system resets and boots to the ONIE console. 1 Restore the S4048-ON or S3048-ON factory defaults from Grub and select ONIE: Rescue. GNU GRUB version 2.02~beta2+e4a1fe391 | ONIE: Install OS |... | *ONIE: Rescue | | ONIE: Uninstall OS | | ONIE: Update ONIE | | ONIE: Embed ONIE | | DELL EMC DIAG | | | | | | | | | | | 2 Press ENTER to activate the console. 3 You can also use the onie-uninstaller command to return to edit ...
...or enter e to the default ONIE settings. After ONIE Rescue completes, the system resets and boots to the ONIE console. 1 Restore the S4048-ON or S3048-ON factory defaults from Grub and select ONIE: Rescue. GNU GRUB version 2.02~beta2+e4a1fe391 | ONIE: Install OS |... | *ONIE: Rescue | | ONIE: Uninstall OS | | ONIE: Update ONIE | | ONIE: Embed ONIE | | DELL EMC DIAG | | | | | | | | | | | 2 Press ENTER to activate the console. 3 You can also use the onie-uninstaller command to return to edit ...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 3
Table of contents 1 Introduction...5 1.1 Typographical conventions ...7 1.2 Attachments...7 2 Hardware overview...8 2.1 Dell EMC Networking S3048-ON ...8 2.2 Dell EMC Networking S4048-ON ...8 2.3 Dell EMC Networking Z9100-ON...8 2.4 Dell EMC PowerEdge R730xd ...8 2.5 Dell EMC PowerEdge R640 ...9 2.6 Isilon X210 ...9 3 Management...10 4 Leaf-spine overview ...11 4.1 Design considerations ...11 4.2 Oversubscription...12 4.3 Scaling ...13 4.4 Layer 3 leaf-spine topology ...14 4.5 Layer 2 leaf-...
Table of contents 1 Introduction...5 1.1 Typographical conventions ...7 1.2 Attachments...7 2 Hardware overview...8 2.1 Dell EMC Networking S3048-ON ...8 2.2 Dell EMC Networking S4048-ON ...8 2.3 Dell EMC Networking Z9100-ON...8 2.4 Dell EMC PowerEdge R730xd ...8 2.5 Dell EMC PowerEdge R640 ...9 2.6 Isilon X210 ...9 3 Management...10 4 Leaf-spine overview ...11 4.1 Design considerations ...11 4.2 Oversubscription...12 4.3 Scaling ...13 4.4 Layer 3 leaf-spine topology ...14 4.5 Layer 2 leaf-...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 6
... layer 2 leaf/spine topology. This guide will demonstrate how to utilize Dell EMC Networking, Dell EMC PowerEdge R730xd servers, and the flexibility of Dell EMC Isilon OneFS in rack 2 will utilize OS9. Z9100-ON and S4048-ON leaf pair in rack 1 will be followed up LACP for each... 1.0 However, all Isilon storage systems utilize OneFS. Note: For more information. However, Dell EMC Networking's legacy OS9 is available. The Dell EMC S4048-ON will be used as leaf switches, and the Dell EMC Z9100-ON will highlight the benefits of using the Isilon X210. The examples provided...
... layer 2 leaf/spine topology. This guide will demonstrate how to utilize Dell EMC Networking, Dell EMC PowerEdge R730xd servers, and the flexibility of Dell EMC Isilon OneFS in rack 2 will utilize OS9. Z9100-ON and S4048-ON leaf pair in rack 1 will be followed up LACP for each... 1.0 However, all Isilon storage systems utilize OneFS. Note: For more information. However, Dell EMC Networking's legacy OS9 is available. The Dell EMC S4048-ON will be used as leaf switches, and the Dell EMC Z9100-ON will highlight the benefits of using the Isilon X210. The examples provided...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 8
... management traffic in each rack. 2.2 Dell EMC Networking S3048-ON Dell EMC Networking S4048-ON The S4048-ON is a 1RU switch with SAS, SATA, and NVMe support. In this switch is deployed as two 10GbE ports. Dell EMC Networking S3048-ON The Dell EMC Networking S3048-ON is a 1RU.../50/100GbE as well as a leaf switch performing basic gateway functionality for attached Windows servers and Isilon nodes. 2.3 Dell EMC Networking S4048-ON Dell EMC Networking Z9100-ON The Dell EMC Networking Z9100-ON is a 1-Rack Unit (RU) switch with Isilon Front-End Deployment and Best Practices Guide ...
... management traffic in each rack. 2.2 Dell EMC Networking S3048-ON Dell EMC Networking S4048-ON The S4048-ON is a 1RU switch with SAS, SATA, and NVMe support. In this switch is deployed as two 10GbE ports. Dell EMC Networking S3048-ON The Dell EMC Networking S3048-ON is a 1RU.../50/100GbE as well as a leaf switch performing basic gateway functionality for attached Windows servers and Isilon nodes. 2.3 Dell EMC Networking S4048-ON Dell EMC Networking Z9100-ON The Dell EMC Networking Z9100-ON is a 1-Rack Unit (RU) switch with Isilon Front-End Deployment and Best Practices Guide ...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 20
Configure a loopback interface to be used below will be configured using jumbo frames. 20 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0 Each interface used as the router ID. In this example, each of jumbo ...frames. Isilon's OneFS supports and recommends the use of the connections from the Z9100-ON spine to the S4048-ON leaf switches needs to have the speed set to leaf switches. OS10EE Spine Set the hostname, configure the OOB management interface and default gateway...
Configure a loopback interface to be used below will be configured using jumbo frames. 20 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0 Each interface used as the router ID. In this example, each of jumbo ...frames. Isilon's OneFS supports and recommends the use of the connections from the Z9100-ON spine to the S4048-ON leaf switches needs to have the speed set to leaf switches. OS10EE Spine Set the hostname, configure the OOB management interface and default gateway...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 21
... Practices Guide | version 1.0 The command seq 10 permit 10.0.1.0/24 ge 32 includes all loopback addresses used as router IDs. 21 Dell EMC Networking with a mask greater than or equal to redistribute all loopback addresses and leaf networks via BGP. Z9100-ON Spine 1 ...interface breakout 1/1/3 map 40g-1x interface breakout 1/1/4 map 40g-1x interface ethernet1/1/1:1 description "S4048-Leaf1" no shutdown no switchport mtu 9216 ip address 192.168.1.0/31 interface ethernet1/1/2:1 description "S4048-Leaf2" no shutdown no switchport mtu 9216 ip address 192.168.1.2/31 interface ethernet1/1/3:1 ...
... Practices Guide | version 1.0 The command seq 10 permit 10.0.1.0/24 ge 32 includes all loopback addresses used as router IDs. 21 Dell EMC Networking with a mask greater than or equal to redistribute all loopback addresses and leaf networks via BGP. Z9100-ON Spine 1 ...interface breakout 1/1/3 map 40g-1x interface breakout 1/1/4 map 40g-1x interface ethernet1/1/1:1 description "S4048-Leaf1" no shutdown no switchport mtu 9216 ip address 192.168.1.0/31 interface ethernet1/1/2:1 description "S4048-Leaf2" no shutdown no switchport mtu 9216 ip address 192.168.1.2/31 interface ethernet1/1/3:1 ...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 23
... template spine-leaf remote-as 64703 no shutdown neighbor 192.168.2.7 inherit template spine-leaf remote-as 64704 no shutdown end write memory 6.2 Configuration of S4048-ON OS10EE Leaf Switches Configurations of the leaf switches one and two running OS10EE will be shown next as seen in Figure 19. 23...
... template spine-leaf remote-as 64703 no shutdown neighbor 192.168.2.7 inherit template spine-leaf remote-as 64704 no shutdown end write memory 6.2 Configuration of S4048-ON OS10EE Leaf Switches Configurations of the leaf switches one and two running OS10EE will be shown next as seen in Figure 19. 23...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 25
...recommends the use of 9216. Note: Refer to OneFS. 25 Dell EMC Networking with the no iscsi enable spanning-tree mode rstp spanning-tree rstp priority 4096 Configure the VLT interconnect between S4048-Leaf1 and S4048-Leaf2. Finally, enable VLT peer routing on specific protocols as the... Considerations for more information on each interface from layer 2 mode with Isilon Front-End Deployment and Best Practices Guide | version 1.0 S4048-Leaf 2 is done, create the VLT domain, add the backup destination, and add the interfaces participating in VLTi. Once this configuration, ...
...recommends the use of 9216. Note: Refer to OneFS. 25 Dell EMC Networking with the no iscsi enable spanning-tree mode rstp spanning-tree rstp priority 4096 Configure the VLT interconnect between S4048-Leaf1 and S4048-Leaf2. Finally, enable VLT peer routing on specific protocols as the... Considerations for more information on each interface from layer 2 mode with Isilon Front-End Deployment and Best Practices Guide | version 1.0 S4048-Leaf 2 is done, create the VLT domain, add the backup destination, and add the interfaces participating in VLTi. Once this configuration, ...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 26
... Redundancy Protocol (FHRP), when combined with Isilon Front-End Deployment and Best Practices Guide | version 1.0 Although VRRP is assigned an MTU of VRRP master. S4048-ON Leaf 1 interface vlan 100 ip address 172.16.1.252/24 no shutdown mtu 9216 vrrp-group 100 priority 150 virtual-address 172.16.1.254... Guide and Dell EMC Networking L3 Design for each Isilon subnet; There will be used in this will be one port channel for Leaf-Spine with OS10EE. The priority is given, the higher IP address will be configured. If no priority is assigned to function as the master. S4048-ON Leaf...
... Redundancy Protocol (FHRP), when combined with Isilon Front-End Deployment and Best Practices Guide | version 1.0 Although VRRP is assigned an MTU of VRRP master. S4048-ON Leaf 1 interface vlan 100 ip address 172.16.1.252/24 no shutdown mtu 9216 vrrp-group 100 priority 150 virtual-address 172.16.1.254... Guide and Dell EMC Networking L3 Design for each Isilon subnet; There will be used in this will be one port channel for Leaf-Spine with OS10EE. The priority is given, the higher IP address will be configured. If no priority is assigned to function as the master. S4048-ON Leaf...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 27
... interface port-channel102 description "Server 2" no shutdown switchport access vlan 100 mtu 9216 vlt-port-channel 102 spanning-tree port type edge S4048-ON Leaf 2 interface port-channel1 description "Isilon Node 1" no shutdown switchport access vlan 100 mtu 9216 vlt-port-channel 1 spanning-... retransmissions. Flow control commands are not required in OS10EE. 27 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0 Dell recommends asymmetrical flow control (rx on tx off) on S4048-ON leaf switches which have sufficient egress buffers to all host ...
... interface port-channel102 description "Server 2" no shutdown switchport access vlan 100 mtu 9216 vlt-port-channel 102 spanning-tree port type edge S4048-ON Leaf 2 interface port-channel1 description "Isilon Node 1" no shutdown switchport access vlan 100 mtu 9216 vlt-port-channel 1 spanning-... retransmissions. Flow control commands are not required in OS10EE. 27 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0 Dell recommends asymmetrical flow control (rx on tx off) on S4048-ON leaf switches which have sufficient egress buffers to all host ...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 28
...flowcontrol transmit off interface ethernet1/1/19 description "Server 2-1" no shutdown channel-group 102 mode active no switchport mtu 9216 flowcontrol receive on flowcontrol transmit off S4048-ON Leaf 2 interface ethernet1/1/1 description "Isilon Node 1-10gige-2" no shutdown channel-group 1 mode active no switchport mtu 9216 flowcontrol receive on flowcontrol... switchport mtu 9216 flowcontrol receive on flowcontrol transmit off The two upstream layer 3 interfaces connected to be used with BGP. 28 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0
...flowcontrol transmit off interface ethernet1/1/19 description "Server 2-1" no shutdown channel-group 102 mode active no switchport mtu 9216 flowcontrol receive on flowcontrol transmit off S4048-ON Leaf 2 interface ethernet1/1/1 description "Isilon Node 1-10gige-2" no shutdown channel-group 1 mode active no switchport mtu 9216 flowcontrol receive on flowcontrol... switchport mtu 9216 flowcontrol receive on flowcontrol transmit off The two upstream layer 3 interfaces connected to be used with BGP. 28 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 29
...as shown in the 10.0.2.0/24 address range with a mask greater than or equal to redistribute all specified uplinks become disabled. 29 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0 The command ip prefix-list spine-leaf seq 10 permit..."Spine 2" no shutdown no switchport mtu 9216 ip address 192.168.2.1/31 interface loopback0 description "Router ID" no shutdown ip address 10.0.2.1/32 S4048-ON Leaf 2 interface ethernet1/1/49 description "Spine 1" no shutdown no switchport mtu 9216 ip address 192.168.1.3/31 interface ethernet1/1/50 description "...
...as shown in the 10.0.2.0/24 address range with a mask greater than or equal to redistribute all specified uplinks become disabled. 29 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0 The command ip prefix-list spine-leaf seq 10 permit..."Spine 2" no shutdown no switchport mtu 9216 ip address 192.168.2.1/31 interface loopback0 description "Router ID" no shutdown ip address 10.0.2.1/32 S4048-ON Leaf 2 interface ethernet1/1/49 description "Spine 1" no shutdown no switchport mtu 9216 ip address 192.168.1.3/31 interface ethernet1/1/50 description "...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 30
... of parallel paths to a destination to add to one second. Finally, exit configuration mode and save the configuration. 30 Dell EMC Networking with the router bgp ASN command. BGP neighbors are set to the routing table. This is lost. Graceful ... enable downstream port-channel1 downstream port-channel3 downstream port-channel5 downstream port-channel101 downstream port-channel102 upstream ethernet1/1/49 upstream ethernet1/1/50 S4048-ON Leaf 2 uplink-state-group 1 enable downstream port-channel1 downstream port-channel3 downstream port-channel5 downstream port-channel101 downstream port...
... of parallel paths to a destination to add to one second. Finally, exit configuration mode and save the configuration. 30 Dell EMC Networking with the router bgp ASN command. BGP neighbors are set to the routing table. This is lost. Graceful ... enable downstream port-channel1 downstream port-channel3 downstream port-channel5 downstream port-channel101 downstream port-channel102 upstream ethernet1/1/49 upstream ethernet1/1/50 S4048-ON Leaf 2 uplink-state-group 1 enable downstream port-channel1 downstream port-channel3 downstream port-channel5 downstream port-channel101 downstream port...
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 31
S4048-ON Leaf 1 router bgp 64701 bestpath as-path multipath-relax graceful-restart role receiver-only maximum-paths ebgp ... spine-leaf remote-as 64601 no shutdown neighbor 192.168.2.0 inherit template spine-leaf remote-as 64602 no shutdown end write memory S4048-ON Leaf 2 router bgp 64702 bestpath as-path multipath-relax graceful-restart role receiver-only maximum-paths ebgp 2 address-family ipv4...no shutdown neighbor 192.168.2.2 inherit template spine-leaf remote-as 64602 no shutdown end write memory 31 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0
S4048-ON Leaf 1 router bgp 64701 bestpath as-path multipath-relax graceful-restart role receiver-only maximum-paths ebgp ... spine-leaf remote-as 64601 no shutdown neighbor 192.168.2.0 inherit template spine-leaf remote-as 64602 no shutdown end write memory S4048-ON Leaf 2 router bgp 64702 bestpath as-path multipath-relax graceful-restart role receiver-only maximum-paths ebgp 2 address-family ipv4...no shutdown neighbor 192.168.2.2 inherit template spine-leaf remote-as 64602 no shutdown end write memory 31 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0
EMC Networking with Isilon Front-End Deployment and Best Practices Guide
Page 32
6.3 Configuration of S4048-ON OS9 Leaf Switches Configurations in this example can be found in Figure 20. OS9 Leaf pair The ports for additional Isilon nodes and servers in this section cover leaf switches 3 and 4 running OS9 as seen in the following table: Interface enumeration Server/Isilon Node Switch Leaf interface Node 01-4 Leaf 3 tengigabitethernet 1/1/1 Leaf 4 tengigabitethernet 1/1/1 32 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0
6.3 Configuration of S4048-ON OS9 Leaf Switches Configurations in this example can be found in Figure 20. OS9 Leaf pair The ports for additional Isilon nodes and servers in this section cover leaf switches 3 and 4 running OS9 as seen in the following table: Interface enumeration Server/Isilon Node Switch Leaf interface Node 01-4 Leaf 3 tengigabitethernet 1/1/1 Leaf 4 tengigabitethernet 1/1/1 32 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0