EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 1
August 2019 Dell EMC Configuration and Deployment Guide Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Deploying S5200F-ON series switches for a VxRail 4.7 cluster Abstract This document provides Dell EMC SmartFabric OS10 switch configuration examples and topology options for a VxRail 4.7 cluster deployment using S5200F-ON series switches.
August 2019 Dell EMC Configuration and Deployment Guide Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Deploying S5200F-ON series switches for a VxRail 4.7 cluster Abstract This document provides Dell EMC SmartFabric OS10 switch configuration examples and topology options for a VxRail 4.7 cluster deployment using S5200F-ON series switches.
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 2
.... or its subsidiaries. Use, copying, and distribution of any kind with respect to change without notice. 2 Dell EMC SmartFabric OS10 Switch Configuration Guide for a particular purpose. Other trademarks may be trademarks of Dell Inc. Dell Inc. Revisions Date August 2019 Description Initial release The information in this publication, and specifically disclaims implied warranties of...
.... or its subsidiaries. Use, copying, and distribution of any kind with respect to change without notice. 2 Dell EMC SmartFabric OS10 Switch Configuration Guide for a particular purpose. Other trademarks may be trademarks of Dell Inc. Dell Inc. Revisions Date August 2019 Description Initial release The information in this publication, and specifically disclaims implied warranties of...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 3
......6 2 Hardware overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S3048-ON...7 2.3 Dell EMC VxRail 14G nodes ...7 2.3.1 Dell EMC VxRail P Series node ...8 2.3.2 Dell EMC VxRail V Series node ...8 2.3.3 Dell EMC VxRail S Series node ...8 2.3.4 Dell EMC VxRail E Series node ...8 2.3.5 VxRail node network adapters...8 3 Topology options ...10 3.1 Dual switch ...10 3.1.1 Dual switch with VLT ...10 3.1.2 Dual switch without VLT ...11 3.2 Single switch...12 4 VxRail in...
......6 2 Hardware overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S3048-ON...7 2.3 Dell EMC VxRail 14G nodes ...7 2.3.1 Dell EMC VxRail P Series node ...8 2.3.2 Dell EMC VxRail V Series node ...8 2.3.3 Dell EMC VxRail S Series node ...8 2.3.4 Dell EMC VxRail E Series node ...8 2.3.5 VxRail node network adapters...8 3 Topology options ...10 3.1 Dual switch ...10 3.1.1 Dual switch with VLT ...10 3.1.2 Dual switch without VLT ...11 3.2 Single switch...12 4 VxRail in...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 4
... settings...27 7.2.2 Configure VLANs ...27 7.2.3 Configure interfaces ...28 7.2.4 Configure the switch interconnect ...30 7.3 Single switch...31 7.3.1 General settings...31 7.3.2 Configure VLANs ...32 7.3.3 Configure interfaces ...33 8 Switch validation...36 8.1 General validation commands ...36 8.1.1 show interface status ...36 8.1.2 show......41 9 Deploy VxRail ...42 9.1 Management network VLAN ID ...43 A Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port...
... settings...27 7.2.2 Configure VLANs ...27 7.2.3 Configure interfaces ...28 7.2.4 Configure the switch interconnect ...30 7.3 Single switch...31 7.3.1 General settings...31 7.3.2 Configure VLANs ...32 7.3.3 Configure interfaces ...33 8 Switch validation...36 8.1 General validation commands ...36 8.1.1 show interface status ...36 8.1.2 show......41 9 Deploy VxRail ...42 9.1 Management network VLAN ID ...43 A Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 5
...(minimum of three and maximum of quality, consistency, and support. The inclusion of dedicated switches for the deployment of a VxRail cluster when a pair of dedicated Dell EMC PowerSwitches is purchased with the deployment of a hyperconverged solution. This document covers the ...as the preferred topology • A pair of Dell PowerSwitches not configured for VLT • A single Dell PowerSwitch This document provides switch topology options and configuration examples for the emerging cloud-native world. Dell EMC provides further customer enablement through validated deployment guides ...
...(minimum of three and maximum of quality, consistency, and support. The inclusion of dedicated switches for the deployment of a VxRail cluster when a pair of dedicated Dell EMC PowerSwitches is purchased with the deployment of a hyperconverged solution. This document covers the ...as the preferred topology • A pair of Dell PowerSwitches not configured for VLT • A single Dell PowerSwitch This document provides switch topology options and configuration examples for the emerging cloud-native world. Dell EMC provides further customer enablement through validated deployment guides ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 6
... the icon in the left pane halfway down the page, then click the icon. 6 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 and later: 1.2 1.3 Supported Dell EMC PowerSwitches and operating systems Typographical conventions The CLI and GUI examples in this deployment guide ...Text Variables in CLI examples Bold Monospace Text Commands entered at the CLI prompt, or to S5248F-ON switches running Dell EMC SmartFabric OS10. 1.1 Supported switches and operating systems The examples provided in this document use VxRail 4.7 nodes connected to highlight information in CLI...
... the icon in the left pane halfway down the page, then click the icon. 6 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 and later: 1.2 1.3 Supported Dell EMC PowerSwitches and operating systems Typographical conventions The CLI and GUI examples in this deployment guide ...Text Variables in CLI examples Bold Monospace Text Commands entered at the CLI prompt, or to S5248F-ON switches running Dell EMC SmartFabric OS10. 1.1 Supported switches and operating systems The examples provided in this document use VxRail 4.7 nodes connected to highlight information in CLI...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 7
... in Figure 4. This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The S3048-ON is a 1-Rack Unit (RU), multilayer switch with 48x1GbE BASE-T ports and 4x10GbE SFP+ ports. Dell EMC VxRail E Series node 7 Dell EMC SmartFabric OS10 Switch Configuration Guide for out-of hardware and software validated for this...
... in Figure 4. This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The S3048-ON is a 1-Rack Unit (RU), multilayer switch with 48x1GbE BASE-T ports and 4x10GbE SFP+ ports. Dell EMC VxRail E Series node 7 Dell EMC SmartFabric OS10 Switch Configuration Guide for out-of hardware and software validated for this...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 8
... suited for remote office or entry workloads. S Series nodes support up to 40 CPU cores, 1536GB memory, and 16TB hybrid or 30TB all -flash storage. 2.3.3 Dell EMC VxRail S Series node VxRail S Series nodes provide expanded storage capacity for collaboration, data, and analytics. Note: The deployment examples in this guide contains a Broadcom... hybrid or 46TB all -flash storage. 2.3.5 VxRail node network adapters Each 14G VxRail node includes a rack server Network Daughter Card (rNDC) with 2x25GbE SFP28 ports. 8 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
... suited for remote office or entry workloads. S Series nodes support up to 40 CPU cores, 1536GB memory, and 16TB hybrid or 30TB all -flash storage. 2.3.3 Dell EMC VxRail S Series node VxRail S Series nodes provide expanded storage capacity for collaboration, data, and analytics. Note: The deployment examples in this guide contains a Broadcom... hybrid or 46TB all -flash storage. 2.3.5 VxRail node network adapters Each 14G VxRail node includes a rack server Network Daughter Card (rNDC) with 2x25GbE SFP28 ports. 8 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 9
P, V, S, and E Series VxRail nodes also include a 1GbE BASE-T integrated Dell Remote Access Card (iDRAC) for different traffic types. See the Dell EMC VxRail Network Planning Guide for more information. 9 Dell EMC SmartFabric OS10 Switch Configuration Guide for more information. See the Dell EMC VxRail Network Planning Guide for VxRail 4.7 Note: P, V, and S Series nodes support additional network adapters in PCIe slots. VxRail optimizes network traffic by splitting it across rNDC uplinks and by using Network I/O control (NIOC) shares for OOB management.
P, V, S, and E Series VxRail nodes also include a 1GbE BASE-T integrated Dell Remote Access Card (iDRAC) for different traffic types. See the Dell EMC VxRail Network Planning Guide for more information. 9 Dell EMC SmartFabric OS10 Switch Configuration Guide for more information. See the Dell EMC VxRail Network Planning Guide for VxRail 4.7 Note: P, V, and S Series nodes support additional network adapters in PCIe slots. VxRail optimizes network traffic by splitting it across rNDC uplinks and by using Network I/O control (NIOC) shares for OOB management.
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 10
... VxRail node 2 100GbE VLTi connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology with VLT. A dual switch configuration may be used , the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. VLT provides the following benefits: • Provides a loop-free topology and eliminates...
... VxRail node 2 100GbE VLTi connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology with VLT. A dual switch configuration may be used , the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. VLT provides the following benefits: • Provides a loop-free topology and eliminates...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 11
... node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in Figure 8. The switch pair is supported, but it does not provide the advantages of a switch pair without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for active/active Layer 2 multipathing. For more information about...
... node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in Figure 8. The switch pair is supported, but it does not provide the advantages of a switch pair without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for active/active Layer 2 multipathing. For more information about...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 12
3.2 Single switch In a single switch topology, all VxRail nodes connect to a single switch. This topology is not recommended as the switch becomes a single point of failure. S5248F-ON 12 VxRail node 1 12 VxRail node 2 25GbE connections 12 VxRail node n Rack 1 Single switch topology 12 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
3.2 Single switch In a single switch topology, all VxRail nodes connect to a single switch. This topology is not recommended as the switch becomes a single point of failure. S5248F-ON 12 VxRail node 1 12 VxRail node 2 25GbE connections 12 VxRail node n Rack 1 Single switch topology 12 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 13
...routing of ports available in each rack is switched (Layer 2) and traffic between leafs and spines, and routing protocols, see the Dell EMC Networking Layer 3 Leaf-Spine Deployment and Best Practices with OS10 document. 13 Dell EMC SmartFabric OS10 Switch Configuration Guide for Software-Defined Data Center 5.1... other devices as VLT peers. 4 VxRail in the data center 4.1 Leaf-spine network Dell EMC recommends using a leaf-spine network in the data center with leaf switches configured as needed. The switches and VxRail nodes covered in Figure 10 scales to its own Layer 2 VLAN. The...
...routing of ports available in each rack is switched (Layer 2) and traffic between leafs and spines, and routing protocols, see the Dell EMC Networking Layer 3 Leaf-Spine Deployment and Best Practices with OS10 document. 13 Dell EMC SmartFabric OS10 Switch Configuration Guide for Software-Defined Data Center 5.1... other devices as VLT peers. 4 VxRail in the data center 4.1 Leaf-spine network Dell EMC recommends using a leaf-spine network in the data center with leaf switches configured as needed. The switches and VxRail nodes covered in Figure 10 scales to its own Layer 2 VLAN. The...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 14
...Dell EMC SmartFabric OS10 Switch Configuration Guide for use as uplinks to be confused with the External and Internal Management networks. Devices on each rack as shown: OOB Management Network Rack 1 S3048-ON Rack 2 S3048-ON Rack 3 S3048-ON Rack n S3048-ON Leaf Switch 1A Leaf Switch 2A Leaf Switch 1B Leaf Switch... in other racks are for illustration purposes only. 1GbE BASE-T ports on each S3048-ON are available on each S3048-ON for VxRail 4.7 For OOB Management network connections, one S3048-ON switch is not to the OOB management network core. Devices shown in Chapter 5. Four...
...Dell EMC SmartFabric OS10 Switch Configuration Guide for use as uplinks to be confused with the External and Internal Management networks. Devices on each rack as shown: OOB Management Network Rack 1 S3048-ON Rack 2 S3048-ON Rack 3 S3048-ON Rack n S3048-ON Leaf Switch 1A Leaf Switch 2A Leaf Switch 1B Leaf Switch... in other racks are for illustration purposes only. 1GbE BASE-T ports on each S3048-ON are available on each S3048-ON for VxRail 4.7 For OOB Management network connections, one S3048-ON switch is not to the OOB management network core. Devices shown in Chapter 5. Four...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 15
... on this deployment are shown in Chapter 3. VLAN configuration and IP network addresses planned for this VLAN for node discovery to succeed. 15 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 VLAN IDs and IP addresses VLAN ID Description Network 1611 External Management 172.16.11.0/24 1612 vMotion 172.16... used is based on a separate VLAN. 5 Configuration planning 5.1 VLANs and IP addresses VLANs and IP addresses used for VxRail node traffic must be planned before switch configuration and VxRail deployment can begin.
... on this deployment are shown in Chapter 3. VLAN configuration and IP network addresses planned for this VLAN for node discovery to succeed. 15 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 VLAN IDs and IP addresses VLAN ID Description Network 1611 External Management 172.16.11.0/24 1612 vMotion 172.16... used is based on a separate VLAN. 5 Configuration planning 5.1 VLANs and IP addresses VLANs and IP addresses used for VxRail node traffic must be planned before switch configuration and VxRail deployment can begin.
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 16
....101 vxman 172.16.11.102 255.255.255.0 172.16.11.254 root_password administrator_password 172.16.12.1 16 Dell EMC SmartFabric OS10 Switch Configuration Guide for IP pool Values used are shown in the VxRail network configuration table is untagged traffic on the ...VxRail network configuration table, see the Dell EMC VxRail Network Planning Guide. If you deploy VxRail. 5.2 VxRail network configuration table Information provided...
....101 vxman 172.16.11.102 255.255.255.0 172.16.11.254 root_password administrator_password 172.16.12.1 16 Dell EMC SmartFabric OS10 Switch Configuration Guide for IP pool Values used are shown in the VxRail network configuration table is untagged traffic on the ...VxRail network configuration table, see the Dell EMC VxRail Network Planning Guide. If you deploy VxRail. 5.2 VxRail network configuration table Information provided...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 17
...four VxRail nodes. The DNS server must be able to reach a correctly configured DNS server from the External Management VLAN during switch configuration. Note: A PowerEdge server is configured on the DNS server using the hostnames and IP addresses in this connection. ... leaf switch for remote access. Table 4 summaries the DNS entries for VxRail 4.7 Values used Hostname IP Address vxhost01.dell.local 172.16.11.1 vxhost02.dell.local 172.16.11.2 vxhost03.dell.local 172.16.11.3 vxhost04.dell.local 172.16.11.4 17 Dell EMC SmartFabric OS10 Switch Configuration Guide...
...four VxRail nodes. The DNS server must be able to reach a correctly configured DNS server from the External Management VLAN during switch configuration. Note: A PowerEdge server is configured on the DNS server using the hostnames and IP addresses in this connection. ... leaf switch for remote access. Table 4 summaries the DNS entries for VxRail 4.7 Values used Hostname IP Address vxhost01.dell.local 172.16.11.1 vxhost02.dell.local 172.16.11.2 vxhost03.dell.local 172.16.11.3 vxhost04.dell.local 172.16.11.4 17 Dell EMC SmartFabric OS10 Switch Configuration Guide...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 18
Hostname vxvcenter.dell.local vxpsc.dell.local vxman.dell.local vxinsight.dell.local IP Address 172.16.11.100 172.16.11.101 172.16.11.102 172.16.11.103 An NTP server is not required ... and NTP services for VxRail 4.7 If an NTP server is not provided, VxRail uses the time that is recommended. It is connected to both leaf switches for redundancy using Microsoft Windows NIC teaming (switch-independent load balancing). 18 Dell EMC SmartFabric OS10 Switch Configuration Guide for the VxRail cluster.
Hostname vxvcenter.dell.local vxpsc.dell.local vxman.dell.local vxinsight.dell.local IP Address 172.16.11.100 172.16.11.101 172.16.11.102 172.16.11.103 An NTP server is not required ... and NTP services for VxRail 4.7 If an NTP server is not provided, VxRail uses the time that is recommended. It is connected to both leaf switches for redundancy using Microsoft Windows NIC teaming (switch-independent load balancing). 18 Dell EMC SmartFabric OS10 Switch Configuration Guide for the VxRail cluster.
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 19
...Version: 10.5.0.0 Build Version: 10.5.0.0.326 Note: Figure 1 at the beginning of this guide lists supported switches and operating systems for download on Dell Digital Locker. OS10# show version S5248F-ON# show license status to verify license installation. The License Type:...Verify license installation Run the command show version Dell EMC Networking OS10-Enterprise Copyright (c) 1999-2019 by Dell Inc. 6 Switch configuration prerequisites 6.1 6.2 Check switch OS version S5248F-ON switches must be running SmartFabric OS10.5.0.0 or later. Dell EMC recommends upgrading to check the OS ...
...Version: 10.5.0.0 Build Version: 10.5.0.0.326 Note: Figure 1 at the beginning of this guide lists supported switches and operating systems for download on Dell Digital Locker. OS10# show version S5248F-ON# show license status to verify license installation. The License Type:...Verify license installation Run the command show version Dell EMC Networking OS10-Enterprise Copyright (c) 1999-2019 by Dell Inc. 6 Switch configuration prerequisites 6.1 6.2 Check switch OS version S5248F-ON switches must be running SmartFabric OS10.5.0.0 or later. Dell EMC recommends upgrading to check the OS ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 20
...username and password are both admin. Note: SmartFabric OS10 at their default configuration using DHCP. Dell EMC recommends changing the admin password to the switch. Dell EMC PowerSwitches running SmartFabric OS10 can also be reset to its IP address using the serial console... command immediately ends the remote access session to a complex password during the first login. 20 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 The switch reboots to their factory default settings. 6.3 Factory default configuration The configuration commands in the sections ...
...username and password are both admin. Note: SmartFabric OS10 at their default configuration using DHCP. Dell EMC recommends changing the admin password to the switch. Dell EMC PowerSwitches running SmartFabric OS10 can also be reset to its IP address using the serial console... command immediately ends the remote access session to a complex password during the first login. 20 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 The switch reboots to their factory default settings. 6.3 Factory default configuration The configuration commands in the sections ...