EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 4
... VLANs ...32 7.3.3 Configure interfaces ...33 8 Switch validation...36 8.1 General validation commands ...36 8.1.1 show interface status ...36 8.1.2 show port-channel summary ...36 8.1.3 show vlan...37 8.1.4 show ipv6 mld snooping interface ...38 8.1.5 show lldp neighbors ...39 8.1.6 show vrrp brief... Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port groups ...46 C Technical resources ...48 D Support and feedback ...49 4 Dell EMC SmartFabric OS10 Switch...
... VLANs ...32 7.3.3 Configure interfaces ...33 8 Switch validation...36 8.1 General validation commands ...36 8.1.1 show interface status ...36 8.1.2 show port-channel summary ...36 8.1.3 show vlan...37 8.1.4 show ipv6 mld snooping interface ...38 8.1.5 show lldp neighbors ...39 8.1.6 show vrrp brief... Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port groups ...46 C Technical resources ...48 D Support and feedback ...49 4 Dell EMC SmartFabric OS10 Switch...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 7
... overview This section briefly describes the hardware used to validate this guide. Dell EMC PowerSwitch S5248F-ON The S5248F-ON is a 1-RU switch with 48x25GbE, 4x100GbE, and 2x200GbE ports. VxRail P, V, and S Series nodes use a 1-RU form factor, as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The S3048-ON is a 1-Rack Unit (RU...
... overview This section briefly describes the hardware used to validate this guide. Dell EMC PowerSwitch S5248F-ON The S5248F-ON is a 1-RU switch with 48x25GbE, 4x100GbE, and 2x200GbE ports. VxRail P, V, and S Series nodes use a 1-RU form factor, as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The S3048-ON is a 1-Rack Unit (RU...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 8
... 16TB hybrid or 30TB all-flash storage. 2.3.5 VxRail node network adapters Each 14G VxRail node includes a rack server Network Daughter Card (rNDC) with 2x25GbE SFP28 ports. 8 Dell EMC SmartFabric OS10 Switch Configuration Guide for uses such as databases. V Series nodes support up to 40 CPU cores, 1024GB memory, 3 GPUs, and 24TB hybrid...
... 16TB hybrid or 30TB all-flash storage. 2.3.5 VxRail node network adapters Each 14G VxRail node includes a rack server Network Daughter Card (rNDC) with 2x25GbE SFP28 ports. 8 Dell EMC SmartFabric OS10 Switch Configuration Guide for uses such as databases. V Series nodes support up to 40 CPU cores, 1024GB memory, 3 GPUs, and 24TB hybrid...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 10
...the following benefits: • Provides a loop-free topology and eliminates STP-blocked ports • Optimizes the use of the two leaf switches providing redundancy at the NIC and switch levels. S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE ... the switch pair appear as shown in Figure 7. If VLT is used, the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. 3 Topology options VxRail may be deployed using a dual switch configuration ...
...the following benefits: • Provides a loop-free topology and eliminates STP-blocked ports • Optimizes the use of the two leaf switches providing redundancy at the NIC and switch levels. S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE ... the switch pair appear as shown in Figure 7. If VLT is used, the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. 3 Topology options VxRail may be deployed using a dual switch configuration ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 11
... S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in an LACP port channel. For more information about VLT, see the Dell EMC SmartFabric OS10 User Guide Release 10....5.0. 3.1.2 Dual switch without VLT The configuration of a switch pair without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for active/active...
... S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in an LACP port channel. For more information about VLT, see the Dell EMC SmartFabric OS10 User Guide Release 10....5.0. 3.1.2 Dual switch without VLT The configuration of a switch pair without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for active/active...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 13
... in Figure 10 scales to sixteen racks or more, depending on the number of ports available in Figure 10 and are shown in Rack 1 in each spine. 4 VxRail in the data center 4.1 Leaf-spine network Dell EMC recommends using a leaf-spine network in the data center with OS10 document. ..., the Layer 2/Layer 3 boundary is at the leafs, meaning traffic within each vSAN should be contained within a single rack. Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F-Leaf1B VLTi Leaf-2A Leaf-2B VLTi Leaf-nA L3 Leaf-nB L2 VLTi VxRail node 1 VxRail node 2 VxRail node n Rack 1 Additional VxRail ...
... in Figure 10 scales to sixteen racks or more, depending on the number of ports available in Figure 10 and are shown in Rack 1 in each spine. 4 VxRail in the data center 4.1 Leaf-spine network Dell EMC recommends using a leaf-spine network in the data center with OS10 document. ..., the Layer 2/Layer 3 boundary is at the leafs, meaning traffic within each vSAN should be contained within a single rack. Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F-Leaf1B VLTi Leaf-2A Leaf-2B VLTi Leaf-nA L3 Leaf-nB L2 VLTi VxRail node 1 VxRail node 2 VxRail node n Rack 1 Additional VxRail ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 14
... network core. This includes VxRail node iDRACs, PowerEdge Server iDRACs, and dedicated management ports on the devices in each S3048-ON are for use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for remote management of servers, switches, and storage... devices using their VLANs are available on each S3048-ON for illustration purposes only. 1GbE BASE-T ports on each rack as VLT peers. Four ...
... network core. This includes VxRail node iDRACs, PowerEdge Server iDRACs, and dedicated management ports on the devices in each S3048-ON are for use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for remote management of servers, switches, and storage... devices using their VLANs are available on each S3048-ON for illustration purposes only. 1GbE BASE-T ports on each rack as VLT peers. Four ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 15
...used exclusively for VxRail node discovery using IPv6 multicast. This example uses two networks for this VLAN for node discovery to succeed. 15 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 VLAN IDs and IP addresses VLAN ID Description Network 1611 External Management 172.16.11....15.0/24 3939 Internal Management IPv6 multicast Gateway 172.16.11.254 NA NA Optional, not used Optional, not used not used VLAN ports Untagged Tagged Tagged Tagged Tagged Tagged Note: By default, VxRail does not enable routing of VM data networks used is based on customer requirements...
...used exclusively for VxRail node discovery using IPv6 multicast. This example uses two networks for this VLAN for node discovery to succeed. 15 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 VLAN IDs and IP addresses VLAN ID Description Network 1611 External Management 172.16.11....15.0/24 3939 Internal Management IPv6 multicast Gateway 172.16.11.254 NA NA Optional, not used Optional, not used not used VLAN ports Untagged Tagged Tagged Tagged Tagged Tagged Note: By default, VxRail does not enable routing of VM data networks used is based on customer requirements...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 16
... each ESXi™ host using DCUI, and set an alternate IP address Time zone NTP server(s) DNS server(s) IP address and port Username and password ESXi hostname prefix Separator Iterator Offset Suffix Domain ESXi starting with Release 4.0.100. If you deploy VxRail. If you...host starting address for IP pool ESXi ending address for this deployment example are based on the VxRail network configuration table, see the Dell EMC VxRail Network Planning Guide. 5.2 VxRail network configuration table Information provided in the right column. VxRail Manager and VxRail vCenter Server ...
... each ESXi™ host using DCUI, and set an alternate IP address Time zone NTP server(s) DNS server(s) IP address and port Username and password ESXi hostname prefix Separator Iterator Offset Suffix Domain ESXi starting with Release 4.0.100. If you deploy VxRail. If you...host starting address for IP pool ESXi ending address for this deployment example are based on the VxRail network configuration table, see the Dell EMC VxRail Network Planning Guide. 5.2 VxRail network configuration table Information provided in the right column. VxRail Manager and VxRail vCenter Server ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 20
Note: SmartFabric OS10 at their default configuration using DHCP. The switch reboots to its IP address using the serial console port as follows: OS10# delete startup-configuration Proceed to delete startup-configuration [confirm yes/no(default)]:y OS10# reload System ... first login. 20 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Dell EMC PowerSwitches running SmartFabric OS10 can also be reset to their factory default settings. 6.3 Factory default configuration The configuration commands in the sections that follow begin with S5248F-ON switches at its...
Note: SmartFabric OS10 at their default configuration using DHCP. The switch reboots to its IP address using the serial console port as follows: OS10# delete startup-configuration Proceed to delete startup-configuration [confirm yes/no(default)]:y OS10# reload System ... first login. 20 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Dell EMC PowerSwitches running SmartFabric OS10 can also be reset to their factory default settings. 6.3 Factory default configuration The configuration commands in the sections that follow begin with S5248F-ON switches at its...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 21
... different topologies. Dual switch with VLT, as attachments to this topology. S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 VLTi VxRail node 1 VxRail node 2 VxRail node 3 25GbE connections 100GbE VLTi connections, ports 1/1/53-54 Note: The jump box/DNS server, not shown, is... connected to those shown in the file attachments named S5248F-1A-vlt.txt and S5248F-1B-vlt.txt. 21 Dell EMC SmartFabric OS10 Switch Configuration Guide for all examples are...
... different topologies. Dual switch with VLT, as attachments to this topology. S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 VLTi VxRail node 1 VxRail node 2 VxRail node 3 25GbE connections 100GbE VLTi connections, ports 1/1/53-54 Note: The jump box/DNS server, not shown, is... connected to those shown in the file attachments named S5248F-1A-vlt.txt and S5248F-1B-vlt.txt. 21 Dell EMC SmartFabric OS10 Switch Configuration Guide for all examples are...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 23
...interfaces as a best practice. 23 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Use the switchport mode trunk command to enable ports to the VxRail nodes. Configure the interfaces for connections to carry traffic for multiple VLANs. S5248F-Leaf1A interface vlan1612 description vMotion no ... computer connections to 10GbE for jump box or laptop computer connections. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to be used for redundancy. This example uses 10GbE interface 1/1/9:1 on VLAN 1611 (the External Management VLAN)....
...interfaces as a best practice. 23 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Use the switchport mode trunk command to enable ports to the VxRail nodes. Configure the interfaces for connections to carry traffic for multiple VLANs. S5248F-Leaf1A interface vlan1612 description vMotion no ... computer connections to 10GbE for jump box or laptop computer connections. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to be used for redundancy. This example uses 10GbE interface 1/1/9:1 on VLAN 1611 (the External Management VLAN)....
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 24
Note: Flow control is enabled on flowcontrol transmit off no shutdown 24 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Configure interfaces - dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning...
Note: Flow control is enabled on flowcontrol transmit off no shutdown 24 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Configure interfaces - dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 26
...S5248F-1B-no-vlt.txt. 26 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 All commands are provided in the following sections are run to complete the configuration of both switches. VxRail node 4 Rack 1 Four-node cluster connected to a switch pair without VLT, as shown in Figure 13. The port... a switch pair without VLT In this topology, an LACP port channel is connected to port 1/1/9 on each switch. Note: The commands in the tables below should be entered in Figure 13. S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 LACP VxRail node 1 VxRail ...
...S5248F-1B-no-vlt.txt. 26 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 All commands are provided in the following sections are run to complete the configuration of both switches. VxRail node 4 Rack 1 Four-node cluster connected to a switch pair without VLT, as shown in Figure 13. The port... a switch pair without VLT In this topology, an LACP port channel is connected to port 1/1/9 on each switch. Note: The commands in the tables below should be entered in Figure 13. S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 LACP VxRail node 1 VxRail ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 28
... mode trunk command to enable ports to "receive on" and "transmit off" on other endpoints as a best practice. 28 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Add these services are located on node-connected ports as STP edge ports. Note: In this example,...for jump box or laptop computer connections. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to the VxRail nodes. S5248F-Leaf1A description vMotion no shutdown interface vlan1613 description vSAN no shutdown interface vlan1614 description VM_Network_A no shutdown ...
... mode trunk command to enable ports to "receive on" and "transmit off" on other endpoints as a best practice. 28 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Add these services are located on node-connected ports as STP edge ports. Note: In this example,...for jump box or laptop computer connections. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to the VxRail nodes. S5248F-Leaf1A description vMotion no shutdown interface vlan1613 description vSAN no shutdown interface vlan1614 description VM_Network_A no shutdown ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 29
...S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port...16121615,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...16121615,3939 spanning-tree port type edge flowcontrol ...3939 spanning-tree port type edge flowcontrol receive...
...S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port...16121615,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...,3939 spanning-tree port type edge flowcontrol ...16121615,3939 spanning-tree port type edge flowcontrol ...3939 spanning-tree port type edge flowcontrol receive...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 30
... 127 mode active command. 7.2.4 Configure the switch interconnect Create a port channel to use between the two leaf switches, 127 in this example. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface port-channel 127 description To_Leaf_1B switchport mode trunk switchport trunk allowed vlan 16111615...no shutdown end write memory end write memory 30 Dell EMC SmartFabric OS10 Switch Configuration Guide for multiple VLANs, and allow all VLANs on the port channel. Use the switchport mode trunk command to enable the port channel to carry traffic for VxRail 4.7 Configure ...
... 127 mode active command. 7.2.4 Configure the switch interconnect Create a port channel to use between the two leaf switches, 127 in this example. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface port-channel 127 description To_Leaf_1B switchport mode trunk switchport trunk allowed vlan 16111615...no shutdown end write memory end write memory 30 Dell EMC SmartFabric OS10 Switch Configuration Guide for multiple VLANs, and allow all VLANs on the port channel. Use the switchport mode trunk command to enable the port channel to carry traffic for VxRail 4.7 Configure ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 31
...to complete the switch configuration. Specify an NTP server accessible by default, and RPVST+ VLAN priority numbers start at 32769. The port numbers used in the file attachment named S5248F-single-switch.txt. 7.3.1 General settings Configure the hostname, OOB management IP address, and default gateway. In this example, this... for VxRail 4.7 7.3 Single switch This example uses a four-node VxRail cluster connected to a single switch, as shown in the order shown. Dell EMC recommends leaving it enabled. 31 Dell EMC SmartFabric OS10 Switch Configuration Guide for your environment.
...to complete the switch configuration. Specify an NTP server accessible by default, and RPVST+ VLAN priority numbers start at 32769. The port numbers used in the file attachment named S5248F-single-switch.txt. 7.3.1 General settings Configure the hostname, OOB management IP address, and default gateway. In this example, this... for VxRail 4.7 7.3 Single switch This example uses a four-node VxRail cluster connected to a single switch, as shown in the order shown. Dell EMC recommends leaving it enabled. 31 Dell EMC SmartFabric OS10 Switch Configuration Guide for your environment.
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 33
... on" and "transmit off" on node-connected ports as trunk (tagged) ports on VLAN 1611 (the External Management VLAN). Configure the ports as a best practice. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to 10GbE for connections to be...tree port type edge no shutdown interface ethernet1/1/10:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/17 description Node1_Port1 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 33 Dell EMC...
... on" and "transmit off" on node-connected ports as trunk (tagged) ports on VLAN 1611 (the External Management VLAN). Configure the ports as a best practice. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to 10GbE for connections to be...tree port type edge no shutdown interface ethernet1/1/10:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/17 description Node1_Port1 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 33 Dell EMC...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 35
S5248F-ON interface ethernet1/1/23 description Node4_Port1 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown interface ethernet1/1/24 description Node4_Port2 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown end write memory 35 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
S5248F-ON interface ethernet1/1/23 description Node4_Port1 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown interface ethernet1/1/24 description Node4_Port2 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown end write memory 35 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7