EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 3
... contents Revisions...2 1 Introduction...5 1.1 Supported switches and operating systems ...6 1.2 Typographical conventions ...6 1.3 Attachments...6 2 Hardware overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S3048-ON...7 2.3 Dell EMC VxRail 14G nodes ...7 2.3.1 Dell EMC VxRail P Series node ...8 2.3.2 Dell EMC VxRail V Series node ...8 2.3.3 Dell EMC VxRail S Series node ...8 2.3.4 Dell EMC VxRail E Series node ...8 2.3.5 VxRail node network adapters...8 3 Topology options ...10 3.1 Dual switch ...10...
... contents Revisions...2 1 Introduction...5 1.1 Supported switches and operating systems ...6 1.2 Typographical conventions ...6 1.3 Attachments...6 2 Hardware overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S3048-ON...7 2.3 Dell EMC VxRail 14G nodes ...7 2.3.1 Dell EMC VxRail P Series node ...8 2.3.2 Dell EMC VxRail V Series node ...8 2.3.3 Dell EMC VxRail S Series node ...8 2.3.4 Dell EMC VxRail E Series node ...8 2.3.5 VxRail node network adapters...8 3 Topology options ...10 3.1 Dual switch ...10...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 4
... vlt domain_id ...40 8.2.2 show vlt domain_id backup-link...41 8.2.3 show vlt domain_id mismatch...41 9 Deploy VxRail ...42 9.1 Management network VLAN ID ...43 A Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45...
... vlt domain_id ...40 8.2.2 show vlt domain_id backup-link...41 8.2.3 show vlt domain_id mismatch...41 9 Deploy VxRail ...42 9.1 Management network VLAN ID ...43 A Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 6
... The examples provided in the left pane halfway down the page, then click the icon. 6 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 and later: 1.2 1.3 Supported Dell EMC PowerSwitches and operating systems Typographical conventions The CLI and GUI examples in this deployment guide use ... the page Italic Monospace Text Variables in CLI examples Bold Monospace Text Commands entered at the CLI prompt, or to S5248F-ON switches running Dell EMC SmartFabric OS10. To access attachments in Adobe Acrobat Reader, click the icon in this document use VxRail 4.7 nodes...
... The examples provided in the left pane halfway down the page, then click the icon. 6 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 and later: 1.2 1.3 Supported Dell EMC PowerSwitches and operating systems Typographical conventions The CLI and GUI examples in this deployment guide use ... the page Italic Monospace Text Variables in CLI examples Bold Monospace Text Commands entered at the CLI prompt, or to S5248F-ON switches running Dell EMC SmartFabric OS10. To access attachments in Adobe Acrobat Reader, click the icon in this document use VxRail 4.7 nodes...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 7
... form factor, as shown in Figure 4. Dell EMC VxRail E Series node 7 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Dell EMC PowerSwitch S5248F-ON The S5248F-ON is a 1-RU switch with 48x25GbE, 4x100GbE, and 2x200GbE ports. This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The S3048-ON...
... form factor, as shown in Figure 4. Dell EMC VxRail E Series node 7 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Dell EMC PowerSwitch S5248F-ON The S5248F-ON is a 1-RU switch with 48x25GbE, 4x100GbE, and 2x200GbE ports. This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The S3048-ON...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 10
...configuration helps ensure high availability by eliminating this single point of the two leaf switches providing redundancy at the NIC and switch levels. S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE connections 12 VxRail node n Rack 1 Dual switch ...connections to connected devices. If VLT is used, the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. A dual switch configuration may be used , the switches are connected with VLT ...
...configuration helps ensure high availability by eliminating this single point of the two leaf switches providing redundancy at the NIC and switch levels. S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE connections 12 VxRail node n Rack 1 Dual switch ...connections to connected devices. If VLT is used, the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. A dual switch configuration may be used , the switches are connected with VLT ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 11
...S5248F-Leaf1A S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in Figure 8. The links connecting the two switches are configured in the previous section. For more information about VLT, see the Dell...SmartFabric OS10 User Guide Release 10.5.0. 3.1.2 Dual switch without VLT The configuration of a switch pair without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for active/active Layer 2 multipathing. • Guarantees fast convergence if either ...
...S5248F-Leaf1A S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in Figure 8. The links connecting the two switches are configured in the previous section. For more information about VLT, see the Dell...SmartFabric OS10 User Guide Release 10.5.0. 3.1.2 Dual switch without VLT The configuration of a switch pair without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for active/active Layer 2 multipathing. • Guarantees fast convergence if either ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 12
This topology is not recommended as the switch becomes a single point of failure. 3.2 Single switch In a single switch topology, all VxRail nodes connect to a single switch. S5248F-ON 12 VxRail node 1 12 VxRail node 2 25GbE connections 12 VxRail node n Rack 1 Single switch topology 12 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
This topology is not recommended as the switch becomes a single point of failure. 3.2 Single switch In a single switch topology, all VxRail nodes connect to a single switch. S5248F-ON 12 VxRail node 1 12 VxRail node 2 25GbE connections 12 VxRail node n Rack 1 Single switch topology 12 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 13
...network. Rack 2 Rack n Leaf-spine connections VLTi connections Device connections Layer 2/Layer 3 boundary Dual switch topology with OS10 document. 13 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Note: By default, VxRail does not enable routing of ports available in each vSAN ...switches, servers, storage arrays, and other devices as VLT peers. Therefore, for Software-Defined Data Center 5.1 - Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F-Leaf1B VLTi Leaf-2A Leaf-2B VLTi Leaf-nA L3 Leaf-nB L2 VLTi VxRail node 1 VxRail node 2 VxRail node n Rack 1...
...network. Rack 2 Rack n Leaf-spine connections VLTi connections Device connections Layer 2/Layer 3 boundary Dual switch topology with OS10 document. 13 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Note: By default, VxRail does not enable routing of ports available in each vSAN ...switches, servers, storage arrays, and other devices as VLT peers. Therefore, for Software-Defined Data Center 5.1 - Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F-Leaf1B VLTi Leaf-2A Leaf-2B VLTi Leaf-nA L3 Leaf-nB L2 VLTi VxRail node 1 VxRail node 2 VxRail node n Rack 1...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 19
...guide lists supported switches and operating systems for VxRail 4.7 Run the show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON Hardware Version: A01 Platform Name : x86_64-dellemc_s5200f_c3538-r0 PPID : CN00Y2VTCES0082O0018 Service Tag : D8MCG02 License Details...a perpetual license is installed, licenses purchased from Dell EMC are provided in the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. 6 Switch configuration prerequisites 6.1 6.2 Check switch OS version S5248F-ON switches must be running SmartFabric OS10.5.0.0 or ...
...guide lists supported switches and operating systems for VxRail 4.7 Run the show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON Hardware Version: A01 Platform Name : x86_64-dellemc_s5200f_c3538-r0 PPID : CN00Y2VTCES0082O0018 Service Tag : D8MCG02 License Details...a perpetual license is installed, licenses purchased from Dell EMC are provided in the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. 6 Switch configuration prerequisites 6.1 6.2 Check switch OS version S5248F-ON switches must be running SmartFabric OS10.5.0.0 or ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 20
Dell EMC PowerSwitches running SmartFabric OS10 can also be reset to their factory default settings. Note: SmartFabric OS10 at their default configuration using DHCP. The default username and password are both admin. 6.3 Factory default configuration The configuration commands in the sections that follow begin with S5248F-ON switches at its default settings has...
Dell EMC PowerSwitches running SmartFabric OS10 can also be reset to their factory default settings. Note: SmartFabric OS10 at their default configuration using DHCP. The default username and password are both admin. 6.3 Factory default configuration The configuration commands in the sections that follow begin with S5248F-ON switches at its default settings has...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 21
... switches configured with VLT The commands in the following sections are provided in the file attachments named S5248F-1A-vlt.txt and S5248F-1B-vlt.txt. 21 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Dell EMC recommends using this guide. The port numbers used in the configuration commands correspond to complete the...
... switches configured with VLT The commands in the following sections are provided in the file attachments named S5248F-1A-vlt.txt and S5248F-1B-vlt.txt. 21 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Dell EMC recommends using this guide. The port numbers used in the configuration commands correspond to complete the...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 22
... spanning tree settings are configured per Table 2. Configure VRRP to both switches. The switch with VLT S5248F-Leaf1A configure terminal S5248F-Leaf1B configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route ...0.0.0.0/0 100.67.172.254 interface mgmt1/1/1 no ip address ip address 100.67.172.37/24 no shutdown 22 Dell...
... spanning tree settings are configured per Table 2. Configure VRRP to both switches. The switch with VLT S5248F-Leaf1A configure terminal S5248F-Leaf1B configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route ...0.0.0.0/0 100.67.172.254 interface mgmt1/1/1 no ip address ip address 100.67.172.37/24 no shutdown 22 Dell...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 23
...VM_Network_A no shutdown interface vlan1615 description VM_Network_B no shutdown interface vlan3939 description Internal_Mgmt no shutdown ipv6 mld snooping querier S5248F-Leaf1B interface vlan1612 description vMotion no shutdown interface vlan1613 description vSAN no shutdown interface vlan1614 description VM_Network_A no ...jump box also provides DNS and NTP services as STP edge ports. Configure the ports as a best practice. 23 Dell EMC SmartFabric OS10 Switch Configuration Guide for jump box or laptop computer connections. This example uses 10GbE interface 1/1/9:1 on VLANs...
...VM_Network_A no shutdown interface vlan1615 description VM_Network_B no shutdown interface vlan3939 description Internal_Mgmt no shutdown ipv6 mld snooping querier S5248F-Leaf1B interface vlan1612 description vMotion no shutdown interface vlan1613 description vSAN no shutdown interface vlan1614 description VM_Network_A no ...jump box also provides DNS and NTP services as STP edge ports. Configure the ports as a best practice. 23 Dell EMC SmartFabric OS10 Switch Configuration Guide for jump box or laptop computer connections. This example uses 10GbE interface 1/1/9:1 on VLANs...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 24
Configure interfaces - dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access ...trunk switchport access vlan 1611 switchport trunk allowed vlan 16121615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown 24 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 For more information, see VMware vSAN Network Design. Note: Flow control is enabled on ...
Configure interfaces - dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access ...trunk switchport access vlan 1611 switchport trunk allowed vlan 16121615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown 24 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 For more information, see VMware vSAN Network Design. Note: Flow control is enabled on ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 25
... VxRail 4.7 The backup destination is complete, exit configuration mode and save the configuration with VLT S5248F-Leaf1A interface ethernet1/1/53 description VLTi no switchport no shutdown S5248F-Leaf1B interface ethernet1/1/53 description VLTi no switchport no shutdown interface ethernet1/1/54 description VLTi no switchport...127 backup destination 100.67.172.38 discovery-interface ethernet1/1/531/1/54 peer-routing end write memory end write memory 25 Dell EMC SmartFabric OS10 Switch Configuration Guide for the VLTi between the two leaf switches. Remove each interface from Layer 2 ...
... VxRail 4.7 The backup destination is complete, exit configuration mode and save the configuration with VLT S5248F-Leaf1A interface ethernet1/1/53 description VLTi no switchport no shutdown S5248F-Leaf1B interface ethernet1/1/53 description VLTi no switchport no shutdown interface ethernet1/1/54 description VLTi no switchport...127 backup destination 100.67.172.38 discovery-interface ethernet1/1/531/1/54 peer-routing end write memory end write memory 25 Dell EMC SmartFabric OS10 Switch Configuration Guide for the VLTi between the two leaf switches. Remove each interface from Layer 2 ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 26
... shown. The commands in the following sections are provided in the file attachments named S5248F-1A-no-vlt.txt and S5248F-1B-no-vlt.txt. 26 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 LACP VxRail node 1 VxRail node 2 VxRail node 3 25GbE...
... shown. The commands in the following sections are provided in the file attachments named S5248F-1A-no-vlt.txt and S5248F-1B-no-vlt.txt. 26 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 LACP VxRail node 1 VxRail node 2 VxRail node 3 25GbE...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 27
... than the one used in this section, VLANs are used by the switch. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B configure terminal configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route 0.0.0.0/0... 100.67.172.254 interface mgmt1/1/1 no ip address ip address 100.67.172.37/24 no shutdown interface vlan1612 interface vlan1612 27 Dell ...
... than the one used in this section, VLANs are used by the switch. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B configure terminal configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route 0.0.0.0/0... 100.67.172.254 interface mgmt1/1/1 no ip address ip address 100.67.172.37/24 no shutdown interface vlan1612 interface vlan1612 27 Dell ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 28
...switch interfaces are used in this example, the jump box also provides DNS and NTP services as a best practice. 28 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Add these services are located on other endpoints as access (untagged) ... VM_Network_A no shutdown interface vlan1615 description VM_Network_B no shutdown interface vlan3939 description Internal_Mgmt no shutdown ipv6 mld snooping querier S5248F-Leaf1B description vMotion no shutdown interface vlan1613 description vSAN no shutdown interface vlan1614 description VM_Network_A no shutdown interface vlan1615 ...
...switch interfaces are used in this example, the jump box also provides DNS and NTP services as a best practice. 28 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Add these services are located on other endpoints as access (untagged) ... VM_Network_A no shutdown interface vlan1615 description VM_Network_B no shutdown interface vlan3939 description Internal_Mgmt no shutdown ipv6 mld snooping querier S5248F-Leaf1B description vMotion no shutdown interface vlan1613 description vSAN no shutdown interface vlan1614 description VM_Network_A no shutdown interface vlan1615 ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 29
For more information, see VMware vSAN Network Design. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-... edge flowcontrol receive on all network interfaces in ESXi by default. Configure interfaces - Note: Flow control is enabled on flowcontrol transmit off no shutdown 29 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
For more information, see VMware vSAN Network Design. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-... edge flowcontrol receive on all network interfaces in ESXi by default. Configure interfaces - Note: Flow control is enabled on flowcontrol transmit off no shutdown 29 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 30
...switch interconnect Create a port channel to use between the two leaf switches, 127 in this example. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface port-channel 127 description To_Leaf_1B switchport mode trunk switchport trunk allowed vlan 16111615,3939 no shutdown interface port-channel 127... no shutdown interface ethernet1/1/54 description To_Leaf_1A channel-group 127 mode active no shutdown end write memory end write memory 30 Dell EMC SmartFabric OS10 Switch Configuration Guide for multiple VLANs, and allow all VLANs on the port channel. Use 100GbE interfaces ...
...switch interconnect Create a port channel to use between the two leaf switches, 127 in this example. dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface port-channel 127 description To_Leaf_1B switchport mode trunk switchport trunk allowed vlan 16111615,3939 no shutdown interface port-channel 127... no shutdown interface ethernet1/1/54 description To_Leaf_1A channel-group 127 mode active no shutdown end write memory end write memory 30 Dell EMC SmartFabric OS10 Switch Configuration Guide for multiple VLANs, and allow all VLANs on the port channel. Use 100GbE interfaces ...