EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 3
... ...15 5.2 VxRail network configuration table ...16 5.3 Using a jump box or laptop computer...17 5.4 DNS and NTP servers ...17 6 Switch configuration prerequisites...19 6.1 Check switch OS version...19 6.2 Verify license installation ...19 6.3 Factory default configuration ...20 7 Configure switches ...21 7.1 Dual switch with VLT ...21 7.1.1 General settings...22 7.1.2 Configure VLANs ...22 3 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
... ...15 5.2 VxRail network configuration table ...16 5.3 Using a jump box or laptop computer...17 5.4 DNS and NTP servers ...17 6 Switch configuration prerequisites...19 6.1 Check switch OS version...19 6.2 Verify license installation ...19 6.3 Factory default configuration ...20 7 Configure switches ...21 7.1 Dual switch with VLT ...21 7.1.1 General settings...22 7.1.2 Configure VLANs ...22 3 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 4
... 8.2.3 show vlt domain_id mismatch...41 9 Deploy VxRail ...42 9.1 Management network VLAN ID ...43 A Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port groups ...46 C Technical resources ...48 D Support and feedback ...49 4 Dell EMC SmartFabric OS10 Switch Configuration Guide for...
... 8.2.3 show vlt domain_id mismatch...41 9 Deploy VxRail ...42 9.1 Management network VLAN ID ...43 A Validated components for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port groups ...46 C Technical resources ...48 D Support and feedback ...49 4 Dell EMC SmartFabric OS10 Switch Configuration Guide for...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 5
... of three and maximum of 64 nodes) connect to : • A pair of Dell PowerSwitches configured for Virtual Link Trunking (VLT), using VLT as the preferred topology • A pair of Dell PowerSwitches not configured for VLT • A single Dell PowerSwitch This document provides switch topology options and configuration examples for a VxRail 4.7 cluster using nodes built on 14th generation (14G) PowerEdge...
... of three and maximum of 64 nodes) connect to : • A pair of Dell PowerSwitches configured for Virtual Link Trunking (VLT), using VLT as the preferred topology • A pair of Dell PowerSwitches not configured for VLT • A single Dell PowerSwitch This document provides switch topology options and configuration examples for a VxRail 4.7 cluster using nodes built on 14th generation (14G) PowerEdge...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 10
... point of failure. A dual switch configuration may be used , the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. A dual switch configuration helps ensure high availability by eliminating this...switch topology, each VxRail node has one logical unit to each of all available uplink bandwidth 10 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE connections 12 VxRail...
... point of failure. A dual switch configuration may be used , the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a single or dual switch topology. A dual switch configuration helps ensure high availability by eliminating this...switch topology, each VxRail node has one logical unit to each of all available uplink bandwidth 10 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE connections 12 VxRail...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 11
.... S5248F-Leaf1A S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in Figure 8. For more information about VLT, see the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. 3.1.2 Dual switch without VLT The configuration of a switch pair without VLT 11 Dell...
.... S5248F-Leaf1A S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT is cabled, as shown in Figure 8. For more information about VLT, see the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. 3.1.2 Dual switch without VLT The configuration of a switch pair without VLT 11 Dell...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 13
4 VxRail in the data center 4.1 Leaf-spine network Dell EMC recommends using a leaf-spine network in the data center with leaf switches configured as needed. Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F-Leaf1B VLTi Leaf-2A Leaf-2B VLTi Leaf-nA L3 Leaf-nB L2 VLTi VxRail node 1 VxRail node...between racks is also contained within a single rack. Racks may contain additional VxRail clusters, switches, servers, storage arrays, and other devices as VLT peers. Architecture and Design recommends isolating vSAN traffic to a leaf-spine network In Figure 10, the Layer 2/Layer 3 boundary is at ...
4 VxRail in the data center 4.1 Leaf-spine network Dell EMC recommends using a leaf-spine network in the data center with leaf switches configured as needed. Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F-Leaf1B VLTi Leaf-2A Leaf-2B VLTi Leaf-nA L3 Leaf-nB L2 VLTi VxRail node 1 VxRail node...between racks is also contained within a single rack. Racks may contain additional VxRail clusters, switches, servers, storage arrays, and other devices as VLT peers. Architecture and Design recommends isolating vSAN traffic to a leaf-spine network In Figure 10, the Layer 2/Layer 3 boundary is at ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 14
... PowerEdge Server Storage Array Note: This guide focuses on each S3048-ON for use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Four 10GbE SFP+ ports are available on the devices in Rack 1. Devices shown in other racks are for...-ON are connected downstream to hardware management ports on switches and storage arrays. Devices on the OOB Management network in this guide use as VLT peers. 4.2 OOB Management network The Out-of-band (OOB) Management network is an isolated network for remote management of servers, switches, ...
... PowerEdge Server Storage Array Note: This guide focuses on each S3048-ON for use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Four 10GbE SFP+ ports are available on the devices in Rack 1. Devices shown in other racks are for...-ON are connected downstream to hardware management ports on switches and storage arrays. Devices on the OOB Management network in this guide use as VLT peers. 4.2 OOB Management network The Out-of-band (OOB) Management network is an isolated network for remote management of servers, switches, ...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 21
... VxRail 4.7 Dual switch with VLT, as attachments to this topology. Note: The commands in the tables below should be entered in the different topologies. Commands for all examples are provided in the file attachments named S5248F-1A-vlt.txt and S5248F-1B-vlt.txt. 21 Dell EMC SmartFabric OS10 Switch Configuration Guide for S5248F-ON switches in the...
... VxRail 4.7 Dual switch with VLT, as attachments to this topology. Note: The commands in the tables below should be entered in the different topologies. Commands for all examples are provided in the file attachments named S5248F-1A-vlt.txt and S5248F-1B-vlt.txt. 21 Dell EMC SmartFabric OS10 Switch Configuration Guide for S5248F-ON switches in the...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 22
...priority numbers start at 32769. The example shows an NTP server on the OOB management network with VLT S5248F-Leaf1A configure terminal S5248F-Leaf1B configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route...address 100.67.172.37/24 no shutdown 22 Dell EMC SmartFabric OS10 Switch Configuration Guide for node discovery. LLDP is useful for your environment. Assign the same virtual address to provide gateway redundancy. Configure VLANs - dual switch with a different IP address...
...priority numbers start at 32769. The example shows an NTP server on the OOB management network with VLT S5248F-Leaf1A configure terminal S5248F-Leaf1B configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route...address 100.67.172.37/24 no shutdown 22 Dell EMC SmartFabric OS10 Switch Configuration Guide for node discovery. LLDP is useful for your environment. Assign the same virtual address to provide gateway redundancy. Configure VLANs - dual switch with a different IP address...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 24
Configure interfaces - For more information, see VMware vSAN Network Design. dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-... port type edge flowcontrol receive on all network interfaces in ESXi by default. Note: Flow control is enabled on flowcontrol transmit off no shutdown 24 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Configure interfaces - For more information, see VMware vSAN Network Design. dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-... port type edge flowcontrol receive on all network interfaces in ESXi by default. Note: Flow control is enabled on flowcontrol transmit off no shutdown 24 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 25
... memory end write memory 25 Dell EMC SmartFabric OS10 Switch Configuration Guide for the VLTi between the two leaf switches. Enable peer routing. Configure VLT - Create the VLT domain. Configure the interfaces used as the VLTi with VLT S5248F-Leaf1A interface ethernet1/1/53 description ...VLTi no switchport no shutdown S5248F-Leaf1B interface ethernet1/1/53 description VLTi no switchport no...
... memory end write memory 25 Dell EMC SmartFabric OS10 Switch Configuration Guide for the VLTi between the two leaf switches. Enable peer routing. Configure VLT - Create the VLT domain. Configure the interfaces used as the VLTi with VLT S5248F-Leaf1A interface ethernet1/1/53 description ...VLTi no switchport no shutdown S5248F-Leaf1B interface ethernet1/1/53 description VLTi no switchport no...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 40
... backup role. Ensure Peer-Routing is identical to the above. The VLTi Link Status and VLT Peer Status must both be up fda5:74c8:b79e:1::2 2.3 40 Dell EMC SmartFabric OS10 Switch Configuration Guide for management traffic. S5248F-Leaf1A# show vlt 127 Domain ID : 127 Unit ID : 1 Role : primary Version : 2.3 Local System MAC address : d8:9e...
... backup role. Ensure Peer-Routing is identical to the above. The VLTi Link Status and VLT Peer Status must both be up fda5:74c8:b79e:1::2 2.3 40 Dell EMC SmartFabric OS10 Switch Configuration Guide for management traffic. S5248F-Leaf1A# show vlt 127 Domain ID : 127 Unit ID : 1 Role : primary Version : 2.3 Local System MAC address : d8:9e...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 29
...Set the MTU to its maximum size, 9216 bytes. Set the backup destination IP address. VLT configuration S5248F-Leaf1A interface ethernet1/1/49 description VLTi no shutdown no switchport mtu 9216 S5248F-Leaf1B interface ethernet1/1/49 description VLTi no shutdown no switchport mtu 9216 interface ethernet1/1/50 description ... the VLT domain with the no switchport mtu 9216 vlt-domain 127 backup destination 100.67.168.31 vlt-domain 127 backup destination 100.67.168.32 29 Dell EMC Solutions for the VLTi between the two leaf switches as shown in Figure 5. When the configuration is the...
...Set the MTU to its maximum size, 9216 bytes. Set the backup destination IP address. VLT configuration S5248F-Leaf1A interface ethernet1/1/49 description VLTi no shutdown no switchport mtu 9216 S5248F-Leaf1B interface ethernet1/1/49 description VLTi no shutdown no switchport mtu 9216 interface ethernet1/1/50 description ... the VLT domain with the no switchport mtu 9216 vlt-domain 127 backup destination 100.67.168.31 vlt-domain 127 backup destination 100.67.168.32 29 Dell EMC Solutions for the VLTi between the two leaf switches as shown in Figure 5. When the configuration is the...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 35
... of the peer. S5248F-Leaf1A# show vlt 127 backup-link VLT Backup Link Destination : 100.67.168.31 Peer Heartbeat status : Up Heartbeat interval : 30 Heartbeat timeout : 90 Destination VRF : default 35 Dell EMC Solutions for one switch in the VLT pair is primary, and...Link Status port-channel1000 : up VLT Peer Unit ID System MAC Address Status IP Address Version 2 3c:2c:30:10:34:00 up . The Role for Microsoft Azure Stack HCI Networking Guide 8.2 VLT validation commands 8.2.1 show vlt domain_id This command is used to validate the VLT configuration status.
... of the peer. S5248F-Leaf1A# show vlt 127 backup-link VLT Backup Link Destination : 100.67.168.31 Peer Heartbeat status : Up Heartbeat interval : 30 Heartbeat timeout : 90 Destination VRF : default 35 Dell EMC Solutions for one switch in the VLT pair is primary, and...Link Status port-channel1000 : up VLT Peer Unit ID System MAC Address Status IP Address Version 2 3c:2c:30:10:34:00 up . The Role for Microsoft Azure Stack HCI Networking Guide 8.2 VLT validation commands 8.2.1 show vlt domain_id This command is used to validate the VLT configuration status.
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 36
... mismatch Virtual Network VNI Mismatch: No mismatch Virtual Network Remote-VTEP Mismatch: No mismatch 36 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Mismatch examples include incompatible VLT configuration settings and VLAN differences. S5248F-Leaf1A# show vlt domain_id mismatch This command highlights configuration issues between VLT peers. Any mismatches reported should be resolved before proceeding.
... mismatch Virtual Network VNI Mismatch: No mismatch Virtual Network Remote-VTEP Mismatch: No mismatch 36 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Mismatch examples include incompatible VLT configuration settings and VLAN differences. S5248F-Leaf1A# show vlt domain_id mismatch This command highlights configuration issues between VLT peers. Any mismatches reported should be resolved before proceeding.
EMC Networking Virtualization Overlay with BGP EVPN
Page 3
......6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN...configuration ...20 5.4 Configure switch port profile (S4148U-ON only 20 6 Configure leaf switches ...21 6.1 Initial configuration settings ...21 6.2 VLT configuration...22 6.3 Virtual network configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell...
......6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN...configuration ...20 5.4 Configure switch port profile (S4148U-ON only 20 6 Configure leaf switches ...21 6.1 Initial configuration settings ...21 6.2 VLT configuration...22 6.3 Virtual network configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell...
EMC Networking Virtualization Overlay with BGP EVPN
Page 22
...each VNI: a. For each leaf. 3. Configure a Route Distinguisher (RD) using at least two high-bandwidth ports for the VTEP. Dell EMC recommends increasing the restore timer in an EVPN configuration from Layer 2 mode with a VNI in a 1:1 mapping. VLT configuration Leaf1a Leaf1b interface range ethernet 1/1/55-1/1/56 ...delay-restore 120 discovery-interface ethernet 1/1/55 discovery-interface ethernet 1/1/56 vlt-mac 00:00:01:02:03:01 Note: The remaining leaf switches are configured in the same manner. Dell EMC recommends using the format 4-octet-ipv4addr:2-octet-number. This ...
...each VNI: a. For each leaf. 3. Configure a Route Distinguisher (RD) using at least two high-bandwidth ports for the VTEP. Dell EMC recommends increasing the restore timer in an EVPN configuration from Layer 2 mode with a VNI in a 1:1 mapping. VLT configuration Leaf1a Leaf1b interface range ethernet 1/1/55-1/1/56 ...delay-restore 120 discovery-interface ethernet 1/1/55 discovery-interface ethernet 1/1/56 vlt-mac 00:00:01:02:03:01 Note: The remaining leaf switches are configured in the same manner. Dell EMC recommends using the format 4-octet-ipv4addr:2-octet-number. This ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 39
.... S5248F-Leaf1A# show vlt domain_id command on the backup link over the OOB management network. The Destination is assigned the secondary role. Any mismatches reported should be Up. 8.2 VLT validation commands 8.2.1 8.2.2 8.2.3 show vlt domain_id VLT configuration is verified by running the show vlt 127 mismatch VLT-MAC mismatch: No mismatch Peer-routing mismatch: No mismatch VLAN mismatch: 39 Dell...
.... S5248F-Leaf1A# show vlt domain_id command on the backup link over the OOB management network. The Destination is assigned the secondary role. Any mismatches reported should be Up. 8.2 VLT validation commands 8.2.1 8.2.2 8.2.3 show vlt domain_id VLT configuration is verified by running the show vlt 127 mismatch VLT-MAC mismatch: No mismatch Peer-routing mismatch: No mismatch VLAN mismatch: 39 Dell...
VxFlex Network Deployment Guide using EMC Networking 25GbE switches and OS10EE
Page 20
...12)# mode Eth 10g-4x S5248-Leaf1A(conf-pg-1/1/12)# exit Save the configuration. A gateway is optional. Connecting SDC's via router on the same subnet. The output from S5248F-Leaf1B is similar. 4.3.1 show vlt domain id The show vlt 1 Domain ID Unit ID Role Version Local System MAC address Role priority :... 1 : 1 : primary : 2.0 : 54:bf:64:e6:dd:c1 : 1 20 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE ...
...12)# mode Eth 10g-4x S5248-Leaf1A(conf-pg-1/1/12)# exit Save the configuration. A gateway is optional. Connecting SDC's via router on the same subnet. The output from S5248F-Leaf1B is similar. 4.3.1 show vlt domain id The show vlt 1 Domain ID Unit ID Role Version Local System MAC address Role priority :... 1 : 1 : primary : 2.0 : 54:bf:64:e6:dd:c1 : 1 20 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE ...
EMC Networking OS10 Enterprise Edition Switch Configuration Guide for VxRail featuring S5248F-ON S5232F-ON and S5148F-ON
Page 39
...253 172.16.11.254 Note: For the dual switch without VLT topology, the output is Enabled. S5148F-Leaf1A#show vlt 127 backup-link 39 Dell EMC Networking OS10 Enterprise Edition Switch Configuration Guide for one switch in the VLT pair is primary, and its peer switch (not shown) is...in-band management VLAN, 1611, to provide gateway redundancy for management traffic. The Role for VxRail featuring S5248F-ON, S5232F-ON and S5148F-ON The Destination is assigned the secondary role. S5148F-Leaf1A#show vlt 127 Domain ID : 127 Unit ID : 1 Role : primary Version : 2.0 Local System MAC ...
...253 172.16.11.254 Note: For the dual switch without VLT topology, the output is Enabled. S5148F-Leaf1A#show vlt 127 backup-link 39 Dell EMC Networking OS10 Enterprise Edition Switch Configuration Guide for one switch in the VLT pair is primary, and its peer switch (not shown) is...in-band management VLAN, 1611, to provide gateway redundancy for management traffic. The Role for VxRail featuring S5248F-ON, S5232F-ON and S5148F-ON The Destination is assigned the secondary role. S5148F-Leaf1A#show vlt 127 Domain ID : 127 Unit ID : 1 Role : primary Version : 2.0 Local System MAC ...