EMC Networking Virtualization Overlay with BGP EVPN
Page 3
......19 5.1 Check switch OS version...19 5.2 Verify license installation ...19 5.3 Factory default configuration ...20 5.4 Configure switch port profile (S4148U-ON only 20 6 Configure leaf switches ...21 6.1 Initial configuration settings ...21 6.2 VLT configuration...22 6.3 Virtual network configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell EMC Networking Virtualization Overlay with BGP...
......19 5.1 Check switch OS version...19 5.2 Verify license installation ...19 5.3 Factory default configuration ...20 5.4 Configure switch port profile (S4148U-ON only 20 6 Configure leaf switches ...21 6.1 Initial configuration settings ...21 6.2 VLT configuration...22 6.3 Virtual network configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell EMC Networking Virtualization Overlay with BGP...
EMC Networking Virtualization Overlay with BGP EVPN
Page 4
...27 6.9 BGP configuration...28 6.10 Static route configuration...30 7 Configure spine switches ...31 7.1 Initial configuration settings ...31 7.2 Downstream interface configuration ...31 7.3 Route map configuration ...33 7.4 BGP configuration...33 8 Leaf switch validation ...37 8.1 General commands ...37 8.1.1 show interface status...37 8.1.2...l2vpn evpn summary ...43 8.4.4 show ip bgp l2vpn evpn ...43 8.4.5 show evpn mac-ip...45 9 Spine switch validation ...46 9.1 General commands ...46 9.1.1 show interface status...46 9.1.2 show lldp neighbors...46 9.2 Routing validation commands ...47 9.2.1 show...
...27 6.9 BGP configuration...28 6.10 Static route configuration...30 7 Configure spine switches ...31 7.1 Initial configuration settings ...31 7.2 Downstream interface configuration ...31 7.3 Route map configuration ...33 7.4 BGP configuration...33 8 Leaf switch validation ...37 8.1 General commands ...37 8.1.1 show interface status...37 8.1.2...l2vpn evpn summary ...43 8.4.4 show ip bgp l2vpn evpn ...43 8.4.5 show evpn mac-ip...45 9 Spine switch validation ...46 9.1 General commands ...46 9.1.1 show interface status...46 9.1.2 show lldp neighbors...46 9.2 Routing validation commands ...47 9.2.1 show...
EMC Networking Virtualization Overlay with BGP EVPN
Page 5
... ...58 11.2 Validate routing using anycast gateways ...59 11.3 Validate routing using the indirect gateway...60 A Gateway/firewall switch configuration ...62 A.1 Initial configuration settings ...62 A.2 Indirect gateway configuration...62 A.3 Simulated external network interface configuration 63 A.4 ...interfaces ...63 A.5 Static routes to VNIs...63 B Validated components...64 B.1 Dell EMC PowerSwitches...64 B.2 PowerEdge R740xd Servers ...64 B.3 VMware software ...64 C Technical resources ...65 C.1 Dell EMC product manuals and technical guides 65 C.1 VMware product manuals and technical ...
... ...58 11.2 Validate routing using anycast gateways ...59 11.3 Validate routing using the indirect gateway...60 A Gateway/firewall switch configuration ...62 A.1 Initial configuration settings ...62 A.2 Indirect gateway configuration...62 A.3 Simulated external network interface configuration 63 A.4 ...interfaces ...63 A.5 Static routes to VNIs...63 B Validated components...64 B.1 Dell EMC PowerSwitches...64 B.2 PowerEdge R740xd Servers ...64 B.3 VMware software ...64 C Technical resources ...65 C.1 Dell EMC product manuals and technical guides 65 C.1 VMware product manuals and technical ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 7
... S5248F-ON The Dell EMC PowerSwitch S5248F-ON is a 1-RU, multilayer switch with twenty-four 10GbE ports, two 40GbE ports, four 10/25/40/50/100GbE or FC8/16/32 ports, and twenty-four 10GbE or FC8/16 ports. This guide uses four S4148U-ONs as routing ...a complete list of tunnels (RIOT). This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S4148U-ON The Dell EMC PowerSwitch S4148U-ON is a 1-Rack Unit (RU), multilayer switch with BGP EVPN Leaf switches used to validate the deployment examples in this guide. As of this writing, this...
... S5248F-ON The Dell EMC PowerSwitch S5248F-ON is a 1-RU, multilayer switch with twenty-four 10GbE ports, two 40GbE ports, four 10/25/40/50/100GbE or FC8/16/32 ports, and twenty-four 10GbE or FC8/16 ports. This guide uses four S4148U-ONs as routing ...a complete list of tunnels (RIOT). This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S4148U-ON The Dell EMC PowerSwitch S4148U-ON is a 1-Rack Unit (RU), multilayer switch with BGP EVPN Leaf switches used to validate the deployment examples in this guide. As of this writing, this...
EMC Networking Virtualization Overlay with BGP EVPN
Page 8
... making it well-suited for out-of-band (OOB) management traffic. 2.5 Dell EMC PowerSwitch S3048-ON Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is a 1-RU switch with BGP EVPN The R740xd server features Intel Xeon processors, with up to 128... memory and a variety of high-performance network interface options. This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is a dual socket 2-RU platform that require greater storage, without sacrificing I/O performance...
... making it well-suited for out-of-band (OOB) management traffic. 2.5 Dell EMC PowerSwitch S3048-ON Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is a 1-RU switch with BGP EVPN The R740xd server features Intel Xeon processors, with up to 128... memory and a variety of high-performance network interface options. This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is a dual socket 2-RU platform that require greater storage, without sacrificing I/O performance...
EMC Networking Virtualization Overlay with BGP EVPN
Page 10
... to their maximum supported MTU size of 9216 bytes. In this deployment example, switch interfaces are the VTEPs. 10 Dell EMC Networking Virtualization Overlay with BGP EVPN Note: In this implementation, the leaf switches are set to 16 Million VNIs, far more than the traditional 4,094 VLAN ...IDs allowed on all switches in the underlay (physical) network must be configured to as a ...
... to their maximum supported MTU size of 9216 bytes. In this deployment example, switch interfaces are the VTEPs. 10 Dell EMC Networking Virtualization Overlay with BGP EVPN Note: In this implementation, the leaf switches are set to 16 Million VNIs, far more than the traditional 4,094 VLAN ...IDs allowed on all switches in the underlay (physical) network must be configured to as a ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 11
...table for all VMs on VNIs with different networks, their local leaf switches always do the routing. VMs on that virtual network. When a host sends a packet to servers. As of OS10EE version 10.4.3.1, Dell EMC PowerSwitches support asymmetric IRB. This replaces Virtual Router Redundancy Protocol (... as RIOT, occurs on leaf switches. When those VMs communicate with anycast gateways use the indirect gateway to access the Internet by configuring static routes. 11 Dell EMC Networking Virtualization Overlay with outer IP and Ethernet headers for another network, it is tunneled to ...
...table for all VMs on VNIs with different networks, their local leaf switches always do the routing. VMs on that virtual network. When a host sends a packet to servers. As of OS10EE version 10.4.3.1, Dell EMC PowerSwitches support asymmetric IRB. This replaces Virtual Router Redundancy Protocol (... as RIOT, occurs on leaf switches. When those VMs communicate with anycast gateways use the indirect gateway to access the Internet by configuring static routes. 11 Dell EMC Networking Virtualization Overlay with outer IP and Ethernet headers for another network, it is tunneled to ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 12
... is at the top of each rack. For additional leaf-spine network information, refer to enable the BGP EVPN VXLAN feature. 12 Dell EMC Networking Virtualization Overlay with OS10. There are some BGP configuration differences in Figure 8. Note: For this guide to.../ Firewall Note: Using a leaf-spine network in Rack 1, and four S4148U-ON switches are used to each host is used as spines and two leaf switches per rack, this example, two Z9264F-ON switches are used as spines, two S5248F-ON switches are added to load balance traffic across the Layer 3 connections. 4 Topology...
... is at the top of each rack. For additional leaf-spine network information, refer to enable the BGP EVPN VXLAN feature. 12 Dell EMC Networking Virtualization Overlay with OS10. There are some BGP configuration differences in Figure 8. Note: For this guide to.../ Firewall Note: Using a leaf-spine network in Rack 1, and four S4148U-ON switches are used to each host is used as spines and two leaf switches per rack, this example, two Z9264F-ON switches are used as spines, two S5248F-ON switches are added to load balance traffic across the Layer 3 connections. 4 Topology...
EMC Networking Virtualization Overlay with BGP EVPN
Page 13
... IDs 10.2.2.5 VLTi 10.2.2.6 AS65203 Point-to -point networks Leaf 2a VNLTi Leaf 2b Rack 2 JK L Leaf 3a VOLTi Leaf 3b Rack n 13 Dell EMC Networking Virtualization Overlay with the next pair assigned an ASN of 65204. Using private ASNs in the hundreds place, 65201 for example, and the... with BGP EVPN 4.1.1 BGP ASNs and router IDs Figure 9 shows the autonomous system numbers (ASNs) and router IDs used for the leaf and spine switches in this deployment are labeled A-O in Figure 10. The IP addresses shown are loopback addresses used in the address represents the layer, "1" for spine ...
... IDs 10.2.2.5 VLTi 10.2.2.6 AS65203 Point-to -point networks Leaf 2a VNLTi Leaf 2b Rack 2 JK L Leaf 3a VOLTi Leaf 3b Rack n 13 Dell EMC Networking Virtualization Overlay with the next pair assigned an ASN of 65204. Using private ASNs in the hundreds place, 65201 for example, and the... with BGP EVPN 4.1.1 BGP ASNs and router IDs Figure 9 shows the autonomous system numbers (ASNs) and router IDs used for the leaf and spine switches in this deployment are labeled A-O in Figure 10. The IP addresses shown are loopback addresses used in the address represents the layer, "1" for spine ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 14
... The IP addresses in the switch configuration examples. The example point-topoint addresses above use a 31-bit mask to -point IP network. This is a separate, point-to save address space. Table 1 details the links labeled in RFC 3021. 14 Dell EMC Networking Virtualization Overlay with ...all examples in this guide, any valid IP address scheme can be used in the table are used . Point-to-point network IP addresses Link Source label switch Source IP address Destination switch Destination IP address Network A...
... The IP addresses in the switch configuration examples. The example point-topoint addresses above use a 31-bit mask to -point IP network. This is a separate, point-to save address space. Table 1 details the links labeled in RFC 3021. 14 Dell EMC Networking Virtualization Overlay with ...all examples in this guide, any valid IP address scheme can be used in the table are used . Point-to-point network IP addresses Link Source label switch Source IP address Destination switch Destination IP address Network A...
EMC Networking Virtualization Overlay with BGP EVPN
Page 15
Each leaf has one connection to each spine. 100GbE uplink ports on S4148U-ONs also used as a VLT port channel on S5248F-ON switches, may be used to S4148U-ON leaf switches are 10GbE (not shown). Connections from hosts to maximize bandwidth. However, QSFP28-DD ports are not available on leafs ... port channel on the host and as leaf switches in Figure 11. Each host has one connection to S5248F-ON leaf switches are used for the VLTi instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN This ...
Each leaf has one connection to each spine. 100GbE uplink ports on S4148U-ONs also used as a VLT port channel on S5248F-ON switches, may be used to S4148U-ON leaf switches are 10GbE (not shown). Connections from hosts to maximize bandwidth. However, QSFP28-DD ports are not available on leafs ... port channel on the host and as leaf switches in Figure 11. Each host has one connection to S5248F-ON leaf switches are used for the VLTi instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN This ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 16
....16.16.253 Indirect gateway - Because these VNIs have anycast gateways configured, and VMs on those VMs route, their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with anycast gateways. This topology also uses a traditional centralized gateway for instance, can get the benefit of....222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N.1I6.1165.12453 VLT VM R740xd-1 VM VM R740xd-2 VM VTEP 10.222.222.2 S4148U-2a VLTi S4148U-2b 172.16.14.253 172.16.15.253 VLT VM R740xd-3 VM VM R740xd-4 VM eBGP ECMP eBGP VTEP 10.222.222...
....16.16.253 Indirect gateway - Because these VNIs have anycast gateways configured, and VMs on those VMs route, their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with anycast gateways. This topology also uses a traditional centralized gateway for instance, can get the benefit of....222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N.1I6.1165.12453 VLT VM R740xd-1 VM VM R740xd-2 VM VTEP 10.222.222.2 S4148U-2a VLTi S4148U-2b 172.16.14.253 172.16.15.253 VLT VM R740xd-3 VM VM R740xd-4 VM eBGP ECMP eBGP VTEP 10.222.222...
EMC Networking Virtualization Overlay with BGP EVPN
Page 17
... used to server iDRACs and switch management ports. Each S3048-ON has forty-eight 1GbE Base-T ports for OOB management network connections. It is an isolated network for ESXi host management as VLT peers. Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for ...connections to carry heartbeat messages sent between leaf switches configured as shown in Figure 13.
... used to server iDRACs and switch management ports. Each S3048-ON has forty-eight 1GbE Base-T ports for OOB management network connections. It is an isolated network for ESXi host management as VLT peers. Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for ...connections to carry heartbeat messages sent between leaf switches configured as shown in Figure 13.
EMC Networking Virtualization Overlay with BGP EVPN
Page 18
... Networking Virtualization Overlay with its factory default settings, or it may be configured as an OOB management switch with BGP EVPN At a minimum, Dell EMC recommends changing the admin password to the OOB management network core (links not shown). By default, all ports are available on the S3048-ON ...
... Networking Virtualization Overlay with its factory default settings, or it may be configured as an OOB management switch with BGP EVPN At a minimum, Dell EMC recommends changing the admin password to the OOB management network core (links not shown). By default, all ports are available on the S3048-ON ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 19
... 10.4.3.1 or later for download on the switch. 19 Dell EMC Networking Virtualization Overlay with BGP EVPN OS10# show version command to verify license installation. Run the show version Dell EMC Networking OS10-Enterprise Copyright (c) 1999-2019 by Dell Inc. If an evaluation license is already on Dell Digital Locker. Installation instructions are available for...
... 10.4.3.1 or later for download on the switch. 19 Dell EMC Networking Virtualization Overlay with BGP EVPN OS10# show version command to verify license installation. Run the show version Dell EMC Networking OS10-Enterprise Copyright (c) 1999-2019 by Dell Inc. If an evaluation license is already on Dell Digital Locker. Installation instructions are available for...
EMC Networking Virtualization Overlay with BGP EVPN
Page 20
...# write memory OS10# reload Proceed to reboot the system? [confirm yes/no]:y 20 Dell EMC Networking Virtualization Overlay with the leaf switches at its factory default configuration. See the Switch-port profiles section of switches and S4148U-ON switches. To change the switch port profile from its default setting to its default settings has Telnet disabled, SSH...
...# write memory OS10# reload Proceed to reboot the system? [confirm yes/no]:y 20 Dell EMC Networking Virtualization Overlay with the leaf switches at its factory default configuration. See the Switch-port profiles section of switches and S4148U-ON switches. To change the switch port profile from its default setting to its default settings has Telnet disabled, SSH...
EMC Networking Virtualization Overlay with BGP EVPN
Page 21
... scaled-overlay-routing bfd enable ip vrf tenant1 21 Dell EMC Networking Virtualization Overlay with the configure terminal command. 2. Configuration differences for more switch hardware resources to this .pdf. Note: All switches start at their factory default settings per Section 5.3. ... network configuration which enables the overlay networks between all switches. Enable Bidirectional Forwarding Detection (BFD). 7. After setting to factory defaults, S4148U-ON switches are set the hardware overlay routing profile to switch-port-profile 3 as annotated text file attachments to ...
... scaled-overlay-routing bfd enable ip vrf tenant1 21 Dell EMC Networking Virtualization Overlay with the configure terminal command. 2. Configuration differences for more switch hardware resources to this .pdf. Note: All switches start at their factory default settings per Section 5.3. ... network configuration which enables the overlay networks between all switches. Enable Bidirectional Forwarding Detection (BFD). 7. After setting to factory defaults, S4148U-ON switches are set the hardware overlay routing profile to switch-port-profile 3 as annotated text file attachments to ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 22
...ARP/neighbor addresses under EVIs to be downloaded by EVPN. 5. 6.2 6.3 Leaf1a exit Leaf1b exit Note: The remaining leaf switches are configured in the same manner. VLT configuration Leaf1a Leaf1b interface range ethernet 1/1/55-1/1/56 interface range ethernet 1/1/55-1/1/56 description... VLTi description VLTi no switchport no switchport command. 2. This example uses the format vtep-ip-address:evi. 22 Dell EMC Networking Virtualization Overlay with the nve command and specify loopback0 as the designated VTEP source interface. 4. Use a unique IP...
...ARP/neighbor addresses under EVIs to be downloaded by EVPN. 5. 6.2 6.3 Leaf1a exit Leaf1b exit Note: The remaining leaf switches are configured in the same manner. VLT configuration Leaf1a Leaf1b interface range ethernet 1/1/55-1/1/56 interface range ethernet 1/1/55-1/1/56 description... VLTi description VLTi no switchport no switchport command. 2. This example uses the format vtep-ip-address:evi. 22 Dell EMC Networking Virtualization Overlay with the nve command and specify loopback0 as the designated VTEP source interface. 4. Use a unique IP...
EMC Networking Virtualization Overlay with BGP EVPN
Page 24
This is created on all six leaf switches. 24 Dell EMC Networking Virtualization Overlay with the ip virtual-router mac-address command above. VRF tenant1 is considered a best practice and ensures that routes are shared between the leaf switches. 6.4 Leaf1a ip virtual-router address 172.16.15.253 Leaf1b... virtual-network 1616 no shutdown interface vlan4000 ip address 192.168.3.0/31 interface vlan4000 ip address 192.168.3.1/31 Note: The remaining leaf switches are from Table 1. Create VLANs 1614, 1615, and 1616 and map them to them. This is used for iBGP adjacency between ...
This is created on all six leaf switches. 24 Dell EMC Networking Virtualization Overlay with the ip virtual-router mac-address command above. VRF tenant1 is considered a best practice and ensures that routes are shared between the leaf switches. 6.4 Leaf1a ip virtual-router address 172.16.15.253 Leaf1b... virtual-network 1616 no shutdown interface vlan4000 ip address 192.168.3.0/31 interface vlan4000 ip address 192.168.3.1/31 Note: The remaining leaf switches are from Table 1. Create VLANs 1614, 1615, and 1616 and map them to them. This is used for iBGP adjacency between ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 25
Set the MTU to 9216 bytes to allow jumbo frames on the trunked port channel. a. Leaf switches 3a and 3b are configured in the same manner, with BGP EVPN a. Give the port channel a description. b. Configure the port channel as follows... active interface ethernet 1/1/32 description "Server 2" channel-group 101 mode active Note: Leaf switches 2a and 2b are connected to the switch acting as an external gateway/firewall via a single VLT port channel. 25 Dell EMC Networking Virtualization Overlay with VLT port channels going to Server 2. 6.5 Downstream interface configuration...
Set the MTU to 9216 bytes to allow jumbo frames on the trunked port channel. a. Leaf switches 3a and 3b are configured in the same manner, with BGP EVPN a. Give the port channel a description. b. Configure the port channel as follows... active interface ethernet 1/1/32 description "Server 2" channel-group 101 mode active Note: Leaf switches 2a and 2b are connected to the switch acting as an external gateway/firewall via a single VLT port channel. 25 Dell EMC Networking Virtualization Overlay with VLT port channels going to Server 2. 6.5 Downstream interface configuration...
