EMC Networking Virtualization Overlay with BGP EVPN
Page 1
May 2019 Dell EMC Configuration and Deployment Guide Dell EMC Networking Virtualization Overlay with BGP EVPN Deploying a BGP EPVN leaf-spine topology with VXLAN anycast gateways Abstract This guide covers the deployment of a physical Layer 3 leaf-spine underlay network and Layer 2 virtual network overlays with anycast gateways using VXLAN-based BGP EVPN.
May 2019 Dell EMC Configuration and Deployment Guide Dell EMC Networking Virtualization Overlay with BGP EVPN Deploying a BGP EPVN leaf-spine topology with VXLAN anycast gateways Abstract This guide covers the deployment of a physical Layer 3 leaf-spine underlay network and Layer 2 virtual network overlays with anycast gateways using VXLAN-based BGP EVPN.
EMC Networking Virtualization Overlay with BGP EVPN
Page 2
...representations or warranties of any software described in this publication requires an applicable software license. © 2019 Dell Inc. Dell believes the information in this document is accurate as is." or its subsidiaries. All Rights Reserved. The ... date. Use, copying, and distribution of any kind with respect to change without notice. 2 Dell EMC Networking Virtualization Overlay with BGP EVPN or its subsidiaries. Dell Inc. Other trademarks may be trademarks of Dell Inc. Dell, EMC, Dell EMC and other trademarks are trademarks of their respective owners.
...representations or warranties of any software described in this publication requires an applicable software license. © 2019 Dell Inc. Dell believes the information in this document is accurate as is." or its subsidiaries. All Rights Reserved. The ... date. Use, copying, and distribution of any kind with respect to change without notice. 2 Dell EMC Networking Virtualization Overlay with BGP EVPN or its subsidiaries. Dell Inc. Other trademarks may be trademarks of Dell Inc. Dell, EMC, Dell EMC and other trademarks are trademarks of their respective owners.
EMC Networking Virtualization Overlay with BGP EVPN
Page 3
...1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN VXLAN overview ...9 3.1 The VXLAN ...OS version...19 5.2 Verify license installation ...19 5.3 Factory default configuration ...20 5.4 Configure switch port profile (S4148U-ON only 20 6 Configure leaf switches ...21 6.1 Initial configuration settings ...21 6.2 VLT configuration...22 6.3 Virtual...
...1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN VXLAN overview ...9 3.1 The VXLAN ...OS version...19 5.2 Verify license installation ...19 5.3 Factory default configuration ...20 5.4 Configure switch port profile (S4148U-ON only 20 6 Configure leaf switches ...21 6.1 Initial configuration settings ...21 6.2 VLT configuration...22 6.3 Virtual...
EMC Networking Virtualization Overlay with BGP EVPN
Page 4
...-ip...45 9 Spine switch validation ...46 9.1 General commands ...46 9.1.1 show interface status...46 9.1.2 show lldp neighbors...46 9.2 Routing validation commands ...47 9.2.1 show bfd neighbors ...47 4 Dell EMC Networking Virtualization Overlay with BGP EVPN
...-ip...45 9 Spine switch validation ...46 9.1 General commands ...46 9.1.1 show interface status...46 9.1.2 show lldp neighbors...46 9.2 Routing validation commands ...47 9.2.1 show bfd neighbors ...47 4 Dell EMC Networking Virtualization Overlay with BGP EVPN
EMC Networking Virtualization Overlay with BGP EVPN
Page 5
... configuration...62 A.3 Simulated external network interface configuration 63 A.4 Upstream interfaces ...63 A.5 Static routes to VNIs...63 B Validated components...64 B.1 Dell EMC PowerSwitches...64 B.2 PowerEdge R740xd Servers ...64 B.3 VMware software ...64 C Technical resources ...65 C.1 Dell EMC product manuals and technical guides 65 C.1 VMware product manuals and technical guides 65 D Fabric Design Center ...66 E Support and...
... configuration...62 A.3 Simulated external network interface configuration 63 A.4 Upstream interfaces ...63 A.5 Static routes to VNIs...63 B Validated components...64 B.1 Dell EMC PowerSwitches...64 B.2 PowerEdge R740xd Servers ...64 B.3 VMware software ...64 C Technical resources ...65 C.1 Dell EMC product manuals and technical guides 65 C.1 VMware product manuals and technical guides 65 D Fabric Design Center ...66 E Support and...
EMC Networking Virtualization Overlay with BGP EVPN
Page 6
...different virtual networks and to demonstrate tunneling Layer 2 virtual network traffic through a Layer 3 leaf-spine network. The virtual networks using Dell EMC PowerSwitches and PowerEdge servers. BGP EVPN for Virtual Extensible LAN (VXLAN) using anycast gateways demonstrate integrated routing and bridging (IRB). ... wrap the page Italic Monospace Text Variables in the left pane halfway down the page, then click the icon. 6 Dell EMC Networking Virtualization Overlay with an open strategy that maximize the benefits of the market with BGP EVPN To access attachments in ...
...different virtual networks and to demonstrate tunneling Layer 2 virtual network traffic through a Layer 3 leaf-spine network. The virtual networks using Dell EMC PowerSwitches and PowerEdge servers. BGP EVPN for Virtual Extensible LAN (VXLAN) using anycast gateways demonstrate integrated routing and bridging (IRB). ... wrap the page Italic Monospace Text Variables in the left pane halfway down the page, then click the icon. 6 Dell EMC Networking Virtualization Overlay with an open strategy that maximize the benefits of the market with BGP EVPN To access attachments in ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 7
...Note: While the steps in this includes S41xx-ON series, S52xx-ON series, S4048T-ON, and S6010-ON PowerSwitches. Dell EMC PowerSwitch S4148U-ON 7 Dell EMC Networking Virtualization Overlay with forty-eight SFP28 25GbE ports, two QSFP28-DD ports (two 100GbE interfaces per port), and ...the hardware and software validated for 25GbE and 10GbE compute and storage. This guide uses four S4148U-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S4148U-ON The Dell EMC PowerSwitch S4148U-ON is a 1-RU, multilayer switch with twenty-four 10GbE ports, two 40GbE ports,...
...Note: While the steps in this includes S41xx-ON series, S52xx-ON series, S4048T-ON, and S6010-ON PowerSwitches. Dell EMC PowerSwitch S4148U-ON 7 Dell EMC Networking Virtualization Overlay with forty-eight SFP28 25GbE ports, two QSFP28-DD ports (two 100GbE interfaces per port), and ...the hardware and software validated for 25GbE and 10GbE compute and storage. This guide uses four S4148U-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S4148U-ON The Dell EMC PowerSwitch S4148U-ON is a 1-RU, multilayer switch with twenty-four 10GbE ports, two 40GbE ports,...
EMC Networking Virtualization Overlay with BGP EVPN
Page 8
...storage performance and data set processing to adapt to a variety of -band (OOB) management traffic. 2.5 Dell EMC PowerSwitch S3048-ON Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is used in this deployment, one S3048-ON is a dual socket 2-RU platform that...This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is a 2-RU, multilayer switch with BGP EVPN Dell EMC PowerEdge R740xd server 8 Dell EMC Networking Virtualization Overlay with sixty-four 100GbE ports, or up...
...storage performance and data set processing to adapt to a variety of -band (OOB) management traffic. 2.5 Dell EMC PowerSwitch S3048-ON Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is used in this deployment, one S3048-ON is a dual socket 2-RU platform that...This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is a 2-RU, multilayer switch with BGP EVPN Dell EMC PowerEdge R740xd server 8 Dell EMC Networking Virtualization Overlay with sixty-four 100GbE ports, or up...
EMC Networking Virtualization Overlay with BGP EVPN
Page 9
.../ Firewall • Tunneling of Layer 2 overlay virtual networks through a physical Layer 3 leaf-spine underlay network using an indirect gateway located on the external gateway/firewall 9 Dell EMC Networking Virtualization Overlay with BGP EVPN EVPN uses multiprotocol BGP (MP-BGP) to exchange information between VXLAN tunnel endpoints (VTEPs). EVPN was introduced in the...
.../ Firewall • Tunneling of Layer 2 overlay virtual networks through a physical Layer 3 leaf-spine underlay network using an indirect gateway located on the external gateway/firewall 9 Dell EMC Networking Virtualization Overlay with BGP EVPN EVPN uses multiprotocol BGP (MP-BGP) to exchange information between VXLAN tunnel endpoints (VTEPs). EVPN was introduced in the...
EMC Networking Virtualization Overlay with BGP EVPN
Page 10
... User Datagram Protocol (UDP) segments, as shown in Internet Engineering Task Force document RFC 7348. In this deployment example, switch interfaces are the VTEPs. 10 Dell EMC Networking Virtualization Overlay with BGP EVPN Each overlay is referred to their maximum supported MTU size of at least 1600 bytes on a physical switch. Note...
... User Datagram Protocol (UDP) segments, as shown in Internet Engineering Task Force document RFC 7348. In this deployment example, switch interfaces are the VTEPs. 10 Dell EMC Networking Virtualization Overlay with BGP EVPN Each overlay is referred to their maximum supported MTU size of at least 1600 bytes on a physical switch. Note...
EMC Networking Virtualization Overlay with BGP EVPN
Page 11
...the same IP address are removed, and the switch sends the original packet to access the Internet by configuring static routes. 11 Dell EMC Networking Virtualization Overlay with outer IP and Ethernet headers for a match. It uses an indirect gateway attached to an endpoint, ... between VTEPs. If it is set as the default gateway for another network, it is tunneled to servers. As of OS10EE version 10.4.3.1, Dell EMC PowerSwitches support asymmetric IRB. Integrated routing and bridging (IRB) With EVPN, overlay routing occurs on the destination VNI. 3.2 3.3 3.4 3.5 BGP...
...the same IP address are removed, and the switch sends the original packet to access the Internet by configuring static routes. 11 Dell EMC Networking Virtualization Overlay with outer IP and Ethernet headers for a match. It uses an indirect gateway attached to an endpoint, ... between VTEPs. If it is set as the default gateway for another network, it is tunneled to servers. As of OS10EE version 10.4.3.1, Dell EMC PowerSwitches support asymmetric IRB. Integrated routing and bridging (IRB) With EVPN, overlay routing occurs on the destination VNI. 3.2 3.3 3.4 3.5 BGP...
EMC Networking Virtualization Overlay with BGP EVPN
Page 12
...is connected using a VLT port channel. For additional leaf-spine network information, refer to enable the BGP EVPN VXLAN feature. 12 Dell EMC Networking Virtualization Overlay with OS10. There are some BGP configuration differences in the remaining two racks. BGP is an additional switch attached... Connection ZS9p2i6n4eF1-1 ZS9p26in4eF-2 ECMP L3 L2 S5248F-1a VLTi S5248F-1b Rack 1 VLT S4148U-2a VLTi S4148U-2b Rack 2 VLT Host Leaf-spine underlay network Host Border Leafs S4148U-3a VLTi L3 S4148U-3b L2 Rack n VLT Gateway/ Firewall Note: Using a leaf-spine network in ...
...is connected using a VLT port channel. For additional leaf-spine network information, refer to enable the BGP EVPN VXLAN feature. 12 Dell EMC Networking Virtualization Overlay with OS10. There are some BGP configuration differences in the remaining two racks. BGP is an additional switch attached... Connection ZS9p2i6n4eF1-1 ZS9p26in4eF-2 ECMP L3 L2 S5248F-1a VLTi S5248F-1b Rack 1 VLT S4148U-2a VLTi S4148U-2b Rack 2 VLT Host Leaf-spine underlay network Host Border Leafs S4148U-3a VLTi L3 S4148U-3b L2 Rack n VLT Gateway/ Firewall Note: Using a leaf-spine network in ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 13
..., the 10.2.0.0/16 IP address space is used to -point networks Leaf 2a VNLTi Leaf 2b Rack 2 JK L Leaf 3a VOLTi Leaf 3b Rack n 13 Dell EMC Networking Virtualization Overlay with the next pair assigned an ASN of leaf switches shares a common ASN. The point-to -point IP networks Establishing a logical, scalable...
..., the 10.2.0.0/16 IP address space is used to -point networks Leaf 2a VNLTi Leaf 2b Rack 2 JK L Leaf 3a VOLTi Leaf 3b Rack n 13 Dell EMC Networking Virtualization Overlay with the next pair assigned an ASN of leaf switches shares a common ASN. The point-to -point IP networks Establishing a logical, scalable...
EMC Networking Virtualization Overlay with BGP EVPN
Page 14
.../31 192.168.3.1 192.168.3.3 192.168.3.5 192.168.3.0/31 192.168.3.2/31 192.168.3.4/31 Note: As with all examples in RFC 3021. 14 Dell EMC Networking Virtualization Overlay with BGP EVPN The example point-topoint addresses above use a 31-bit mask to -point IP network. This is a separate, point-to...
.../31 192.168.3.1 192.168.3.3 192.168.3.5 192.168.3.0/31 192.168.3.2/31 192.168.3.4/31 Note: As with all examples in RFC 3021. 14 Dell EMC Networking Virtualization Overlay with BGP EVPN The example point-topoint addresses above use a 31-bit mask to -point IP network. This is a separate, point-to...
EMC Networking Virtualization Overlay with BGP EVPN
Page 15
... instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN 4.2 Underlay network connections The physical underlay network connections are not available on S4148U-ONs also used as a VLT port channel on leafs are 10GbE (not shown...). Connections from hosts to S4148U-ON leaf switches are used to S5248F-ON leaf switches are 25GbE. Each ...
... instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN 4.2 Underlay network connections The physical underlay network connections are not available on S4148U-ONs also used as a VLT port channel on leafs are 10GbE (not shown...). Connections from hosts to S4148U-ON leaf switches are used to S5248F-ON leaf switches are 25GbE. Each ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 16
...to the third leaf pair where their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with anycast gateways. Note: VNIs can any number be doing the routing. However, only...253 17V2N.1I6.1165.12453 VLT VM R740xd-1 VM VM R740xd-2 VM VTEP 10.222.222.2 S4148U-2a VLTi S4148U-2b 172.16.14.253 172.16.15.253 VLT VM R740xd-3 VM VM R740xd-4 VM ...eBGP ECMP eBGP VTEP 10.222.222.3 S4148U-3a VLTi S4148U-3b Border leafs VLT 172.16.16.253 Gateway/ Firewall Rack 1 Rack 2 172.16.14.253...
...to the third leaf pair where their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with anycast gateways. Note: VNIs can any number be doing the routing. However, only...253 17V2N.1I6.1165.12453 VLT VM R740xd-1 VM VM R740xd-2 VM VTEP 10.222.222.2 S4148U-2a VLTi S4148U-2b 172.16.14.253 172.16.15.253 VLT VM R740xd-3 VM VM R740xd-4 VM ...eBGP ECMP eBGP VTEP 10.222.222.3 S4148U-3a VLTi S4148U-3b Border leafs VLT 172.16.16.253 Gateway/ Firewall Rack 1 Rack 2 172.16.14.253...
EMC Networking Virtualization Overlay with BGP EVPN
Page 17
...-ON Spine 2 Stack ID Reset GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B R740xd 1GbE OOB management link OOB management network connections 17 Dell EMC Networking Virtualization Overlay with BGP EVPN Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for remote management of servers, switches, and other devices.
...-ON Spine 2 Stack ID Reset GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B R740xd 1GbE OOB management link OOB management network connections 17 Dell EMC Networking Virtualization Overlay with BGP EVPN Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for remote management of servers, switches, and other devices.
EMC Networking Virtualization Overlay with BGP EVPN
Page 18
... its factory default settings, or it may be configured as needed for uplinks to a complex password during the first login. 18 Dell EMC Networking Virtualization Overlay with BGP EVPN At a minimum, Dell EMC recommends changing the admin password to the OOB management network core (links not shown). By default, all ports are available on...
... its factory default settings, or it may be configured as needed for uplinks to a complex password during the first login. 18 Dell EMC Networking Virtualization Overlay with BGP EVPN At a minimum, Dell EMC recommends changing the admin password to the OOB management network core (links not shown). By default, all ports are available on...
EMC Networking Virtualization Overlay with BGP EVPN
Page 19
... License Duration: Unlimited License Status : Active License location: /mnt/license/68X00Q2.lic Note: If OS10EE was factory installed, a perpetual license is installed, licenses purchased from Dell EMC are provided in bold below. All Rights Reserved. Installation instructions are available for this deployment. OS10# show license status to verify license installation. The License...
... License Duration: Unlimited License Status : Active License location: /mnt/license/68X00Q2.lic Note: If OS10EE was factory installed, a perpetual license is installed, licenses purchased from Dell EMC are provided in bold below. All Rights Reserved. Installation instructions are available for this deployment. OS10# show license status to verify license installation. The License...
EMC Networking Virtualization Overlay with BGP EVPN
Page 20
..., and the OOB management interface configured to get its IP address via DHCP. Dell EMC recommends changing the admin password to the spines and two for switch-port profile options and details. Four S4148U-ON switches are used as leafs in this section for other configurations will be ...applied only after the reload. Dell EMC PowerSwitches running OS10EE can be retained but all other models. Save? [yes/no...
..., and the OOB management interface configured to get its IP address via DHCP. Dell EMC recommends changing the admin password to the spines and two for switch-port profile options and details. Four S4148U-ON switches are used as leafs in this section for other configurations will be ...applied only after the reload. Dell EMC PowerSwitches running OS10EE can be retained but all other models. Save? [yes/no...