VCF on VxRail Multirack Deployment using BGP EVPN
Page 3
... Data Center...9 1.4 Prerequisites...10 1.5 Supported switches and operating systems...10 1.6 Typographical conventions ...10 1.7 Attachments...10 2 Hardware overview...11 2.1 Dell EMC VxRail E560...11 2.2 Dell EMC PowerSwitch S5248F-ON ...11 2.3 Dell EMC PowerSwitch Z9264F-ON...11 2.4 Dell EMC PowerSwitch S3048-ON...12 3 Network transport ...13 3.1 Layer 3 leaf and spine topology...13 3.2 BGP EVPN VXLAN overview ...13...
... Data Center...9 1.4 Prerequisites...10 1.5 Supported switches and operating systems...10 1.6 Typographical conventions ...10 1.7 Attachments...10 2 Hardware overview...11 2.1 Dell EMC VxRail E560...11 2.2 Dell EMC PowerSwitch S5248F-ON ...11 2.3 Dell EMC PowerSwitch Z9264F-ON...11 2.4 Dell EMC PowerSwitch S3048-ON...12 3 Network transport ...13 3.1 Layer 3 leaf and spine topology...13 3.2 BGP EVPN VXLAN overview ...13...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 11
...Network Daughter Card (NDC), and the other Dell EMC PowerSwitch models using BGP EVPN The example within this document uses two Z9264F-ON switches as leaf switches. 2.3 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch Z9264F-ON The Dell EMC PowerSwitch Z9264F-ON is a 2-RU 100 GbE aggregation/spine... storage in this document uses four VxRail E560 nodes. 2.2 Dell EMC VxRail 1-RU node Dell EMC PowerSwitch S5248F-ON The Dell EMC PowerSwitch S5248F-ON is used for upstream connectivity. Dell EMC PowerSwitch Z9264F-ON 11 VCF on VxRail Multirack Deployment using the same networking...
...Network Daughter Card (NDC), and the other Dell EMC PowerSwitch models using BGP EVPN The example within this document uses two Z9264F-ON switches as leaf switches. 2.3 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch Z9264F-ON The Dell EMC PowerSwitch Z9264F-ON is a 2-RU 100 GbE aggregation/spine... storage in this document uses four VxRail E560 nodes. 2.2 Dell EMC VxRail 1-RU node Dell EMC PowerSwitch S5248F-ON The Dell EMC PowerSwitch S5248F-ON is used for upstream connectivity. Dell EMC PowerSwitch Z9264F-ON 11 VCF on VxRail Multirack Deployment using the same networking...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 16
...leaf-spine network in Rack 1 and Rack 2. As administrators add racks to the data center, two leaf switches configured for VLT are routed. With Z9264F-ON switches as leaf switches in the data center is used to exchange routes. 4 Topology 4.1 Leaf-spine underlay In a Layer 3 leaf-spine ... the leaf switches. In this topology scales to load balance traffic across the Layer 3 connections. For more leaf-spine network information, see Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with OS10. BGP is at the top of each rack. Connections within racks from...
...leaf-spine network in Rack 1 and Rack 2. As administrators add racks to the data center, two leaf switches configured for VLT are routed. With Z9264F-ON switches as leaf switches in the data center is used to exchange routes. 4 Topology 4.1 Leaf-spine underlay In a Layer 3 leaf-spine ... the leaf switches. In this topology scales to load balance traffic across the Layer 3 connections. For more leaf-spine network information, see Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with OS10. BGP is at the top of each rack. Connections within racks from...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 59
... CPU @ 3.00GHz, 12 cores - 12 16GB DDR4 DIMMs (192GB total) - 2 800GB SAS SSD - 8 1.2TB SAS HDD EF03 1 Dell HBA330 Storage Controller 15.17.09.06 1 Boot Optimized Storage Solution (BOSS) 2.5.13.3016 Controller w/ 2x240GB SATA SSDs 1 Broadcom 57414 NDC -...nodes were each configured using BGP EVPN A Validated components A.1 Dell EMC PowerSwitch models Switches and operating system versions Qty Item 4 Dell EMC PowerSwitch S5248F-ON leaf switches 2 Dell EMC PowerSwitch Z9264F-ON spine switches 2 Dell EMC PowerSwitch S3048-ON OOB mgmt switches Version 10.4.3.5 10...
... CPU @ 3.00GHz, 12 cores - 12 16GB DDR4 DIMMs (192GB total) - 2 800GB SAS SSD - 8 1.2TB SAS HDD EF03 1 Dell HBA330 Storage Controller 15.17.09.06 1 Boot Optimized Storage Solution (BOSS) 2.5.13.3016 Controller w/ 2x240GB SATA SSDs 1 Broadcom 57414 NDC -...nodes were each configured using BGP EVPN A Validated components A.1 Dell EMC PowerSwitch models Switches and operating system versions Qty Item 4 Dell EMC PowerSwitch S5248F-ON leaf switches 2 Dell EMC PowerSwitch Z9264F-ON spine switches 2 Dell EMC PowerSwitch S3048-ON OOB mgmt switches Version 10.4.3.5 10...
EMC Networking Virtualization Overlay with BGP EVPN
Page 3
Table of contents Revisions...2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN VXLAN overview ...9 3.1 The VXLAN protocol...10 3.2 BGP EVPN... configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell EMC Networking Virtualization Overlay with BGP EVPN
Table of contents Revisions...2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN VXLAN overview ...9 3.1 The VXLAN protocol...10 3.2 BGP EVPN... configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell EMC Networking Virtualization Overlay with BGP EVPN
EMC Networking Virtualization Overlay with BGP EVPN
Page 8
...Four R740xd servers running VMware ESXi are used in this guide. This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is a 1-RU switch with sixty-four 100GbE ports, or ...band (OOB) management traffic. 2.5 Dell EMC PowerSwitch S3048-ON Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is a dual socket 2-RU platform that require greater storage, without sacrificing I/O performance. 2.3 Dell EMC PowerSwitch Z9264F-ON The Dell EMC PowerSwitch Z9264F-ON is a 2-RU, multilayer ...
...Four R740xd servers running VMware ESXi are used in this guide. This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is a 1-RU switch with sixty-four 100GbE ports, or ...band (OOB) management traffic. 2.5 Dell EMC PowerSwitch S3048-ON Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is a dual socket 2-RU platform that require greater storage, without sacrificing I/O performance. 2.3 Dell EMC PowerSwitch Z9264F-ON The Dell EMC PowerSwitch Z9264F-ON is a 2-RU, multilayer ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 12
...leaf-spine network, traffic between leafs and spines is considered a best practice. In this deployment example, any leaf pair may be used to Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with BGP EVPN 4 Topology 4.1 Leaf-spine underlay This deployment uses a Layer 3... leaf-spine topology for the virtual network overlays. Note: For this example, two Z9264F-ON switches are used as spines, two S5248F-ON switches are some BGP configuration differences in the remaining two racks. The underlay ...
...leaf-spine network, traffic between leafs and spines is considered a best practice. In this deployment example, any leaf pair may be used to Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with BGP EVPN 4 Topology 4.1 Leaf-spine underlay This deployment uses a Layer 3... leaf-spine topology for the virtual network overlays. Note: For this example, two Z9264F-ON switches are used as spines, two S5248F-ON switches are some BGP configuration differences in the remaining two racks. The underlay ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 15
Z9264F-ON Spine 1 Z9264F-ON Spine 2 Stack ID Reset Stack ID Reset S5248F-ON Stack ID Leaf 1A S5248F-ON Leaf 1B Stack ID VLT port channel VLTi GRN =... used as a VLT port channel on leafs are used for the VLTi instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN Each host has one connection to each leaf configured as an LACP port channel on the host and...
Z9264F-ON Spine 1 Z9264F-ON Spine 2 Stack ID Reset Stack ID Reset S5248F-ON Stack ID Leaf 1A S5248F-ON Leaf 1B Stack ID VLT port channel VLTi GRN =... used as a VLT port channel on leafs are used for the VLTi instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN Each host has one connection to each leaf configured as an LACP port channel on the host and...
EMC Networking Virtualization Overlay with BGP EVPN
Page 16
... route traffic from one leaf pair to another VNI or Internet destination, their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with anycast gateways also use the physical gateway/firewall switch as the Internet. All VNIs are installed on all on this... VNI 1614, for routing to other networks can any number be doing the routing. This way, a VM on VNI 1616. 4.3 BGP EVPN VXLAN overlay Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N.1I6.1165.12453...
... route traffic from one leaf pair to another VNI or Internet destination, their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with anycast gateways also use the physical gateway/firewall switch as the Internet. All VNIs are installed on all on this... VNI 1614, for routing to other networks can any number be doing the routing. This way, a VM on VNI 1616. 4.3 BGP EVPN VXLAN overlay Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N.1I6.1165.12453...
EMC Networking Virtualization Overlay with BGP EVPN
Page 17
...additional 1GbE OOB management connection for remote management of servers, switches, and other devices. Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for connections to... between leaf switches configured as shown in Figure 13. S3048-ON OOB management S5248F-ON Leaf 1A S5248F-ON Leaf 1B Z9264F-ON Spine 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19.../ LNK A GRN =10G ACT/ LNK B R740xd 1GbE OOB management link OOB management network connections 17 Dell EMC Networking Virtualization Overlay with BGP EVPN Each S3048-ON has forty-eight 1GbE Base-T ports for OOB ...
...additional 1GbE OOB management connection for remote management of servers, switches, and other devices. Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for connections to... between leaf switches configured as shown in Figure 13. S3048-ON OOB management S5248F-ON Leaf 1A S5248F-ON Leaf 1B Z9264F-ON Spine 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19.../ LNK A GRN =10G ACT/ LNK B R740xd 1GbE OOB management link OOB management network connections 17 Dell EMC Networking Virtualization Overlay with BGP EVPN Each S3048-ON has forty-eight 1GbE Base-T ports for OOB ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 31
...7 7.1 Configure spine switches This chapter details the configuration commands issued to access .pdf attachments. Section 1.2 describes how to the two Z9264F-ON spine switches, Spine1 and Spine2. The configuration of the spines consists of interface configuration and BGP configuration. Enter configuration mode with BGP... file attachments to this section, the six point-to-point interfaces to allow jumbo frames. 31 Dell EMC Networking Virtualization Overlay with the configure terminal command. 2. Enable BFD. The switches start at their factory default settings per Table 1.
...7 7.1 Configure spine switches This chapter details the configuration commands issued to access .pdf attachments. Section 1.2 describes how to the two Z9264F-ON spine switches, Spine1 and Spine2. The configuration of the spines consists of interface configuration and BGP configuration. Enter configuration mode with BGP... file attachments to this section, the six point-to-point interfaces to allow jumbo frames. 31 Dell EMC Networking Virtualization Overlay with the configure terminal command. 2. Enable BFD. The switches start at their factory default settings per Table 1.
EMC Networking Virtualization Overlay with BGP EVPN
Page 58
...IP address 172.16.14.3. VNI 1615 172.16.16.253 Indirect gateway - In this section, connectivity is on the same and different VNIs. Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 eBGP ECMP eBGP VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N...VM-1614-1 has the IP address 172.16.14.1. A packet capture of the successful exchange with BGP EVPN It is shown in Figure 23. 58 Dell EMC Networking Virtualization Overlay with a ping request selected is on R740xd-3 connected to the second leaf pair in validation examples Rack n Physical L3 connection ...
...IP address 172.16.14.3. VNI 1615 172.16.16.253 Indirect gateway - In this section, connectivity is on the same and different VNIs. Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 eBGP ECMP eBGP VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N...VM-1614-1 has the IP address 172.16.14.1. A packet capture of the successful exchange with BGP EVPN It is shown in Figure 23. 58 Dell EMC Networking Virtualization Overlay with a ping request selected is on R740xd-3 connected to the second leaf pair in validation examples Rack n Physical L3 connection ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 65
... Deployment and Best Practices with OS10 Manuals and documentation for Dell EMC PowerSwitch S3048-ON Manuals and documentation for Dell EMC PowerSwitch S4148U-ON Manuals and documentation for Dell EMC PowerSwitch S5248F-ON Manuals and documentation for Dell EMC PowerSwitch Z9264F-ON Manuals and documentation for Dell EMC PowerEdge R740xd VMware product manuals and technical guides...
... Deployment and Best Practices with OS10 Manuals and documentation for Dell EMC PowerSwitch S3048-ON Manuals and documentation for Dell EMC PowerSwitch S4148U-ON Manuals and documentation for Dell EMC PowerSwitch S5248F-ON Manuals and documentation for Dell EMC PowerSwitch Z9264F-ON Manuals and documentation for Dell EMC PowerEdge R740xd VMware product manuals and technical guides...
Open Networking Hardware Diagnostic Guide December 2021
Page 25
...the default verbosity level is set to upgrade the CPLD. NOTE: For newer platforms, such as the S5200-ON Series and Z9264F-ON, cpldupgradetool is written in hexadecimal. Passed 0x50 ..... export VERB_LEVEL= To clear the environment variable, use the environment variable ..., 2017/05/23, Syntax: cpldupgradetool Print the Help-Text:= cpldupgradetool --h cpldupgradetool -h Print the CPLD versions:= cpldupgradetool --cpldver cpldupgradetool -c (or) (or) Dell EMC DAIG-OS tools 25 Passed 0x50 ..... + Checking SFP+ 32 + Checking SFP+ 33 + Checking SFP+ 34 + Checking SFP+ 35 0x50 ........
...the default verbosity level is set to upgrade the CPLD. NOTE: For newer platforms, such as the S5200-ON Series and Z9264F-ON, cpldupgradetool is written in hexadecimal. Passed 0x50 ..... export VERB_LEVEL= To clear the environment variable, use the environment variable ..., 2017/05/23, Syntax: cpldupgradetool Print the Help-Text:= cpldupgradetool --h cpldupgradetool -h Print the CPLD versions:= cpldupgradetool --cpldver cpldupgradetool -c (or) (or) Dell EMC DAIG-OS tools 25 Passed 0x50 ..... + Checking SFP+ 32 + Checking SFP+ 33 + Checking SFP+ 34 + Checking SFP+ 35 0x50 ........
Technologies Rail Bracket and Tray Guide June 2022
Page 4
...-BCIN 770-BBJF 575-BBMQ 770-BDKS Similar to use in rear-mount (I/O-side of the switch faces the back of switching equipment with the Z9264F-ON, S6100-ON, or S5296-ON products. For a 434 mm (17.08 in to align with the stop removed. Supports a 450...Abbreviation Rail description 1U-S-RR Standard ReadyRail (1) Rack height 1U Part number N243X SKU 770-BBGY, 770-BDRL Additional information Standard Dell ReadyRail mounting slides. 1 Rails The following sections describe Dell EMC Networking rack rails. Standard B9 ReadyRail mounting slides. Use with a 434 mm (17.08 in ) wide switch.
...-BCIN 770-BBJF 575-BBMQ 770-BDKS Similar to use in rear-mount (I/O-side of the switch faces the back of switching equipment with the Z9264F-ON, S6100-ON, or S5296-ON products. For a 434 mm (17.08 in to align with the stop removed. Supports a 450...Abbreviation Rail description 1U-S-RR Standard ReadyRail (1) Rack height 1U Part number N243X SKU 770-BBGY, 770-BDRL Additional information Standard Dell ReadyRail mounting slides. 1 Rails The following sections describe Dell EMC Networking rack rails. Standard B9 ReadyRail mounting slides. Use with a 434 mm (17.08 in ) wide switch.
Technologies Rail Bracket and Tray Guide June 2022
Page 27
...adapter two-battery holder brackets 39VWT Quick reference 27 Rails, brackets, or trays listed by Dell Technologies part number. 4 Quick reference The following table is a quick reference guide of abbreviations, products..., and rails, brackets, or trays by abbreviation and Dell part number Abbreviation Product Part Number 1RU-S-RR 1RU Standard ReadyRail N243X 1RU-R-RR 1RU Reversible... 19T1K 1U-EMC-3-RR 1RU EMC Gen3 bezel rails V45CP 2U-EMC-Z92xx-RR 2RU Z9264F-ON rails for EMC 2RU Gen3.14/Gen3 bezel 150-042-005 1RU-DN-RR ...
...adapter two-battery holder brackets 39VWT Quick reference 27 Rails, brackets, or trays listed by Dell Technologies part number. 4 Quick reference The following table is a quick reference guide of abbreviations, products..., and rails, brackets, or trays by abbreviation and Dell part number Abbreviation Product Part Number 1RU-S-RR 1RU Standard ReadyRail N243X 1RU-R-RR 1RU Reversible... 19T1K 1U-EMC-3-RR 1RU EMC Gen3 bezel rails V45CP 2U-EMC-Z92xx-RR 2RU Z9264F-ON rails for EMC 2RU Gen3.14/Gen3 bezel 150-042-005 1RU-DN-RR ...
EMC PowerSwitch Installation Guide March 2022
Page 1
Dell EMC PowerSwitch Z9264F-ON Installation Guide March 2022 March 2022 Rev. A09
Dell EMC PowerSwitch Z9264F-ON Installation Guide March 2022 March 2022 Rev. A09
EMC PowerSwitch Installation Guide March 2022
Page 5
...: • Related documents Related documents For more information about the Z9264F-ON switch, see the following documents: ● Dell EMC SmartFabric User Guide ● Dell EMC SmartFabric Release Notes ● Dell EMC PowerSwitch Z9264F-ON Set-up this equipment. 1 About this equipment. Avoid exposure... by -step procedures for specific Dell EMC PowerSwitches, see Dell EMC support: www.dell.com/support. About this equipment. For all other resources, see the Dell EMC Networking OS10 Info Hub. Figure 1. Regulatory Marketing model Z9264F-ON is connected, visible and ...
...: • Related documents Related documents For more information about the Z9264F-ON switch, see the following documents: ● Dell EMC SmartFabric User Guide ● Dell EMC SmartFabric Release Notes ● Dell EMC PowerSwitch Z9264F-ON Set-up this equipment. 1 About this equipment. Avoid exposure... by -step procedures for specific Dell EMC PowerSwitches, see Dell EMC support: www.dell.com/support. About this equipment. For all other resources, see the Dell EMC Networking OS10 Info Hub. Figure 1. Regulatory Marketing model Z9264F-ON is connected, visible and ...
EMC PowerSwitch Installation Guide March 2022
Page 6
...The QSFP28 ports support the following sections describe the Dell EMC Z9264F-ON switch: Topics: • Introduction • Features • Physical dimensions • LED display • Prerequisites • Z9264F-ON switch configurations • Luggage tag Introduction The Z9264F-ON switch is a two rack unit (RU),...management port, and one USB type-A port for the external storage. For specific port profile details, see the OS10 Enterprise Edition User Guide. 2 Z9264F-ON switch The following : ● 64 x 100G-native Q28 ● 128 x 50G-via breakout ● 128 x 25G-via breakout ...
...The QSFP28 ports support the following sections describe the Dell EMC Z9264F-ON switch: Topics: • Introduction • Features • Physical dimensions • LED display • Prerequisites • Z9264F-ON switch configurations • Luggage tag Introduction The Z9264F-ON switch is a two rack unit (RU),...management port, and one USB type-A port for the external storage. For specific port profile details, see the OS10 Enterprise Edition User Guide. 2 Z9264F-ON switch The following : ● 64 x 100G-native Q28 ● 128 x 50G-via breakout ● 128 x 25G-via breakout ...
EMC PowerSwitch Installation Guide March 2022
Page 13
... AC or DC PSU with fan airflow from -40°C to 70°C (-40° to 158°F). Switch ground Dell Technologies recommends grounding your Z9264F-ON switch and components immediately, properly store the switch and all power cables are disconnected. Fan combinations Fan installation is powered-up ...in your area uses. Use a single type of the factory install based on internal temperature monitoring. When you install two Z9264F-ON switches near the equipment and is grounded. For more information, see Fans. The switch is done as the main disconnect device. ...
... AC or DC PSU with fan airflow from -40°C to 70°C (-40° to 158°F). Switch ground Dell Technologies recommends grounding your Z9264F-ON switch and components immediately, properly store the switch and all power cables are disconnected. Fan combinations Fan installation is powered-up ...in your area uses. Use a single type of the factory install based on internal temperature monitoring. When you install two Z9264F-ON switches near the equipment and is grounded. For more information, see Fans. The switch is done as the main disconnect device. ...