VCF on VxRail Multirack Deployment using BGP EVPN
Page 3
... Data Center...9 1.4 Prerequisites...10 1.5 Supported switches and operating systems...10 1.6 Typographical conventions ...10 1.7 Attachments...10 2 Hardware overview...11 2.1 Dell EMC VxRail E560...11 2.2 Dell EMC PowerSwitch S5248F-ON ...11 2.3 Dell EMC PowerSwitch Z9264F-ON...11 2.4 Dell EMC PowerSwitch S3048-ON...12 3 Network transport ...13 3.1 Layer 3 leaf and spine topology...13 3.2 BGP EVPN VXLAN overview ...13...
... Data Center...9 1.4 Prerequisites...10 1.5 Supported switches and operating systems...10 1.6 Typographical conventions ...10 1.7 Attachments...10 2 Hardware overview...11 2.1 Dell EMC VxRail E560...11 2.2 Dell EMC PowerSwitch S5248F-ON ...11 2.3 Dell EMC PowerSwitch Z9264F-ON...11 2.4 Dell EMC PowerSwitch S3048-ON...12 3 Network transport ...13 3.1 Layer 3 leaf and spine topology...13 3.2 BGP EVPN VXLAN overview ...13...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 11
... 100 GbE, and 2x 200 GbE ports. The example within this document uses two Z9264F-ON switches as leaf switches. 2.3 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch Z9264F-ON The Dell EMC PowerSwitch Z9264F-ON is a 2-RU 100 GbE aggregation/spine switch. The example within this document uses... four S5248F-ON switches in VLT pairs as spine switches. Dell EMC PowerSwitch Z9264F-ON 11 VCF on VxRail Multirack Deployment using supported breakout cables. Each node has 4x 25 GbE ports for this document. The...
... 100 GbE, and 2x 200 GbE ports. The example within this document uses two Z9264F-ON switches as leaf switches. 2.3 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch Z9264F-ON The Dell EMC PowerSwitch Z9264F-ON is a 2-RU 100 GbE aggregation/spine switch. The example within this document uses... four S5248F-ON switches in VLT pairs as spine switches. Dell EMC PowerSwitch Z9264F-ON 11 VCF on VxRail Multirack Deployment using supported breakout cables. Each node has 4x 25 GbE ports for this document. The...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 16
BGP is used to 32 racks. For more leaf-spine network information, see Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with OS10. Two leaf switches are configured as leaf switches in Rack 1 and Rack 2. As administrators ... between leaf switches and spine switches are used as Virtual Link Trunking (VLT) peers at the leaf switches. With Z9264F-ON switches as spines and two leaf switches per rack, this example, two Z9264F-ON switches are used as spines, and four S5248F-ON switches are routed. Equal cost multipath routing (ECMP...
BGP is used to 32 racks. For more leaf-spine network information, see Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with OS10. Two leaf switches are configured as leaf switches in Rack 1 and Rack 2. As administrators ... between leaf switches and spine switches are used as Virtual Link Trunking (VLT) peers at the leaf switches. With Z9264F-ON switches as spines and two leaf switches per rack, this example, two Z9264F-ON switches are used as spines, and four S5248F-ON switches are routed. Equal cost multipath routing (ECMP...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 59
...CPU @ 3.00GHz, 12 cores - 12 16GB DDR4 DIMMs (192GB total) - 2 800GB SAS SSD - 8 1.2TB SAS HDD EF03 1 Dell HBA330 Storage Controller 15.17.09.06 1 Boot Optimized Storage Solution (BOSS) 2.5.13.3016 Controller w/ 2x240GB SATA SSDs 1 Broadcom 57414 NDC ...2x25GbE SFP29 ports 21.40.22.21 - A Validated components A.1 Dell EMC PowerSwitch models Switches and operating system versions Qty Item 4 Dell EMC PowerSwitch S5248F-ON leaf switches 2 Dell EMC PowerSwitch Z9264F-ON spine switches 2 Dell EMC PowerSwitch S3048-ON OOB mgmt switches Version 10.4.3.5 10.4.3.5 10...
...CPU @ 3.00GHz, 12 cores - 12 16GB DDR4 DIMMs (192GB total) - 2 800GB SAS SSD - 8 1.2TB SAS HDD EF03 1 Dell HBA330 Storage Controller 15.17.09.06 1 Boot Optimized Storage Solution (BOSS) 2.5.13.3016 Controller w/ 2x240GB SATA SSDs 1 Broadcom 57414 NDC ...2x25GbE SFP29 ports 21.40.22.21 - A Validated components A.1 Dell EMC PowerSwitch models Switches and operating system versions Qty Item 4 Dell EMC PowerSwitch S5248F-ON leaf switches 2 Dell EMC PowerSwitch Z9264F-ON spine switches 2 Dell EMC PowerSwitch S3048-ON OOB mgmt switches Version 10.4.3.5 10.4.3.5 10...
EMC Networking Virtualization Overlay with BGP EVPN
Page 3
Table of contents Revisions...2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN VXLAN overview ...9 3.1 The VXLAN protocol...10 3.2 BGP EVPN... configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell EMC Networking Virtualization Overlay with BGP EVPN
Table of contents Revisions...2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S4148U-ON ...7 2.3 Dell EMC PowerSwitch Z9264F-ON...8 2.4 Dell EMC PowerSwitch S3048-ON...8 2.5 Dell EMC PowerEdge R740xd server ...8 3 BGP EVPN VXLAN overview ...9 3.1 The VXLAN protocol...10 3.2 BGP EVPN... configuration ...22 6.4 VLAN configuration...24 6.5 Downstream interface configuration ...25 6.6 Upstream interface configuration...26 3 Dell EMC Networking Virtualization Overlay with BGP EVPN
EMC Networking Virtualization Overlay with BGP EVPN
Page 8
... ESXi are used in this deployment, one S3048-ON is a 1-RU switch with BGP EVPN This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is used in each rack for dataintensive applications that brings scalable storage performance and data...
... ESXi are used in this deployment, one S3048-ON is a 1-RU switch with BGP EVPN This guide uses two Z9264F-ONs as spine switches. 2.4 Dell EMC PowerSwitch Z9264F-ON Dell EMC PowerSwitch S3048-ON The Dell EMC PowerSwitch S3048-ON is used in each rack for dataintensive applications that brings scalable storage performance and data...
EMC Networking Virtualization Overlay with BGP EVPN
Page 12
... leaf switches configured for connections to enable the BGP EVPN VXLAN feature. 12 Dell EMC Networking Virtualization Overlay with OS10. Connections within racks from hosts to 32 racks. The leafs in the remaining two racks. With Z9264F-ON switches as border leafs, and hosts may be used as spines and ...two leaf switches per rack, this topology will scale to leaf switches are used to Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with...
... leaf switches configured for connections to enable the BGP EVPN VXLAN feature. 12 Dell EMC Networking Virtualization Overlay with OS10. Connections within racks from hosts to 32 racks. The leafs in the remaining two racks. With Z9264F-ON switches as border leafs, and hosts may be used as spines and ...two leaf switches per rack, this topology will scale to leaf switches are used to Dell EMC PowerSwitch Layer 3 Leaf-Spine Deployment and Best Practices with...
EMC Networking Virtualization Overlay with BGP EVPN
Page 15
Connections from hosts to S5248F-ON leaf switches are 25GbE. Connections from hosts to S4148U-ON leaf switches are 10GbE (not shown). Z9264F-ON Spine 1 Z9264F-ON Spine 2 Stack ID Reset Stack ID Reset S5248F-ON Stack ID Leaf 1A S5248F-ON Leaf 1B Stack ID VLT port channel VLTi GRN =... used as a VLT port channel on leafs are used for the VLTi instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN For this guide. Each leaf has one connection to each spine. 100GbE uplink ports on the two leafs...
Connections from hosts to S5248F-ON leaf switches are 25GbE. Connections from hosts to S4148U-ON leaf switches are 10GbE (not shown). Z9264F-ON Spine 1 Z9264F-ON Spine 2 Stack ID Reset Stack ID Reset S5248F-ON Stack ID Leaf 1A S5248F-ON Leaf 1B Stack ID VLT port channel VLTi GRN =... used as a VLT port channel on leafs are used for the VLTi instead of the QSFP28 ports (1x100GbE interface per switch for the VLTi. 15 Dell EMC Networking Virtualization Overlay with BGP EVPN For this guide. Each leaf has one connection to each spine. 100GbE uplink ports on the two leafs...
EMC Networking Virtualization Overlay with BGP EVPN
Page 16
...is performed much closer to another VNI or Internet destination, their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with BGP EVPN It also eliminates hairpinning and improves link utilization since routing is forwarded according to the indirect ...as the Internet. With the addition of anycast gateways, while also being able to communicate with anycast gateways. 4.3 BGP EVPN VXLAN overlay Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N.1I6....
...is performed much closer to another VNI or Internet destination, their local leaf switches will always be in the range 1-16777215. 16 Dell EMC Networking Virtualization Overlay with BGP EVPN It also eliminates hairpinning and improves link utilization since routing is forwarded according to the indirect ...as the Internet. With the addition of anycast gateways, while also being able to communicate with anycast gateways. 4.3 BGP EVPN VXLAN overlay Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253 17V2N.1I6....
EMC Networking Virtualization Overlay with BGP EVPN
Page 17
...is also used to server iDRACs and switch management ports. S3048-ON OOB management S5248F-ON Leaf 1A S5248F-ON Leaf 1B Z9264F-ON Spine 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 ...38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID Reset Z9264F-ON Spine 2 Stack ID Reset GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B R740xd ...1GbE OOB management link OOB management network connections 17 Dell EMC Networking Virtualization Overlay with BGP EVPN It is an isolated network for OOB management network connections. Dell EMC recommends using at least one S3048-ON switch per ...
...is also used to server iDRACs and switch management ports. S3048-ON OOB management S5248F-ON Leaf 1A S5248F-ON Leaf 1B Z9264F-ON Spine 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 ...38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID Reset Z9264F-ON Spine 2 Stack ID Reset GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B R740xd ...1GbE OOB management link OOB management network connections 17 Dell EMC Networking Virtualization Overlay with BGP EVPN It is an isolated network for OOB management network connections. Dell EMC recommends using at least one S3048-ON switch per ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 31
... Table 1. This example uses RSTP. 5. c. Enable spanning tree protocol as text file attachments to allow jumbo frames. 31 Dell EMC Networking Virtualization Overlay with the configure terminal command. 2. b. Section 1.2 describes how to the two Z9264F-ON spine switches, Spine1 and Spine2. Initial configuration settings 1. 7 7.1 Configure spine switches This chapter details the configuration...
... Table 1. This example uses RSTP. 5. c. Enable spanning tree protocol as text file attachments to allow jumbo frames. 31 Dell EMC Networking Virtualization Overlay with the configure terminal command. 2. b. Section 1.2 describes how to the two Z9264F-ON spine switches, Spine1 and Spine2. Initial configuration settings 1. 7 7.1 Configure spine switches This chapter details the configuration...
EMC Networking Virtualization Overlay with BGP EVPN
Page 58
...the second leaf pair in Rack 2. A packet capture of the successful exchange with a ping request selected is shown in Figure 23. 58 Dell EMC Networking Virtualization Overlay with VMs and IP addresses used in validation examples Rack n Physical L3 connection Physical L2 connection Virtual L2 connection Virtual... between two VMs on R740xd-1 connected to different leaf pairs. 11 Validate connectivity The switches in this example, VM1614-1 pings VM-1614-3. Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 eBGP ECMP eBGP VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253...
...the second leaf pair in Rack 2. A packet capture of the successful exchange with a ping request selected is shown in Figure 23. 58 Dell EMC Networking Virtualization Overlay with VMs and IP addresses used in validation examples Rack n Physical L3 connection Physical L2 connection Virtual L2 connection Virtual... between two VMs on R740xd-1 connected to different leaf pairs. 11 Validate connectivity The switches in this example, VM1614-1 pings VM-1614-3. Z9264F-1 Z9264F-2 VNI 1615 VRF tenant1 VNI 1614 VNI 1616 eBGP ECMP eBGP VTEP 10.222.222.1 S5248F-1a VLTi S5248F-1b 172.16.14.253...
EMC Networking Virtualization Overlay with BGP EVPN
Page 65
... Deployment and Best Practices with OS10 Manuals and documentation for Dell EMC PowerSwitch S3048-ON Manuals and documentation for Dell EMC PowerSwitch S4148U-ON Manuals and documentation for Dell EMC PowerSwitch S5248F-ON Manuals and documentation for Dell EMC PowerSwitch Z9264F-ON Manuals and documentation for Dell EMC PowerEdge R740xd VMware product manuals and technical guides...
... Deployment and Best Practices with OS10 Manuals and documentation for Dell EMC PowerSwitch S3048-ON Manuals and documentation for Dell EMC PowerSwitch S4148U-ON Manuals and documentation for Dell EMC PowerSwitch S5248F-ON Manuals and documentation for Dell EMC PowerSwitch Z9264F-ON Manuals and documentation for Dell EMC PowerEdge R740xd VMware product manuals and technical guides...
Open Networking Hardware Diagnostic Guide December 2021
Page 25
... 0x50 ..... For example, to set the verbose level to upgrade the CPLD. NOTE: For newer platforms, such as the S5200-ON Series and Z9264F-ON, cpldupgradetool is being used to 2, set the verbose level. 1. The value is 0/zero. + Checking SFP+ 32 + Checking SFP+...23, Syntax: cpldupgradetool Print the Help-Text:= cpldupgradetool --h cpldupgradetool -h Print the CPLD versions:= cpldupgradetool --cpldver cpldupgradetool -c (or) (or) Dell EMC DAIG-OS tools 25 export VERB_LEVEL= To clear the environment variable, use the environment variable method to 1. Tests There are no defined ...
... 0x50 ..... For example, to set the verbose level to upgrade the CPLD. NOTE: For newer platforms, such as the S5200-ON Series and Z9264F-ON, cpldupgradetool is being used to 2, set the verbose level. 1. The value is 0/zero. + Checking SFP+ 32 + Checking SFP+...23, Syntax: cpldupgradetool Print the Help-Text:= cpldupgradetool --h cpldupgradetool -h Print the CPLD versions:= cpldupgradetool --cpldver cpldupgradetool -c (or) (or) Dell EMC DAIG-OS tools 25 export VERB_LEVEL= To clear the environment variable, use the environment variable method to 1. Tests There are no defined ...
Technologies Rail Bracket and Tray Guide June 2022
Page 4
...Standard ReadyRail (1) Rack height 1U Part number N243X SKU 770-BBGY, 770-BDRL Additional information Standard Dell ReadyRail mounting slides. A5. For a 434 mm (17.08 in )-rack span. Standard ... to 31.2 in ) wide switch. 1U-R-RR Reversible ReadyRail 1U J9CKF 770-BCFQ Standard Dell ReadyRail where the rails can be used with the standard B9 ReadyRail but with a 434 ... from either front or rear of the rack) four-post racks. 1 Rails The following sections describe Dell EMC Networking rack rails. Table 1. Permits an extra 9" face offset to 820.4 mm). 1U-S52S41...
...Standard ReadyRail (1) Rack height 1U Part number N243X SKU 770-BBGY, 770-BDRL Additional information Standard Dell ReadyRail mounting slides. A5. For a 434 mm (17.08 in )-rack span. Standard ... to 31.2 in ) wide switch. 1U-R-RR Reversible ReadyRail 1U J9CKF 770-BCFQ Standard Dell ReadyRail where the rails can be used with the standard B9 ReadyRail but with a 434 ... from either front or rear of the rack) four-post racks. 1 Rails The following sections describe Dell EMC Networking rack rails. Table 1. Permits an extra 9" face offset to 820.4 mm). 1U-S52S41...
Technologies Rail Bracket and Tray Guide June 2022
Page 27
...quick reference guide of abbreviations, products, and rails, brackets, or trays by abbreviation and Dell part number Abbreviation Product Part Number 1RU-S-RR 1RU Standard ReadyRail N243X 1RU-R-RR 1RU ... rails 19T1K 1U-EMC-3-RR 1RU EMC Gen3 bezel rails V45CP 2U-EMC-Z92xx-RR 2RU Z9264F-ON rails for EMC 2RU Gen3.14/Gen3 bezel 150-042-005 1RU-DN-RR 1RU ... 1U-2P-BR Two-post brackets 5PX47 WM-XSer-NSer-BR X- Rails, brackets, or trays listed by Dell Technologies part number. and N-Series wall-mount brackets 9JM64 1U-NSer-BR N-Series rack-mount brackets HCDHT 1U...
...quick reference guide of abbreviations, products, and rails, brackets, or trays by abbreviation and Dell part number Abbreviation Product Part Number 1RU-S-RR 1RU Standard ReadyRail N243X 1RU-R-RR 1RU ... rails 19T1K 1U-EMC-3-RR 1RU EMC Gen3 bezel rails V45CP 2U-EMC-Z92xx-RR 2RU Z9264F-ON rails for EMC 2RU Gen3.14/Gen3 bezel 150-042-005 1RU-DN-RR 1RU ... 1U-2P-BR Two-post brackets 5PX47 WM-XSer-NSer-BR X- Rails, brackets, or trays listed by Dell Technologies part number. and N-Series wall-mount brackets 9JM64 1U-NSer-BR N-Series rack-mount brackets HCDHT 1U...
EMC PowerSwitch Installation Guide March 2022
Page 1
Dell EMC PowerSwitch Z9264F-ON Installation Guide March 2022 March 2022 Rev. A09
Dell EMC PowerSwitch Z9264F-ON Installation Guide March 2022 March 2022 Rev. A09
EMC PowerSwitch Installation Guide March 2022
Page 5
... exposure to a power source. Topics: • Related documents Related documents For more information about the Z9264F-ON switch, see the following documents: ● Dell EMC SmartFabric User Guide ● Dell EMC SmartFabric Release Notes ● Dell EMC PowerSwitch Z9264F-ON Set-up this guide 5 Do not stare into open apertures. About this equipment. Figure 1. Class...
... exposure to a power source. Topics: • Related documents Related documents For more information about the Z9264F-ON switch, see the following documents: ● Dell EMC SmartFabric User Guide ● Dell EMC SmartFabric Release Notes ● Dell EMC PowerSwitch Z9264F-ON Set-up this guide 5 Do not stare into open apertures. About this equipment. Figure 1. Class...
EMC PowerSwitch Installation Guide March 2022
Page 6
...switch. The QSFP28 ports support the following sections describe the Dell EMC Z9264F-ON switch: Topics: • Introduction • Features • Physical dimensions • LED display • Prerequisites • Z9264F-ON switch configurations • Luggage tag Introduction The Z9264F-ON switch is a two rack unit (RU), full... ● 128 x 1G-via breakout ● 64 x 40G-native 40G and 128 x 40G via breakout Figure 2. In addition, the Z9264F-ON supports two SFP+ ports at 1/10 Mbps with 10 GbE multi-mode and single-mode options. The switch includes two hot-swappable AC ...
...switch. The QSFP28 ports support the following sections describe the Dell EMC Z9264F-ON switch: Topics: • Introduction • Features • Physical dimensions • LED display • Prerequisites • Z9264F-ON switch configurations • Luggage tag Introduction The Z9264F-ON switch is a two rack unit (RU), full... ● 128 x 1G-via breakout ● 64 x 40G-native 40G and 128 x 40G via breakout Figure 2. In addition, the Z9264F-ON supports two SFP+ ports at 1/10 Mbps with 10 GbE multi-mode and single-mode options. The switch includes two hot-swappable AC ...
EMC PowerSwitch Installation Guide March 2022
Page 13
...or DC switches, follow the requirements of clearance around the exhaust vents. CAUTION: Always disconnect the power cable before you install two Z9264F-ON switches near the equipment and is grounded. The switch has multiple power cables. Site preparations 13 The ground path must remain ... power cable is done as the main disconnect device. Ensure that the socketoutlet is located and installed near each PSU. Switch ground Dell Technologies recommends grounding your area uses. NOTE: The software controls the module power. Rack mounting When you prepare your equipment rack, ...
...or DC switches, follow the requirements of clearance around the exhaust vents. CAUTION: Always disconnect the power cable before you install two Z9264F-ON switches near the equipment and is grounded. The switch has multiple power cables. Site preparations 13 The ground path must remain ... power cable is done as the main disconnect device. Ensure that the socketoutlet is located and installed near each PSU. Switch ground Dell Technologies recommends grounding your area uses. NOTE: The software controls the module power. Rack mounting When you prepare your equipment rack, ...