VCF on VxRail Multirack Deployment using BGP EVPN
Page 6
...in Figure 2. 6 VCF on Dell EMC VxRail, part of Dell Technologies Cloud Platform, provides the simplest path to disrupting the fundamental economics of quality, consistency, and support. Spine 1 Z9264-ON Spine 2 Z9264-ON Leaf 1A S5248F-ON Leaf 1B S5248F-ON Layer 3 IP fabric VXLAN...Defined Data Center (SDDC), the Layer 2 or Layer 3 transport services provide the switching fabric. Dell EMC is available only in both the HCI infrastructure layer and cloud software stack in separate racks 1.1 VMware Cloud Foundation on VxRail VMware Cloud Foundation on VxRail Multirack Deployment using...
...in Figure 2. 6 VCF on Dell EMC VxRail, part of Dell Technologies Cloud Platform, provides the simplest path to disrupting the fundamental economics of quality, consistency, and support. Spine 1 Z9264-ON Spine 2 Z9264-ON Leaf 1A S5248F-ON Leaf 1B S5248F-ON Layer 3 IP fabric VXLAN...Defined Data Center (SDDC), the Layer 2 or Layer 3 transport services provide the switching fabric. Dell EMC is available only in both the HCI infrastructure layer and cloud software stack in separate racks 1.1 VMware Cloud Foundation on VxRail VMware Cloud Foundation on VxRail Multirack Deployment using...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 7
...the SDDC Manager management experience, VxRail Manager is what gives customers a truly unique turnkey hybrid cloud experience not available on Dell EMC VxRail provides a consistent hybrid cloud unifying customer public and private cloud platforms under a common operating environment and management ...service support as multi-cluster workload domains. Customers can operate both platforms. This consistency allows for the entire cloud infrastructure stack including hardware. VMware Cloud Foundation on VxRail (VCF on VxRail) high-level architecture To learn more about VMware Cloud ...
...the SDDC Manager management experience, VxRail Manager is what gives customers a truly unique turnkey hybrid cloud experience not available on Dell EMC VxRail provides a consistent hybrid cloud unifying customer public and private cloud platforms under a common operating environment and management ...service support as multi-cluster workload domains. Customers can operate both platforms. This consistency allows for the entire cloud infrastructure stack including hardware. VMware Cloud Foundation on VxRail (VCF on VxRail) high-level architecture To learn more about VMware Cloud ...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 19
... attachments. 19 VCF on VxRail Multirack Deployment using BGP EVPN Z9264F-ON sfo01-spine01 Stack ID Reset Z9264F-ON sfo01-spine02 Stack ID Reset Rack 1 Rack 2 S5248F-ON Stack ID sfo01-leaf01a S5248F-ON Stack ID sfo01-leaf01b S5248F-ON Stack ID sfo01-leaf02a S5248F-ON Stack ID sfo01-leaf02b Physical switch topology Note: All switch configuration commands are used...
... attachments. 19 VCF on VxRail Multirack Deployment using BGP EVPN Z9264F-ON sfo01-spine01 Stack ID Reset Z9264F-ON sfo01-spine02 Stack ID Reset Rack 1 Rack 2 S5248F-ON Stack ID sfo01-leaf01a S5248F-ON Stack ID sfo01-leaf01b S5248F-ON Stack ID sfo01-leaf02a S5248F-ON Stack ID sfo01-leaf02b Physical switch topology Note: All switch configuration commands are used...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 21
... uplink traffic. This connection is achieved by providing redundant leaf switches at the ToR. The S5248F-ON leaf switches are configured using two QSFP28-DD 200 GbE direct-access cables (DAC) ... 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID S5248F-ON Stack ID sfo01-leaf01b GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B GRN=10G ...ACT/ LNK A GRN=10G ACT/ LNK B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B VxRail E node sfo01w02vxrail01 VxRail E node sfo01w02vxrail03 Rack 1 Dell...
... uplink traffic. This connection is achieved by providing redundant leaf switches at the ToR. The S5248F-ON leaf switches are configured using two QSFP28-DD 200 GbE direct-access cables (DAC) ... 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID S5248F-ON Stack ID sfo01-leaf01b GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B GRN=10G ...ACT/ LNK A GRN=10G ACT/ LNK B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B VxRail E node sfo01w02vxrail01 VxRail E node sfo01w02vxrail03 Rack 1 Dell...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 1
May 2019 Dell EMC Configuration and Deployment Guide Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Abstract This guide provides Microsoft Azure Stack HCI networking deployment examples using Dell EMC Storage Spaces Direct Ready Nodes and Dell EMC Networking switches.
May 2019 Dell EMC Configuration and Deployment Guide Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Abstract This guide provides Microsoft Azure Stack HCI networking deployment examples using Dell EMC Storage Spaces Direct Ready Nodes and Dell EMC Networking switches.
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 2
... the information in this publication requires an applicable software license. © 2019 Dell Inc. All Rights Reserved. Other trademarks may be trademarks of Dell Inc. Use, copying, and distribution of any kind with respect to the information in this publication is provided "as...Appendix B Initial release The information in this publication, and specifically disclaims implied warranties of merchantability or fitness for Microsoft Azure Stack HCI Networking Guide makes no representations or warranties of any software described in this document is accurate as is subject to change ...
... the information in this publication requires an applicable software license. © 2019 Dell Inc. All Rights Reserved. Other trademarks may be trademarks of Dell Inc. Use, copying, and distribution of any kind with respect to the information in this publication is provided "as...Appendix B Initial release The information in this publication, and specifically disclaims implied warranties of merchantability or fitness for Microsoft Azure Stack HCI Networking Guide makes no representations or warranties of any software described in this document is accurate as is subject to change ...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 3
Table of contents Revisions...2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC Networking S5248F-ON ...7 2.2 Dell EMC Networking S3048-ON ...7 2.3 Dell EMC S2D Ready Nodes...7 2.4 Management system ...8 2.5 Supported Dell EMC Networking switches...8 3 Topology...9 3.1 Connections to leaf switches ...10 3.2 Connections to OOB management switch ...11 4 ... VLANs and VRRP...26 7.4 Configure storage interfaces ...27 7.5 Configure in-band management interfaces ...28 3 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Table of contents Revisions...2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC Networking S5248F-ON ...7 2.2 Dell EMC Networking S3048-ON ...7 2.3 Dell EMC S2D Ready Nodes...7 2.4 Management system ...8 2.5 Supported Dell EMC Networking switches...8 3 Topology...9 3.1 Connections to leaf switches ...10 3.2 Connections to OOB management switch ...11 4 ... VLANs and VRRP...26 7.4 Configure storage interfaces ...27 7.5 Configure in-band management interfaces ...28 3 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 4
... Nodes...47 10 PowerShell validation commands and output ...48 10.1 Get-NetAdapter...48 10.2 Get-VMSwitch...48 10.3 Get-NetIPAddress ...49 10.4 Get-NetRoute...49 4 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
... Nodes...47 10 PowerShell validation commands and output ...48 10.1 Get-NetAdapter...48 10.2 Get-VMSwitch...48 10.3 Get-NetIPAddress ...49 10.4 Get-NetRoute...49 4 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 5
... DCB validation commands ...55 11.1 Show queuing statistics ...55 11.2 Show interface priority flow control...55 A Validated components...56 A.1 Dell EMC Networking Switches ...56 A.2 S2D Ready Nodes ...56 A.3 Management System...57 A.4 Dell EMC Networking Optics and Cables ...58 A.5 S2D Ready Node and management system software 58 B Port-groups...59 C Technical resources ...61...
... DCB validation commands ...55 11.1 Show queuing statistics ...55 11.2 Show interface priority flow control...55 A Validated components...56 A.1 Dell EMC Networking Switches ...56 A.2 S2D Ready Nodes ...56 A.3 Management System...57 A.4 Dell EMC Networking Optics and Cables ...58 A.5 S2D Ready Node and management system software 58 B Port-groups...59 C Technical resources ...61...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 6
...-standard servers to create highly available softwaredefined storage. The examples in the left pane halfway down the page, then click the icon. 6 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide S2D is included with Microsoft Windows Server 2019 Datacenter and Windows Server 2016 Datacenter editions. For more file attachments. To...
...-standard servers to create highly available softwaredefined storage. The examples in the left pane halfway down the page, then click the icon. 6 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide S2D is included with Microsoft Windows Server 2019 Datacenter and Windows Server 2016 Datacenter editions. For more file attachments. To...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 7
...this guide. This guide uses two S5248F-ONs as leaf switches for out-of HDD and SSD), All-Flash (SSD), and NVMe storage configurations. See the Dell EMC Microsoft Storage Spaces Direct Ready Nodes page for Microsoft Azure Stack HCI Networking Guide This guide uses one...leaf switches for this document. PowerEdge R740xd S2D Ready Node 7 Dell EMC Solutions for detailed configuration options. Section 2.5 contains a list of hardware and software validated for S2D. 2.2 Dell EMC Networking S5248F-ON Dell EMC Networking S3048-ON The Dell EMC Networking S3048-ON is a 1-Rack Unit (RU), ...
...this guide. This guide uses two S5248F-ONs as leaf switches for out-of HDD and SSD), All-Flash (SSD), and NVMe storage configurations. See the Dell EMC Microsoft Storage Spaces Direct Ready Nodes page for Microsoft Azure Stack HCI Networking Guide This guide uses one...leaf switches for this document. PowerEdge R740xd S2D Ready Node 7 Dell EMC Solutions for detailed configuration options. Section 2.5 contains a list of hardware and software validated for S2D. 2.2 Dell EMC Networking S5248F-ON Dell EMC Networking S3048-ON The Dell EMC Networking S3048-ON is a 1-Rack Unit (RU), ...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 8
...cluster. For switch configuration examples using OS9, see Support Matrix for Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Dell EMC Solutions for Microsoft Azure Stack HCI. 8 Dell EMC Solutions for Microsoft Azure Stack HCI. Optionally, existing AD and DNS infrastructure may be used ... see Sample Switch Configurations - In this deployment guide use two Dell EMC Networking S5248F-ON switches running OS10 Enterprise Edition (OS10EE) for storage, in-band management, and VM traffic. One Dell EMC Networking S3048-ON switch is used for the examples provided...
...cluster. For switch configuration examples using OS9, see Support Matrix for Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Dell EMC Solutions for Microsoft Azure Stack HCI. 8 Dell EMC Solutions for Microsoft Azure Stack HCI. Optionally, existing AD and DNS infrastructure may be used ... see Sample Switch Configurations - In this deployment guide use two Dell EMC Networking S5248F-ON switches running OS10 Enterprise Edition (OS10EE) for storage, in-band management, and VM traffic. One Dell EMC Networking S3048-ON switch is used for the examples provided...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 9
... 16 nodes. The devices are cabled as shown in a single rack along with two leaf switches and one OOB management switch. S3048-ON OOB Mgmt S5248F-ON Leaf 1A 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26...32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID S5248F-ON Leaf 1B R640 Management System R740xd S2D Ready Node 1 GRN =10G ACT/ LNK A GRN =10G ACT/ LNK... 10GbE In-band mgmt and VM traffic 2x100GbE VLTi (QSFP28-DD DAC) 1GbE OOB mgmt All cabling for the S2D environment 9 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
... 16 nodes. The devices are cabled as shown in a single rack along with two leaf switches and one OOB management switch. S3048-ON OOB Mgmt S5248F-ON Leaf 1A 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26...32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID S5248F-ON Leaf 1B R640 Management System R740xd S2D Ready Node 1 GRN =10G ACT/ LNK A GRN =10G ACT/ LNK... 10GbE In-band mgmt and VM traffic 2x100GbE VLTi (QSFP28-DD DAC) 1GbE OOB mgmt All cabling for the S2D environment 9 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 10
...-converged network configuration shown in Figure 6. Inband host management and VM traffic share two 10GbE connections from each S5248F-ON. 10 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide S5248F-ON Stack ID Leaf 1A S5248F-ON Stack ID Leaf 1B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B R740xd S2D Ready Node 25GbE Storage...
...-converged network configuration shown in Figure 6. Inband host management and VM traffic share two 10GbE connections from each S5248F-ON. 10 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide S5248F-ON Stack ID Leaf 1A S5248F-ON Stack ID Leaf 1B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B R740xd S2D Ready Node 25GbE Storage...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 11
...is enabled. Optionally, for small deployments, the dedicated iDRAC port on each iDRAC connection. The S5248F-ON ports used for uplinks to the S3048-ON. Note: When running OS10EE, the S3048-... Each S3048-ON has forty-eight 1GbE Base-T ports for Microsoft Azure Stack HCI Networking Guide By default, all ports are available on port-groups. 11 Dell EMC Solutions for connections to 10GbE with its factory default configuration. Use ...34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 S5248F-ON Leaf 1A S5248F-ON Leaf 1B GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B R740xd S2D Ready ...
...is enabled. Optionally, for small deployments, the dedicated iDRAC port on each iDRAC connection. The S5248F-ON ports used for uplinks to the S3048-ON. Note: When running OS10EE, the S3048-... Each S3048-ON has forty-eight 1GbE Base-T ports for Microsoft Azure Stack HCI Networking Guide By default, all ports are available on port-groups. 11 Dell EMC Solutions for connections to 10GbE with its factory default configuration. Use ...34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 S5248F-ON Leaf 1A S5248F-ON Leaf 1B GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B R740xd S2D Ready ...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 12
... is used to prevent frame loss due to guarantee a minimum percentage of available bandwidth may be reserved for Microsoft Azure Stack HCI Networking Guide If Mellanox ConnectX-4 adapters are in use. 12 Dell EMC Solutions for storage traffic with iWARP. iWARP is defined by performing direct memory transfers between traffic classes. Priority...
... is used to prevent frame loss due to guarantee a minimum percentage of available bandwidth may be reserved for Microsoft Azure Stack HCI Networking Guide If Mellanox ConnectX-4 adapters are in use. 12 Dell EMC Solutions for storage traffic with iWARP. iWARP is defined by performing direct memory transfers between traffic classes. Priority...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 13
... 1611 1613 1614 S2D Ready Node 2 storage-02.dell.lab 1611 1613 1614 S2D Ready Node 3 storage-03.dell.lab 1611 1613 1614 S2D Ready Node 4 storage-04.dell.lab 1611 1613 1614 Management system mgmt-01.dell.lab 1611 S2D Cluster cluster-01.dell.lab 1611 IP address 172.16.11.1 172.16.13....16.11.3 172.16.13.3 172.16.14.3 172.16.11.4 172.16.13.4 172.16.14.4 172.16.11.5 172.16.11.250 13 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
... 1611 1613 1614 S2D Ready Node 2 storage-02.dell.lab 1611 1613 1614 S2D Ready Node 3 storage-03.dell.lab 1611 1613 1614 S2D Ready Node 4 storage-04.dell.lab 1611 1613 1614 Management system mgmt-01.dell.lab 1611 S2D Cluster cluster-01.dell.lab 1611 IP address 172.16.11.1 172.16.13....16.11.3 172.16.13.3 172.16.14.3 172.16.11.4 172.16.13.4 172.16.14.4 172.16.11.5 172.16.11.250 13 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 14
... to the server's iDRAC in the list to the iDRAC. 5 5.1 Configure network adapters Note: Exact iDRAC steps in the device list 14 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide See the PowerEdge server documentation for steps to connect to launch the Main Configuration Page for the port. Device Settings...
... to the server's iDRAC in the list to the iDRAC. 5 5.1 Configure network adapters Note: Exact iDRAC steps in the device list 14 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide See the PowerEdge server documentation for steps to connect to launch the Main Configuration Page for the port. Device Settings...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 15
...Mellanox ConnectX-4 Lx adapters use their default System Setup configuration for iWARP with or without DCB. QL41262 adapter Port 1 menu item 15 Dell EMC Solutions for each network adapter port listed on the first QLogic QL41262 port to the server's iDRAC in System Setup from the Next...menu, select BIOS Setup. 3. 5.2 6. On the Main Configuration Page for the port. Click Yes to Section 5.3. Repeat steps 5-8 for Microsoft Azure Stack HCI Networking Guide If Mellanox ConnectX-4 Lx adapters are used, skip to save changes. Click on the Device Settings page. 10. Connect to launch the...
...Mellanox ConnectX-4 Lx adapters use their default System Setup configuration for iWARP with or without DCB. QL41262 adapter Port 1 menu item 15 Dell EMC Solutions for each network adapter port listed on the first QLogic QL41262 port to the server's iDRAC in System Setup from the Next...menu, select BIOS Setup. 3. 5.2 6. On the Main Configuration Page for the port. Click Yes to Section 5.3. Repeat steps 5-8 for Microsoft Azure Stack HCI Networking Guide If Mellanox ConnectX-4 Lx adapters are used, skip to save changes. Click on the Device Settings page. 10. Connect to launch the...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 16
Virtualization Mode set to None. Click the Back button to return to None 8. NIC Configuration menu item 16 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Device Level Configuration menu item 7. On the Main Configuration Page, click Device Level Configuration. On the Main Configuration Page, click NIC Configuration. Verify Virtualization Mode is set to the Main Configuration Page. 9. 6.
Virtualization Mode set to None. Click the Back button to return to None 8. NIC Configuration menu item 16 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide Device Level Configuration menu item 7. On the Main Configuration Page, click Device Level Configuration. On the Main Configuration Page, click NIC Configuration. Verify Virtualization Mode is set to the Main Configuration Page. 9. 6.