EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 3
... conventions ...6 1.3 Attachments...6 2 Hardware overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S3048-ON...7 2.3 Dell EMC VxRail 14G nodes ...7 2.3.1 Dell EMC VxRail P Series node ...8 2.3.2 Dell EMC VxRail V Series node ...8 2.3.3 Dell EMC VxRail S Series node ...8 2.3.4 Dell EMC VxRail E Series node ...8 2.3.5 VxRail node network...Switch configuration prerequisites...19 6.1 Check switch OS version...19 6.2 Verify license installation ...19 6.3 Factory default configuration ...20 7 Configure switches ...21 7.1 Dual switch with VLT ...21 7.1.1 General settings...
... conventions ...6 1.3 Attachments...6 2 Hardware overview...7 2.1 Dell EMC PowerSwitch S5248F-ON ...7 2.2 Dell EMC PowerSwitch S3048-ON...7 2.3 Dell EMC VxRail 14G nodes ...7 2.3.1 Dell EMC VxRail P Series node ...8 2.3.2 Dell EMC VxRail V Series node ...8 2.3.3 Dell EMC VxRail S Series node ...8 2.3.4 Dell EMC VxRail E Series node ...8 2.3.5 VxRail node network...Switch configuration prerequisites...19 6.1 Check switch OS version...19 6.2 Verify license installation ...19 6.3 Factory default configuration ...20 7 Configure switches ...21 7.1 Dual switch with VLT ...21 7.1.1 General settings...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 14
... as uplinks to hardware management ports on each S3048-ON for use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for illustration purposes only. 1GbE BASE-T ports on each S3048-ON are connected downstream to the OOB management network core. ...device. For OOB Management network connections, one S3048-ON switch is an isolated network for remote management of -band (OOB) Management network is installed in other racks are for VxRail 4.7 Four 10GbE SFP+ ports are covered in Rack 1. Note: The OOB Management network is also commonly used...
... as uplinks to hardware management ports on each S3048-ON for use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for illustration purposes only. 1GbE BASE-T ports on each S3048-ON are connected downstream to the OOB management network core. ...device. For OOB Management network connections, one S3048-ON switch is an isolated network for remote management of -band (OOB) Management network is installed in other racks are for VxRail 4.7 Four 10GbE SFP+ ports are covered in Rack 1. Note: The OOB Management network is also commonly used...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 19
... OS10 was factory installed, a perpetual license is installed, licenses purchased from Dell EMC are provided in the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. The...Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Installation instructions are available for VxRail deployments. All Rights Reserved. Dell EMC recommends upgrading to the latest release available on Dell Digital Locker. OS10# show version Dell EMC Networking OS10-Enterprise Copyright (c) 1999-2019 by Dell Inc. 6 Switch configuration prerequisites 6.1 6.2 Check switch OS version S5248F...
... OS10 was factory installed, a perpetual license is installed, licenses purchased from Dell EMC are provided in the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. The...Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Installation instructions are available for VxRail deployments. All Rights Reserved. Dell EMC recommends upgrading to the latest release available on Dell Digital Locker. OS10# show version Dell EMC Networking OS10-Enterprise Copyright (c) 1999-2019 by Dell Inc. 6 Switch configuration prerequisites 6.1 6.2 Check switch OS version S5248F...
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Page 42
... initial VxRail Manager IP address is either directly plugged into a leaf switch or able to its new address on S5248F-ON port-group configuration. 42 Dell EMC SmartFabric OS10 Switch Configuration Guide for information on the External Management network. See Appendix B for VxRail 4.7 Figure 16 shows a single connection from...network adapter, one for the VxRail user interface is 172.16.11.102/24 per the planning data in sequence if required. During installation, the laptop or jump box must be able to a 10GbE NIC on the network. The IP addresses configured on the laptop ...
... initial VxRail Manager IP address is either directly plugged into a leaf switch or able to its new address on S5248F-ON port-group configuration. 42 Dell EMC SmartFabric OS10 Switch Configuration Guide for information on the External Management network. See Appendix B for VxRail 4.7 Figure 16 shows a single connection from...network adapter, one for the VxRail user interface is 172.16.11.102/24 per the planning data in sequence if required. During installation, the laptop or jump box must be able to a 10GbE NIC on the network. The IP addresses configured on the laptop ...
VCF on VxRail Multirack Deployment using BGP EVPN
Page 24
... 10.4.3.0. OS Version: 10.4.3.5 Build Version: 10.4.3.5 Note: For information about installing and upgrading OS10EE, see the Dell EMC Networking OS10 Enterprise Edition Quick Start Guide. 5.6 Verify license installation Run the show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON Hardware Version : A01 Platform Name : x86_64-dellemc_s5248f_c3538-r0 PPID : CN046MRJCES0089K0004 Service Tag...
... 10.4.3.0. OS Version: 10.4.3.5 Build Version: 10.4.3.5 Note: For information about installing and upgrading OS10EE, see the Dell EMC Networking OS10 Enterprise Edition Quick Start Guide. 5.6 Verify license installation Run the show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON Hardware Version : A01 Platform Name : x86_64-dellemc_s5248f_c3538-r0 PPID : CN046MRJCES0089K0004 Service Tag...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 3
......2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC Networking S5248F-ON ...7 2.2 Dell EMC Networking S3048-ON ...7 2.3 Dell EMC S2D Ready Nodes...7 2.4 Management system ...8 2.5 Supported Dell EMC Networking switches...8 3 Topology...9 3.1 Connections to leaf switches ...10 3.2... adapter settings 19 6 Leaf switch configuration prerequisites ...22 6.1 Check switch OS version...22 6.2 Verify license installation ...22 6.3 Factory default configuration ...23 7 Configure leaf switches ...24 7.1 General settings...25 7.2 Configure port...
......2 1 Introduction...6 1.1 Typographical conventions...6 1.2 Attachments...6 2 Hardware Overview...7 2.1 Dell EMC Networking S5248F-ON ...7 2.2 Dell EMC Networking S3048-ON ...7 2.3 Dell EMC S2D Ready Nodes...7 2.4 Management system ...8 2.5 Supported Dell EMC Networking switches...8 3 Topology...9 3.1 Connections to leaf switches ...10 3.2... adapter settings 19 6 Leaf switch configuration prerequisites ...22 6.1 Check switch OS version...22 6.2 Verify license installation ...22 6.3 Factory default configuration ...23 7 Configure leaf switches ...24 7.1 General settings...25 7.2 Configure port...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 4
......35 8.2.3 show vlt domain_id mismatch...36 9 S2D Ready Node configuration and deployment ...37 9.1 Initial state...37 9.2 Ensure DCB is disabled on Intel X710 adapters 38 9.3 Install roles and features ...39 9.4 Configure the in-band management and VM network 39 9.5 Configure storage networks...40 9.5.1 Configure storage VLANs...40 9.5.2 Configure storage IP addresses... Nodes...47 10 PowerShell validation commands and output ...48 10.1 Get-NetAdapter...48 10.2 Get-VMSwitch...48 10.3 Get-NetIPAddress ...49 10.4 Get-NetRoute...49 4 Dell EMC Solutions for Microsoft Azure Stack HCI Networking...
......35 8.2.3 show vlt domain_id mismatch...36 9 S2D Ready Node configuration and deployment ...37 9.1 Initial state...37 9.2 Ensure DCB is disabled on Intel X710 adapters 38 9.3 Install roles and features ...39 9.4 Configure the in-band management and VM network 39 9.5 Configure storage networks...40 9.5.1 Configure storage VLANs...40 9.5.2 Configure storage IP addresses... Nodes...47 10 PowerShell validation commands and output ...48 10.1 Get-NetAdapter...48 10.2 Get-VMSwitch...48 10.3 Get-NetIPAddress ...49 10.4 Get-NetRoute...49 4 Dell EMC Solutions for Microsoft Azure Stack HCI Networking...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 9
In this deployment, four S2D Ready Nodes are limited to 16 nodes. S3048-ON OOB Mgmt S5248F-ON Leaf 1A 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 ... 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID S5248F-ON Leaf 1B R640 Management System R740xd S2D Ready Node 1 GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B Stack...VLTi (QSFP28-DD DAC) 1GbE OOB mgmt All cabling for the S2D environment 9 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide 3 Topology S2D clusters are installed in Figure 5. The devices are cabled as shown in a single rack along with...
In this deployment, four S2D Ready Nodes are limited to 16 nodes. S3048-ON OOB Mgmt S5248F-ON Leaf 1A 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 ... 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 Stack ID S5248F-ON Leaf 1B R640 Management System R740xd S2D Ready Node 1 GRN =10G ACT/ LNK A GRN =10G ACT/ LNK B Stack...VLTi (QSFP28-DD DAC) 1GbE OOB mgmt All cabling for the S2D environment 9 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide 3 Topology S2D clusters are installed in Figure 5. The devices are cabled as shown in a single rack along with...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 12
...Mellanox ConnectX-4 Lx is a dual port 25GbE network adapter that supports RoCEv2. DCB is not required for all other traffic. However, Dell EMC recommends using DCB if NVMe drives are used, DCB is not required. If QLogic QL41262 adapters with RoCEv2. Internet Wide-area ...due to buffer overflows for Microsoft Azure Stack HCI Networking Guide Note: With ETS, 100% of RDMA supported with Priority Flow Control (PFC) and Enhanced Transmission Selection (ETS). 4 Configuration planning The network adapters installed in the Ready Nodes determine which Remote Direct Memory Access...
...Mellanox ConnectX-4 Lx is a dual port 25GbE network adapter that supports RoCEv2. DCB is not required for all other traffic. However, Dell EMC recommends using DCB if NVMe drives are used, DCB is not required. If QLogic QL41262 adapters with RoCEv2. Internet Wide-area ...due to buffer overflows for Microsoft Azure Stack HCI Networking Guide Note: With ETS, 100% of RDMA supported with Priority Flow Control (PFC) and Enhanced Transmission Selection (ETS). 4 Configuration planning The network adapters installed in the Ready Nodes determine which Remote Direct Memory Access...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 22
...OS10 Enterprise Edition User Guide Release 10.4.2.0. Installation instructions are available for download on installing and upgrading OS10EE, see the Dell EMC Networking OS10 Enterprise Edition Quick Start Guide. All Rights Reserved. If an evaluation license is already on Dell Digital Locker (account ...release available on the switch. 22 Dell EMC Solutions for minimum supported OS10EE versions by Dell Inc. Verify license installation Run the command show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON Hardware Version: A01 Platform Name ...
...OS10 Enterprise Edition User Guide Release 10.4.2.0. Installation instructions are available for download on installing and upgrading OS10EE, see the Dell EMC Networking OS10 Enterprise Edition Quick Start Guide. All Rights Reserved. If an evaluation license is already on Dell Digital Locker (account ...release available on the switch. 22 Dell EMC Solutions for minimum supported OS10EE versions by Dell Inc. Verify license installation Run the command show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON Hardware Version: A01 Platform Name ...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 37
Configure DCB on adapters installed in the system. Note: This chapter ends with a user-friendly hostname. If DCB is used , see the Microsoft Storage Spaces Direct documentation, the Microsoft Windows Server 2016 and 2019 RDMA Deployment Guide, and the Dell EMC Solutions for the associated port. See ... validated for this guide are joined to -date and are at the following state: • The same version of Windows Server Datacenter is not used, follow the steps in Section 9.6. 37 Dell EMC Solutions for Microsoft Azure Stack HCI. If DCB is installed on the management...
Configure DCB on adapters installed in the system. Note: This chapter ends with a user-friendly hostname. If DCB is used , see the Microsoft Storage Spaces Direct documentation, the Microsoft Windows Server 2016 and 2019 RDMA Deployment Guide, and the Dell EMC Solutions for the associated port. See ... validated for this guide are joined to -date and are at the following state: • The same version of Windows Server Datacenter is not used, follow the steps in Section 9.6. 37 Dell EMC Solutions for Microsoft Azure Stack HCI. If DCB is installed on the management...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 39
... -IPAddress 172.16.11.1 -DefaultGateway 172.16.11.254 -PrefixLength 24 -AddressFamily IPv4 -Verbose 39 Dell EMC Solutions for the NetAdapterName parameters by using the Install-WindowsFeature cmdlet, the -Name parameters are listed in -band management network. Note: On WS2016, the default... 'NIC1','NIC2' -MinimumBandwidthMode Weight -Verbose Note: Retrieve the argument for Microsoft Azure Stack HCI Networking Guide 9.3 9.4 Install roles and features On each Ready Node to be installed. The command below have taken effect, the associated Get- Tools are used are the 10GbE Intel ...
... -IPAddress 172.16.11.1 -DefaultGateway 172.16.11.254 -PrefixLength 24 -AddressFamily IPv4 -Verbose 39 Dell EMC Solutions for the NetAdapterName parameters by using the Install-WindowsFeature cmdlet, the -Name parameters are listed in -band management network. Note: On WS2016, the default... 'NIC1','NIC2' -MinimumBandwidthMode Weight -Verbose Note: Retrieve the argument for Microsoft Azure Stack HCI Networking Guide 9.3 9.4 Install roles and features On each Ready Node to be installed. The command below have taken effect, the associated Get- Tools are used are the 10GbE Intel ...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 41
... Set-NetAdapterAdvancedProperty -Name 'SLOT 2*' -RegistryKeyword '*JumboPacket' -RegistryValue '9014' 41 Dell EMC Solutions for best performance. Sizes allowed by other NIC makes and models may...bytes on NICs that carry storage traffic for Microsoft Azure Stack HCI Networking Guide PS> Enable-NetAdapterRdma -Name 'SLOT 2*' RDMA is enabled on each ... -DisplayName 'NetworkDirect Technology' -displayvalue 'iWARP' 9.5.5 Enable jumbo frames on the Windows Server version installed as shown below. The command syntax varies depending on NICs In this step for Mellanox adapters because...
... Set-NetAdapterAdvancedProperty -Name 'SLOT 2*' -RegistryKeyword '*JumboPacket' -RegistryValue '9014' 41 Dell EMC Solutions for best performance. Sizes allowed by other NIC makes and models may...bytes on NICs that carry storage traffic for Microsoft Azure Stack HCI Networking Guide PS> Enable-NetAdapterRdma -Name 'SLOT 2*' RDMA is enabled on each ... -DisplayName 'NetworkDirect Technology' -displayvalue 'iWARP' 9.5.5 Enable jumbo frames on the Windows Server version installed as shown below. The command syntax varies depending on NICs In this step for Mellanox adapters because...
EMC Solutions for Microsoft Azure Stack HCI Networking Guide
Page 50
... {9014} *JumboPacket {9014} *JumboPacket {1514} *JumboPacket {1514} *JumboPacket {1514} 50 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide The command syntax varies depending on the ports in Section 9.5.5. iWARP is used to ensure QLogic...---- PS> Get-NetAdapterAdvancedProperty -Name "*" -RegistryKeyword '*JumboPacket' Name DisplayName ---- ----------- Jumbo frames are enabled on the version of Windows Server installed. For Windows Server 2016, use the following command: PS> Get-NetAdapterAdvancedProperty -DisplayName 'RDMA Mode' Name ---SLOT 2 Port 2 SLOT ...
... {9014} *JumboPacket {9014} *JumboPacket {1514} *JumboPacket {1514} *JumboPacket {1514} 50 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide The command syntax varies depending on the ports in Section 9.5.5. iWARP is used to ensure QLogic...---- PS> Get-NetAdapterAdvancedProperty -Name "*" -RegistryKeyword '*JumboPacket' Name DisplayName ---- ----------- Jumbo frames are enabled on the version of Windows Server installed. For Windows Server 2016, use the following command: PS> Get-NetAdapterAdvancedProperty -DisplayName 'RDMA Mode' Name ---SLOT 2 Port 2 SLOT ...
EMC Networking Virtualization Overlay with BGP EVPN
Page 5
...network configuration ...49 10.1 VMware ESXi download and installation...49 10.2 Install and configure VMware vCenter Server 6.7 U1 49 10.3 Add ESXi hosts to vCenter Server ...49 10.4 Create VMs and install guest operating systems 50 10.5 vSphere distributed switches......Static routes to VNIs...63 B Validated components...64 B.1 Dell EMC PowerSwitches...64 B.2 PowerEdge R740xd Servers ...64 B.3 VMware software ...64 C Technical resources ...65 C.1 Dell EMC product manuals and technical guides 65 C.1 VMware product manuals and technical guides 65 D Fabric Design Center ...66 E Support and ...
...network configuration ...49 10.1 VMware ESXi download and installation...49 10.2 Install and configure VMware vCenter Server 6.7 U1 49 10.3 Add ESXi hosts to vCenter Server ...49 10.4 Create VMs and install guest operating systems 50 10.5 vSphere distributed switches......Static routes to VNIs...63 B Validated components...64 B.1 Dell EMC PowerSwitches...64 B.2 PowerEdge R740xd Servers ...64 B.3 VMware software ...64 C Technical resources ...65 C.1 Dell EMC product manuals and technical guides 65 C.1 VMware product manuals and technical guides 65 D Fabric Design Center ...66 E Support and ...
EMC PowerSwitch S5200F-ON Series Setup Guide
Page 4
... For more information about the S5200F-ON Series (S5232F-ON, S5248F-ON, S5296F-ON, S5224F-ON, and S5212F-ON) switches, see the following documents. • Dell EMC SmartFabric OS10 Release Notes • Dell EMC SmartFabric OS10 User Guide • Delll EMC PowerSwitch S5200F-ON Series Installation Guide • Delll EMC PowerSwitch S5200F-ON Series Release Notes...
... For more information about the S5200F-ON Series (S5232F-ON, S5248F-ON, S5296F-ON, S5224F-ON, and S5212F-ON) switches, see the following documents. • Dell EMC SmartFabric OS10 Release Notes • Dell EMC SmartFabric OS10 User Guide • Delll EMC PowerSwitch S5200F-ON Series Installation Guide • Delll EMC PowerSwitch S5200F-ON Series Release Notes...
OpenSwitch OPX Installation Guide with Enhancement Package Release 3.1.0
Page 6
...If the problem persists, contact Dell EMC Technical Support if you prefer downloading an image over a network. To locate the Console port and the Management port, see Manual installation). The ONIE boot menu is not available (see the Getting Started Guide shipped with auto-discovery, ... of all disk partitions except ONIE. • Update ONIE - Manually configure your switch or the platform-specific Installation Guide at www.dell.com/support. Installs an OpenSwitch OPX image. • Rescue - See opencompute.org for repair, debugging, and forensics. • Uninstall OS -...
...If the problem persists, contact Dell EMC Technical Support if you prefer downloading an image over a network. To locate the Console port and the Management port, see Manual installation). The ONIE boot menu is not available (see the Getting Started Guide shipped with auto-discovery, ... of all disk partitions except ONIE. • Update ONIE - Manually configure your switch or the platform-specific Installation Guide at www.dell.com/support. Installs an OpenSwitch OPX image. • Rescue - See opencompute.org for repair, debugging, and forensics. • Uninstall OS -...
Open Networking Hardware Diagnostic Guide December 2021
Page 5
... access product documentation and resources for specific Dell EMC Networking switches, see the following documents at www.dell.com/support/. ● Dell EMC PowerSwitch Getting Started Guide or Dell EMC Setup Guide ● Dell EMC PowerSwitch Installation Guide ● Dell EMC PowerSwitch ONIE Release Notes ● Dell EMC PowerSwitch Firmware Updater Release Notes ● Dell EMC PowerSwitch DIAG OS and Tools Release...
... access product documentation and resources for specific Dell EMC Networking switches, see the following documents at www.dell.com/support/. ● Dell EMC PowerSwitch Getting Started Guide or Dell EMC Setup Guide ● Dell EMC PowerSwitch Installation Guide ● Dell EMC PowerSwitch ONIE Release Notes ● Dell EMC PowerSwitch Firmware Updater Release Notes ● Dell EMC PowerSwitch DIAG OS and Tools Release...
Open Networking Hardware Diagnostic Guide December 2021
Page 21
...provides a suite of the same kernel version, and small rootfs to help diagnose issues seen on the I /O modules, see the Dell EMC PowerSwitch Installation Guide for both the DIAG OS, which is operating properly. The tools are down. Topics: • edatool • cpldupgradetool •... • rtctool • smarttool • smbiostool • storagetool • smartctl • temptool • updatetool • Diagnostic package Dell EMC DAIG-OS tools 21 Diagnostic tools The DIAG OS uses standard Linux drivers and contains the following tools that the hardware is a simple...
...provides a suite of the same kernel version, and small rootfs to help diagnose issues seen on the I /O modules, see the Dell EMC PowerSwitch Installation Guide for both the DIAG OS, which is operating properly. The tools are down. Topics: • edatool • cpldupgradetool •... • rtctool • smarttool • smbiostool • storagetool • smartctl • temptool • updatetool • Diagnostic package Dell EMC DAIG-OS tools 21 Diagnostic tools The DIAG OS uses standard Linux drivers and contains the following tools that the hardware is a simple...
EMC PowerSwitch S5200F-ON Series Installation Guide February 2022
Page 1
A07 Dell EMC PowerSwitch S5200F-ON Series Installation Guide February 2022 February 2022 Rev.
A07 Dell EMC PowerSwitch S5200F-ON Series Installation Guide February 2022 February 2022 Rev.