Converged Networks and Fibre Channel over Ethernet
Page 1
... Fibre Channel over Ethernet Table of contents Abstract 2 Introduction 2 Converged networks 2 Data Center Bridging 3 Fibre Channel over Ethernet (FCoE) 3 Challenges for end-to-end network convergence 4 Servers 4 Direct-attach storage 5 Storage Area Network 5 iSCSI: SANs using...Approaches to converged data center networks 5 Convergence strategies 6 Cost structure 7 Congestion and flow control 7 FCoE and DCB progress and challenges ahead 8 Using HP Flat SAN technology to enhance single hop FCoE 9 Evolution of storage 10 Conclusion 11 For more information 12
... Fibre Channel over Ethernet Table of contents Abstract 2 Introduction 2 Converged networks 2 Data Center Bridging 3 Fibre Channel over Ethernet (FCoE) 3 Challenges for end-to-end network convergence 4 Servers 4 Direct-attach storage 5 Storage Area Network 5 iSCSI: SANs using...Approaches to converged data center networks 5 Convergence strategies 6 Cost structure 7 Congestion and flow control 7 FCoE and DCB progress and challenges ahead 8 Using HP Flat SAN technology to enhance single hop FCoE 9 Evolution of storage 10 Conclusion 11 For more information 12
Converged Networks and Fibre Channel over Ethernet
Page 2
...protocol standards. but for different types of data center networking and the difficult tradeoffs facing IT organizations today, we look at FCoE and DCB network standards. The next major challenge is the first hop for networks in multi-hop or multiswitch network environments...of -rack (ToR) switches, Virtual Connect (VC) FlexFabric module, FlexFabric Adapters, and Converged Network Adapters (CNAs). We also compare HP and Cisco approaches to -end converged networks in such data centers include separate, heterogeneous network devices for both technological and business reasons, none...
...protocol standards. but for different types of data center networking and the difficult tradeoffs facing IT organizations today, we look at FCoE and DCB network standards. The next major challenge is the first hop for networks in multi-hop or multiswitch network environments...of -rack (ToR) switches, Virtual Connect (VC) FlexFabric module, FlexFabric Adapters, and Converged Network Adapters (CNAs). We also compare HP and Cisco approaches to -end converged networks in such data centers include separate, heterogeneous network devices for both technological and business reasons, none...
Converged Networks and Fibre Channel over Ethernet
Page 3
... using simple wire-once servers reduces deployment, diagnosis, management, and operating costs. Fibre Channel over Ethernet (FCoE) FCoE is a layer 2 (non-routable over Ethernet links. FCoE packets encapsulate Fibre Channel frames inside Ethernet frames (Figure 2). It does not incorporate TCP or even IP ...in servers. Before the network can easily implement logic for transporting them over IP) protocol just like Fibre Channel. Figure 2: The FCoE protocol embeds FC frames within a data center. Data Center Bridging An informal consortium of network vendors originally defined a set of ...
... using simple wire-once servers reduces deployment, diagnosis, management, and operating costs. Fibre Channel over Ethernet (FCoE) FCoE is a layer 2 (non-routable over Ethernet links. FCoE packets encapsulate Fibre Channel frames inside Ethernet frames (Figure 2). It does not incorporate TCP or even IP ...in servers. Before the network can easily implement logic for transporting them over IP) protocol just like Fibre Channel. Figure 2: The FCoE protocol embeds FC frames within a data center. Data Center Bridging An informal consortium of network vendors originally defined a set of ...
Converged Networks and Fibre Channel over Ethernet
Page 4
...routable over Ethernet. Cisco is in the data center. This is not consistent with DCB, legacy Ethernet, and legacy Fibre Channel ports. FCoE has several advantages: • The CNA appears to storage). They also expect to all things to include the installed base of challenges. ... and management model • Makes storage targets that is, multiple FCoE/DCB switch hops from its Ethernet products with the same limitations and lack of FCFs include HP VC FlexFabric modules and HP Networking 5820X top-ofrack access switches with existing Cisco Fibre Channel hardware...
...routable over Ethernet. Cisco is in the data center. This is not consistent with DCB, legacy Ethernet, and legacy Fibre Channel ports. FCoE has several advantages: • The CNA appears to storage). They also expect to all things to include the installed base of challenges. ... and management model • Makes storage targets that is, multiple FCoE/DCB switch hops from its Ethernet products with the same limitations and lack of FCFs include HP VC FlexFabric modules and HP Networking 5820X top-ofrack access switches with existing Cisco Fibre Channel hardware...
Converged Networks and Fibre Channel over Ethernet
Page 5
...and complexity in this fabric can be expensive and complex. See the "Using HP Flat SAN technology to enhance single hop FCoE" section later in the IT infrastructure. In the latter scenario, the FCoE benefit is the storage fabric of InfiniBand. As a result, half of ...parallel databases. HP Virtual Connect direct-attach Fibre Channel for communication between pieces of a particular switch ASIC. However, this paper...
...and complexity in this fabric can be expensive and complex. See the "Using HP Flat SAN technology to enhance single hop FCoE" section later in the IT infrastructure. In the latter scenario, the FCoE benefit is the storage fabric of InfiniBand. As a result, half of ...parallel databases. HP Virtual Connect direct-attach Fibre Channel for communication between pieces of a particular switch ASIC. However, this paper...
Converged Networks and Fibre Channel over Ethernet
Page 6
... & management Push all levels - Converged Network Candidates Network environments Directory, security, other, SAN services Flow control (one hop) FCoE on DCB Fibre Channel switch software Per priority pause (PFC) part of current and future network convergence efforts. This table shows the...is more aligned with the overall business solution in which the software and applications are the tenants of the network infrastructure and HP supports this viewpoint with fabric extensions / centralize control Flatter, less complicated L2 networks / removing the hierarchy where possible Leverage...
... & management Push all levels - Converged Network Candidates Network environments Directory, security, other, SAN services Flow control (one hop) FCoE on DCB Fibre Channel switch software Per priority pause (PFC) part of current and future network convergence efforts. This table shows the...is more aligned with the overall business solution in which the software and applications are the tenants of the network infrastructure and HP supports this viewpoint with fabric extensions / centralize control Flatter, less complicated L2 networks / removing the hierarchy where possible Leverage...
Converged Networks and Fibre Channel over Ethernet
Page 7
... feeds" and examine the pool of buffers. Table 3. Category FCoE Cisco Consolidate Fibre Channel traffic with Ethernet / push FCoE for data center Lead the market in data center (multi-hop) FCoE via proprietary methods HP Converge Fibre Channel at c7000 chassis level and in Networking devices where... costs are justified and easily defended In advance of FCoE standards becoming economically viable and available in end-to-end network environments, HP recommends 3PAR Storage Solutions with Flat SAN technology as the preferred mechanism to provide end ...
... feeds" and examine the pool of buffers. Table 3. Category FCoE Cisco Consolidate Fibre Channel traffic with Ethernet / push FCoE for data center Lead the market in data center (multi-hop) FCoE via proprietary methods HP Converge Fibre Channel at c7000 chassis level and in Networking devices where... costs are justified and easily defended In advance of FCoE standards becoming economically viable and available in end-to-end network environments, HP recommends 3PAR Storage Solutions with Flat SAN technology as the preferred mechanism to provide end ...
Converged Networks and Fibre Channel over Ethernet
Page 8
... considered proven. In the Cisco model Fibre Channel traffic is fixed assignment of limited buffer space, whether that , just as FCoE packets being granted on configuring and tuning any multi-hop network that almost no two implementations behave identically. The methods for the... network capacity Congestion management technology Behavior Technology example showing that behavior can move within a full square mile. Networks become congested like FCoE. When an auto accident occurs at the server edge, from multiple vendors and should expect to buffers not being forwarded at Layer...
... considered proven. In the Cisco model Fibre Channel traffic is fixed assignment of limited buffer space, whether that , just as FCoE packets being granted on configuring and tuning any multi-hop network that almost no two implementations behave identically. The methods for the... network capacity Congestion management technology Behavior Technology example showing that behavior can move within a full square mile. Networks become congested like FCoE. When an auto accident occurs at the server edge, from multiple vendors and should expect to buffers not being forwarded at Layer...
Converged Networks and Fibre Channel over Ethernet
Page 9
... of Cisco and Brocade switches prevent them from CNA to enhance single hop FCoE Fibre channel is available in "HP Virtual Connect direct-attach Fibre Channel for Fibre Channel and FCoE traffic. • Nearly every enterprise customer in real use the 3PAR Storage... the storage fabric of choice for 3PAR Storage Solutions with HP Virtual Connect direct-attach Fibre Channel for most enterprises will accommodate arbitrary FCoE traffic Technology experiments Cisco approach: all switches forward FCoE using that implemented the DCB features. This innovative solution requires...
... of Cisco and Brocade switches prevent them from CNA to enhance single hop FCoE Fibre channel is available in "HP Virtual Connect direct-attach Fibre Channel for Fibre Channel and FCoE traffic. • Nearly every enterprise customer in real use the 3PAR Storage... the storage fabric of choice for 3PAR Storage Solutions with HP Virtual Connect direct-attach Fibre Channel for most enterprises will accommodate arbitrary FCoE traffic Technology experiments Cisco approach: all switches forward FCoE using that implemented the DCB features. This innovative solution requires...
Converged Networks and Fibre Channel over Ethernet
Page 10
...supercomputers a large parallel file system (such as HP IBRIX) runs on some of these cases as an application-level protocol on a big change until it . FCoE is a very compelling edge connection for decades and have a respectable share of the FCoE/Fibre Channel combination. We can think of the ... the available choices will fare. Perhaps it is a lot to build an iSCSI/FCoE hybrid with Fibre Channel for not spending resources on the network, not as a block storage protocol. The HP Left Hand Networks clustered iSCSI products are evolving away from the major vendors will potentially...
...supercomputers a large parallel file system (such as HP IBRIX) runs on some of these cases as an application-level protocol on a big change until it . FCoE is a very compelling edge connection for decades and have a respectable share of the FCoE/Fibre Channel combination. We can think of the ... the available choices will fare. Perhaps it is a lot to build an iSCSI/FCoE hybrid with Fibre Channel for not spending resources on the network, not as a block storage protocol. The HP Left Hand Networks clustered iSCSI products are evolving away from the major vendors will potentially...
Converged Networks and Fibre Channel over Ethernet
Page 11
... other planning considerations: • On what scale do you implement migration strategies (like the FC-based HP 3PAR Flat SAN technology Systems that end-to-end FCoE will only work on single vendor networks. The winning approaches have on the network. Such uncertainly discourages ... about the DCB standards among network hardware vendors. 11 A year ago, Cisco changed plans from traffic as switch hops are some consensus about FCoE's requirements. Any deployment of traffic.? • What choices should you a different "winning approach" that MAC and IP addresses stay intact? ...
... other planning considerations: • On what scale do you implement migration strategies (like the FC-based HP 3PAR Flat SAN technology Systems that end-to-end FCoE will only work on single vendor networks. The winning approaches have on the network. Such uncertainly discourages ... about the DCB standards among network hardware vendors. 11 A year ago, Cisco changed plans from traffic as switch hops are some consensus about FCoE's requirements. Any deployment of traffic.? • What choices should you a different "winning approach" that MAC and IP addresses stay intact? ...
ProCurve Series 6120 Blade Switches Management and Configuration Guide
Page 639
...feature that you are licensing. When you install this license is required to enable Priority Flow Control and Data Center Bridging Exchange for the HP 6120XG switch.This allows the switch to interact with the license you provide. H-1 The product number for this number into the switch, it ...enables the feature that you purchase, and represents your right to run applications such as FCoE. This number is provided by the My ProCurve portal, based on a particular type of switch. ■ hardware ID - This number is generated...
...feature that you are licensing. When you install this license is required to enable Priority Flow Control and Data Center Bridging Exchange for the HP 6120XG switch.This allows the switch to interact with the license you provide. H-1 The product number for this number into the switch, it ...enables the feature that you purchase, and represents your right to run applications such as FCoE. This number is provided by the My ProCurve portal, based on a particular type of switch. ■ hardware ID - This number is generated...
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 252
...(DCBX) Protocol ■ 802.1Qau - Congestion Notification (QCN) CEE supports standard lossy LAN communications and lossless FCoE communications simultaneously. The new features are defined by data center administrators that enhance Ethernet and data link layer protocols ...hosts. Enhanced Transmission Scheduling (ETS) ■ 802.1Qaz - An HP-provided license is optimized for storage protocols. Fibre Channel is required to enable CEE features on the HP ProCurve 6120XG Switch Introduction Introduction Data centers typically use two separate communication protocols for ...
...(DCBX) Protocol ■ 802.1Qau - Congestion Notification (QCN) CEE supports standard lossy LAN communications and lossless FCoE communications simultaneously. The new features are defined by data center administrators that enhance Ethernet and data link layer protocols ...hosts. Enhanced Transmission Scheduling (ETS) ■ 802.1Qaz - An HP-provided license is optimized for storage protocols. Fibre Channel is required to enable CEE features on the HP ProCurve 6120XG Switch Introduction Introduction Data centers typically use two separate communication protocols for ...
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 253
Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch Terminology Terminology CEE Converged Enhanced Ethernet-a set of four new IEEE draft standards that enhance Ethernet and data link layer protocols in support of FCoE and traditional Ethernet traffic. CNA Converged Network Adapter-a server... grouped with features to support a combination of lossless Ethernet for assignment of Fibre Channel frames into Ethernet frames (FCoE) and the FCoE Initialization Protocol (FIP). LLDP Link Layer Discovery Protocol-An LLDP packet contains data about their configured capabilities. FC-...
Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch Terminology Terminology CEE Converged Enhanced Ethernet-a set of four new IEEE draft standards that enhance Ethernet and data link layer protocols in support of FCoE and traditional Ethernet traffic. CNA Converged Network Adapter-a server... grouped with features to support a combination of lossless Ethernet for assignment of Fibre Channel frames into Ethernet frames (FCoE) and the FCoE Initialization Protocol (FIP). LLDP Link Layer Discovery Protocol-An LLDP packet contains data about their configured capabilities. FC-...
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 254
...1p priorities. TLV Type, Length, Value-Describes a field within a number of protocols in which value is allowed between the HP ProCurve 6120XG switch and the network. CEE Network Example The figure below illustrates an example network configuration for a Traffic Group. The traffic ...Converged Network Adapter (CNA) sends both Ethernet and Fibre Channel traffic over the FCoE connection. 6-5 Exchanged by a unique type, along with length. Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch CEE Network Example QoS Quality of Service-Manages the bandwidth and priority scheme...
...1p priorities. TLV Type, Length, Value-Describes a field within a number of protocols in which value is allowed between the HP ProCurve 6120XG switch and the network. CEE Network Example The figure below illustrates an example network configuration for a Traffic Group. The traffic ...Converged Network Adapter (CNA) sends both Ethernet and Fibre Channel traffic over the FCoE connection. 6-5 Exchanged by a unique type, along with length. Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch CEE Network Example QoS Quality of Service-Manages the bandwidth and priority scheme...
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 255
Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch CEE Network Example Ethernet FFiberer Channel FCF Switch FCF Switch CNAs 6120XG 6120XG Server C-Class Enclosure Figure 6-1. Example of a CEE Network Fibre Channel Ethernet FCoE 6-6
Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch CEE Network Example Ethernet FFiberer Channel FCF Switch FCF Switch CNAs 6120XG 6120XG Server C-Class Enclosure Figure 6-1. Example of a CEE Network Fibre Channel Ethernet FCoE 6-6
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 256
...queues to 2 to this guide for your switch. See the instructions that handle FCoE traffic (See "Configuring Priority Flow Control (PFC)" on the switch: 1. Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch Getting Started Getting Started You must execute these ports as tagged ports to ... chapter titled "Port Traffic Controls" in this VLAN. The FCoE VLAN ports must be untagged in VLAN 1, the default VLAN. 6. Install the CEE license. 2. After you can use the CEE features, the HP ProCurve 6120XG switch must have installed the license, enter the show licenses ...
...queues to 2 to this guide for your switch. See the instructions that handle FCoE traffic (See "Configuring Priority Flow Control (PFC)" on the switch: 1. Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch Getting Started Getting Started You must execute these ports as tagged ports to ... chapter titled "Port Traffic Controls" in this VLAN. The FCoE VLAN ports must be untagged in VLAN 1, the default VLAN. 6. Install the CEE license. 2. After you can use the CEE features, the HP ProCurve 6120XG switch must have installed the license, enter the show licenses ...
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 258
... to "Invalid" and will be specified, or just enter the parameter "all". 6-9 See "Configuring Priority Flow Control (PFC)" on the HP ProCurve 6120XG Switch Configuring Traffic Templates lossless: Only available when CEE is licensed, the group-id option can be unique within the traffic template for each ...2228 bytes. When CEE is licensed. When a new traffic template is added, the group-id for each traffic group is initialized to the FCoE maximum frame size of the traffic template is enabled. Note Converged Enhanced Ethernet on page 6-17. If a group-id is specified that ...
... to "Invalid" and will be specified, or just enter the parameter "all". 6-9 See "Configuring Priority Flow Control (PFC)" on the HP ProCurve 6120XG Switch Configuring Traffic Templates lossless: Only available when CEE is licensed, the group-id option can be unique within the traffic template for each ...2228 bytes. When CEE is licensed. When a new traffic template is added, the group-id for each traffic group is initialized to the FCoE maximum frame size of the traffic template is enabled. Note Converged Enhanced Ethernet on page 6-17. If a group-id is specified that ...
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 261
...TLV allows peer neighbors to its internal configuration; Default: Enabled when CEE license is installed no ] lldp dcbx [application fcoe priority ] Configures the priority value that is applied. Note: The HP ProCurve 6120XG switch is not allowed. DCBX is applied. Example of Enabling DCBX on the ports. This TLV contains information about ... config 2-3 dcbx Figure 6-4. Enabling DCBX Note DCBX is only available as an LLDP feature when the CEE license is enabled by default on the HP ProCurve 6120XG Switch Data Center Bridging Exchange ■ Priority Flow Control (PFC)-
...TLV allows peer neighbors to its internal configuration; Default: Enabled when CEE license is installed no ] lldp dcbx [application fcoe priority ] Configures the priority value that is applied. Note: The HP ProCurve 6120XG switch is not allowed. DCBX is applied. Example of Enabling DCBX on the ports. This TLV contains information about ... config 2-3 dcbx Figure 6-4. Enabling DCBX Note DCBX is only available as an LLDP feature when the CEE license is enabled by default on the HP ProCurve 6120XG Switch Data Center Bridging Exchange ■ Priority Flow Control (PFC)-
HP ProCurve Series 6120 Blade Switches Advanced Traffic Management Guide
Page 262
ProCurve(config)# show lldp config command. Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch Data Center Bridging Exchange fcoe: Configure FCoE options. ProCurve(config)# lldp dcbx application fcoe 4 Figure 6-5. Configuring the Application FCoE Priority Displaying DCBX Status Information To display a list of the TLVs being advertised for the ports, enter the show lldp config ...including the DCBX TLV IpAddress Advertised: Figure 6-6. priority : Specify a priority that will be advertised for a Port 6-13 Displaying the TLVs Being Advertised for the FCoE application.
ProCurve(config)# show lldp config command. Converged Enhanced Ethernet on the HP ProCurve 6120XG Switch Data Center Bridging Exchange fcoe: Configure FCoE options. ProCurve(config)# lldp dcbx application fcoe 4 Figure 6-5. Configuring the Application FCoE Priority Displaying DCBX Status Information To display a list of the TLVs being advertised for the ports, enter the show lldp config ...including the DCBX TLV IpAddress Advertised: Figure 6-6. priority : Specify a priority that will be advertised for a Port 6-13 Displaying the TLVs Being Advertised for the FCoE application.