brocade FC交换机interopmode模式应用介绍

最近研究了一下brocade FC交换机interopmode模式，在brocade交换机中支持三种interopmode模式：Brocade Native Mode (IM0)，McDATA Fabric Mode (IM2)和McDATA Open Fabric Mode (IM3)。具体介绍如下：

Mode 0 ：Brocade Native Mode (IM0)

Brocade私有模式，不支持级联。

1. 配置如下：
2. Step 1

1. brocade300:root> switchdisable

1. Step 2 重配置交换机参数
2. brocade300:root> configure

2. Configure...

2. Fabric parameters (yes, y, no, n): [no] y

2. Domain: (1..239) [6]

1. WWN Based persistent PID (yes, y, no, n): [no]
2. R_A_TOV: (4000..120000) [10000]

1. E_D_TOV: (1000..5000) [2000]
2. WAN_TOV: (0..30000) [0]

1. MAX_HOPS: (7..19) [7]
2. Data field size: (256..2112) [2112]

1. Sequence Level Switching: (0..1) [0]
2. Disable Device Probing: (0..1) [0]

1. Suppress Class F Traffic: (0..1) [0]
2. Per-frame Route Priority: (0..1) [0]

1. Long Distance Fabric: (0..1) [0]
2. BB credit: (1..27) [16]

1. Disable FID Check (yes, y, no, n): [yes]
2. Insistent Domain ID Mode (yes, y, no, n): [yes]

1. Virtual Channel parameters (yes, y, no, n): [no]
2. F-Port login parameters (yes, y, no, n): [no]

1. Zoning Operation parameters (yes, y, no, n): [no]
2. RSCN Transmission Mode (yes, y, no, n): [no]

1. Arbitrated Loop parameters (yes, y, no, n): [no]
2. System services (yes, y, no, n): [no]

1. Portlog events enable (yes, y, no, n): [no]
2. ssl attributes (yes, y, no, n): [no]

1. rpcd attributes (yes, y, no, n): [no]
2. cfgload attributes (yes, y, no, n): [no]

1. webtools attributes (yes, y, no, n): [no]
2. Custom attributes (yes, y, no, n): [no]

1. system attributes (yes, y, no, n): [no]
2. System (yes, y, no, n): [no]

2. No changes.

1. Step 3 配置为模式3

1. brocade300:root>
2. brocade300:root> interopmode 1

2. Step 4 保存配置

1. brocade300:root>
2. brocade300:root> cfgsave

1. You are about to save the Defined zoning configuration. This
2. action will only save the changes on Defined configuration.

1. Any changes made on the Effective configuration will not
2. take effect until it is re-enabled.

1. Do you want to save Defined zoning configuration only? (yes, y, no, n): [no] y
2. Nothing changed: nothing to save, returning ...

brocade300:root>
brocade300:root>reboot

interopmode 0 只要重配置交换机，设置为0后保存配置重启就可以生效，并不一定需要配置zone。就可以获取存储磁盘。

Mode 2 ：McDATA Fabric Mode (IM2)

Brocade私有模式，支持级联。CISCO也有兼容这个模式的选项。

1. 配置如下 :
2. Step 1

1. brocade300:root> switchdisable

1. Step 2 重配置交换机参数
2. brocade300:root> configure

2. Configure...

2. Fabric parameters (yes, y, no, n): [no] y

2. Domain: (1..239) [6]

1. WWN Based persistent PID (yes, y, no, n): [no]
2. R_A_TOV: (4000..120000) [10000]

1. E_D_TOV: (1000..5000) [2000]
2. WAN_TOV: (0..30000) [0]

1. MAX_HOPS: (7..19) [7]
2. Data field size: (256..2112) [2112]

1. Sequence Level Switching: (0..1) [0]
2. Disable Device Probing: (0..1) [0]

1. Suppress Class F Traffic: (0..1) [0]
2. Per-frame Route Priority: (0..1) [0]

1. Long Distance Fabric: (0..1) [0]
2. BB credit: (1..27) [16]

1. Disable FID Check (yes, y, no, n): [yes]
2. Insistent Domain ID Mode (yes, y, no, n): [yes]

1. Virtual Channel parameters (yes, y, no, n): [no]
2. F-Port login parameters (yes, y, no, n): [no]

1. Zoning Operation parameters (yes, y, no, n): [no]
2. RSCN Transmission Mode (yes, y, no, n): [no]

1. Arbitrated Loop parameters (yes, y, no, n): [no]
2. System services (yes, y, no, n): [no]

1. Portlog events enable (yes, y, no, n): [no]
2. ssl attributes (yes, y, no, n): [no]

1. rpcd attributes (yes, y, no, n): [no]
2. cfgload attributes (yes, y, no, n): [no]

1. webtools attributes (yes, y, no, n): [no]
2. Custom attributes (yes, y, no, n): [no]

1. system attributes (yes, y, no, n): [no]
2. System (yes, y, no, n): [no]

2. No changes.

1. Step 3 配置为模式3

1. brocade300:root>
2. brocade300:root> interopmode 2

2. Step 4 保存配置

1. brocade300:root>
2. brocade300:root> cfgsave

1. You are about to save the Defined zoning configuration. This
2. action will only save the changes on Defined configuration.

1. Any changes made on the Effective configuration will not
2. take effect until it is re-enabled.

1. Do you want to save Defined zoning configuration only? (yes, y, no, n): [no] y
2. Nothing changed: nothing to save, returning ...

1. brocade300:root>
2. brocade300:root>reboot

2. 创建一个zone。如把0，1，2这3个光纤端口划在一个zone里

1. brocade300:root>zonecreate “zoneliu”,”3,1;3.3”

1. 创建一个配置，创建的zone需要加入到一个cfg里才能有效。
2. brocade300:root>cfgcreate “cfgliu”,”zoneliu”

2. 启用一个cfg

1. brocade300:root> cfgenable "cfgliu"

1. 把zone加入到cfg里后，要使用cfgsave保存
2. brocade300:root> cfgsave

2. 补充：

1. 增加一个光纤端口到一个zone里
2. swd77:admin> zoneadd "zone3","1,8"

1. 增加zone3到cfg1里
2. swd77:admin> cfgadd "cfg1","zone3"

2. 使一个cfg失效

1. swd77:admin> cfgdisable "cfg1"

1. 从一个cfg里删除一个zone
2. swd77:admin> cfgremove "cfg1","zone3"

2. 从一个zone里删除一个光纤端口

1. swd77:admin> zoneremove "zone3","1,8"

1. 暴力删除一个zone
2. swd77:admin> zonedelete "zone3"

2. 暴力删除一个cfg

swd77:admin> cfgdelete "cfg1"

注意做以上步骤后都记着用cfgsave保存配置。
如果要配置mode 2的交换机级联请看：《brocade FC交换机与cisco 级联配置详解》

Mode 3：McDATA Open Fabric Mode (IM3)

开放模式，用于兼容所有其他产品，这个模式只能让其他设备配置好zone同步到本机，否则无法使用。
这里要注意前面两种模式交换机可以配置zone，所以单机情况下可以前面两种模式就可以正常访问存储。同时也可以通过级联方式访问存储。
而配置为第三种模式后，broacade交换机本身不能配置zone，需要其他交换机配置好zone后同步给brocade的交换机，这样brocade交换机才会有zone信息。所以在这种模式下不能用单机使用只能用级联的方式进行访问存储。
注：两台交换机一样就是0，不一样是2或3.

1. Brocade配置如下：
2. Step 1

1. brocade300:root> switchdisable

1. Step 2 重配置交换机参数
2. brocade300:root> configure

2. Configure...

2. Fabric parameters (yes, y, no, n): [no] y

2. Domain: (1..239) [6]

1. WWN Based persistent PID (yes, y, no, n): [no]
2. R_A_TOV: (4000..120000) [10000]

1. E_D_TOV: (1000..5000) [2000]
2. WAN_TOV: (0..30000) [0]

1. MAX_HOPS: (7..19) [7]
2. Data field size: (256..2112) [2112]

1. Sequence Level Switching: (0..1) [0]
2. Disable Device Probing: (0..1) [0]

1. Suppress Class F Traffic: (0..1) [0]
2. Per-frame Route Priority: (0..1) [0]

1. Long Distance Fabric: (0..1) [0]
2. BB credit: (1..27) [16]

1. Disable FID Check (yes, y, no, n): [yes]
2. Insistent Domain ID Mode (yes, y, no, n): [yes]

1. Virtual Channel parameters (yes, y, no, n): [no]
2. F-Port login parameters (yes, y, no, n): [no]

1. Zoning Operation parameters (yes, y, no, n): [no]
2. RSCN Transmission Mode (yes, y, no, n): [no]

1. Arbitrated Loop parameters (yes, y, no, n): [no]
2. System services (yes, y, no, n): [no]

1. Portlog events enable (yes, y, no, n): [no]
2. ssl attributes (yes, y, no, n): [no]

1. rpcd attributes (yes, y, no, n): [no]
2. cfgload attributes (yes, y, no, n): [no]

1. webtools attributes (yes, y, no, n): [no]
2. Custom attributes (yes, y, no, n): [no]

1. system attributes (yes, y, no, n): [no]
2. System (yes, y, no, n): [no]

2. No changes.

1. Step 3 配置为模式3

1. brocade300:root>
2. brocade300:root> interopmode 3

2. Step 4 保存配置

1. brocade300:root>
2. brocade300:root> cfgsave

1. You are about to save the Defined zoning configuration. This
2. action will only save the changes on Defined configuration.

1. Any changes made on the Effective configuration will not
2. take effect until it is re-enabled.

1. Do you want to save Defined zoning configuration only? (yes, y, no, n): [no] y
2. Nothing changed: nothing to save, returning ...

brocade300:root>
brocade300:root>reboot

其他什么不用配置，只要在CISCO交换机上配置就可以了。

1. CISCO交换机配置如下：
2. Step 1 Place the VSAN of the E ports(s) that connect to the OEM switch in interoperability mode.

1. C5548-1# config t
2. Enter configuration commands, one per line. End with CNTL/Z.

1. C5548-1(config)# vsan database
2. C5548-1(config-vsan-db)# no vsan 2 interop 配置为默认模式

1. vsan 2:interoperability mode 1 allowed domain list [97-127] does not include all assigned
2. and configured domains or conflicts with existing allowed domain lists

1. Step 2 Assign a domain ID in the range of 97 (0x61) through 127 (0x7F). This interop mode limitation restricts the fabric to a total of 31 switches.
2. C5548-1# config t

1. Enter configuration commands, one per line. End with CNTL/Z.
2. C5548-1(config)# fcdomain domain 100 preferred vsan 2

1. Step 3 Change the Fibre Channel timers if they have been changed from the system defaults.
2. The FC error Detect (ED_TOV) and Resource Allocation (RA_TOV) timers on the MDS 9000 switch and Brocade switches default to the same values. The RA_TOV defaults to 10 seconds, and the ED_TOV defaults to 2 seconds. These values can be changed. According to the FC-SW2 standard, these values must be the same on each switch in the fabric.

1. C5548-1# config t
2. C5548-1(config)# fctimer e_d_tov 2000

1. <1000-100000> E_D_TOV in milliseconds(1000-4000)
2. C5548-1(config)# fctimer r_a_tov 10000

1. <5000-100000> R_A_TOV in milliseconds(5000-100000)
2. Step 4 After making changes to the domain, restart the MDS 9000 switch domain manager function for the altered VSAN. To do this, suspend and then resume the VSAN.

1. C5548-1(config)# vsan database
2. C5548-1(config-vsan-db)# vsan 2 suspend

1. C5548-1(config-vsan-db)# no vsan 2 suspend
2. Step 5: 配置接口

1. C5548-1(config-vsan-db)# vsan 2 interface fc2/1 ---接节点
2. C5548-1(config-vsan-db)# vsan 2 interface fc2/2 ---接交换机E模式

1. C5548-1(config)# interface fc2/1
2. C5548-1(config)# switchport mode F

C5548-1(config)# interface fc2/2
C5548-1(config)# switchport mode E

CISCO上查看SHOW信息：

1. 查看交换机间协商信息：
2. C5548-1(config)# show fcdomain vsan 2

1. The local switch is the Principal Switch.

1. Local switch run time information:
2. State: Stable

1. Local switch WWN: 20:02:00:05:73:b9:0c:c1
2. Running fabric name: 20:02:00:05:73:b9:0c:c1

1. Running priority: 2
2. Current domain ID: 0x64(100)

2. Local switch configuration information:

1. State: Enabled
2. FCID persistence: Enabled

1. Auto-reconfiguration: Disabled
2. Contiguous-allocation: Disabled

1. Configured fabric name: 20:01:00:05:30:00:28:df
2. Optimize Mode: Disabled

1. Configured priority: 128
2. Configured domain ID: 0x64(100) (static)

2. Principal switch run time information:

1. Running priority: 2

1. Interface Role RCF-reject
2. ------------------ ------------- ------------

1. fc2/2 Downstream Disabled
2. ------------------ ------------- ------------

1. C5548-1(config)# show fcdomain domain-list vsan 2

1. Number of domains: 2
2. Domain ID WWN

1. --------- -----------------------
2. 0x64(100) 20:02:00:05:73:b9:0c:c1 [Local] [Principal] ----- CISCO交换机

1. 0x66(102) 10:00:00:05:33:49:b8:f8 -----brocade交换机
2. C5548-1(config)#

2. 查看NS

1. C5548-1(config)# show fcns database vsan 2

1. VSAN 2:
2. --------------------------------------------------------------------------

1. FCID TYPE PWWN (VENDOR) FC4-TYPE:FEATURE
2. --------------------------------------------------------------------------

1. 0x640002 N 50:0a:09:84:8d:7e:de:48 (NetApp) scsi-fcp:target
2. 0x661100 N 21:00:00:24:ff:29:68:3c scsi-fcp:init

2. Total number of entries = 2

2. Interopmode 模式为默认模式

1. C5548-1(config)# show vsan 2
2. vsan 2 information

1. name:VSAN0002 state:active
2. interoperability mode:default

loadbalancing:src-id/dst-id/oxid
operational state:up

Broacde上查看信息：

1. 查看协商结果信息
2. brocade300:root> switchshow

1. switchName: brocade300
2. switchType: 71.2

1. switchState: Online
2. switchMode: McDATA Open Fabric

1. switchRole: Subordinate
2. DomainIDOffset: 0x60

1. switchDomain: 102
2. switchId: fffc66

1. switchWwn: 10:00:00:05:33:49:b8:f8
2. zoning: ON (edge_zs)

1. switchBeacon: OFF

1. Index Port Address Media Speed State Proto
2. ==============================================

1. 0 0 661900 -- N8 No_Module FC
2. 1 1 661300 id N8 Online FC E-Port 20:02:00:05:73:b9:0c:c1 "C5548-1" (upstream)

1. 2 2 661800 -- N8 No_Module FC
2. 3 3 661100 id N4 Online FC F-Port 21:00:00:24:ff:29:68:3c

1. 4 4 661600 -- N8 No_Module FC
2. 5 5 661400 -- N8 No_Module FC

1. 6 6 661200 -- N8 No_Module FC
2. 7 7 661000 -- N8 No_Module FC

2. 在brocade 端查看本机的ns信息。

1. brocade300:root> nsshow
2. {

1. Type Pid COS PortName NodeName TTL(sec)
2. N 661100; 3;21:00:00:24:ff:29:68:3c;20:00:00:24:ff:29:68:3c; na

1. FC4s: FCP
2. NodeSymb: [32] "QLE2562 FW:v4.06.01 DVR:v9.1.8.6"

1. Fabric Port Name: 20:03:00:05:33:49:b8:f8
2. Permanent Port Name: 21:00:00:24:ff:29:68:3c

1. Port Index: 3
2. Share Area: No

1. Device Shared in Other AD: No
2. Redirect: No

1. The Local Name Server has 1 entry }

1. 查看全局的Name Server 信息
2. brocade300:root> nsallshow

1. {
2. 640002 661100 -----这里有两个一个是本机的ns，一个是cisco上的ns信息。

1. 2 Nx_Ports in the Fabric }

1. 查看zone配置信息
2. brocade300:root> cfgshow

1. Defined configuration:
2. no configuration defined

2. Effective configuration:

no configuration in effect

如上可知mode 3本机不能配置zone所以configuration和effective两个选项都是空的。需要在CISCO上配置zone信息后同步到Brocade上，这里ns全局信息同步后才可以获取到存储LUN。

1. CISCO 5548配置zone：
2. Step 1：创建zone 命名为edgezone

1. C5548-1(config)# zone name edgezone vsan 2

1. Step 2：将添加pwwn到zone中
2. C5548-1(config-zone)# member pwwn 50:0a:09:84:8d:7e:de:48

1. C5548-1(config-zone)# member pwwn 21:00:00:24:ff:29:68:3c

1. Step 3：创建zoneset 命名为 edge_zs
2. C5548-1(config)# zoneset name edge_zs vsan 2

2. Step 3：将edgezone加入zoneset

1. C5548-1(config-zoneset)# member edgezone
2. C5548-1(config-zoneset)# ex

2. Step 4：激活zoneset

C5548-1(config)# zoneset activate name edge_zs vsan 2
Zoneset activation initiated. check zone status

在CISCO上查看zone 激活状态：

1. C5548-1(config)# show zoneset active
2. zoneset name edge_zs vsan 2

1. zone name edgezone vsan 2
2. * fcid 0x640002 [pwwn 50:0a:09:84:8d:7e:de:48]

1. * fcid 0x661100 [pwwn 21:00:00:24:ff:29:68:3c]

zone name $default_zone$ vsan 2
C5548-1(config)#

在brocade上查看zone配置信息：

1. brocade300:root> cfgshow
2. Defined configuration:

1. no configuration defined

1. Effective configuration:
2. cfg: edge_zs

1. zone: edgezone
2. 50:0a:09:84:8d:7e:de:48

21:00:00:24:ff:29:68:3c

可以看到brocade zone 已经同步过来，同时提一点由于这个zone信息不是brocade本机配置的而是从其他交换机同步过来，所以defined configuration是空的，而effective configuration是有zone信息。
这样整个mode 3模式下交换机级联就配置完成，服务器可以正常读取到存储的磁盘信息。