English Community

Datacenter SystemsBladeCenter / Flex Systems
All Forum Topics
Options

6 Posts

02-22-2017

FR

9 Signins

87 Page Views

  • Posts: 6
  • Registered: ‎02-22-2017
  • Location: FR
  • Views: 87
  • Message 1 of 7

Linux fcoe with an CN4022

2018-07-19, 7:59 AM

Hello,

I’ve got a server blade x240 M5 with a CN4022 (BCM57840) in a flex bay with 2 switchs CN4093 and I’d like to install a Linux RHEL 7.3 with fcoe.

II have already 20 servers vSphere and few Windows 2012R2 with the same configuration and it works fine. It’s just with Linux.

The configuration is simple:

The switchs CN4093/8.4.6 ( the conf is in the file)

 

The board CN4022 npar/UFP. The first partition if Fcoe and the second Ethernet. I haven’t any problem with Ethernet.

The zoning is correct : if I install a windows or a vSphere I can see a LUN.

Also, if I install a RHEL 7.3 and the lenovo package lnvgy_utl_uxsp_c4sp03p-5.00 and  I follow this Howto  https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/storage_administration_guide/fcoe-config

Nothing.

 Fcoe interface appears on vlan 5.

No fip connexion (I can see it on cn4093, it doesn’t appear on the database)

The command fcoeadm –i  says « interface  offline »

The command ifconfig shows the interface ens1f0.5-fcoe up.

Help !

Thanks and …… sorry for my english

 

 

 

 

Solved! See the solution
Reply
Options

6 Posts

02-22-2017

FR

9 Signins

87 Page Views

  • Posts: 6
  • Registered: ‎02-22-2017
  • Location: FR
  • Views: 87
  • Message 2 of 7

Re: Linux fcoe with an CN4022

2018-07-19, 10:12 AM

Messages at boot ont the switch CN4093

 

Jul 19 11:06:13 cblade-17-sw1 NOTICE server: link up on port INTA3
Jul 19 11:06:13 cblade-17-sw1 NOTICE lldp: LLDP neighbor discovered (Chassis = 00 0e 1e ab 32 30, local port = INTA3)
Jul 19 11:06:13 cblade-17-sw1 NOTICE dcbx: Detected DCBX peer on port INTA3
Jul 19 11:06:13 cblade-17-sw1 NOTICE lldp: LLDP neighbor discovered (Chassis = 00 0e 1e ab 32 30, local port = INTA3)
Jul 19 11:06:14 cblade-17-sw1 NOTICE ufp: link up on vPort INTA3.1!
Jul 19 11:06:14 cblade-17-sw1 NOTICE ufp: link up on vPort INTA3.2!
Jul 19 11:06:35 cblade-17-sw1 NOTICE fcoe: FCOE connection between VN_PORT 0e:fc:00:bc:34:04 and FCF a4:8c:db:8b:e7:c8 has been established.
Jul 19 11:06:55 cblade-17-sw1 NOTICE fcoe: FCOE connection between VN_PORT 0e:fc:00:bc:34:04 and FCF a4:8c:db:8b:e7:c8 was removed because fcf had sent clear virtual links.
Jul 19 11:07:03 cblade-17-sw1 NOTICE fcoe: FCOE connection between VN_PORT 0e:fc:00:bc:34:04 and FCF a4:8c:db:8b:e7:c8 has been established.
Jul 19 11:08:34 cblade-17-sw1 NOTICE fcoe: FCOE connection between VN_PORT 0e:fc:00:bc:34:04 and FCF a4:8c:db:8b:e7:c8 was removed because fcf had sent clear virtual links.
Jul 19 11:08:46 cblade-17-sw1 ALERT system: Protocol control discards: arp-bcast or ipv6-nd packets are received at rate higher than 200pps,hence are discarded on queue 5!
Jul 19 11:10:46 cblade-17-sw1 ALERT system: Protocol control discards: arp-bcast or ipv6-nd packets are received at rate higher than 200pps,hence are discarded on queue 5!

Reply
Options

126 Posts

08-24-2016

CN

342 Signins

3290 Page Views

  • Posts: 126
  • Registered: ‎08-24-2016
  • Location: CN
  • Views: 3290
  • Message 3 of 7

Re: Linux fcoe with an CN4022

2018-07-23, 8:11 AM
We checked the configuration you provided ,seems FCoE configuration is correct.

The logs you provided show that the fcoe connection is established successfully, but removed afte a while (not sure what casue that).

We recommend following actions:

1.Upgrade CN4022 fw and driver to latest version on Lenovo support site:
http://datacentersupport.lenovo.com/
2.Since Broadcom utilizes an offloaded DCBX client, you need make following changes:
#Modify /etc/fcoe/cfg-<interface> by setting DCB_REQUIRED=yes to DCB_REQUIRED=no.
#dcbtool sc ethX dcb off
3.After all change and upgrade, reboot OS or
restart lldp and FCoE :

#systemctl restart lldpad
#systemctl stop fcoe
# systemctl -s SIGHUP kill fcoe
#systemctl start fcoe

If you still see issue ,reviewing your diagram and tech-support logs is reuiqred ,we recommend opening a ticket to Lenovo Support for in-depth analyzing.
Reply
Options

6 Posts

02-22-2017

FR

9 Signins

87 Page Views

  • Posts: 6
  • Registered: ‎02-22-2017
  • Location: FR
  • Views: 87
  • Message 4 of 7

Re: Linux fcoe with an CN4022

2018-07-23, 11:53 AM

Thanks for the answer.

1) The version of the firmware card is the last:

MFW           7.14.46

MBA            7.14.10

EFI                8.0.2

Fcode           1.0.0

iSCSI Boot   7.15.2

L2FW           7.12.25

Fcoe Boot      N/A

CCM                N/A

OEM Id          0.0.4

and the driver is is issue of the UXSP 5.0 ( the driver qlgc-lnvgy_dd_nic_nx2-2.2.5t-171417b_rhel7 is not avaible on the lenovo support site)

2) The DCB_REQUIRED is already at "no"  ( cf RHEL 7 tuto)

3) I opened a case at the Lenovo support

Thanks

PS: I see That there is a new UXSP 5.5 20/07/2018 and perhaps ....

 

 

 

 

 

Reply
Options

6 Posts

02-22-2017

FR

9 Signins

87 Page Views

  • Posts: 6
  • Registered: ‎02-22-2017
  • Location: FR
  • Views: 87
  • Message 5 of 7

Re: Linux fcoe with an CN4022

2018-07-24, 5:12 AM

The good receip is:

1) For the Firmware --->  qlgc-lnvgy_fw_nic_nx2-7.14.46.14_linux_x86-64.bin

                     MFW                  7.14.46

                     MBA                   7.14.10

                     EFI                         8.0.2

                     Fcode                    1.0.0

                     iSCSI Boot           7.15.2

                     L2FW                  7.12.25

                     Fcoe Boot               N/A

                     CCM                         N/A

                     OEM Id                   0.0.4

 

2) For the drivers in the package lnvgy_utl_uxsp_c4sp02p-5.50_rhel7_32-64_Package 

                    ---> qlgc-lnvgy_dd_nic_nx2-2.2.5t-1.714.17b_rhel7_x86-64

And all is OK

Reply
Options

126 Posts

08-24-2016

CN

342 Signins

3290 Page Views

  • Posts: 126
  • Registered: ‎08-24-2016
  • Location: CN
  • Views: 3290
  • Message 6 of 7

Re: Linux fcoe with an CN4022

2018-07-25, 8:16 AM
So, the issue is solved with driver upgrade ?

0 person found this solution to be helpful.

This helped me too

Reply
Options

6 Posts

02-22-2017

FR

9 Signins

87 Page Views

  • Posts: 6
  • Registered: ‎02-22-2017
  • Location: FR
  • Views: 87
  • Message 7 of 7

Re: Linux fcoe with an CN4022

2018-07-25, 13:27 PM
Yes, with RHEL 7 and CentOS
Reply
Forum Home

Community Guidelines

Please review our Guidelines before posting.

Learn More

Check out current deals!

Go Shop
X

Save

X

Delete

X

No, I don’t want to share ideas Yes, I agree to these terms