cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Schlabberer
Token Ring
Posts: 48
Registered: ‎02-04-2015
Location: DE
Views: 230
Message 1 of 4

TS250 - Link flapping: The port 1 of PCIe device 03:00:00 at onboard has link down / link up.

A new TS250 7Y45CTO1WW S4BBE834 is set up as VMware vSphere 6.7 U3 (+updates) Host. NIC1 and 2 are both connected to a switch.

After we configured notifications, we found reoccouring notifications about link up and link down events on ethernet Interface 1.

We can confirm this from looking at the logs of the HPE 1920 S switch as well as we find this messages in the VMware event logs as loss of uplink redundancy.

To exclude cable or switch fault, we crosss plugged the cables between NIC1 and NIC2. The error remained at NIC1.

 

The event happes about once per hour but intermittently. The link up message comes 10 seconds after the link down event.

 

The machine has the latest firmware and drivers from date 08.10.2019.

 

Known issue or hardware fault?

 

Alert Text: The port 1 of PCIe device 03:00:00 at onboard has link down.

            Type of Alert: System - Other

 

            Severity: 4

            Date(m/d/y): 10/12/2019

            Time(h:m:s): 07:48:02

 

            Contact:

 

            Location: Main

            BMC Text ID: ESX01-XCC

            BMC Serial Number: S4BBE834

            BMC UUID: DDE04666CA2111E9936F9E5A4402E943

            Event ID: 400000dc00000000

 

 

Alert Text: The port 1 of PCIe device 03:00:00 at onboard has link up.

            Type of Alert: System - Other

 

            Severity: 4

            Date(m/d/y): 10/12/2019

            Time(h:m:s): 07:48:12

 

            Contact:

 

            Location: Main

            BMC Text ID: ESX01-XCC

            BMC Serial Number: S4BBE834

            BMC UUID: DDE04666CA2111E9936F9E5A4402E943

            Event ID: 400000dc00000000

Schlabberer
Token Ring
Posts: 48
Registered: ‎02-04-2015
Location: DE
Views: 170
Message 2 of 4

Re: TS250 - Link flapping: The port 1 of PCIe device 03:00:00 at onboard has link down / link up.

Opened a Lenovo support case. Seems there is a not publicy documented issue with the Broadcom NIC firmware 214.0.5.5 we are using. NCSI, some feature only of NIC1 to communicate with the XCC controller.

Answer from support:

Firmware 214.0.5.5 of the LOM is affected.
 

 Workaround 1:
 -------------
 If the LXCC is connected via "Dedicated Network Port" to the network you can disable NCSI on NIC1.
 
 The procedure to disable NCSI as a temporary workaround would be:
 - boot a BOMC disk with the Broadcom firmware .bin file on the host with issues
 - as soon as the BOMC screen opens, minimize the update screen
 - right click the desktop and open xterm terminal
 - cd /run/initramfs/live/
 - mkdir /home/broadcom
 - ./brcm-lnvgy_fw_nic_nx1-214.0.5.5_linux_x86-64.bin -x /home/broadcom
 - cd /home/broadcom
 - ./lnxfwupg -all cfg -mgmt 0
 - reboot
 
 
 ​
 Workaround 2:
 -------------
Downgrade LOM Firmware to 212.0.5.4.
 https://datacentersupport.lenovo.com/us/en/downloads/ds505285




Btw: the Changelog of the firmware 214.0.5.5  does not state any known issues by today:

Firmware Version: 214.0.5.5

---------------------------

Problems Fixed: - Updated UEFI driver with signed version Incremental

Interoperability: -

None Known Issues: - None

Lenovo Employee ccchen
Lenovo Employee
Posts: 368
Registered: ‎09-03-2018
Location: US
Views: 163
Message 3 of 4

Re: TS250 - Link flapping: The port 1 of PCIe device 03:00:00 at onboard has link down / link up.

Hi Schlabberer,

 

Glad to hear you've reached out support team and got a fixed. 

If there are no further questions would it be safe to say this post can be resolved? If so, please mark this thread with a solution so others can utilize it if needed.

Thank you.

 

Schlabberer
Token Ring
Posts: 48
Registered: ‎02-04-2015
Location: DE
Views: 61
Message 4 of 4

Re: TS250 - Link flapping: The port 1 of PCIe device 03:00:00 at onboard has link down / link up.

The Workaround 1 did not solve the issue.
Support now suggested to install Firmwareupgrade 214.0.6.1 for the Broadcom LOM.

Check out current deals!


Shop current deals

Top Kudoed Authors