Welcome to our peer-to-peer forums, where owners help owners. Need help now? Visit eSupport here.

English Community

Datacenter SystemsSystem x - X6, M5, M4
All Forum Topics
Options

18 Posts

10-21-2018

Australia

38 Signins

233 Page Views

  • Posts: 18
  • Registered: ‎10-21-2018
  • Location: Australia
  • Views: 233
  • Message 1 of 14

Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-10, 22:52 PM

Hi Lenovo Support,

 

I am having an issue adding 1TB Samsung 860 SSD into x3650 M5 (8871).

 

The machine is currently populated with 14 SSDs:

 

3 x 800 GB SAS SSD

6 x 1TB SATA SSD

3 x 4TB SATA SSD

2 x 500GB SATA SSD

 

It has M5210 RAID with BBU & SAS Expander Backplane

 

When I add additional 1TB SATA SSD (into slot 6) is keeps coming up with Disk Failure.

I have booted into Setup (F1) and gone into Storage/Physical Disk configuration and the SSD does not appear in connected disk list,  so I cannot initialise disk and set it to "Configured Good" to make it availabe for use.

 

On IMM2 Web interfaces disk appears in "Physical Resources" window with Error Flag under "Non-manageable drives to IMM".

 

I have tested the drive in alternate x3650 M5 and it is able to configure and access the drive without issues.

 

In system log was reporting "Physical Backplane" error, so I  swapped the 0-7 Drive Backplane board over and still get disk error.

 

Could I have a faulty SAS Expander backplane on my machine ???

 

I have done all the simple testing I can at this point, so open to suggestions on other testing to help isolate the problem.

 

Thank you.

 

Zebity.

 

Reply
Options

97 Posts

08-13-2015

China

148 Signins

1344 Page Views

  • Posts: 97
  • Registered: ‎08-13-2015
  • Location: China
  • Views: 1344
  • Message 2 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-12, 7:04 AM

what slot does the M5210 seated , Per document M5210 on 8871 should install on slot 9 /4 /1/6.

 

https://lenovopress.com/lp0068-lenovo-system-x3650-m5-machine-type-8871

 

what's the firmware on the raid adapter, could you help to update the raid fw to latest veverion before install,  i had ever run into a case that new replace HDD doesn't recognize by raid adapter after drive failed / PFA.  after raid fw update to latest ,it solved. hope those info help you out.

Reply
Options

18 Posts

10-21-2018

Australia

38 Signins

233 Page Views

  • Posts: 18
  • Registered: ‎10-21-2018
  • Location: Australia
  • Views: 233
  • Message 3 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-12, 19:40 PM

Hi Jeromez,

 

thank you for response.

 

Here is extra information.

 

1. The M5210 RAID controller is in dedicated (slotless) internal slot #9

2. I created xClarity Boot Media just recently and did auto update on all firmware in machine: IMM2 - 5.11 / TC40046F, UEFI - 2.80 / TCE138D, M5210 - Firmware: 4.680.00-8392 (jul 17 2018 23:25:58)

3. Error Log:

ErrorDisks10 Dec 2018, 09:45:24.177 AM0x806f010d0406ffffThe Drive 6 has been disabled due to a detected fault

 

 

 

 

As per original post, the SSD works fine in alternate x3650 M5 (with same firmware versions).

 

Should I proceed with M5210 FW update ?

 

Thank you for responding.

 

Regards,

 

Zebity

 

Reply
Options

97 Posts

08-13-2015

China

148 Signins

1344 Page Views

  • Posts: 97
  • Registered: ‎08-13-2015
  • Location: China
  • Views: 1344
  • Message 4 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-13, 1:50 AM

seem raid fw (4.680.00-8392) already update to latest, Perhaps related to hdd expander, was other slot  when move to low slot number also fails ,s0 /s1.

 

could you output the storcli log for check 

 

x stand for the controller numer (0 ,1,2..) ,if only one raid controller /RAID HBA, should be c0

 

first clear all raid events,

 

./storcli64 /cx delete events

./storci64 /cx  delete termlog

 

then reseated the drive (pull out ,wait for some seconds, then pull in) , check IMM if still call out drive fails, collect the below raid logs

 

 

,/storcli64  /cx show events  >  events.log

./storcli64 /cx show termlog

./storcli64 /cx/eall show all

./storcli64 /cx show all

Reply
Options

97 Posts

08-13-2015

China

148 Signins

1344 Page Views

  • Posts: 97
  • Registered: ‎08-13-2015
  • Location: China
  • Views: 1344
  • Message 5 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-13, 1:57 AM

did the expander fw also the same when you test on other server, the latest expander should GA51. Sugggest to make sure the expander the same version when compare two server ( one can recognize this hdd ,the other can't ) ,

Reply
Options

18 Posts

10-21-2018

Australia

38 Signins

233 Page Views

  • Posts: 18
  • Registered: ‎10-21-2018
  • Location: Australia
  • Views: 233
  • Message 6 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-13, 6:26 AM

Hi Jeromez,

 

thanks again for tips.

 

I also read this forum item: https://forums.lenovo.com/t5/System-x-X6-M5-M4/x3650-expander-kit-running-slow/td-p/4224233

 

Where it identified that there is differences in documentation on way that Expander is wired up to M5120.

 

I opened my machine up and it was not wired as per the TypeL 8871 documention, so I changed the cabling around.

 

The result was that now I have got disk failure on drive in Slot #2 (previously it was Slot #6).

 

As this resulted in RAID configuration going into "Degraded" state, I have had to do some disk swaping to get RAID array rebuilt.

 

 

Also on the second machine I have it only has 8 disk slots and no expander, so while the M5210 card is on the same version. the physical connectivity is different.

 

In both the IMM2, Setup Screens and MegaRAID UI, I cannot see anything that shows version of the expander...

 

Does the Expander have its own Firmware that is seperate from the M5210 firmware ?

 

Once the RAID5 rebuilt completes I will conduct testing you suggested and post log results, against Slot #2 failure.

 

Thanks again.

 

Regards,

 


Zebity

 

Reply
Options

18 Posts

10-21-2018

Australia

38 Signins

233 Page Views

  • Posts: 18
  • Registered: ‎10-21-2018
  • Location: Australia
  • Views: 233
  • Message 7 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-13, 7:56 AM

Hi Jeromez,

 

I have done:

 

Changed the expander connection cabling, which resulted in slot #2 now failing. Hence using Slot #2 in this test,

 

1. sudo ./storcli64 /c0 delete events

2. sudo ./strocli64 /c0 delete termlog

3. Put drive back into x3650 (slot #2)

4. Logged into IMM2 where Slot #2 disk appears under physical devices under the "Non-managable drive to IMM" list at the bottom of drive list (though with Green Normal Tick Against it.

5. I have captured the logs as per your direction (but not surre how to diagnose these.

6. So while disk is there I cannot to anything with it as it is not one of disks under the M5210 pool.

7. The only thing that I can do now is reboot the machine and try to add drive via Setup utility....

 

Here is list of visible drives found via: storcli64 /c0 /eall /sall show:

---------------------------------------------------------------------------------------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type
---------------------------------------------------------------------------------------
9:0 10 Onln 0 744.125 GB SAS SSD N N 512B TXA2D20800GA6001 U -
9:1 11 Onln 0 744.125 GB SAS SSD N N 512B TXA2D20800GA6001 U -
9:3 12 Onln 0 744.125 GB SAS SSD N N 512B TXA2D20800GA6001 U -
9:4 26 Onln 1 930.390 GB SATA SSD N N 512B Samsung SSD 850 EVO 1TB U -
9:5 27 Onln 1 930.390 GB SATA SSD N N 512B Samsung SSD 850 EVO 1TB U -
9:7 19 Onln 1 930.390 GB SATA SSD N N 512B Samsung SSD 850 EVO 1TB U -
9:8 13 Onln 1 930.390 GB SATA SSD N N 512B Samsung SSD 850 EVO 1TB U -
9:9 23 Onln 1 930.390 GB SATA SSD N N 512B Samsung SSD 850 EVO 1TB U -
9:10 24 Onln 1 930.390 GB SATA SSD N N 512B Samsung SSD 860 EVO 1TB U -
9:11 18 Onln 2 3.637 TB SATA SSD N N 512B Samsung SSD 860 EVO 4TB U -
9:12 22 Onln 2 3.637 TB SATA SSD N N 512B Samsung SSD 860 EVO 4TB U -
9:13 21 Onln 2 3.637 TB SATA SSD N N 512B Samsung SSD 860 EVO 4TB U -
9:14 15 Onln 3 464.729 GB SATA SSD N N 512B Samsung SSD 850 EVO 500GB U -
9:15 14 Onln 4 464.729 GB SATA SSD N N 512B Samsung SSD 850 EVO 500GB U -
---------------------------------------------------------------------------------------

 

As you can see the drive in Slot #2 is not showing, yet if appears when you look at IMM web page.

 

 

Cheers,

 

Zebity

 

 

 

Reply
Options

11802 Posts

09-04-2014

Slovakia

33077 Signins

1238290 Page Views

  • Posts: 11802
  • Registered: ‎09-04-2014
  • Location: Slovakia
  • Views: 1238290
  • Message 8 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-13, 6:32 AM
 

Andy

 

Community Administrator
Lenovo eServices

Please remember to come back and mark the post that you feel solved your question as the solution, it earns the member + points 
Did you find a post helpfull? You can thank the member by awarding them a Thumbs Up
 

Please don't ask me questions by Personal Message; questions belong in the forums.


Using Browser Search to find your answers in Lenovo and Moto Community
Reply
Options

97 Posts

08-13-2015

China

148 Signins

1344 Page Views

  • Posts: 97
  • Registered: ‎08-13-2015
  • Location: China
  • Views: 1344
  • Message 9 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-14, 0:36 AM

Below link was for 8871 internal sas cable layout, pls help to follow & check

 

http://systemx.lenovofiles.com/help/index.jsp?topic=/com.lenovo.sysx.8871.doc/t_installing_8_25_hdd_kit_with_expander.html

 

second, yes there is seperated expander fw for expander below (GA51)

 

https://datacentersupport.lenovo.com/us/zh/products/SERVERS/SYSTEM-X/SYSTEM-X3650-M5/8871/downloads/DS505400

 

last, so after your re-cable sas route, s6 was recognized in os,  ,but s2 failed(not detetect, previously this HDD s2 was fine before re-cable layout).

 

So you can have a try to make the sas cable routing is good, and update expander to latest, and check

 

pls help to attache the IMM ffdc logs & requred raid logs you had capature yesterday , i can have a look.

Reply
Options

18 Posts

10-21-2018

Australia

38 Signins

233 Page Views

  • Posts: 18
  • Registered: ‎10-21-2018
  • Location: Australia
  • Views: 233
  • Message 10 of 14

Re: Disk Failure adding 1TB SSD to x3650 M5 (8871) with M5210 + Expander

2018-12-14, 18:41 PM

Hi Jeromez,

 

I run the expander firmware update as per link and rebooted machine.

 

On reboot slot #2 comes up as red in IMM and is flagged as "Non-Manageable by IMM".

 

I recaptured logs:

1. Events log

2. Termlog

3. Expander show all

4. Controller show all

 

Thank you.

 

Zebity

Reply
Forum Home

Community Guidelines

Please review our Guidelines before posting.

Learn More

Check out current deals!

Go Shop
X

Save

X

Delete

X

No, I don’t want to share ideas Yes, I agree to these terms