English Community

Datacenter StorageLenovo Iomega Networking Storage
All Forum Topics
Options

7 Posts

07-21-2015

Portugal

10 Signins

79 Page Views

  • Posts: 7
  • Registered: ‎07-21-2015
  • Location: Portugal
  • Views: 79
  • Message 1 of 9

IX4 Raid 5 error

2015-07-21, 15:07 PM

Hello I have a IX4-200D on Raid 5, one of the drives died.

 

The iscsi volumes disapeared, and the NAS say that 3 new drives have been added to the NAS.

The NAS changed one disk to spare.

 

i-ve connected with ssh

 

root@storage:/# mdadm -D /dev/md1
/dev/md1:
Version : 01.00
Creation Time : Wed Sep 10 18:54:47 2014
Raid Level : raid5
Array Size : 5854422528 (5583.21 GiB 5994.93 GB)
Used Dev Size : 3902948352 (3722.14 GiB 3996.62 GB)
Raid Devices : 4
Total Devices : 3
Preferred Minor : 1
Persistence : Superblock is persistent


Update Time : Tue Jul 7 09:21:34 2015
State : clean, degraded
Active Devices : 2
Working Devices : 3
Failed Devices : 0
Spare Devices : 1

Layout : left-symmetric
Chunk Size : 64K

Name : storage:1 (local to host storage)
UUID : eb95f611:2296fbea:6f602af2:927375ea
Events : 493154

Number Major Minor RaidDevice State
0 0 0 0 removed
1 8 18 1 active sync /dev/sdb2
2 0 0 2 removed
3 8 50 3 active sync /dev/sdd2

2 8 34 - spare /dev/sdc2
root@storage:/#

Personalities : [linear] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md1 : active raid5 sdc2[2](S) sdd2[3] sdb2[1]
5854422528 blocks super 1.0 level 5, 64k chunk, algorithm 2 [4/2] [_U_U]


md0 : active raid1 sdd1[3] sdc1[2] sdb1[1]
2040128 blocks [4/3] [_UUU]


unused devices: <none>

There is any way to move the drive to the array again without loose the data ?

Thanks and Regards

Reply
Options

1143 Posts

05-07-2015

US

601 Signins

9247 Page Views

  • Posts: 1143
  • Registered: ‎05-07-2015
  • Location: US
  • Views: 9247
  • Message 2 of 9

Re: IX4 Raid 5 error

2015-07-21, 19:15 PM
Hello joaoccc,

The majority of the time, this is caused by a drive failure, which cannot be fixed via VI.

However, some users have had success with UFS Explorer in this type of scenario.

Another option is trying to restart the RAID, here is a search return to get you started:
https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=linux%20restart%20raid
Reply
Options

7 Posts

07-21-2015

Portugal

10 Signins

79 Page Views

  • Posts: 7
  • Registered: ‎07-21-2015
  • Location: Portugal
  • Views: 79
  • Message 3 of 9

Re: IX4 Raid 5 error

2015-07-22, 9:04 AM

Hello

 

After reboot the NAS recognizeall the drives and begin rebuilding the Raid.

 

when it finished, the disk that the NAS don't recognize was put as spare, so now i have two spares.

 

root@storage:/# mdadm -D /dev/md1
/dev/md1:
Version : 01.00
Creation Time : Wed Sep 10 18:54:47 2014
Raid Level : raid5
Array Size : 5854422528 (5583.21 GiB 5994.93 GB)
Used Dev Size : 3902948352 (3722.14 GiB 3996.62 GB)
Raid Devices : 4
Total Devices : 4
Preferred Minor : 1
Persistence : Superblock is persistent

Update Time : Wed Jul 22 07:56:07 2015
State : clean, degraded
Active Devices : 2
Working Devices : 4
Failed Devices : 0
Spare Devices : 2

Layout : left-symmetric
Chunk Size : 64K

Name : storage:1 (local to host storage)
UUID : eb95f611:2296fbea:6f602af2:927375ea
Events : 493200

Number Major Minor RaidDevice State
0 0 0 0 removed
1 8 18 1 active sync /dev/sdb2
2 0 0 2 removed
3 8 50 3 active sync /dev/sdd2

0 8 2 - spare /dev/sda2
2 8 34 - spare /dev/sdc2

 

and i can't stop the Raid

 

root@storage:/# mdadm --stop /dev/md1
mdadm: fail to stop array /dev/md1: Device or resource busy

 

Regards

 

Reply
Options

1143 Posts

05-07-2015

US

601 Signins

9247 Page Views

  • Posts: 1143
  • Registered: ‎05-07-2015
  • Location: US
  • Views: 9247
  • Message 4 of 9

Re: IX4 Raid 5 error

2015-07-22, 19:09 PM
joaoccc,

It's been a while since I've been that deep into an SSH session.

Give me a bit to consult with a tier III agent here.

I would also recommend keeping the UFS Explorer option in mind.

Reply
Options

1143 Posts

05-07-2015

US

601 Signins

9247 Page Views

  • Posts: 1143
  • Registered: ‎05-07-2015
  • Location: US
  • Views: 9247
  • Message 5 of 9

Re: IX4 Raid 5 error

2015-07-24, 15:09 PM
joaoccc,

I've gotten replies from two different tier III agents, posting below:

"He can force the Raid controller to assembly the array.
Probably will not do him any good since he is using iSCSI.
If he was using SMB/CIFS or NFS, and after forcing the RAID Array.
He could then check to see what LVM shows.
Since this is iSCSI that is not an option."

"Yep different story with iSCSI, not likely he will be able to recover it even if we had detailed information on how to get it back. Even less so than doing the usul MDADM stuff to recover shares."

Reply
Options

3 Posts

07-24-2015

United States

4 Signins

25 Page Views

  • Posts: 3
  • Registered: ‎07-24-2015
  • Location: United States
  • Views: 25
  • Message 6 of 9

Re: IX4 Raid 5 error

2015-07-24, 17:14 PM

Do you have a valid and up tgo date backup?

If you do, then your best option is make sure you have 4 good driveds in the array by testing them individually with Seatools and then restoring from backup to a fresh array.

 

If you don't then you should stop what you're doing and contact a proffessional data recovery lab.

 

Why?

 

1. Your array became inaccessible after 1 drive failed, which means either another drive is unstable/failing, or there is a porblem with inconsistent parity on the remaining 3 drives.

2. You have already tried to do a rebuild that failed with bad drives in the array, which has almost certianly caused some unrecoverable data loss(how much is unclear).

3. If you take the advice to force the array online, you will only be causing more data loss by attempting to reassemble an already inconsistent set of drives.

4. UFS won't help you reverse the damage you've alraedy done to the parity set and will only give you useful information to rebuild if you have consistent parity.

5 There are plenty of data recovery labs that will do a free evaluation to tell you exact what's wrong and what can be done to get your data back.

 

Example: www.raiddatarecovery.com

 

Of course, you can alwasy PM me if you need further explanantion on the above points.

 

Best Regards,

 

Leon

Reply
Options

2 Posts

07-25-2015

Boston, USA

2 Signins

47 Page Views

  • Posts: 2
  • Registered: ‎07-25-2015
  • Location: Boston, USA
  • Views: 47
  • Message 7 of 9

Re: IX4 Raid 5 error

2015-07-25, 16:10 PM

I've worked on several failed Iomega IX4-200D systems and can say that recovery is usually possible.

 

First what we need to see is the SMART data on the drives. This will show if the drives are sound or failling. The Seagate drives used in the IX4 are often the problem. The Linux command for this is... smartctl.

 

Then post the RAID5 metadata. This will show how each RAID member drive is seen by the RAID5. Thiscommand should show it... mdadm --examine /dev/sd[abcd]2 

 

Note at this point you do not want to take any action that writes to the drives unless you are very sure of what you ae doing. In fact many would advise you to make image backups of each drive before proceeding. 

 

 

 

On-Line Data Recovery Consultant. Serving clients world-wide since 2011.
Reply
Options

3 Posts

07-24-2015

United States

4 Signins

25 Page Views

  • Posts: 3
  • Registered: ‎07-24-2015
  • Location: United States
  • Views: 25
  • Message 8 of 9

Re: IX4 Raid 5 error

2015-07-27, 15:59 PM

Stephen,

 

i know you offer your services based on donations(which I think is great), but this array is way beyond remote recovery in my opinion(I also work for a lab that offeres remote recovery services).

 

Part of the problem is that making immages on the failed or unstable drives will result in incomplete images even if you use low level tools like ddrescue, wheras a full suite of hardware tools will result in much cleaner images and as a result a clean RAID reconstruction.

 

The fact that there has been a partial rebuild done means you'll need as close as possible to 100% sector dumps from drive 10 AND drive 14(the initially failed one), so remote recovery is not going to be the the most complete data recovery possible.

 

I don't mean any offense to what you do, since you seem to do a good job of avoiding cuasing more problems, unlike the vast majority of people who troubleshoot these kinds of cases online.

 

However, i do think a full evaluation at a proffessional lab is the better route.

 

Best Regards,

 

Leon

Reply
Options

2 Posts

07-25-2015

Boston, USA

2 Signins

47 Page Views

  • Posts: 2
  • Registered: ‎07-25-2015
  • Location: Boston, USA
  • Views: 47
  • Message 9 of 9

Re: IX4 Raid 5 error

2015-07-27, 19:35 PM

Leon, Thank you for checking me out, If you like I would be happy to give you a demo of my remote recovery servce sometime. Note it is purely Linux based but easy to use.

 

In this case I think it is much too soon to say if the OP needs to ship the drives out to a lab. That's why I asked to see the SMART data to determine if any drives are showing signs of failure. And even if one drive has failed recovery may still be possible, in degraded mode, using the remaining three drives.

 

I do alot of remote NAS recovery work (WD ShareSpace, Seagate BlackArnor, Netgear ReadyNAS etc) and it is very rare that the services of a data recovery lab are needed. My therory is that the sensitivity of the RAID operating software will fail a RAID array long before serious drive damage can occur. So the drives from these failed NAS units are generally good candidates for remote recovery work.

 

Bottom line, more info is needed from the OP to determine the best course of action.

On-Line Data Recovery Consultant. Serving clients world-wide since 2011.
Reply
Forum Home

Community Guidelines

Please review our Guidelines before posting.

Learn More

Check out current deals!

Go Shop
X

Save

X

Delete