DSM-G600, DNS-3xx and NSA-220 Hack Forum

Unfortunately no one can be told what fun_plug is - you have to see it for yourself.

You are not logged in.

Announcement

#1 2007-08-08 20:55:39

Spine
New member
Registered: 2007-08-08
Posts: 2

RAID Reliability

Hello everyone,  I've been lurking on the forum for a while and have been reading about some of the topics/issues with this unit but would like to hear some opinions on a topic specifically:  RAID 1 (mirroring).

I am becoming more concerned with data backup for my home network.  I would like to use the DNS-323 with two 500GB drives in a RAID 1 configuration but after reading some of the troubles people are having I am wondering how reliable the DNS-323 will be if one of the drives fails.  I guess I have a few questions for the experts.

1.  In the event of a drive failure, how likely is it that the DNS-323 will notify me of a failed drive.
2.  If a drive fails in a RAID1 config, how difficult is it to remove the failed disk and rebuild the array?
3.  How likely is it that the rebuild will end in disaster and mirror the wrong disk?
4.  Does the firmware do this automatically and reliability (i have read reports of people having to manually telnet into the box to rebuild arrays).
5.  What are the things NOT to do in the event of a drive failure
6.  Does it matter which drive fails (i.e. 1st or 2nd disk)

I am very intrigued by this device but do not want to buy it unless this machine is reliable in its RAID operations.

Thanks in advance to everyone that replies.

Offline

 

#2 2007-08-08 21:15:52

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: RAID Reliability

Using firmware v1.03

1 - Very likely - provided you have email notifications enabled and working - don't rely on the front panel LEDs to go amber.
2 - easy as 123 - 1 - power the system down, 2 - remove the failed drive, 3 - insert the new drive.
3 - In my opinion not very likely, I've done some pretty through testing of drive failure scenarios and not had it happen once - see #5 below.
4 - No - it is not automatic, after replacing the drive you must log in through the web interface and accept the format & rebuild prompts.
5 - Ensure the replacement drive has no partitions on it and is the same size or larger than the failed drive.
6 - No - it doesn't.

Having said all that - the purpose of RAID is to reduce the impact of downtime when a disk fails.  It is not a subsitute for backup and if you do not backup the data stored on a RAID array (doesn't matter if it's a DNS-323 or another device) you will at some point lose it.

Offline

 

#3 2007-08-18 15:23:03

Focher
Member
Registered: 2007-05-23
Posts: 35

Re: RAID Reliability

I don't want to be overly alarming, but I had a RAID1 configuration with 2x750GB drives that the DNS-323 just stopped recognizing. The wizard basically acted like I had 2 fresh drives in the unit.

My "solution" was to put the drives in a normal Linux box. Even then, the RAID wasn't directly recognized. I had to manually reassemble the RAID using the mdadm software and then use some ext2 recovery software to get my files back. I didn't experience any data loss, but my recovery method was not something I would recommend for anyone without very good Linux skills. D-Link basically ignored me when I asked for help. I wasn't surprised by this, but just sharing the experience so you are warned.

Fonz recommended what I think is the best approach regarding the DNS if you are thinking of RAID1. Just format the drives separately and periodically backup one drive to the other. Considerably more reliable if you ask me.

Offline

 

#4 2007-08-19 13:56:41

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Hi Focker,

So are you saying just put in 2 drives (without RAID1) and manually drop and drag files across every so often?  Is there a script that could be run with Windows scheduler to automate this, if indeed this is the most reliable way to back up?

I could be missing something here...

Chumby

Offline

 

#5 2007-08-20 14:27:20

Emacs
Member
Registered: 2007-06-24
Posts: 110

Re: RAID Reliability

Chumby,

if your DNS323 is funplugged and you have some basic Linux knowledge I would strongly advice not to copy via Windows.
When you copy though Windows, all data has to be transfered through the network, to the PC and back to the 2nd disk in the DNS323.

If you issue a copy-command or script directly on the DNS323 within a telnet session, the files are just copied within the DNS323.

The later version is faster - much, much faster.

Cheers,

Emacs

Offline

 

#6 2007-08-20 14:45:34

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Emacs - thanks very much for the tip.

Hmmm.... dns not funplugged but thinking about it.  Just a bit nervous as I literaly know zip about Linux.  Saying that I would be able to pick up the basics I guess??

So is there any way to automate the copying?  Would I schedule a telnet session (using putty or something) via the windows scheduler which could copy the files on a regular basis?

Are there any example scripts around to have a look at?

Finally, I am presuming NOT to go RAID1 is the way to go - just do this manual copy idea.

Thanks heaps for the help.

Cheers,
Chumby.

Offline

 

#7 2007-08-20 18:38:02

Emacs
Member
Registered: 2007-06-24
Posts: 110

Re: RAID Reliability

Chumby,

I'm still working on an automatic solution myself - haven't found the time yet.
Theoretically it can be down via the web-interface of the DNS-323. There is an "automatic download" feature, which - if configured correctly - should be able to copy the content of one disk to the other. But I remember some forum postings, of people who ran into problems doing this.

The better approach is to write a shell-script using something like the "rsync" command (still looking into details here) and to have it run by the DNS' scheduler (called "crond" in the Linux world).

The general advantage in doing a copy compared to a RAID in this case is, that your have the data twice in case of harddisk failure and additionally are safe from accidental deletion of files, as not both filesystems are affected.

Cheers,

Emacs

Last edited by Emacs (2007-08-20 18:39:16)

Offline

 

#8 2007-08-20 23:54:43

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Emacs - thanks heaps for the info on this.  Yea, I can see the advantages over RAID1.  I wonder if you would need to delete evreything on Volume_2 before the copy over, to ensure their are no files that you wanted to delete on Volume_1 still hanging round on Volume_2 from a previous backup.

What about copying to an attached storage device instead of Volume_2.  Would that have any advantages?

Chumby

Offline

 

#9 2007-08-21 00:11:30

Brent212
Member
Registered: 2007-06-21
Posts: 5

Re: RAID Reliability

fordem wrote:

the purpose of RAID is to reduce the impact of downtime when a disk fails.  It is not a subsitute for backup and if you do not backup the data stored on a RAID array (doesn't matter if it's a DNS-323 or another device) you will at some point lose it.

Assuming you never had a time where both drives failed before the array could be rebuilt, could you still lose data? If so, how?

Offline

 

#10 2007-08-21 03:57:51

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: RAID Reliability

Brent212 wrote:

fordem wrote:

the purpose of RAID is to reduce the impact of downtime when a disk fails.  It is not a subsitute for backup and if you do not backup the data stored on a RAID array (doesn't matter if it's a DNS-323 or another device) you will at some point lose it.

Assuming you never had a time where both drives failed before the array could be rebuilt, could you still lose data? If so, how?

Ever had a user delete a file - either deliberately or by accident?  Ever had a virus corrupt your files?  Ever had an application crash and corrupt it's data files?

With RAID whatever happens, happens to both copies of the data at the same time - if you don't have a backup, your data is GONE - if you have a backup, you can restore from that backup, however depending on the time interval between the backup and whatever destructive event occured you may lose data, but rekeying a day's worth of transactions is a lot less traumatic than rekeying a month, and backup strategies can (and should) be developed to minimizes that data loss.

Offline

 

#11 2007-08-21 04:11:56

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Fordem....

Do you know how to automate copying data from one volume to the other using funplug and the method that Emacs is talking about.  This seems to be the way to go - but not that easy for a newbie like me wink

Cheers
Chumby.

Offline

 

#12 2007-08-21 15:36:54

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: RAID Reliability

The short answer is no - I know just enough linux to be dangerous, but not enough to be useful - but - I would guess RSYNC to do the copy (if it's available) and some sort of CRON task to automate it, just don't ask me how.

Offline

 

#13 2007-08-21 16:28:15

skydreamer
Member
From: At the Atlantic Coast
Registered: 2007-01-06
Posts: 232

Re: RAID Reliability

This should work if you can get your hands on a full version of rsync

rsync -rlptDv --delete  source_dir destination_dir >log_file


I used it for backups on FC6.

However trying to replace broken RAID1 functionality with rsync is not the way to go.

Offline

 

#14 2007-08-21 16:34:47

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Thanks for the Fordem and Skydreamer...

Just to make it clear - (newbie here)...

I have installed funplug and I can telnet to my dns.  That bit is OK... however...

What step by step process do I go through to get everything from volume_1 to volume_2 (deleting everything off volume_2 first) say once a day at night. (Sorry Skydreamer if this is really basic - I am new to all this...)

You guys are great....

Cheers,
Chumby

Offline

 

#15 2007-08-22 02:03:21

Brent212
Member
Registered: 2007-06-21
Posts: 5

Re: RAID Reliability

fordem wrote:

Brent212 wrote:

fordem wrote:

the purpose of RAID is to reduce the impact of downtime when a disk fails.  It is not a subsitute for backup and if you do not backup the data stored on a RAID array (doesn't matter if it's a DNS-323 or another device) you will at some point lose it.

Assuming you never had a time where both drives failed before the array could be rebuilt, could you still lose data? If so, how?

Ever had a user delete a file - either deliberately or by accident?  Ever had a virus corrupt your files?  Ever had an application crash and corrupt it's data files?

Okay, I see what you're saying, although those causes aren't exactly what I was looking for. Of course if I accidentally delete a file it's gone. I was primarily asking about losing data due to something like a hardware failure... or I guess a good way to put it is a non-user error. Is there any way to lose data if you are completely free from user errors (including being a victim of a virus or some sort of hacking attack)?

Offline

 

#16 2007-08-22 05:30:25

mrmiketheman
Member
Registered: 2007-08-16
Posts: 10

Re: RAID Reliability

I've encountered an interesting variant of this problem. I'm using 2 Hitachi's 1TB drives. Because I needed more space before my DNS-323 arrived, I copied a bunch of data to one of the drives. I called tech support (waste of time) to confirm that I could load 1 drive (left bay as depicted in the manual), copy the data to it, load the 2nd drive, and configure it for RAID 1.  WRONG!!!

I ended up with a JBOD and too much data to offload and start the process over.  The system didn't give me the option to format the 2nd drive for RAID1.  After the format was complete, in order to convert to RAID 1, I'd have to erase EVERYTHING. I've also ended up with Volume_1 mapped to /mnt/HD_b2 and Volume2 mapped to /mnt/HD_a2!  I would recommend updating the FAQ to warn people to put the first drive in the the RIGHT side first.

Questions:
- Any ideas on how to remap Volume_1 back to HD_a2 (as per the std config) and Volume_2 to (HD_b2)?  Do I need to swap the drives?  Is there chance for data loss....OK OK...so I need to purchase a THIRD USB drive to back this sucker up.

- Now I'm thinking an rsync CRON job that copies data from Volume_1 to Volume2 (with Volume_1 treated as the primary) might meet my needs better. Granted, this doesn't save me from 24 hours of data loss if a drive dies, but it does give me 24 hours of recoverability!  Plus if the DNS freaks out, I can use std UNIX tools to access either drive without dealing with any funky RAID setup.

- Anyone setup the BackupPC program using the DNS-323 as a server to perform remote backups and system mirroring?

Offline

 

#17 2007-08-22 07:55:07

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Hi mrmikethman,

I found the software that came with the device a real dud.... you couldn't use it to back information back up to the DNS - you could only copy information down off it.  An $80 purchase or something is needed to get the pro version which sees the NAS both ways.

Chumby.

Offline

 

#18 2007-08-22 21:27:16

Spine
New member
Registered: 2007-08-08
Posts: 2

Re: RAID Reliability

skydreamer wrote:

This should work if you can get your hands on a full version of rsync

rsync -rlptDv --delete  source_dir destination_dir >log_file


I used it for backups on FC6.

However trying to replace broken RAID1 functionality with rsync is not the way to go.

Hi skydreamer - how is the RAID1 functionality broken on the DNS323?

Also, thanks to everyone for adding to this thread.. these are issues that I wanted to hear some opinions on before I pulled the trigger and buy a DNS-323!

Offline

 

#19 2007-08-23 21:20:57

dan.crouthamel
Member
Registered: 2007-08-23
Posts: 43

Re: RAID Reliability

Focher wrote:

Fonz recommended what I think is the best approach regarding the DNS if you are thinking of RAID1. Just format the drives separately and periodically backup one drive to the other. Considerably more reliable if you ask me.

I agree, and that's exactly what I'm doing with my DNS.  On top of that, that data is being synced to another drive on a windows machine.  I hope to avoid that part by reading up on the HowTo for attaching an external USB drive, so I don't have to sync data over the network.

Offline

 

#20 2007-08-23 22:45:44

Brent212
Member
Registered: 2007-06-21
Posts: 5

Re: RAID Reliability

dan.crouthamel wrote:

Focher wrote:

Fonz recommended what I think is the best approach regarding the DNS if you are thinking of RAID1. Just format the drives separately and periodically backup one drive to the other. Considerably more reliable if you ask me.

I agree, and that's exactly what I'm doing with my DNS.  On top of that, that data is being synced to another drive on a windows machine.  I hope to avoid that part by reading up on the HowTo for attaching an external USB drive, so I don't have to sync data over the network.

But then if a file becomes "corrupted", isn't there a chance that you'll be backing up that corrupted file and losing a good version of it? Not sure how it happens, but in the past I've opened up a video file to discover that half of the movie is missing. If I just formatted my backup drive and copied everything to it, I'd now have two copies of that screwed up video file. Incremental backups seem to avoid this, although I'm not positive about that.

Offline

 

#21 2007-08-24 01:23:27

Focher
Member
Registered: 2007-05-23
Posts: 35

Re: RAID Reliability

Brent212 wrote:

But then if a file becomes "corrupted", isn't there a chance that you'll be backing up that corrupted file and losing a good version of it? Not sure how it happens, but in the past I've opened up a video file to discover that half of the movie is missing. If I just formatted my backup drive and copied everything to it, I'd now have two copies of that screwed up video file. Incremental backups seem to avoid this, although I'm not positive about that.

You need to determine what you are really trying to accomplish. If you want to have revisions of files, then you are asking for something more complex than just backing up one drive to the other.

The original question in the thread was about the reliability of the RAID functionality in the DNS. In the experience of some of us, the RAID functionality itself is reliable but the DNS can lose the RAID configuration with no easy method to reassemble the RAID. That is exactly what happened to me with a RAID1 configuration. The DNS unit lost the RAID configuration despite that the drives were fine and the data was intact. The DNS software, however, only offered to format these "new" drives for me. That, in my opinion, makes the RAID more dangerous to use on the unit.

The method of copying the data from one drive to another was specifically to substitute for what a RAID1 configuration does anyway - mirror the drives. You are correct that if the data is corrupt on my drive, the data is corrupt on the other.

Offline

 

#22 2007-08-24 19:51:06

dan.crouthamel
Member
Registered: 2007-08-23
Posts: 43

Re: RAID Reliability

I'm just using rsync to keep data in sync across the 2 drives.  That's good enough for me smile

Offline

 

#23 2007-08-25 16:37:16

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Dan,

Thanks for that.  For the newbies here... how do you run rsync?  Do you automate that on a daily basis or something?  Is it automatied through the DNS scheduler, or windows?

Cheers
Chumby.

Offline

 

#24 2007-08-25 19:23:08

dan.crouthamel
Member
Registered: 2007-08-23
Posts: 43

Re: RAID Reliability

Chumby wrote:

Dan,

Thanks for that.  For the newbies here... how do you run rsync?  Do you automate that on a daily basis or something?  Is it automatied through the DNS scheduler, or windows?

Cheers
Chumby.

The hard way - manually smile  Just telneting into the device and running it from the command line for the directories I really care about.  I'm looking into something more automated, but for now this will work.

Offline

 

#25 2007-08-26 01:36:37

Chumby
Member
From: Tasmania, Australia
Registered: 2007-08-01
Posts: 96
Website

Re: RAID Reliability

Thanks Dan,

So I have done the funplug and can telnet in. 

Can you give me an example line where I can delete everything off Volume2, and then copy everything from Volume1 to Volume2 (lh drive to rh drive) using rsync.

Much appreciated!

Chumby

Offline

 

Board footer

Powered by PunBB
© Copyright 2002–2010 PunBB