DSM-G600, DNS-3xx and NSA-220 Hack Forum

yo_adrian_eh · 2008-11-11 03:49:54

I feel special, a newbie who made a contribution! Thx.

My backup has been running since noon and still isn't finished!! it's 142GB, shouldn't take that long...should it..? We're at 8.5hrs and not quite finished, still 10gb to go. What should I expect as transfer rate between the drives? I figured this might be a 3hr job, not 9hr.

Yo!Adrian, eh?
Toronto

Chumby · 2008-11-11 05:13:05

Hi yo_adrian_eh!

The first one will take a quite a long while, but copies after that will be much quicker. Only the "changes" are copied the second time around ... not all the data again. You should see massive speed increases next time around.

Thanks for the contribution... it all helps

Cheers,
Chumby

yo_adrian_eh · 2008-11-11 20:50:47

Yes, I reset the time, added a folder to Drive 1 and waited to see what it would do, it was running just a few short minutes, perfect! I didn't realize it would do an incremental after the initial full backup. This is great!!

Another question, I think I read somewhere deep in this thread about a log file size limit (?), and if not, what happens if I delete the log file? (I know, it's just a txt file and shouldn't take a lot of space). Will the script basically start from scratch and perform a new full backup, then incrementals as usual from that point?

Thanks again!
Yo!Adrian, eh?
Toronto

silversurfer · 2008-11-11 21:39:48

Nothing will happen when you delete the log file. Rsync doesn't need it to work properly.

Actually I use to overwrite the log file on every run and email it to me. That way I can easily check it and archive the logs.

What you probably read about was a memory issue that occured when rsync has to many files to check. It needs to keep some sort of file list in RAM and the DNS doesn't have plenty of that you know.

Chumby · 2008-11-11 23:57:54

Silversurfer - like your notes earlier about emailing the results of the backup. Is it working AOK now? Would like to put this into the tut at the start...

Welll done for the help..

Cheers
Chumby

silversurfer · 2008-11-12 02:10:53

Yes, email is working in my script but sendmail depends on the version of busybox which is 1.11.1 on my CH3SNAS with ffp version 0.5. You can find my current version of the backup script here

Nurunet has reported a problem with sendmail though and Fonz said that he removed it from version 1.12 of busybox. He suggested using esmtp but I haven't tried that so far.
I don't know if that email configuration of mine is good enough for a tutorial because my network configuration is a bit special. I have my own mail server here.

bent98 · 2008-11-15 04:29:05

Can someone please clarify if this does an incremental backup?

Last edited by bent98 (2008-11-15 15:02:20)

profm2 · 2008-11-15 05:09:36

Chumby ...

Thanks for the tutorial.

One thought crossed my mind about data integrity that I haven't seen mentioned on here .. what about using MD5 hashes of the files that you back up? I understand this would slow down the transfer, but on the "master" drive, generate a MD5 sum of the directory ... then after you back up, verify the file on the backup. If none is provided, then just a copy and assume the file is valid.

Thoughts?

halfsoul · 2008-11-15 23:19:48

bent98 wrote:
Can someone please clarify if this does an incremental backup?

Depends on what you mean. Does incremental mean:
a) only updates changes since the previous sync = YES
b) changes are saved incrementally such that you can go back to previous iterative changes = NO

Alabamaeee · 2008-11-29 11:58:59

My first post so please be gentle :-)

Just bought a DNS 323 and about to do the Fun Plug install but noticed the highest version of firmware in the instructions is 1.04. I have flashed the box to 1.05 and wonder if anyone is using FFP with 1.05, if not is it possible to go back to 1.04 as I need a backup solution that is not Raid.

halfsoul · 2008-11-30 01:19:07

Alabamaeee wrote:
My first post so please be gentle :-)

Just bought a DNS 323 and about to do the Fun Plug install but noticed the highest version of firmware in the instructions is 1.04. I have flashed the box to 1.05 and wonder if anyone is using FFP with 1.05, if not is it possible to go back to 1.04 as I need a backup solution that is not Raid.

I am using ffp with 1.05. You'll be fine. Good luck.

Alabamaeee · 2008-11-30 21:30:04

For some reason I installed 1.04 :-(

I'm having a few problems which I do not want to try and fix until I ask you guys ;-)

Here is the log after a first attempt at backup

**** fun_plug script for DNS-323 (2007-09-16 tp@fonz.de) ****
Sun Nov 30 20:22:04 GMT 2008
* /mnt/HD_a2/fun_plug.d/start/00syslog.sh not executable...
* Running /mnt/HD_a2/fun_plug.d/start/00telnetd.sh start ...
Starting telnetd...
* /mnt/HD_a2/fun_plug.d/start/00timezone.sh not executable...
* Running /mnt/HD_a2/fun_plug.d/start/editcron.sh start ...
* /mnt/HD_a2/fun_plug.d/start/inetd.sh not executable...
* /mnt/HD_a2/fun_plug.d/start/rsyncd.sh not executable...
* Done

Obviously I can go in and stumble my way enough to CHMOD the files above but as it is not in the tutorial I want to check it is OK.

Thanks.

EDIT.......

OK I took a chance and CHModded the files above. The backup went fine with the following appended...

System time: 2008/11/30 Sun 21:1:54
* Running /mnt/HD_a2/fun_plug.d/start/editcron.sh start ...
* Running /mnt/HD_a2/fun_plug.d/start/inetd.sh start ...
ERROR: inetd not found or not executable
* Running /mnt/HD_a2/fun_plug.d/start/rsyncd.sh start ...
Starting rsyncd...
* Done

Only thing I still don't understand is the ERROR "inetd not found or not executable". It's executable OK and I have not moved it from the default DIR it was created in.

Last edited by Alabamaeee (2008-11-30 22:22:34)

Alabamaeee · 2008-12-02 15:00:37

Replying to myself feels weird but I have it running as indicated in my last post, however as you can see below I have two backup times set, but I realised that the log only shows one.

Which lines do I need to duplicate in the script to write the log for the second backup at 22:03?

#!/bin/sh

CRONTXT=/mnt/HD_a2/crontab.txt

/bin/crontab -l >$CRONTXT

/bin/echo "3 13 * * * /mnt/HD_a2/fun_plug.d/bin/rsync -av --delete /mnt/HD_a2 /mnt/HD_b2 >> /mnt/HD_a2/fun_plug.d/log/rsync.last.log 2>&1" >> $CRONTXT
/bin/echo "3 22 * * * /mnt/HD_a2/fun_plug.d/bin/rsync -av --delete /mnt/HD_a2 /mnt/HD_b2 >> /mnt/HD_a2/fun_plug.d/log/rsync.last.log 2>&1" >> $CRONTXT

/bin/crontab $CRONTXT

/bin/rm $CRONTXT

Sorry for such a basic question but I do not yet know what the other lines do exactly

Alabamaeee · 2008-12-03 20:06:33

Anyone have an answer to my last post?

mig · 2008-12-03 21:10:43

Alabamaeee wrote:
... I have two backup times set, but I realised that the log only shows one.

The cron jobs (as written) append the logs for each backup to the same file.
You should have one file with both backup logs in it.
Are you not seeing both backup logs in the file /mnt/HD_a2/fun_plug.d/log/rsync.last.log ?

Alabamaeee · 2008-12-04 00:44:39

I'm mixed up with two log files and what they do!

I can see the files from both sessions OK now that I look in rysnc.last.log. I was looking in the Fun_plug log and wondering why I could not see the backup run at the times. For instance the 13:03 seems to be launched about 12:50 hrs but the drives start working at 13:03. I have the time set from the net and am not worried about a few minutes either way.

This confuses me though

---------------
System time: 2008/12/3 Wed 17:30:27
* Running /mnt/HD_a2/fun_plug.d/start/editcron.sh start ...
* Running /mnt/HD_a2/fun_plug.d/start/inetd.sh start ...
ERROR: inetd not found or not executable
* Running /mnt/HD_a2/fun_plug.d/start/rsyncd.sh start ...
Starting rsyncd...
* Done
-----------------------------------------------------

I know Inetd.sh is executable, I checked all the files in the start dir and they all have the same permissions.

All seems to work though which is great as now I can have faith in having a true copy of my precious data.

Last edited by Alabamaeee (2008-12-04 00:46:07)

Alabamaeee · 2008-12-12 19:12:49

Way back in the thread someone asked how to include code in the script to overwrite the log files when they get large. I'd like to do this but even programming my video recorder is difficult for me so code is in another language (pun intended).

Perhaps some of you guys might post a little code to do this and advise where to place it in the script.

Also one other observation and a bonus. If I don't have the box switched on at backup time it automatically does the backup when I next switch on, great for those who suffer from "senior moments".

Thanks for such a great backup software and for such an informative site.

hoveringbug · 2009-01-12 00:25:32

I copied everything that was said, and everything seemed to work fine. However after I rebooted the dns 323, and confirmed the code was there, it wasn't. There were only the other three codes. Does it have anything to do with the firmware 1.06?

hoveringbug · 2009-01-12 00:57:20

nevermind. I didn't have the end " . though to my defense I have never worked with lenux. Only MS dos.

Chumby · 2009-01-19 12:31:17

Nice work hoveringbug... is it all still working fine for you?

Cheers
Chumby

hoveringbug · 2009-01-19 20:58:58

still works great. Thanks for the lines of code.

daemonx · 2009-01-23 06:01:50

I've around 600GB+ on my 323. I got another disk purely for data backup(my Volume_1 is one of the affected seagate drive). I tried to use the method described here. The sync works, but the initial sync takes way too much time,so i aborted. My question is,can i use 'cp' to do the intial backup and then use rsync for successive backups??

silversurfer · 2009-01-23 14:12:30

"cp" won't be any faster as far as I know but you can try. Use "cp -a" to preserve links and permissions.

daemonx · 2009-02-03 11:05:54

silversurfer wrote:
"cp" won't be any faster as far as I know but you can try. Use "cp -a" to preserve links and permissions.

cp -a is faster than rsync.it took be around 5 hours in rsync to copy around 100Gigs whereas it only took me around 9 hrs or so for me to backup around 700Gigs using 'cp -a'.

After backing using cp, i did a dry run using rsync to see whether they were in sync and voila..it was .

after wards i used rsync to take incremental backups

therefore i recommend using cp first and backup and then use rsync for incremental backups

partimers · 2009-03-06 17:55:36

Hello,

Tks for the nice tutorial. I would like to use DNS-323 in its full capacity, meaning 2x1Tb (or whatever HD I can fit in there) as separate disks (no RAID).

Question:

- Can I use both disks to store data and use the procedure descibred here to backup on two additional backup boths disks?

Meaning:

- I would initially have boths seoarate disks as data storage
- Then I take out VolB and insert VolA backup on left bay, and Backup VolA to VolA Backup
- I then insert VolB back on left bay, take out VolA from right bay and insert there VolB Backup
- Then I backup VolB to VolB backup

Would it work? If yes, would it also work if instead of separate disks, I would use JBOD?

Not sure how I should proceed with the formatting. I would like to avoid having to use USB to backup, as I expect the backup between bays to me much faster.

Thanks in advance for your thoughts and information.

DSM-G600, DNS-3xx and NSA-220 Hack Forum

Announcement

#201 2008-11-11 03:49:54

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#202 2008-11-11 05:13:05

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#203 2008-11-11 20:50:47

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#204 2008-11-11 21:39:48

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#205 2008-11-11 23:57:54

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#206 2008-11-12 02:10:53

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#207 2008-11-15 04:29:05

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#208 2008-11-15 05:09:36

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#209 2008-11-15 23:19:48

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

bent98 wrote:

#210 2008-11-29 11:58:59

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#211 2008-11-30 01:19:07

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

Alabamaeee wrote:

#212 2008-11-30 21:30:04

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#213 2008-12-02 15:00:37

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#214 2008-12-03 20:06:33

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#215 2008-12-03 21:10:43

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

Alabamaeee wrote:

#216 2008-12-04 00:44:39

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#217 2008-12-12 19:12:49

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#218 2009-01-12 00:25:32

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#219 2009-01-12 00:57:20

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#220 2009-01-19 12:31:17

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#221 2009-01-19 20:58:58

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#222 2009-01-23 06:01:50

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#223 2009-01-23 14:12:30

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

#224 2009-02-03 11:05:54

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

silversurfer wrote:

#225 2009-03-06 17:55:36

Re: Tutorial: Backup Everything from Vol A to Vol B once a night

Board footer