DSM-G600, DNS-3xx and NSA-220 Hack Forum

groovyjames wrote:

Hello everyone!

I've just got myself a DNS-323 and have been spending the last week taking in as much information as possible from this site - what a fantastic resource!

Fun_plug 1.04 has been installed, and now I've been trying to get automated backups working with BackupNetClone.  I just want to backup disk 1 to disk 2.  After a bit of trial-and-error, I've managed to get BackupNetClone to do something - however it seems VERY slow, and I'm not entirely sure what it's doing.  The harddrives are spinning, and my data appears to be being copied to disk 2 - but as I said, it's very slow.  For the initial transfer I need to move around 300GB of data from disk 1 to disk 2 - the process started around 35 hours ago, but according to Windows Explorer, only around 40GB has been transfered. 

It would be great if someone could answer a few questions I have:

1). Is this sort of speed normal?
2). Is it because of ssh?  Is it possible to "switch off" ssh withing BackupNetClone when transfering locally inside the DNS?
3). Is it okay to have mapped drives, open explorer windows with the DNS when syncing?
4). Does Telnet have to be continually connect during the sync process?
5). How can I stop the process?

Many thanks for your help, and for the great wiki and forum,

James

Ok, here's a couple thoughts:

- to check on what BNC is doing at any particular moment, do a 'tail backupnetclone.log' from the BackupNetClone/logs/ directory
- my guess is that BNC is in the middle of doing a full rsync of the data, which only happens once
- unfortunately, the speed you're getting sounds about right--this slow speed, as you guessed, is due to the fact that BNC sends all data through an SSH tunnel, even when the connection is local (from one DNS-323 disk to the other); due to the secure nature of SSH it is rather processor-intensive, which keeps the DNS-323 churning on encrypting and decrypting the data throughout the simple transfer from one disk to the other; in a future version I might try to add the feature you suggest where it skips/bypasses the SSH tunnel if performing local or even within the same network
- mapping drives to either drive is just fine while rsync is running; any file changes made will be resynced during the next BNC session
- whatever shell you used to start BNC (by running start_here.sh) does need to remain open; however, if BNC was started from cron, then you don't need any session open
- you can stop BNC in a few ways:
   a) stop the telnet session that's running start_here.sh (quick and dirty)
   b) use a telnet session to kill the start_here.sh or rsync process (not really necessary)
   c) open another telnet session and issue the command 'sh interrupt_transfer.sh' from the BackupNetClone/ directory (cleanest way)
- BNC will clean up after itself no matter which way you stop it, but I still recommend option C above
- for the initial transfer of your 300GB quickly, I recommend you stop the current transfer and do a 'cp' of all of your data from the source drive to the latest target directory; respond back here if you need help with that

I'm glad you got BNC running--it's no small task!  I hope I can help any way possible, and want to answer any questions I can so you can successfully use it.

Glad to hear you figured things out!  I hope that means others have done similar, since I haven't had much feedback about how successful it has been for anyone.

Let me know how the email thing goes.  I could only get mine to work with a 'dumb' SMTP server that only does basic authentication.  It's my goal to someday get mailx compiled with openSSL support so that I can use SMTP servers that require SSL authentication (which most newer ones do, such as Yahoo, gmail, and maybe even your godaddy server).

In the meantime I'm working on auto-cleanup where BNC will remove old directories as the disk gets full.  I've been sort of pushed to finally add this feature since my snapshots go back to October 2007, and the disk is finally getting to 90% full...

Good!  I'm just impressed that you went in and modified things to make it work.  As long as it's stable for you, I think it's great.  I hope the code made some sense for you, since I didn't comment it very well.

For line 70 and the other if statements, you might try looking at the backupnetclone.log and then modify the "Setting up send & response list" lines (in RESPONSEMATRIX variable) of complete_email.sh.  This variable essentially lists the send and receive order that BNC expects for the SMTP server, and you might be able to change sendmail.sh back to normal by just making this simple modification in complete_email.sh.

Or since it works for you now, you could just leave it...  You might run into some issues in upgrading to newer versions of the scripts though.