DSM-G600, DNS-3xx and NSA-220 Hack Forum

nzbget with CH3SNAS I've created a howto
http://www.aroundmyroom.com/2009/01/27/ … laces-all/
nzbget is the best to go for, does only need fun_plug and some simple tools not heavy packages.
Performance? I download with 2MB/s without problem. Threads: I use 4 threads, enough for my usenet server and my download speed

Par2 is done by nzbget & unrar is done by a modified script for the NMT Mediaplayer, also described totally in the howto

NZBget is running really stable, sometimes on very special file(s) the server can choke, but a reboot will solve the issue simple. I use it daily and I've downloaded more than 2TB or even more with nzbget already.

Last edited by zeroday (2009-02-09 09:31:42)

I've tested both sabnzbd and nzbget.
sabnzbd seems to be more RAM consuming, and it needs around 20 shadow processes to run. It worked fine for most of my downloads, but I experienced a problem on a big download (several hundreds of files for a total > 10 GB).
I didn't experience any problem since I switched to nzbget.

I can't tell you much about performance as far as I'm limited to 2Mb/s. I can download at this rate without problem with both sabnzbd and nzbget.
Par checking and unrar works fine also, even for huge archives (50 GB). Of course, it takes a bit more time to complete than on a top-level PC.

For me, the only drawback of nzbget is that it doesn't have a web interface like sabnzbd, and it needs a bit more efforts to configure it to your needs. But once it's done it works perfectly. I think you can even add a web interface also, but I didn't try this.

@zeroday : do you really mean that you download at 2MB/s (16 Mb/s) with 4 threads ? Or is it 2Mb/s ?
It seems to be a very high speed for this NAS, and with only 4 threads !

hey zeroday thanks for your nice howto...

i tried nzbget,sabnzbd and hellanzb... i have to say nzbget is the most lightweight
nzb-downloader compared to the the others on the dns323. it can handle more
threads without killing the cpu

my test with 5 threads reached a speed of 2700KB/s. (more tests will follow after
the setup of the postprocess) - during the dowload top said something about
40-60% cpu usage. i could imagine increasing the number of threads will still
increase the download-speed...

my test with hellanzb and 3 threads (i think) reached a maximum of 1600kb/s with
a cpu usage of 80-90% - increasing the number of threads did not increase the speed
anymore...

if u are thinking about sabnzbd - forget it

with nzbget my harddisk didn't spin down anymore:

i had to put the nzbget "nzb2start" folder AANNDD the "queue" folder on my usb stick...


oohhhh i forgot to mention:

i'm not using fun_plug... i'm in an chrooted debian environment..

running: lighttpd, vsftpd, mediatomb, sshd and the *dns-323-included* samba

Last edited by bluebeer (2009-02-14 13:08:46)

i used www.sabnzbd.org

bluebeer wrote:

hey zeroday thanks for your nice howto...

i tried nzbget,sabnzbd and hellanzb... i have to say nzbget is the most lightweight
nzb-downloader compared to the the others on the dns323. it can handle more
threads without killing the cpu

my test with 5 threads reached a speed of 2700KB/s. (more tests will follow after
the setup of the postprocess) - during the dowload top said something about
40-60% cpu usage. i could imagine increasing the number of threads will still
increase the download-speed...

my test with hellanzb and 3 threads (i think) reached a maximum of 1600kb/s with
a cpu usage of 80-90% - increasing the number of threads did not increase the speed
anymore...

if u are thinking about sabnzbd - forget it

with nzbget my harddisk didn't spin down anymore:

i had to put the nzbget "nzb2start" folder AANNDD the "queue" folder on my usb stick...


oohhhh i forgot to mention:

i'm not using fun_plug... i'm in an chrooted debian environment..

running: lighttpd, vsftpd, mediatomb, sshd and the *dns-323-included* samba

how did you manage to get 2700KB/s?
I have a 2500KB/sec line but only get ~ 1200KB/s ..

Last edited by mastervol (2009-02-15 23:32:16)

I don't know anything about bash scripting but i created a little shell scripts...
it still needs some improvements (response-code...) - but it works!
i'm going to work on it but... hmpf   help is really, really welcome

#!/bin/bash

export NEWZBIN_USER="XXX"
export NEWZBIN_PASS="XXX"
export NZB_TARGET_PATH="/XXX/nzbget/nzb-start"
BOOKMARK_FILE="/var/tmp/myBookmarks"
EXEC_LOAD_REPORTS="/var/tmp/execLoadReports"

rm "${BOOKMARK_FILE}" >> /dev/null 2>1
rm "${EXEC_LOAD_REPORTS}" >> /dev/null 2>1
rm "${BOOKMARK_FILE}.tmp" >> /dev/null 2>1

wget --post-data "username=${NEWZBIN_USER}&password=${NEWZBIN_PASS}&action=fetch" https://www.newzbin.com/api/bookmarks/ -o /dev/null -O "${BOOKMARK_FILE}.tmp" 

if [ $? = 0 ]
then
  if [ $(cat "${BOOKMARK_FILE}.tmp" | wc -l) = "0" ]
  then 
    echo "[INFO] No Bookmarks found - exiting";
    exit
  fi

  tail -n 5 "${BOOKMARK_FILE}.tmp" > "${BOOKMARK_FILE}"

  cat $BOOKMARK_FILE | awk -F '\t' '{
    user=ENVIRON["NEWZBIN_USER"];
    pass=ENVIRON["NEWZBIN_PASS"]; 
    path=ENVIRON["NZB_TARGET_PATH"]; 
    print "wget --post-data \"username="user"&password="pass"&reportid="$1"\" https://www.newzbin.com/api/dnzb/ -o /dev/null -O \""path"/"$3".nzb\"";
  }' > $EXEC_LOAD_REPORTS
  
  chmod +x $EXEC_LOAD_REPORTS
  $EXEC_LOAD_REPORTS
  
  delReports=$(cat "$BOOKMARK_FILE" | awk -F '\t' '{print $1","}')
  delReports=$(echo $delReports |sed 's/ //g')
  delReports=${delReports:0:${#delReports} - 1}
  
  echo "[INFO] Reports ${delReports} loaded - removing from bookmarks"

  wget --post-data "username=${NEWZBIN_USER}&password=${NEWZBIN_PASS}&action=delete&reportids=${delReports}" https://www.newzbin.com/api/bookmarks/ -O /dev/null -o /dev/null
  echo "[INFO] SUCCESS?"
else
  echo "[ERROR] wget failed - user/pass correct?"
fi

rm "${BOOKMARK_FILE}" >> /dev/null 2>1
rm "${EXEC_LOAD_REPORTS}" >> /dev/null 2>1
rm "${BOOKMARK_FILE}.tmp" >> /dev/null 2>1

it will only work for premium members



UPDATE: improved it a little...

Last edited by bluebeer (2009-02-16 19:10:53)

sure...

in newzbin you can easily bookmark a nzb-file-report in your account...

This script will fetch all of your bookmarked reports. Afterwards five of them (there is a limit at newzbin for fetching around 6 per minute i think) will be downloaded into the target directory (which nzbget is watching). Finally these five reports will be removed from your newzbin bookmark-list.

The aim was/is to find/create a(n) application/script which can be run periodically from cron.

If someone is going to use this script on cron - please use at least an interval of 15 or more...  ( to take care of your nas & newzbin )

For me it means that i just have to bookmark an nzb-report on newzbin from my iphone and my nas @home will start downloading followed by the postprocessing


help to improve it is still welcome!!!

Last edited by bluebeer (2009-02-18 15:41:08)

debian etch in chroot....

Bit of a newb here - what do I do with the script once I've added in my login/pass and directory paths? Where do I put it, how do I run it, and if it all works, how do I make it check automatically?
Thanks.

AH

greate job @ niels...

niels wrote:

Hi,

I was firmly locked into getting sabnzbd running on my DNS-323 purely because of the newzbin integration.  Your script made nzbget a viable option, although it lacked the category ability that sabnzbd had.

I rewrote parts of your script to add this in.  I'm not that great at bash scripting either (really prefer perl for this sort of thing) but I'm not sure what others have installed so kept it with bash (although it does require the 'tr' program too).

Attached is the script.  If you have any suggestions or comments let me know.  I'm passing ownership of all these changes back to you so feel free to claim them as your own or change them to suit.

I might re-write this all in perl at a later date (which would make it much easier to perform error checking etc. etc.)  If I do, I'll let you know.

Thanks,
Niels

---8<---
#!/bin/bash

export NEWZBIN_USER="XXX"
export NEWZBIN_PASS="XXX"
export NZB_TEMP_PATH="/XXX/newzbin"

NZB_TARGET_PATH="/XXX/nzb"
BASH="/bin/bash"
BOOKMARK_FILE="/var/tmp/myBookmarks"
EXEC_LOAD_REPORTS="/var/tmp/execLoadReports"

rm "${BOOKMARK_FILE}" >> /dev/null 2>&1
rm "${EXEC_LOAD_REPORTS}" >> /dev/null 2>&1
rm "${BOOKMARK_FILE}.tmp" >> /dev/null 2>&1

wget --post-data "username=${NEWZBIN_USER}&password=${NEWZBIN_PASS}&action=fetch&limit=5" https://www.newzbin.com/api/bookmarks/ -o /dev/null -O "${BOOKMARK_FILE}"

if [ $? = 0 ]
then
  if [ $(cat "${BOOKMARK_FILE}" | wc -l) = "0" ]
  then
    echo "[INFO] No Bookmarks found - exiting";
    exit
  fi

  cat ${BOOKMARK_FILE} | awk -F '\t' '{
    user=ENVIRON["NEWZBIN_USER"];
    pass=ENVIRON["NEWZBIN_PASS"];
    temp=ENVIRON["NZB_TEMP_PATH"];
    print "wget --post-data \"username="user"&password="pass"&reportid="$1"\" https://www.newzbin.com/api/dnzb/ -d -o \""temp"/"$1".dat\" -O \""temp"/"$1".nzb\" > /dev/null 2>&1";
  }' > ${EXEC_LOAD_REPORTS}

  ${BASH} ${EXEC_LOAD_REPORTS}

   for file in `ls -1 ${NZB_TEMP_PATH}/*.nzb | awk -F. '{print $1};'`; do
       NAME=`grep 'X-DNZB-Name:' $file.dat | awk -F:\  '{print $2};' | tr -d \\\r\\\n`
       CATEGORY=`grep 'X-DNZB-Category:' $file.dat | awk -F:\  '{print $2};' | tr -d \\\r\\\n`
       mkdir -p "${NZB_TARGET_PATH}/${CATEGORY}"
       mv ${file}.nzb "${NZB_TARGET_PATH}/${CATEGORY}/${NAME}.nzb"
       rm ${file}.dat
   done

  delReports=$(cat "${BOOKMARK_FILE}" | awk -F '\t' '{print $1","}')
  delReports=$(echo $delReports |sed 's/ //g')
  delReports=${delReports:0:${#delReports} - 1}

  echo "[INFO] Reports ${delReports} loaded - removing from bookmarks"

  wget --post-data "username=${NEWZBIN_USER}&password=${NEWZBIN_PASS}&action=delete&reportids=${delReports}" https://www.newzbin.com/api/bookmarks/ -O /dev/null -o /dev/null
  echo "[INFO] SUCCESS?"
else
  echo "[ERROR] wget failed - user/pass correct?"
fi

rm "${BOOKMARK_FILE}" >> /dev/null 2>&1
rm "${EXEC_LOAD_REPORTS}" >> /dev/null 2>&1
---8<---

When I try to run it, I get the error:
wget: unrecognized option `--post-data'
How do I fix this?
Thanks.

A