DSM-G600, DNS-3xx and NSA-220 Hack Forum

@NagyBandi  You can type 'automatic -h', which will display the normal help for Automatic, but also show the version.

@krystian  Automatic only works with RSS feeds that contain direct links to torrent files. If the feed items only refer to a details page where the actual download link is mentioned, Automatic won't work. (As you already said, it always assumes that the file it downloaded from a link within the RSS is a torrent, and it will send it to Transmission no matter what. Transmission though will detect if it's an actual torrent file or not).

No, not really. Parsing a HTML page for a link is much more difficult than an RSS feed.
a) What if there are multiple torrent links in that HTML?
b) What if the link isn't clearly pointing to a torrent file (i.e. http://example.com/download.php?id=12345)
and proably some other difficulties.

RSS is especially laid out to avoid such ambiguities, that's why most sites rely on parsing this instead of a HTML page.

I know there are some alternative tools out there that offer the functionality you're looking for, but they too can only use some sort of heuristic to "guess" which link to use.

Many private trackers already offer separate RSS feeds, one with links to the Details page, and another one with download links. I would advise you to ask your site administrator to look into this.

Looking at the log it seems  to me that the at the time you tried this the feed simply didn't contain anything that matches your filters.
Also, some of the filters are wrong, as they are not real regular expressions:

"RSS.Item.2x*"

The asterisk "*" means "the previous character exists 0 times or any number of times. So this expression matches "RSS.Item.2", "RSS.Item.2x", "RSS.Item.2xx" and so on.

To correct the pattern, put a dot (.) before the asterisk. The dot is s placeholder for "any character":

"RSS.Item.2x.*"

Some of your patterns contain the expression "*.". Especially at the beginning of a pattern this is wrong. You need to switch this around, so it means "any character, any number of times".

Last but not least: Automatic cannot deal with private torrent sites yet that require uid/pass as in your URL. I've implemented this already though and a new release should be ready in the coming weeks.

Last edited by KyleK (2010-05-16 19:42:58)

I've a little problem to edit the conf-file.
Am I supoused to edit it through telnet or notepad? I'm able to open the text with notepad, and I can read what is written there, but everything is just messed up. The "#" is randomly placed around in the text, an there is no end-lines in the text.

And through telnet, i've tried to open it with "vim" and "pico", but this read-option is not installed, and I'm no expert in linux.



Btw: I have an other anoying problem. I'm only able to set the ffproot-folder with read/write access. But not in the subfolders inside this folder. I've browsed to the folder with the userinterface, and alowed everyone to read and write, but still, I cant create new folders or edit the .conf-file.
But, it works to copy the .conf-file directly to the ffproot-folder, then edit the file, then move it to the correct adress with the "mv"-command in telnet.
Is there any way to do this easier?


(Sorry for my bad english. Please let me know if I've written something you don't understand )



edit: I solved the first problem by using the program "Emacs" in windows. I guess there is many other ways to do it, but this method worked verry well

Last edited by r2d290 (2010-04-07 16:30:02)

Thank you. That explanes my problem.


I thought I gave myself permisions for read and write, but I don't realy care.  It works when I move the file through the telnet, and I will not edit the file every day, so I guess I can live with the problem until I find a solution

I assume that "#" is a coment-sign, and that i should uncomment example this line: # rpc-port = 9091 ?
If so, what is the reason why it's commented?


Thanks for fast reply, and I hope I will be satisfied with your program

Can anyone help me with the patterns?
Can  you confirm my pattern are correct?

patterns =  { "[UTW]_B_Gata_H_Kei_-_*[0-9]_*XviD"
"[Doki] Chu-Bra!! - *[1-9] *mkv"

            }

Thank you.

I think I'm not far away from the goal now. I get automatic to find the torrentfeed, and the filter works at it should. What do I now need to do to have "Transmission" to start downloading the torrent?

root@nsa220plus:/ffp/etc# automatic -f
../src/automatic.c, 522: 1 feed URLs
../src/automatic.c, 523: Read 3 patterns from config file
../src/state.c, 100: [load_state] Error: Unable to open statefile '/root/.config                                                   /automatic.state' for reading: No such file or directory
[10/04/09 16:11:34] ../src/automatic.c, 383: Found new download: WWE.Friday.Nigh                                                   t.Smackdown.2010.04.09.720p.HDTV.x264-WB (http://torrents.thepiratebay.org/54879                                                   90/WWE.Friday.Night.Smackdown.2010.04.09.720p.HDTV.x264-WB.5487990.TPB.torrent)
../src/torrent.c, 131: sendHTTPData() failed!
../src/state.c, 66: Saving state (1 downloaded torrents) to disk
../src/state.c, 68: Error: Unable to open statefile '/root/.config/automatic.sta                                                   te' for writing: No such file or directory
../src/web.c, 421: [getHTTPData] 'http://rss.thepiratebay.org/205': Couldn't connect to server

Here is the config-file:

##############################
## Version-specific options ##
##############################

# Transmission version. Options are "1.2", "1.3", and "external"
transmission-version = "1.3"

# Call an external program instead of transmission directly
#
# If you use this, set transmission-version to "external"
# For best results, use an absolute path to the executable
# Executable is passed a single parameter, the name of the .torrent
# file that was downloaded.  The .torrent file passed to this external
# program may be removed after the program returns.
# The program should return exit code 0 for success and non-0 for failure
# Automatic won't respond to ctrl-C while waiting for this to return
#
# transmission-external = "/usr/local/bin/custom-add-torrent"

# For Transmission 1.3x and newer only: set the host on which Transmission runs (default: localhost)
# rpc-host = "localhost"

# For Transmission 1.3x and newer only: set the RPC port on which Transmission & Clutch communicate (default: 9091)
# rpc-port = 9091

# For Transmission 1.3x and newer only: If you configured Transmission/Clutch to use password authentication, Automatic needs that information as well
# rpc-auth = "user:password"

# For Transmission 1.2x only: Path to the Transmission configuration files
# transmission-home = "~/.config/transmission"


#####################
## General options ##
#####################


# list of feed URLs. You can specify one or more feeds, in case of the latter use curly brackets (see the "patterns" option for an example)
url = "http://rss.thepiratebay.org/205"

# interval in minutes between checks for new downloads
interval = 1

# Limit upload speed (in KB/s) for each torrent that is added to Transmission via Automatic
#upload-limit = 10

# Automatically add downloaded torrents to Transmission (requires
# transmission-daemon and transmission-remote to be installed or use
# of "external" option)
# If this is not set, all Automatic will do is save the .torrent file.
use-transmission = yes

# Instruct Transmission to immediately start downloading torrents after being added
# If set to 'no' torrents will be added in a paused state
start-torrents = yes

# path where Automatic will store downloaded torrents
torrent-folder = "/tmp"

# path to the file which stores information about already downloaded torrents (so they don't get readded to Transmission)
statefile = "~/.config/automatic.state"

# Prowl API key. You can use this to send push notifications to an iPhone. See http://prowl.weks.net for more information
#prowl-apikey = ""

# patterns contains a number of regular expressions which are matched against the RSS feed entries
# please don't use curly brackets within a regular expression, it'll horribly break the configuration parser
# letter-casing does not matter

patterns =  {
          "WWE"
          "Something.else.to.download.*720p"
              "(?!.*720p)Some.Video.But.Not.The.HD.Version"
            }

Fabulous! Now it works. Thank you

Next up now is to wait for the next update that suports private trackers. Can't wait

Removed.

Last edited by KyleK (2010-05-16 19:43:55)

Ok guys,

I've updated Automatic to v0.6 bringing the much-requested support for private tracker feeds, as well as separate download folders per filter.

You can download the new version here.

Unfortunately, I've had only one website to test this with, and I do know that there are multiple implementations used by the private sites, so this might not work for everyone.
Also, it's not very user-friendly to set up, so I'm going to post the instructions only here, at the end of the thread for now, and will update the first post later, after I've got some feedback from you guys.

Ok, let's get started!

1. Feeds

So far, you've specified RSS feeds with the "url" option in the config file:

url = { "http://myfirstfeed.com/rss.xml"
        "http://betterfeed.com/rss.php"
     }

This is still supported to remain backwards-compatible, and if you only use public feeds you can leave everything just as it is now.

The new way to specify feeds goes like this:

feed = { url => "http://myfirstfeed.com/rss.xml"
         cookies => "uid=12345;pass=abcde98765"
       }

feed = { url => "http://betterfeed.com/rss.php?:COOKIE:uid=12345;pass=abcde98765;session=98328sdsd982389sd" }

The hard part for you is to figure out which cookies are required. Some tracker sites already give you the proper URL, so this shouldn't be too hard.
If not, you need to check which cookies your browser stores for the website and add those to the config file manually.

If the URL contains the sequence "?:COOKIE:", Automatic will parse everything after that string automatically and use it as cookies, so you don't have to specify them separately.

I'm really sorry that this is as complicated as it is, but there's not much I can do about it.

2. Filters

Similar to feeds, the "patterns" option has gotten a facelift as well:

filter = { pattern => "Name.of.Something.I.Want.to.Download.Automatically.*"
           folder => "/mnt/HD_a2/Downloads/Automatic"
         }

Now you can specify a specific download folder for each pattern, so any particular matches will land in that directory.
You can omit the "folder" sub-option of course, then the downloads go to Transmissions default download folder.
You can define as many "filter" options in the config file as you want.

The previous "patterns" option is still supported, so if you don't want to download into separate folders you won't have to update your config file.


Please give me as much feedback on this as you can (it works, it doesn't work, Automatic crashes, etc.). You're gonna be my beta testers for a while :)

Last edited by KyleK (2010-05-16 19:44:44)

KyleK,

Folder filter is awesome.
Want to know, if I have several series and want them all to be stored in /Anime/ folder,
Should I repeat the "filter"  or can I use bracket?

Should I do it like this:

 filter = { pattern => { "\[UTW\].+Gata_H_Kei_-_\d+.*(xvid|h264)"
"\[Doki\].+Chu\-Bra"
}
           folder => "/mnt/HD_a2/media/anime"
         }
filter = { pattern => { "Chuck.*S0[3-9]E.*xvid"
"Heroes.*S0[4-9]E.*xvid"
"Merlin.*S0[3-9]E.*xvid"
}
           folder => "/mnt/HD_a2/media/tv series"
         }

Or like this:

filter = { pattern => "\[UTW\].+Gata_H_Kei_-_\d+.*(xvid|h264)"
           folder => "/mnt/HD_a2/media/anime"
         }
filter = { pattern => "\[Doki\].+Chu\-Bra"
           folder => "/mnt/HD_a2/media/anime"
         }
filter = { pattern => "Chuck.*S0[3-9]E.*xvid"
           folder => "/mnt/HD_a2/media/tv series"
         }
filter = { pattern => "Heroes.*S0[4-9]E.*xvid"
           folder => "/mnt/HD_a2/media/tv series"
         }
filter = { pattern => "Merlin.*S0[3-9]E.*xvid"
           folder => "/mnt/HD_a2/media/tv series"
         }

Also, the "\[Doki\].+Chu\-Bra" pattern, how to specify from which episodes I want to download?

Thanks in advance.




==================
UPDATE
==================

Got this when trying to start automatic.

Starting /ffp/bin/automatic -c /ffp/etc/automatic.conf
../src/config_parser.c, 491: parse error at line 117 (pos: 4610)
Error parsing config file: Unknown error
[10/04/12 10:39:00] ../src/automatic.c, 128: Shutting down daemon

Last edited by nyunyu (2010-04-12 05:39:32)

Thanks KyleK, I did use the second patterns and it shows as error. So, I remove automatic and reinstall it again and all is fine now.
Btw, about the second question,
"\[Doki\].+Chu\-Bra" pattern, how to specify from which episodes I want to download?

I would like to select an episode like episode 3 and later with xvid type.