DSM-G600, DNS-3xx and NSA-220 Hack Forum

KyleK · 2012-03-02 11:09:42

Yes, automatic currently cannot deal with magnetic links, but that should be easy to fix.

I'm currently wondering whether someone asked for this previously and I forgot all about it, or whether you're actually the first person with this request

djtaz · 2012-03-02 15:01:56

I went back over all 600 posts and checked yesterday and i didnt see anyone asking.
I have written my own magent page if you want to test with it - its a parser for the pirate bays top 100 movies, but only DVD , Blueray or R5 quality and only ones that are over a day old so as to avoid the fake ones.

http://www.djtazie.com/rss/pirate100_magnet.php (lol , i realised this doesnt work when the pirate bay is down ... which it is at present)

It basically just shows the latest good quality movies on the pirate bay - theres a few duplicates from time to time , but its still very handy but since they changed to magnet links , ive had to do it manually (and im not used to that any more after relying on your excellent code)

Last edited by djtaz (2012-03-02 15:04:22)

djtaz · 2012-03-03 22:33:13

KyleK,

I dont want to push you with requests but i was just thinking and im not sure how hard this would be , but would it be possible to get automatic to send a weekly list of downloads to an e-mail address ?
2 extra fields in the config - smtp server , and mailto address , and use a text file (html if possible) and send it on to the user if the fields are filled in , once sent , delete it and start again for the next week.

It would be handy for people with a lot of TV shows who werent sure what new episodes have been downloaded.

FunFiler · 2012-03-03 22:37:46

djtaz
I use the post download script to write to a text file and use cron to send it to me on a weekly basis.

djtaz · 2012-03-04 13:52:05

Thanks FunFiler - i might give that a go and see how i get on - didnt even know about it so its probably what im looking for

KyleK · 2012-03-04 22:40:35

@djtaz, it seems there are no more RSS feeds available at TPB. I've implemented the feature, but cannot test it. Any ideas?

djtaz · 2012-03-05 23:16:43

http://www.djtazie.com/rss/pirate100_magnet.php is an rss feed with magnet links - im not sure if its written correctly as i dont really use them , but give it a try if u want.

Its the one i got the automatic errors from :

Code:

[12/03/01 21:32:53] ../src/automatic.c, 397: [(null)] Found new download: The Adventures of Tintin 2011 DVDRip XviD-TARGET (magnet:?xt=urn:btih:2ded86af7c0cce8224262ba703                                                                   191bf7d8537a5d&dn=The+Adventures+of+Tintin+2011+DVDRip+XviD-TARGET)
../src/web.c, 422: [getHTTPData] 'magnet:?xt=urn:btih:2ded86af7c0cce8224262ba703191bf7d8537a5d&dn=The+Adventures+of+Tintin+2011+DVDRip+XviD-TARGET': Couldn't resolve host                                                                    name (retval: 6)
[12/03/01 21:32:53] ../src/automatic.c, 397: [(null)] Found new download: Hugo.2011.DVDRip.XviD- AMIABLE (magnet:?xt=urn:btih:047939ea084451b77f60bd4951c53ac62a22ec5e&dn=                                                                   Hugo.2011.DVDRip.XviD-+AMIABLE)
../src/web.c, 422: [getHTTPData] 'magnet:?xt=urn:btih:047939ea084451b77f60bd4951c53ac62a22ec5e&dn=Hugo.2011.DVDRip.XviD-+AMIABLE': Couldn't resolve host name (retval: 6)
[12/03/01 21:32:53] ../src/automatic.c, 397: [(null)] Found new download: Machine Gun Preacher 2011 Dvdrip xvid Cinemagic (magnet:?xt=urn:btih:7be37ac7f65dc78bf8b115629e6                                                                   0220c637fe0d1&dn=Machine+Gun+Preacher+2011+Dvdrip+xvid+Cinemagic)
../src/web.c, 422: [getHTTPData] 'magnet:?xt=urn:btih:7be37ac7f65dc78bf8b115629e60220c637fe0d1&dn=Machine

Last edited by djtaz (2012-03-05 23:18:26)

neonpolaris · 2012-03-07 05:32:37

I've found an RSS feed that allows me far greater control than the one that I'm currently using, however, it doesn't seem to work with Automatic. I believe this stems from the fact that the actual torrent link isn't in the <link> but rather in an <enclosure url="here">. Is there some way around this?

KyleK · 2012-03-07 12:13:01

Automatic uses the <enclosure url=""> tag already, and prefers it to <link> if both exist.
What does the logfile say?
Also try cranking up the log level to 3:

Code:

 
$ automatic -o -f -c /ffp/etc/automatic.conf -v 3 -l automatic.log

(This runs Automatic in the foreground, and it wil quit after checking your feed once, with logging to automatic.log enabled.)

neonpolaris · 2012-03-07 16:29:19

Code:

[12/03/07 08:41:57] ../src/automatic.c, 608: ------ Checking for new episodes ------
../src/web.c, 390: [getHTTPData] url=http://www.dailytvtorrents.org/rss/show/burn-notice?prefer=hd&wait=3&minage=2&norar=yes&single=yes&onlynew=yes, curl_session=(nil)
../src/web.c, 354: [am_curl_init] Created new curl session 0x351d8
../src/regex.c, 95: [getRegExMatch] Text to match against: Content-Length: 4137
 (22 byte)
../src/web.c, 103: Content-Length: 4137
../src/web.c, 420: [getHTTPData] response code: 200
../src/automatic.c, 447: [processFeed] curl_session=0x351d8
../src/xml_parser.c, 87: 6 items in XML
../src/xml_parser.c, 135: == Done extracting RSS items ==
../src/automatic.c, 458: Checking feed 'http://www.dailytvtorrents.org/rss/show/burn-notice?prefer=hd&wait=3&minage=2&norar=yes&single=yes&onlynew=yes' (6 items)
../src/automatic.c, 462: History bucket size changed: 36
../src/list.c, 228: [cleanupList] size before: 6
../src/list.c, 239: [cleanupList] size after: 0
../src/web.c, 559: [closeCURLSession] Closing curl session 0x351d8

Is this the part you need, or should I send the whole thing?

I've set the filter to "HDTV", but really I'd like a filter that accepts everything (no filter at all), is this possible?

djtaz · 2012-03-12 22:45:41

Any luck getting magnet links to work ?

KyleK · 2012-03-13 12:53:58

@neonpolaris
I figured out why you don't get any matches: The regular expression is matched against the <name> tag of an RSS item, while the <enclosure url> tag is used as torrent link. So if your name tag does not contain the string you're matching against (e.g. "HDTV"), Automatic won't download any torrents.

To simply match everything, use this filter:

Code:

filter  { pattern => ".*" }

KyleK · 2012-03-13 12:55:13

djtaz:
Actually, yes, but I haven't had much time testing it and making a package.
I'll try my best and release something in the next days. What format do you need? (ffp-0.5, ffp-0.7-arm, source)

djtaz · 2012-03-13 19:36:09

funplug-0.5 package is the one im using
Thanks man - much appreciated.

KyleK · 2012-03-14 21:29:56

djtaz wrote:
funplug-0.5 package is the one im using :D
Thanks man - much appreciated.

I've packaged Automatic 0.7.3 for ffp-0.5 with Magnet support. Would you please check it out and see if it works for you?

If so I'll update the first page.

djtaz · 2012-03-14 22:29:15

Kylek - Thanks a million - thats working a treat - all i needed to do was (for those that scratch their heads)

1. Change directory into my downloads folder
2. wget the file

Code:

wget http://kylek.is-a-geek.org:31337/files/ffp/0.5/Automatic-0.7.3-1.tgz

3. Update the version you already have

Code:

funpkg -u Automatic-0.7.3-1.tgz

all done !

Im back in action again so im all happy

Last edited by djtaz (2012-03-14 22:54:40)

porc · 2012-03-17 03:11:50

Hello Kylek,
I've just registered here to say you thanks for creating this tool.
I am waiting for the release of this 0.7.3 version in source format

Komano · 2012-03-25 19:13:34

Weird. Automatic doesn't match my show but it works for another RSS Feed and Regex Coach says that it matches.

RSS Feed is : https://ezrss.it/search/index.php?show_ … p;mode=rss

Filter is : S04E1(?!.*(mkv))

Automatic Log is there.

http://pastebin.com/ZLmfRw8E

KyleK · 2012-03-25 20:15:34

The problem is that the regular expression is matched against the <title> attribute of each RSS item, and in your case, the title of each entry has the episode number in the form of "4x??" instead of "S04E??".
That is why the expression won't match.

Also, why the exclusion of "mkv" in the filter? It does not show up anywhere in the feed. Also, exclusions belong to the beginning of the filter expression:

(?!.*mkv)S04E1

Komano · 2012-03-26 06:27:48

Ah i see. Roger.

The exclusion of mkv was just in case the feed had other versions but there's no use for it really.

whiteout · 2012-03-26 14:26:32

Hi!

A regex question. I have searched for this but havent found anything useful.

In automatic i use a filter where i exclude a lot of different words like this for example
(?!.*(word1|word2|word3|word4|word5|word6|word7|word8).

Now this line gets crazy long and i cant divide it into two separate lines since it will mess up automatic. My question is:
Is there a way to use a separate text file or so with all the words that i wanna exclude? someting like this:
(?!.*("file/something/words.txt") where it points to a textfile with all the words.

Or else is there a way in the automatic.conf file to break the line to get a better overview of the whole string?

Thanks
Bjorn

KyleK · 2012-03-26 15:52:58

Currently, that's not possible. I'll see if I can come up with a way so you can split the line in the config file.

whiteout · 2012-03-26 16:05:19

That would be sweet thanks!

ddoggeh · 2012-04-01 02:39:47

I think the kylek.is-a-geek.org site may be down. Went hunting for this but no luck:
http://kylek.is-a-geek.org:31337/files/ … .7.2-1.tgz

Is there a mirror anywhere?

You guys are amazing. This forum made it super easy to get going with fun_plug and my DNS-323

Thanks!

FunFiler · 2012-04-01 07:19:47

I'm sure if his site is down that it will only be a day or so at the most before he has it up again, but here are some links:

Automatic-0.7.2-1.tgz

Automatic-0.7.3-1.tgz

Last edited by FunFiler (2012-04-01 14:02:18)

DSM-G600, DNS-3xx and NSA-220 Hack Forum

Announcement

#601 2012-03-02 11:09:42

Re: [REL] Automatic for funplug-0.5

#602 2012-03-02 15:01:56

Re: [REL] Automatic for funplug-0.5

#603 2012-03-03 22:33:13

Re: [REL] Automatic for funplug-0.5

#604 2012-03-03 22:37:46

Re: [REL] Automatic for funplug-0.5

#605 2012-03-04 13:52:05

Re: [REL] Automatic for funplug-0.5

#606 2012-03-04 22:40:35

Re: [REL] Automatic for funplug-0.5

#607 2012-03-05 23:16:43

Re: [REL] Automatic for funplug-0.5

Code:

#608 2012-03-07 05:32:37

Re: [REL] Automatic for funplug-0.5

#609 2012-03-07 12:13:01

Re: [REL] Automatic for funplug-0.5

Code:

#610 2012-03-07 16:29:19

Re: [REL] Automatic for funplug-0.5

Code:

#611 2012-03-12 22:45:41

Re: [REL] Automatic for funplug-0.5

#612 2012-03-13 12:53:58

Re: [REL] Automatic for funplug-0.5

Code:

#613 2012-03-13 12:55:13

Re: [REL] Automatic for funplug-0.5

#614 2012-03-13 19:36:09

Re: [REL] Automatic for funplug-0.5

#615 2012-03-14 21:29:56

Re: [REL] Automatic for funplug-0.5

djtaz wrote:

#616 2012-03-14 22:29:15

Re: [REL] Automatic for funplug-0.5

Code:

Code:

#617 2012-03-17 03:11:50

Re: [REL] Automatic for funplug-0.5

#618 2012-03-25 19:13:34

Re: [REL] Automatic for funplug-0.5

#619 2012-03-25 20:15:34

Re: [REL] Automatic for funplug-0.5

#620 2012-03-26 06:27:48

Re: [REL] Automatic for funplug-0.5

#621 2012-03-26 14:26:32

Re: [REL] Automatic for funplug-0.5

#622 2012-03-26 15:52:58

Re: [REL] Automatic for funplug-0.5

#623 2012-03-26 16:05:19

Re: [REL] Automatic for funplug-0.5

#624 2012-04-01 02:39:47

Re: [REL] Automatic for funplug-0.5

#625 2012-04-01 07:19:47

Re: [REL] Automatic for funplug-0.5

Board footer