DSM-G600, DNS-3xx and NSA-220 Hack Forum

FunFiler · 2011-09-17 17:41:05

What is your interval setting set to?

Code:

interval = 30

eggeh1982 · 2011-09-17 18:56:32

FunFiler wrote:
What is your interval setting set to?
Code:
interval = 30

Currently have it set at 10

FunFiler · 2011-09-17 20:46:22

Does automatic continue to run after you start it? (check with "ps -ef|grep automatic")
Are there any indications in the log file? Have you tried increasing the verbosity?

dahive31 · 2011-09-23 09:09:23

hi, i recently installed alt-f and have since then also tried out transmission and automatic - and i really love it(kudos to kylek and the other devs!)!
i seem to have a small problem with my filters though:

i have 2 feeds specified (karmorra and bt-chat)
for example i have set:

Code:

filter = { pattern => "(?!.*720p)The.Big.Bang.Theory"    folder => "" }

and last night it downloaded:

The.Big.Bang.Theory.S05E02.HDTV.XviD-ASAP -> came as a folder
download at superseeds.org The.Big.Bang.Theory.S05E02.HDTV.XviD-ASAP[ss] -> folder
The.Big.Bang.Theory.S05E01.HDTV.XviD-ASAP -> folder
[ www.TorrentDay.com ] - The.Big.Bang.Theory.S05E02.HDTV.XviD-ASAP -> folder
The.Big.Bang.Theory.S05E02.HDTV.XviD-ASAP.avi
The.Big.Bang.Theory.S05E01.HDTV.XviD-ASAP.avi
The.Big.Bang.Theory.S05E02.PROPER.HDTV.XviD-TLA.avi

similar things happened with other series as well...
how do i change the filter to only get every episode once?
any hints would be greatly appreciated!

KyleK · 2011-09-23 09:52:02

Well, that one is not easy.
Automatic currently does not have a heuristic to determine what has been downloaded and what not.
I guess when I started working on Automatic I made the assumption that whatever feed was to be used, it would list each episode only once (with the exception of repacks and proper releases).
For most feeds that I've encountered so far, that is the case.

All you can do for now is to modify your regular expression so that it only downloads file releases (and not folders):

Code:

filter = { pattern => "(?!.*720p)The.Big.Bang.Theory.*\.avi) }

FunFiler · 2011-09-23 12:56:15

Try this filter

Code:

filter = { pattern => "(?!.*(720p|micro|repack))^The.Big.Bang.Theory.*eztv" }

dahive31 · 2011-09-23 17:17:07

Thank you both for your suggestions, gonna try it out!

jcard · 2011-09-26 06:59:26

I recently noticed an error at the top of downloaded torrents:

Code:

Notice: Undefined index: HTTP_USER_AGENT in /var/www/www.mininova.org/get.php on line 8
d8:announce36...

To reproduce, use the following

Code:

feed = { url => "http://www.mininova.org/rss.xml?sub=29"    cookies => "" }
filter = { pattern => "Pencil"  folder => "" }

This can be fixed with the following one-line patch:

Code:

--- automatic-0.6.4/src/web.c-orig      2011-09-26 04:27:52.224607286 +0100
+++ automatic-0.6.4/src/web.c   2011-09-26 04:28:05.558339802 +0100
@@ -356,6 +356,7 @@
   curl_easy_setopt(curl, CURLOPT_FORBID_REUSE, 1L );
   curl_easy_setopt(curl, CURLOPT_MAXREDIRS, -1L );
   curl_easy_setopt(curl, CURLOPT_NOSIGNAL, 1L );
+  curl_easy_setopt(curl, CURLOPT_USERAGENT, "WhoCares");
 
   if(auth && *auth) {
     dbg_printf(P_INFO2, "auth: %s", auth);

It also applies to automatic-0.6.6

Thanks
Joao

Added: PS-As a matter of fact I can't run neither 0.6.5 nor 0.6.6 compiled on openSuse-11.4 with pcre-8.10, libcurl-7.21.2 and libxml2-2.7.8.
0.6.5 gives the error

Code:

../src/regex.c, 29: [init_regex] PCRE compilation failed at offset 7: invalid UTF-8 string (pattern: Pencil.�folder => "" )

while 0.6.6 does not seems to download or correctly parse the RSS

Code:

../src/automatic.c, 599: Checking feed 1 ...
../src/web.c, 401: [getHTTPData] url=http://www.mininova.org/rss.xml?sub=29"    cookies => ", curl_session=(nil)
../src/web.c, 365: [am_curl_init] Created new curl session 0x62e2c0
../src/regex.c, 95: [getRegExMatch] Text to match against: Content-Length: 349
 (21 byte)
../src/web.c, 95: Content-Length: 349
../src/web.c, 431: [getHTTPData] response code: 400
../src/automatic.c, 436: [processFeed] curl_session=0x62e2c0
../src/web.c, 570: [closeCURLSession] Closing curl session 0x62e2c0
../src/automatic.c, 604: New bucket size: 30
[11/09/26 16:15:21] ../src/automatic.c, 137: Shutting down daemon

The sames applies to Alt-F with pcre - 8.13, libxml2 - 2.7.8 and libcurl - 7.22.0, so it will keep using automatic-0.6.4

Last edited by jcard (2011-09-26 18:23:00)

KyleK · 2011-10-06 10:10:03

Without being able to look at the code right now, I believe any suboptions of 'feed' or 'filter' need to be on a separate line (e.g. in yoru case, "cookies" and "folder" should be on a separate line.

It seems this is an issue with the config parser.

jcard · 2011-10-09 22:21:17

KyleK wrote:
Without being able to look at the code right now, I believe any suboptions of 'feed' or 'filter' need to be on a separate line (e.g. in yoru case, "cookies" and "folder" should be on a separate line.

It seems this is an issue with the config parser.

Yes, but using <tab> as a separator makes it work on a single line (together with the patch, at least for the indicated URL -- it looks like some sites require HTTP_USER_AGENT to be defined)

KyleK · 2011-10-10 15:40:37

I still think those are 2 separate issues. I haven't tested the user agent problem yet, but I don't think it has anything to do with the suboptions being listed on one line (instead of 2).

As for the other issues, I disagree.
Looking at the code, I don't see why a <tab> would make the config parser behave any different than with spaces. The result should be the same (i.e. an error message).

KyleK · 2011-10-10 16:35:51

Ok, I've tackled both issues you reported. The useragent issue is easily fixed.
As for the parsing problem, I don't see a way to enhance the parser to allow for multiple suboptions on one line.
Automatic will now report a parsing error and will either ignore that specific line (e.g. a filter or a feed), and, if it's the only filter or only feed, quit.

I'll run some tests and will release a fixed version shortly.

Please note that empty suboptions can be omitted entirely, so this problem wouldn't exist in the first place

jcard · 2011-10-10 23:24:01

KyleK wrote:
Ok, I've tackled both issues you reported. The useragent issue is easily fixed.
As for the parsing problem, I don't see a way to enhance the parser to allow for multiple suboptions on one line.
Automatic will now report a parsing error and will either ignore that specific line (e.g. a filter or a feed), and, if it's the only filter or only feed, quit.

I'll run some tests and will release a fixed version shortly.

Please note that empty suboptions can be omitted entirely, so this problem wouldn't exist in the first place

I had no problem with the single line "issue", as I told before it worked fine if using <tab> as a separator (remember, for Alt-F I'm using uClibc, not glibc).

Having the possibility of using a single line was in fact a "blessing", as it is much simpler to 'sed' than multiple lines. Alt-F "Automatic Setup" web page has to parse the configuration file in order to present relevant itens to the user, so he can make changes.

Thanks,
Joao

KyleK · 2011-10-10 23:42:25

That is strange. I've developed Automatic solely on my CH3SNAS, which uses uClibc as well. And I tested it today, multiple options on a single line are not properly parsed. It is destined to fail, at least with Automatic 0.6.6.

I'll try some earlier versions.

jcard · 2011-10-11 05:03:58

KyleK wrote:
That is strange. I've developed Automatic solely on my CH3SNAS, which uses uClibc as well. And I tested it today, multiple options on a single line are not properly parsed. It is destined to fail, at least with Automatic 0.6.6.

I'll try some earlier versions.

Please notice that my initial report applies to 0.6.4, and had to do only with the user agent issue.

The multiline parsing was raised by you. 0.6.4 works fine using tab as a separator on a single line feed/filter configuration file.

On a P.S. I also reported that, faced with the problem, I tried 0.6.5 and 0.6.6 and they fail.

I now have repeated the builds (using glibc on x86) and can confirm that the problems I reported on 0.6.5 and 0.6.6 was due only because I was using the same config file that worked on 0.6.4 (single line tab separated fields).

The differences are in src/config_parser.c, line 134. A simple-minded copy of that line from 0.6.4 into 0.6.6 does not enable single line/tab separated fields in 0.6.6

Thanks and apologies for any confusion,
Joao

KyleK · 2011-10-11 11:29:51

I just finished checking 0.6.4 and discovered that it only works by mistake with multiple suboptions on a single line
(mainly because of the fact that your cookie option is empty. If you'd needed cookies, you'd see an error).

I realize that a single-line solution would be preferrable for you, but I currently see no (easy) way of doing it.
If I come up with a solution you'll be the first to know

KyleK · 2011-10-19 09:41:32

Automatic v0.6.7 is out, it fixes just a couple of bugs.

@jcard, you will probably need to modify your automatic.conf, because this new version prohibits multiple suboptions on the same line.

Let me know if you run into any issues.

armand2099 · 2011-10-27 19:25:59

FunFiler wrote:
Does automatic continue to run after you start it? (check with "ps -ef|grep automatic")
Are there any indications in the log file? Have you tried increasing the verbosity?

I have the same problem, Automatic do not keep running, I have to start the service over and over and Automatic only does 1 check (if there is something to download, it download it) and then it turns off itself, any Ideas? At the beggining it worked great for a couple of weeks, and then out of nowhere it fails.

armand2099 · 2011-10-27 21:27:11

armand2099 wrote:
I have the same problem, Automatic do not keep running, I have to start the service over and over and Automatic only does 1 check (if there is something to download, it download it) and then it turns off itself, any Ideas? At the beggining it worked great for a couple of weeks, and then out of nowhere it fails.

Got it, it was a bad RSS URL in the .config file, sorry, now it is working, but I have other problem:
Automatic do not detect the torrents from this feed:
feed = { url => "http://www.nyaa.eu/?page=rss&term=[HorribleSubs]"
cookies => ""
}
I'm Using the following Filters:
filter = { pattern => "[HorribleSubs].Naruto.Shippuuden*720*"
folder => "/mnt/HD_a2/MOVIES/Anime/Naruto"
}
OR:

filter = { pattern => "[HorribleSubs]*Shippuuden*720*"
folder => "/mnt/HD_a2/MOVIES/Anime/Naruto"
}

The log doesn't show any problems:

[11/10/27 12:19:40] ../src/automatic.c, 538: Daemon started
../src/automatic.c, 543: Automatic version: 0.6.7 (39890)
../src/automatic.c, 560: 2 feed URLs
../src/automatic.c, 561: Read 11 filters from config file
../src/state.c, 111: Restored 60 old entries

Any thoughts?
Thanks a lot in advance.

whiteout · 2011-11-07 17:17:17

Quick question:

Im using this filter

"2011.*.1080p(?!.*(HDChina|CHDBits|BD9))"

Where i want everything from 2011 in 1080p but i wanna exlude everything named HDChina or CHDBits or BD9.

But for some reason it still downloads files with HDChina or CHDBits or BD9.

Is there something wrong with this filter?

Thanks!

KyleK · 2011-11-07 19:32:10

Exception strings need to be placed at the very beginning of the filter:

Code:

"(?!.*(HDChina|CHDBits|BD9))2011..1080p"

That's why it's called "negative look-ahead"

whiteout · 2011-11-07 19:58:06

Thanks!

whiteout · 2011-11-14 21:33:33

KyleK wrote:
Exception strings need to be placed at the very beginning of the filter:
Code:
"(?!.*(HDChina|CHDBits|BD9))2011..1080p"
That's why it's called "negative look-ahead"

For some reason it still downloads torrents with any of the excluded words.
Any ideas what to do? Is there any other way to exclude torrents with those words?

KyleK · 2011-11-16 01:54:19

I think there's still an error in that regular expression.
It should look like this:

Code:

"(?!.*(HDChina|CHDBits|BD9))2011.*1080p"

I encourage you to test your regular expressions with a separate tool, before writing them to the automatic.conf file.
This way you can test around which expression fits your needs.
On Windows, I can recomment the excellent Regex Coach (http://weitz.de/regex-coach/). There are surely similar tools for other platforms.

whiteout · 2011-11-17 13:10:41

KyleK wrote:
I think there's still an error in that regular expression.
It should look like this:
Code:
"(?!.*(HDChina|CHDBits|BD9))2011.*1080p"
I encourage you to test your regular expressions with a separate tool, before writing them to the automatic.conf file.
This way you can test around which expression fits your needs.
On Windows, I can recomment the excellent Regex Coach (http://weitz.de/regex-coach/). There are surely similar tools for other platforms.

Yeah I saw that little glitch and fixed it but it still lets things thorugh. The thing is that im using Reggy (for mac) and in there my filter works just as i want. Thats why im so confusd that Automatic lets things through Any ideas?

I'm using automatic 0.6.5. Has there been any changes to filter management in newer versions at all? I'm a little scared of upgrading since it was a struggle installing it on my synology in the first place.

Anyway thanks for all your support so far..

DSM-G600, DNS-3xx and NSA-220 Hack Forum

Announcement

#526 2011-09-17 17:41:05

Re: [REL] Automatic for funplug-0.5

Code:

#527 2011-09-17 18:56:32

Re: [REL] Automatic for funplug-0.5

FunFiler wrote:

Code:

#528 2011-09-17 20:46:22

Re: [REL] Automatic for funplug-0.5

#529 2011-09-23 09:09:23

Re: [REL] Automatic for funplug-0.5

Code:

#530 2011-09-23 09:52:02

Re: [REL] Automatic for funplug-0.5

Code:

#531 2011-09-23 12:56:15

Re: [REL] Automatic for funplug-0.5

Code:

#532 2011-09-23 17:17:07

Re: [REL] Automatic for funplug-0.5

#533 2011-09-26 06:59:26

Re: [REL] Automatic for funplug-0.5

Code:

Code:

Code:

Code:

Code:

#534 2011-10-06 10:10:03

Re: [REL] Automatic for funplug-0.5

#535 2011-10-09 22:21:17

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

#536 2011-10-10 15:40:37

Re: [REL] Automatic for funplug-0.5

#537 2011-10-10 16:35:51

Re: [REL] Automatic for funplug-0.5

#538 2011-10-10 23:24:01

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

#539 2011-10-10 23:42:25

Re: [REL] Automatic for funplug-0.5

#540 2011-10-11 05:03:58

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

#541 2011-10-11 11:29:51

Re: [REL] Automatic for funplug-0.5

#542 2011-10-19 09:41:32

Re: [REL] Automatic for funplug-0.5

#543 2011-10-27 19:25:59

Re: [REL] Automatic for funplug-0.5

FunFiler wrote:

#544 2011-10-27 21:27:11

Re: [REL] Automatic for funplug-0.5

armand2099 wrote:

#545 2011-11-07 17:17:17

Re: [REL] Automatic for funplug-0.5

#546 2011-11-07 19:32:10

Re: [REL] Automatic for funplug-0.5

Code:

#547 2011-11-07 19:58:06

Re: [REL] Automatic for funplug-0.5

#548 2011-11-14 21:33:33

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

Code:

#549 2011-11-16 01:54:19

Re: [REL] Automatic for funplug-0.5

Code:

#550 2011-11-17 13:10:41

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

Code:

Board footer