DSM-G600, DNS-3xx and NSA-220 Hack Forum

staubnull · 2013-01-13 23:19:28

original feed url

Code:

http://ne****diogroup.tv/rss.php?user=1234&pass=5678

automatic.conf

Code:

feed =  { url     => "http://ne****diogroup.tv/rss.php?user=1234&pass=5678"
          id      => 3
          }

but every once in a message automatic.log

Code:

../src/torrent.c, 151: Error uploading torrent: invalid or corrupt torrent file

I have also tried

Code:

feed =  { url     => "http://ne****iogroup.tv/rss.php?"
          cookie => "user=1234&pass=5678"
          id      => 3
          }

but the same error

KyleK · 2013-01-14 08:58:01

Hm. Private sites that require login data/cookies for torrent retrieval are often a bit tricky.

First thing you should do is configure Automatic so that the torrent files aren't automatically added to Transmission, but downloaded to a folder on your device. Then have a look into one of the files to see what it says.

I suspect that you need to use the URL rewrite feature that I implemented recently, because the URL in the RSS feed is not the actual download URL.
It's also possible that the 'user' and 'pass' cookie values are not enough. Sites often store multiple cookies that are required to authenticate a user. Most browsers should have an option to show all the cookies that are used on a specific site.

Hope you can figure this one out, let me know if you need further assistance.

staubnull · 2013-01-14 15:26:34

KyleK wrote:
Hm. Private sites that require login data/cookies for torrent retrieval are often a bit tricky.

First thing you should do is configure Automatic so that the torrent files aren't automatically added to Transmission, but downloaded to a folder on your device. Then have a look into one of the files to see what it says.

I suspect that you need to use the URL rewrite feature that I implemented recently, because the URL in the RSS feed is not the actual download URL.
It's also possible that the 'user' and 'pass' cookie values are not enough. Sites often store multiple cookies that are required to authenticate a user. Most browsers should have an option to show all the cookies that are used on a specific site.

thanks, i forgot about miltiple cookie.
so now the code is

Code:

#http://ne****diogroup.tv/rss.php?user=1234&pass=5678
feed =  {  url     => "http://ne****diogroup.tv/rss.php?user=1234&pass=5678"
           cookie  => "bb_data=something_from_cookie_manager_of_browser"
           id      => 3
        }

and for now all working, 'll watch some time

Last edited by staubnull (2013-01-14 15:27:41)

stardust · 2013-01-14 16:50:27

Hi,

I'm having some trouble setting up Automatic with Transmission on a Raspberry Pi.
I managed to install it and run it, but I didn't manage to get it to communicate to Transmission.

Can anyone share an "automatic.conf" that is working?
What RSS feeds work with transmission 2.52 and Automatic 0.81? the ones from KAT or TPB work?
Does this one works: http://showrss.karmorra.info/?

Thanks in advance

KyleK · 2013-01-15 08:55:02

What exactly do you have trouble with?
Automatic has several commandline parameters that help you test your configuration until it works like you want it to.

For example, this command runs Automatic in the foreground, and it only displays any matches it found in the feed(s) defined in your config:

Code:

$ automatic -f -m -o -v2 -c /path/to/your/automatic.conf

It will also quit after checking the feeds once, so you can make changes to your configuration if necessary.
The option '-v' accepts a number value up to 4, which increases the log output, 4 being the most verbose.
This way you can check what works and what doesn't.

I'll gladly help if you have trouble setting up filters using regular expressions, although a look inside the previous posts of this thread (especially the first post and the posts it links to, see the multiple EDITS in that post) should contain enough information to set up a proper configuration.

I'm pretty sure Karmorra works, as it was mentioned in this thread several times. I do not know about the other feeds.
Generally speaking, if it's a valid RSS feed, it'll (rather: should) work with Automatic

Last edited by KyleK (2013-01-15 08:55:15)

stardust · 2013-01-15 11:58:02

Thanks for the thorough explanation and for a very nice and simple program.
I got it working this night (a couple of hours before your post). The verbose options helped a lot, and one of the problems were the dots in the filters.

Now something off the subject:
One thing that made it a bit more difficult to find answers was that a search for something related to the program name was always too generic as you can find the word "automatic" everywhere. Have you ever considered an alternative name? Something like:
AutoTrans
TransAuto
AutoKylek
AutoTorrent
Rss2Torrent
...

Komano · 2013-01-16 16:32:21

Hey KyleK,

Automatic has been working great for so long but suddenly today it just stopped working. I looked at the first page and ran the command

"automatic -f -v 3 -c /ffp/etc/automatic.conf >automatic.log 2>&1"

And the output was segmentation fault. I have Pmed you the log and my automatic.conf

mushisushi · 2013-01-17 00:36:50

Hi KyleK,

I haven't been using the automatic script for a while, but recently, I tried it again and I'm getting a segmentation fault. Here's the last bit of the log:

Code:

../src/web.c, 364: [am_curl_init] Created new curl session 0x41b58
[init_regex] Regular expression: Content-Length:\s(\d+)
[getRegExCaptureGroups] Text to match against: Content-Length: 43
 (20 byte)
../src/web.c, 156: Content-Length: 43
[init_regex] Regular expression: Content-Length:\s(\d+)
[getRegExCaptureGroups] Text to match against: Content-Length: 157
 (21 byte)
../src/web.c, 156: Content-Length: 157
../src/web.c, 528: response code: 200
../src/web.c, 572: [closeCURLSession] Closing curl session 0x41b58
[init_regex] Regular expression: "result":\s*"(.+)"
[getRegExCaptureGroups] Text to match against: {"arguments":{"torrent-added":{"h
ashString":"9c37c46400f0b94dabcef5919f4ce216060f8b96","id":2,"name":"NCIS.10x11.
(HDTV-x264-LOL)"}},"result":"success"}
 (152 byte)
../src/torrent.c, 145: Torrent upload successful!
[init_regex] Regular expression: "id":\s*(\d+)
[getRegExCaptureGroups] Text to match against: {"arguments":{"torrent-added":{"h
ashString":"9c37c46400f0b94dabcef5919f4ce216060f8b96","id":2,"name":"NCIS.10x11.
(HDTV-x264-LOL)"}},"result":"success"}
 (152 byte)
../src/downloads.c, 93: [add_to_bucket] bucket gets too large, deleting last ite
m...

Removing last item...
../src/state.c, 66: Saving state (51 downloaded torrents) to disk
Segmentation fault

Komano · 2013-01-17 07:47:33

I wonder if it's the same problem as me.

Last edited by Komano (2013-01-17 07:49:47)

KyleK · 2013-01-17 15:14:05

@Komano, @mushisushi:
I was able to reproduce the problem and have already fixed it.
The package for ffp-0.7-arm is available here.

I plan to put up packages for the other platforms later as well.

stardust · 2013-01-18 04:41:03

I apologize for a newbie question, but how can we start Automatic at startup (of Raspberry Pi)?
Could it be possible to include a couple of lines in Transmission init.d script so that it starts and stops together? How?

Thanks in advance

mushisushi · 2013-01-18 06:40:15

KyleK wrote:
@Komano, @mushisushi:
I was able to reproduce the problem and have already fixed it.
The package for ffp-0.7-arm is available here.

I plan to put up packages for the other platforms later as well.

Thanks for the update KyleK!

KyleK · 2013-01-18 08:15:45

stardust wrote:
I apologize for a newbie question, but how can we start Automatic at startup (of Raspberry Pi)?
Could it be possible to include a couple of lines in Transmission init.d script so that it starts and stops together? How?

Thanks in advance

I've done all the development on my NAS with fun_plug, and never actually used Automatic on a 'real' Linux distro. Since fun_plug uses its own mechanism of launching programs at startup, I unfortunately do not have the slightest idea how such an init.d script has to look.
Also, I'm under the impression that the contents of such a script would vary between different Linux distributions.

Nonetheless if someone can provide such a script that would work with the common Linux distros I'll gladly add it to the Automatic source package.

KyleK · 2013-01-18 09:27:44

Here we go: Automatic v0.8.2 is now available for all ffp versions.
Go fetch them from the first post.

stardust · 2013-01-24 19:07:52

@Kylek

As I mentioned before, I managed to setup Automatic and transmission to work beautifully together in a Raspberry PI running the latest xbian.
I also tried to promote Automatic to be installed in a "Download Package" of xbian:
http://forum.xbian.org/thread-196-post- … ml#pid2631

but unfortunately the developers of xbian would prefer to include programs which would be configured through a web gui...
in any case, a web gui would also facilitate the usability of Automatic.

Couldn't you consider the development of this feature? (at least to define the filters of the config file).

xzempt · 2013-02-13 05:56:40

Hi all,
First off I have to say I love being able to have Transmission on my DNS-323!
I have been trying to get Automatic setup and running as well, I've been going well but am up to editing the config file, but I am unable to save a copy into the location etc due to permissions. Now I am a linux n00b and it is prob a very simple thing to get working, but I just am not 100% sure.
I've done searches all over the place but no one has written a 'complete' guide to setting up Transmission and Automatic, there a guides that help, but I'm not 100%, especially for n00b like myself

So any help in terms of getting the config file into location would be great. I even tried having the config in the root and trying to point it to that using the -c command but it couldn't find the file....

Thanks

X

KyleK · 2013-02-13 07:08:00

stardust wrote:
@Kylek

As I mentioned before, I managed to setup Automatic and transmission to work beautifully together in a Raspberry PI running the latest xbian.
I also tried to promote Automatic to be installed in a "Download Package" of xbian:
http://forum.xbian.org/thread-196-post- … ml#pid2631

but unfortunately the developers of xbian would prefer to include programs which would be configured through a web gui...
in any case, a web gui would also facilitate the usability of Automatic.

Couldn't you consider the development of this feature? (at least to define the filters of the config file).

Configuring via Web interface would mean I'd have to integrate some kind of web server into Automatic. That, plus the fact that I'm not a web developer and wouldn't know where to start, I'm afraid this is not going to happen. Unless, of course, someone with the experience is willing and able to enhance Automatic with web configurability. It is open source after all.

KyleK · 2013-02-13 07:10:00

xzempt wrote:
Hi all,
First off I have to say I love being able to have Transmission on my DNS-323!
I have been trying to get Automatic setup and running as well, I've been going well but am up to editing the config file, but I am unable to save a copy into the location etc due to permissions. Now I am a linux n00b and it is prob a very simple thing to get working, but I just am not 100% sure.
I've done searches all over the place but no one has written a 'complete' guide to setting up Transmission and Automatic, there a guides that help, but I'm not 100%, especially for n00b like myself :D

So any help in terms of getting the config file into location would be great. I even tried having the config in the root and trying to point it to that using the -c command but it couldn't find the file....

Thanks

X

I'd like to help you, but I'm not really sure what the problem is. Where are you trying to store the config file? Why does it not work?
As user root you have write access pretty much anywhere.
Also, the -c option should work with any location for the config file.

Can you paste some error messages so we can work from there?

Last edited by KyleK (2013-02-13 09:26:20)

xzempt · 2013-02-13 11:20:56

Ok, so I've figured out how to edit etc without issues. (It was really just me not knowing my way around linux at all....very rarely do I use linux for anything)
The issues I have run into now is that I have a feed that I want to add to Automatic. This feed ONLY contains stuff I want to download, thus I don't want the 'filters', yet Automatic seems to not let me start it without the filters and feeds defined. When really all I would need is the URL option, but it won't let me use just this option

Last edited by xzempt (2013-02-13 11:34:00)

xzempt · 2013-02-13 11:28:21

Well, I just put a "." in the filter, all the torrents should have a . in them anyway....will see how that works....

KyleK · 2013-02-13 19:15:44

This will do the trick:

Code:

filter = { pattern => ".*" }

lykle · 2013-02-18 16:43:03

Hey KyleK,

Thank you.

I am loving it!

Lykle

Leiz4r · 2013-02-26 00:20:17

Hi all!

When I try to download torrents of feed "http://hachede.me/?p=rss&categories=89&pk=ckd964o******c" I can only download one file because the stored automatic.state this:

1 http://thepiratebay.se/torrent/8190834/
2 http://thepiratebay.se/torrent/8190822/
3 http://hachede.me

Once this happens, all the following items are torrents duplicated. What is the problem?

Example RSS item (It is a private tracker):

<item>
<title>
<![CDATA[
Hawaii Five-0 03x11 - Kahu (2013) HDiT 720p H264 AC3(ES/EN) Sub(ES/EN)
]]>
</title>
<link>
http: //hachede.me/?p=rss&action=download&tid=5900&pk=ckd964o******
</link>
<description>
<![CDATA[
Size: 1.45 GB - Seeders: 20 - Leechers: 1 - Complete x 30
]]>
</description>
<pubDate>Sat, 23 Feb 2013 15:04:44 +0000</pubDate>
<enclosure url="http://hachede.me/data/torrents/torrent_images/s/folder3759.jpg" length="1" type="image/jpeg"/>
<guid isPermaLink="true">http://hachede.me</guid>
</item>

However, I have no problems with piratebay.

Sorry for my bad English :S

Thanks in advance.

KyleK · 2013-02-26 08:40:08

The problem is an invalid feed. Automatic stores the value of the <guid> element in automatic.state because the RSS specifications say that the GUID of an RSS item is a unique identifier (GUID=globally unique ID).
Unfortunately, that is not the case for that feed.
I advise telling the site owner about it so they can fix the issue.

lykle · 2013-03-02 11:05:51

This package is great!
So great in fact that it downloads episodes and I don't even know it.
Since I don't have an iPhone, how in the world can I get a notification to my PC or android phone that a new episode of something is downloaded?

Hmm, maybe I should look at Transmission and post completed, or something like that.

Anyway, any help is appreciated and once again KyleK, great tool, thank you.

DSM-G600, DNS-3xx and NSA-220 Hack Forum

Announcement

#751 2013-01-13 23:19:28

Re: [REL] Automatic for funplug-0.5

Code:

Code:

Code:

Code:

#752 2013-01-14 08:58:01

Re: [REL] Automatic for funplug-0.5

#753 2013-01-14 15:26:34

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

Code:

#754 2013-01-14 16:50:27

Re: [REL] Automatic for funplug-0.5

#755 2013-01-15 08:55:02

Re: [REL] Automatic for funplug-0.5

Code:

#756 2013-01-15 11:58:02

Re: [REL] Automatic for funplug-0.5

#757 2013-01-16 16:32:21

Re: [REL] Automatic for funplug-0.5

#758 2013-01-17 00:36:50

Re: [REL] Automatic for funplug-0.5

Code:

#759 2013-01-17 07:47:33

Re: [REL] Automatic for funplug-0.5

#760 2013-01-17 15:14:05

Re: [REL] Automatic for funplug-0.5

#761 2013-01-18 04:41:03

Re: [REL] Automatic for funplug-0.5

#762 2013-01-18 06:40:15

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

#763 2013-01-18 08:15:45

Re: [REL] Automatic for funplug-0.5

stardust wrote:

#764 2013-01-18 09:27:44

Re: [REL] Automatic for funplug-0.5

#765 2013-01-24 19:07:52

Re: [REL] Automatic for funplug-0.5

#766 2013-02-13 05:56:40

Re: [REL] Automatic for funplug-0.5

#767 2013-02-13 07:08:00

Re: [REL] Automatic for funplug-0.5

stardust wrote:

#768 2013-02-13 07:10:00

Re: [REL] Automatic for funplug-0.5

xzempt wrote:

#769 2013-02-13 11:20:56

Re: [REL] Automatic for funplug-0.5

#770 2013-02-13 11:28:21

Re: [REL] Automatic for funplug-0.5

#771 2013-02-13 19:15:44

Re: [REL] Automatic for funplug-0.5

Code:

#772 2013-02-18 16:43:03

Re: [REL] Automatic for funplug-0.5

#773 2013-02-26 00:20:17

Re: [REL] Automatic for funplug-0.5

#774 2013-02-26 08:40:08

Re: [REL] Automatic for funplug-0.5

#775 2013-03-02 11:05:51

Re: [REL] Automatic for funplug-0.5

Board footer