DSM-G600, DNS-3xx and NSA-220 Hack Forum

stoffeboffe · 2012-11-06 14:43:42

Cool, now I get it. Now my test.xml looks a bit different

I also created a filter in my automatic.conf that I know is in th RSS feed.

When running your command line, I get this though

sh-4.1# automatic -o -f -c automatic.conf --matchonly --xml test.xml
automatic: unrecognized option `--matchonly'

Hopefully my last problem for today.

KyleK · 2012-11-06 14:50:22

My bad, it's actually "--match-only" ( "-m" works as well)

stoffeboffe · 2012-11-06 15:01:19

No worries, I appreciate all the help!

Trying now and that got me

sh-4.1# automatic -o -f -c automatic.conf --match-only --xml test.xml
../src/automatic.c, 697: Automatic version: 0.8.0 (95ada5c)
../src/state.c, 111: Restored 0 old entries
../src/automatic.c, 290: 1 feed URLs
../src/automatic.c, 291: Read 6 filters from config file
[12/11/06 13:59:10] ../src/automatic.c, 149: Shutting down daemon

Does this mean that there is no match in xml or have I messed up something?

KyleK · 2012-11-06 16:11:35

I'd say it means there is no match in the XML.

You can crank up the verbosity by suppling the '-v' parameter, e.g. "-v2". It'll give you more output.

stoffeboffe · 2012-11-06 16:16:19

Cool, thanks for all your help. I'll try some more on my own now.

stoffeboffe · 2012-11-06 20:22:13

I ain't all bad I think I messed with the automatic.conf a bit, with the feed and feedids and so on.

sh-4.1# automatic -o -f -c automatic.conf --match-only --xml test.xml
../src/automatic.c, 697: Automatic version: 0.8.0 (95ada5c)
../src/state.c, 111: Restored 0 old entries
../src/automatic.c, 290: 1 feed URLs
../src/automatic.c, 291: Read 1 filters from config file
../src/regex.c, 70: [isRegExMatch] 'Homeland.*720p.HDTV.x264' matches 'Homeland.S02E06.720p.HDTV.x264-IMMERSE'
[12/11/06 19:18:25] ../src/automatic.c, 589: [(null)] Match: Homeland.S02E06.720p.HDTV.x264-IMMERSE (http://___)
[12/11/06 19:18:25] ../src/automatic.c, 149: Shutting down daemon

So, now I believe I have this working atleast. I guess it's now just for me to wait and see if I set up everything else correct.

I guess there ain't no other way to test the rest but for a release to be found in the feed and if nothing happens, then check the log file?

FunFiler · 2012-11-06 21:56:39

You can always add a bunch of entries to the config file for stuff you don't want. Then just stop/delete the torrents once automatic adds them. Thats what I did. Now I just sit back and wait for one of about 125 shows to 'appear' on the list from my TV :-)

stoffeboffe · 2012-11-07 10:06:10

Yeah, I actually did that and well, it didn't work as it should. When I check my watchdir I find this file.

-rw-r--r-- 1 root root 42 Nov 6 22:03 download.php?id=392180&SSL=0

I can only imagine it's the correct release, since the filter works, but some somehow it hasn't downloaded the .torrent but just somepart of the link to it.

Looking at the test.xml, a release looks like this. Edited offcourse

<item>
<title>Release.S06E01.720p.HDTV.x264-EVOLVE</title>
<description>TV/HD</description>
<pubDate>Tue, 06 Nov 2012 05:08:09 +0000</pubDate>
<category>TV/HD</category>
<guid>http://www.torrentzzzzzz/details.php?id=392720</guid>
<link>http://www.torrentzzzzz/download.php?id=392720&SSL=0</link>
/item>

Any suggestions?

KyleK · 2012-11-07 15:52:12

When requesting to download a file from a server, and the file is not a website, the server usually sends the correct filename of that file. Automatic uses that as filename when saving the file to a folder.
If a server does not send the name, however, Automatic simply uses the last part of the URL.

What you have in your watch folder might be an actual .torrent file, it just has a funny name. Can you open the file with an editor and see what's inside?

PS: It looks to me like this is a private site you're getting your torrents from. Make sure to tell about it, so it can properly download the torrents.
Have a look here for more information.

stoffeboffe · 2012-11-07 21:23:16

KyleK wrote:
When requesting to download a file from a server, and the file is not a website, the server usually sends the correct filename of that file. Automatic uses that as filename when saving the file to a folder.
If a server does not send the name, however, Automatic simply uses the last part of the URL.

What you have in your watch folder might be an actual .torrent file, it just has a funny name. Can you open the file with an editor and see what's inside?

PS: It looks to me like this is a private site you're getting your torrents from. Make sure to tell about it, so it can properly download the torrents.
Have a look here for more information.

From what was inside that file I think that the cookie part in the rss feed might just fix the problem. You are correct, it's a private tracker.

Thanks for the input!

stoffeboffe · 2012-11-10 14:54:46

Hi again,
Still having problems and I think it's related to the the RSS link.

It looks like this, edited a bit. Can someone maybe help how I should enter it in automatic.conf to get it right.

Without cookie:

Code:

http://www.awyea.net/rss.php?passkey=2&username=superflyninjabadass&38&limit=15&direct=1

With (utorrent) cookie:

Code:

http://www.awyea.net/rss.php?passkey=2&username=superflyninjabadass&38&limit=15&direct=1:COOKIE:pass=1;uid=2

If I remember I have tried both lines as they are, but does not work. KyleK, I looked a the post you linked to and tried those suggestions, but no luck.

My conf today looks like this and it doesn't work

Code:

feed =  {  url          => "http://www.awyea.net/rss.php?passkey=2"
           cookies      => "uid=2;pass=1"
        }

Edit: Just remember I'm unsure about this part aswell. I don't use a username and password to access the rpc, so in my conf file I have this.

Code:

# rpc-auth = "user:password"
rpc-auth = ":"

Should I maybe remove the line all in all?

Thanks for your help.

Last edited by stoffeboffe (2012-11-10 15:04:24)

KyleK · 2012-11-10 20:42:18

Last issue first: if you don't use any authentiction, just remove or comment the line.
About the cookie issue: you should be able to just use the utorrent link you posted above. Store it (completely) in the url field of your feed, and omit the cookie option altogether.
Automatic will parse the ":COOKIE:" part for you.

draks · 2012-11-12 01:39:06

I've changed the owner of automatic.state to nobody:allaccount but no luck. Also, when I restart with automatic disabled on boot and I check the state file it's as good as it was just before the boot, however starting automatic manually also does not make it read the file properly.

I'll just reconfigure the whole thing from scratch, thanks for the help though.

draks · 2012-11-12 02:47:23

KyleK · 2012-11-12 12:06:02

Hm, ok?! That is strange indeed.
Automatic stores the <guid> of each RSS feed item in the file automatic.state. That GUID is supposed to always stay the same, even if the item itself gets updated later on. I'm not sure why Automatic wouldn't properly restore the statefile if the GUIDs are not URLs. I'll investigate.

KyleK · 2012-11-12 13:03:49

Oh, what a stupid bug!
For some reason the code that deals with Automatic's download history (which I haven't touched in a long time) assumes that a GUID is always at least 20 characters long (but only when reading the state file, not when writing!). That is why you experienced the problems after reboots.

I've already fixed the problem in source (github is up-to-date) and a package for ffp-0.7-arm is already available as well.
Let me know if you need Automatic for a different ffp version.

KyleK · 2012-11-12 13:36:55

Automatic v0.8.1 is now available for all platforms.
It fixes draks' problem that download history isn't always properly restored after a reboot.

Get your package from the first post.

stoffeboffe · 2012-11-15 10:55:09

Yay I finally solved my filtering issue.

Code:

not working: pattern => "American.Horror.Story*720p.HDTV.x264"
working: pattern => "American.Horror.Story.*720p.HDTV.x264"

One little dot after the y in this case can make all the difference, I wouldn't have guessed.

Thanks KyleK for automatic and all your help. Keep up the good work!

KyleK · 2012-11-15 10:57:09

Glad you were able to get it to work. Let me know if anything else comes up.
Always here to help

cbeneke · 2012-11-25 00:27:57

I have a silly question and I think it might be a quick fix, but I can't seem to figure out what's going on.

I'm trying to use automatic to download the .torrent file from my private tracker's RSS feed, and I'm 99% of the way there, but it seems that the torrent files that are downloaded are dumped in my watched folder in the format

legal.torrent.s01e01.torrent?torrent_pass=xxxxxxxxxxx.

The program that I use to monitor for new torrent files in that folder doesn't recognize the torrent because the file ends with ?torrent_pass=xxxxxxxx instead of just .torrent.

Am I doing something incorrect with your program or is it possible that the site I belong to is appending that extra data onto the end of the torrent file and it's beyond my control?

Thanks in advance for your help!

Chris

KyleK · 2012-11-25 19:31:54

Usually when downloading a file from a webserver, the webserver transmits the actual filename along with the data, and Automatic uses that filename.

When the server does not send the filename, however, Automatic uses whatever comes after the last slash in the URL as filename. That is why your files look rather funny.
Now this can mean two things:
1. Your tracker's site doesn't tell Automatic the actual filename, and only sends the data
2. That file that Automatic downloads and stores to disk isn't actually a torrent file.

Does your torrent client recognize the files as proper torrent files?

PS: If you use Transmission BitTorrent client, you don't need to use a watchfolder.

cbeneke · 2012-11-25 19:59:11

If I manually rename the file, it's recognized as a torrent file and the download begins as it should. I'll look into using Transmission instead. I need something with a CLI, so I'm not sure if it will do the trick. Thanks again for your response!

KyleK · 2012-11-25 20:00:46

Transmission brings a web interface that you can access with any browser. There are also remote clients that do the same (I know at least two for Windows, and Transmission has its own Mac client which should be able to connect to a remotely installed daemon).

FunFiler · 2012-11-26 19:23:59

KyleK wrote:
Transmission brings a web interface that you can access with any browser. There are also remote clients that do the same (I know at least two for Windows, and Transmission has its own Mac client which should be able to connect to a remotely installed daemon).

SmartPhone and Tablet support too :-)

KyleK · 2012-11-28 17:06:28

cbeneke wrote:
If I manually rename the file, it's recognized as a torrent file and the download begins as it should. I'll look into using Transmission instead. I need something with a CLI, so I'm not sure if it will do the trick. Thanks again for your response!

The Automatic logfile should contain the torrent URL that Automatic downloads.
Could you try with wget and curl to download the same file and see if the problem persists?

(If the URL contains '?' symbols, put the whole URL in quotes).

Code:

$ wget -d "<path to torrent>"
$ curl -vOJ "<path to torrent>"

Can you also send me the result of both commands (private message is fine), maybe I can do something about the issue in Automatic.

Last edited by KyleK (2012-11-28 17:09:56)

DSM-G600, DNS-3xx and NSA-220 Hack Forum

Announcement

#726 2012-11-06 14:43:42

Re: [REL] Automatic for funplug-0.5

#727 2012-11-06 14:50:22

Re: [REL] Automatic for funplug-0.5

#728 2012-11-06 15:01:19

Re: [REL] Automatic for funplug-0.5

#729 2012-11-06 16:11:35

Re: [REL] Automatic for funplug-0.5

#730 2012-11-06 16:16:19

Re: [REL] Automatic for funplug-0.5

#731 2012-11-06 20:22:13

Re: [REL] Automatic for funplug-0.5

#732 2012-11-06 21:56:39

Re: [REL] Automatic for funplug-0.5

#733 2012-11-07 10:06:10

Re: [REL] Automatic for funplug-0.5

#734 2012-11-07 15:52:12

Re: [REL] Automatic for funplug-0.5

#735 2012-11-07 21:23:16

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

#736 2012-11-10 14:54:46

Re: [REL] Automatic for funplug-0.5

Code:

Code:

Code:

Code:

#737 2012-11-10 20:42:18

Re: [REL] Automatic for funplug-0.5

#738 2012-11-12 01:39:06

Re: [REL] Automatic for funplug-0.5

#739 2012-11-12 02:47:23

Re: [REL] Automatic for funplug-0.5

#740 2012-11-12 12:06:02

Re: [REL] Automatic for funplug-0.5

#741 2012-11-12 13:03:49

Re: [REL] Automatic for funplug-0.5

#742 2012-11-12 13:36:55

Re: [REL] Automatic for funplug-0.5

#743 2012-11-15 10:55:09

Re: [REL] Automatic for funplug-0.5

Code:

#744 2012-11-15 10:57:09

Re: [REL] Automatic for funplug-0.5

#745 2012-11-25 00:27:57

Re: [REL] Automatic for funplug-0.5

#746 2012-11-25 19:31:54

Re: [REL] Automatic for funplug-0.5

#747 2012-11-25 19:59:11

Re: [REL] Automatic for funplug-0.5

#748 2012-11-25 20:00:46

Re: [REL] Automatic for funplug-0.5

#749 2012-11-26 19:23:59

Re: [REL] Automatic for funplug-0.5

KyleK wrote:

#750 2012-11-28 17:06:28

Re: [REL] Automatic for funplug-0.5

cbeneke wrote:

Code:

Board footer