Archived
1
0
Fork 0
Commit graph

15 commits

Author SHA1 Message Date
Henrik Hautakoski
269ddffa78 dlight.c: use buffer_write() 2012-05-23 22:05:16 +02:00
Henrik Hautakoski
37ba894802 make dlight.c use the new dlhist 2011-12-15 13:35:13 +01:00
Henrik Hautakoski
1350330dd2 dlhist: rename to proc-cache.
A new datastructure is about to take dlhist place. dlhist is currently
implemented as a mixture of an "process cache" that should record what
rss items has been processed (that is why the url is used as a unique
identifier), but right now it only stores an url if it has been
downloaded. A new datastructure that should be "download history"
shall be implemented, that will keep track of what title and where
it has been downloaded to. this will make it possible to only
download an rss title to a location once.

Splitting this datastructure into two separated structures is trivial
as a "process cache" will threat URL's as a unique identifier and
a "download history" will threat the title in an rss item as a
unique identifier (and also track it's destinations).

This commit does not change any functionality, I just rename
this to keep the "dlhist" prefix and source files clear for
when implementing the real dlhist.
2011-11-14 16:11:18 +01:00
Henrik Hautakoski
90365e9de2 dlight.c: do not call perror when dlhist_open() fails 2011-11-05 16:45:43 +01:00
Henrik Hautakoski
dcd515b4b1 http.c: use buffer.h 2011-11-05 15:18:19 +01:00
Henrik Hautakoski
c41f11e57a dlight.c: do not add a newline to error() calls 2011-10-25 16:58:24 +02:00
Henrik Hautakoski
1f46350f84 dlight.c: don't use errno from http_fetch_file
http_fetch_file does not set errno. so dont use it.
2011-10-02 22:42:34 +02:00
Henrik Hautakoski
02814cc1f7 dlight.c: only download a file once.
When going through the filter list for an item, we download and store the item
everytime a filter is matched.
This patch allowes an item to be downloaded the first time a filter
match and save the data throughout the rest of the list, so all
other matches never downloads the item again but uses the data in memory.
2011-09-29 21:34:34 +02:00
Henrik Hautakoski
2f9e968717 dlight.c: more verbose output 2011-09-20 16:33:55 +02:00
Henrik Hautakoski
fce177b486 dlight.c: dlhist purge: remove magic number and set interval to 6h 2011-09-21 17:19:12 +02:00
Henrik Hautakoski
90505d8e5b remove new-line from error() calls. 2011-09-21 17:19:12 +02:00
Henrik Hautakoski
3aea2adbc6 dlight.c: print items that are downloaded 2011-09-21 17:19:11 +02:00
Henrik Hautakoski
a2f2e58353 Make the other modules use error.c 2011-09-21 17:19:10 +02:00
Henrik Hautakoski
1166d3be86 compiled file format: associate destination whit each invidual filter
Better to have an destination for every filter then every target.
otherwise one will have to have two targets with the same source but
different destination.
2011-09-21 17:19:09 +02:00
Henrik Hautakoski
b2df740514 Initial commit 2011-09-21 17:13:28 +02:00