lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Noble Paul നോബിള്‍ नोब्ळ्" <noble.p...@gmail.com>
Subject Re: HttpDataSource questions
Date Sat, 12 Jul 2008 04:38:37 GMT
On Fri, Jul 11, 2008 at 11:46 PM, Jon Baer <jonbaer@gmail.com> wrote:
> Hi,
>
> On the wiki it says that url attribute can be templatized but Im not sure
> how that happens, do you I need to create something read from a database
> column in order to use that type of function?  ie Id like to run over some
> RSS feeds for multiple URLs (~ 30), do I need to copy 1 per URL I want to
> read or is there an easier method?
It is a simple passthrough of parameters you passed over to the http request.
eg:
If you want to read a feed with say an extra attribute (date) which
you will know in runtime
you can make the http request with command=full-import&date=some_date.
The date can be consumed in the url as
url="http://xyz.com?a=b&thedate=${dataimporter.request.date}


if you could give me a sample on how the diffrent urls look like I may
be able to suggest you something. Actually there are many ways to
achieve it.

>
> Also does anything currently get compared when doing a delta-import for
> these types of data sources?  Does the dataimport.properties compare itself
> to anything?  (ie a pubdate on RSS, etc).
>
> Thanks!
>
> - Jon
>



-- 
--Noble Paul

Mime
View raw message