Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of noble.paul@gmail.com
 designates 64.233.182.190 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references;
        b=VDSxjEaAipGetZPdWiT1HcLzRDg4rQSx8Rol3Y1mEgVWdswuVkzReNQ9Us+T10MRrC
         Sq5ActwNlcL5uO7b3bZLcAqEnxqtAc8IQWiuj/Webp5+Obb+Z1FilE1j01EInlq6iqe/
         2HtAxbJriSJLIDQjcoI7UdM2/ozayZCJi4K10=
Message-ID: <5e76b0ad0807112138r2c7d056ge59be150855c2a3d@mail.gmail.com>
Date: Sat, 12 Jul 2008 10:08:37 +0530
From: "=?UTF-8?B?Tm9ibGUgUGF1bCDgtKg=?=
 =?UTF-8?B?4LWL4LSs4LS/4LSz4LWN4oCNIOCkqOCli+CkrOCljeCks+CljQ==?="
 <noble.paul@gmail.com>
To: solr-user@lucene.apache.org
Subject: Re: HttpDataSource questions
In-Reply-To: <678D6E9F-16C7-467E-A09F-DAECF00E7BC0@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <678D6E9F-16C7-467E-A09F-DAECF00E7BC0@gmail.com>

On Fri, Jul 11, 2008 at 11:46 PM, Jon Baer <jonbaer@gmail.com> wrote:
> Hi,
>
> On the wiki it says that url attribute can be templatized but Im not sure
> how that happens, do you I need to create something read from a database
> column in order to use that type of function?  ie Id like to run over some
> RSS feeds for multiple URLs (~ 30), do I need to copy 1 per URL I want to
> read or is there an easier method?
It is a simple passthrough of parameters you passed over to the http request.
eg:
If you want to read a feed with say an extra attribute (date) which
you will know in runtime
you can make the http request with command=full-import&date=some_date.
The date can be consumed in the url as
url="http://xyz.com?a=b&thedate=${dataimporter.request.date}


if you could give me a sample on how the diffrent urls look like I may
be able to suggest you something. Actually there are many ways to
achieve it.

>
> Also does anything currently get compared when doing a delta-import for
> these types of data sources?  Does the dataimport.properties compare itself
> to anything?  (ie a pubdate on RSS, etc).
>
> Thanks!
>
> - Jon
>


-- 
--Noble Paul