Mailing-List: contact solr-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-dev@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of noble.paul@gmail.com designates
 209.85.216.180 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:reply-to:in-reply-to:references:from:date
         :x-google-sender-auth:message-id:subject:to:content-type
         :content-transfer-encoding;
        b=s4LkcZgWx56SG1x4wOQqzBXvJ5/sWABDruXGf20OPBKVUGSu+lIyWlU7fYoKdNT4xu
         qz7QEqi0v/V6bAdlug5wFcDYN0Yt+VgoETls2hoxofKNP6jwXpTaOfgtTO8/+fOtQmag
         jRcYsOMqPaeWcrCbXmA5rP++sEx1BybrAMAAg=
MIME-Version: 1.0
Sender: noble.paul@gmail.com
Reply-To: noble.paul@gmail.com
In-Reply-To: <1421482655.1254420743636.JavaMail.jira@brutus>
References: <1333324508.1252705198379.JavaMail.jira@brutus>
	<1421482655.1254420743636.JavaMail.jira@brutus>
From: 
 =?UTF-8?B?Tm9ibGUgUGF1bCDgtKjgtYvgtKzgtL/gtLPgtY3igI0gIOCkqOCli+CkrOCljeCks+CljQ==?=
 <noble.paul@corp.aol.com>
Date: Fri, 2 Oct 2009 00:14:07 +0530
Message-ID: <5e76b0ad0910011144p53382eabpa3cf2beb0ce16843@mail.gmail.com>
Subject: Re: [jira] Commented: (SOLR-1426) Allow delta-import to run
	continously until aborted
To: solr-dev@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

the lastIndexTime is removed from DataImporter because it is redundant.

On Thu, Oct 1, 2009 at 11:42 PM, Abdul Chaudhry (JIRA) <jira@apache.org> wr=
ote:
>
> =A0 =A0[ https://issues.apache.org/jira/browse/SOLR-1426?page=3Dcom.atlas=
sian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D=
12761289#action_12761289 ]
>
> Abdul Chaudhry commented on SOLR-1426:
> --------------------------------------
>
> NOTE: the last_index_time is broken with the perpetual patch
>
> I hacked around this by changing the data-config.xml file for the deltaQu=
ery to do something like this:-
>
> WHERE updated_at > DATE_SUB('${dataimporter.last_index_time}',INTERVAL 10=
 SECOND)
>
> This is because of the time discrepancy between the sleep and the writers=
 last_index_time.
>
> However, it looks like the delta-import is broken in the latest build of =
solr trunk revision 820731. It looks like the lastIndexTime in the DataImpo=
rter is not populated after a delta and so if you used ${dataimporter.last_=
index_time} then the deltaQuery uses the wrong time.
>
> I am going to wait until delta-import is fixed before I update a patch.
>
>
>> Allow delta-import to run continously until aborted
>> ---------------------------------------------------
>>
>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 Key: SOLR-1426
>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 URL: https://issues.apache.org/jira/brow=
se/SOLR-1426
>> =A0 =A0 =A0 =A0 =A0 =A0 Project: Solr
>> =A0 =A0 =A0 =A0 =A0Issue Type: Improvement
>> =A0 =A0 =A0 =A0 =A0Components: contrib - DataImportHandler
>> =A0 =A0Affects Versions: 1.4
>> =A0 =A0 =A0 =A0 =A0 =A0Reporter: Abdul Chaudhry
>> =A0 =A0 =A0 =A0 =A0 =A0Assignee: Noble Paul
>> =A0 =A0 =A0 =A0 =A0 =A0 Fix For: 1.5
>>
>> =A0 =A0 =A0 =A0 Attachments: delta-import-perpetual.patch
>>
>>
>> Modify the delta-import so that it takes a perpetual flag that makes it =
run continuously until its aborted.
>> http://localhost:8985/solr/select/?command=3Ddelta-import&clean=3Dfalse&=
qt=3D/dataimport&commit=3Dtrue&perpetual=3Dtrue
>> perpetual means the delta import will keep running and pause for a few s=
econds when running queries.
>> The only way to stop delta import will be to explicitly issue an abort l=
ike so:-
>> http://localhost:8985/solr/tickets/select/?command=3Dabort
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>


--=20
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com