Return-Path: 
 <solr-user-return-13816-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-solr-user-archive@locus.apache.org
Received: (qmail 61779 invoked from network); 17 Sep 2008 16:02:31 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 17 Sep 2008 16:02:31 -0000
Received: (qmail 30107 invoked by uid 500); 17 Sep 2008 16:02:25 -0000
Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org
Received: (qmail 29901 invoked by uid 500); 17 Sep 2008 16:02:24 -0000
Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-user-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-user-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-user@lucene.apache.org>
List-Id: <solr-user.lucene.apache.org>
Reply-To: solr-user@lucene.apache.org
Delivered-To: mailing list solr-user@lucene.apache.org
Received: (qmail 29890 invoked by uid 99); 17 Sep 2008 16:02:24 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Sep 2008 09:02:24 -0700
X-ASF-Spam-Status: No, hits=2.2 required=10.0
	tests=HTML_MESSAGE,SPF_PASS,WHOIS_MYPRIVREG
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of shalinmangar@gmail.com
 designates 209.85.217.13 as permitted sender)
Received: from [209.85.217.13] (HELO mail-gx0-f13.google.com) (209.85.217.13)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Sep 2008 16:01:25 +0000
Received: by gxk6 with SMTP id 6so20598424gxk.5
        for <solr-user@lucene.apache.org>;
 Wed, 17 Sep 2008 09:01:57 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=domainkey-signature:received:received:message-id:date:from:to
         :subject:in-reply-to:mime-version:content-type:references;
        bh=26gutvwr0KTjE0Ipgbgs/lc362iq34jw5fGrxSxrzUs=;
        b=M/P/qW5cGFoug87NfoJ3aWTCWO3F1QBSFPKyfGcshwludIIWmWXQAN2rBGpOjtkpa8
         cLh8CBSdg1btj5EHuzhVJfxgn0Inx3qHstwxa0xQKZPsiMpKYy2lpZe4LAFrOG1wqeZ0
         CS2A9dVH8UlTBEoYD1aa1R0zUw4/rX+JXYNQQ=
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:references;
        b=aR4/fNV6qPGzp6e8TX5ngoH47/fLZyAg85iuzhxF2INFo9Lx0ee3Xl1fLSZ6ZZ+THQ
         I4fb0sii9OemcGpU8UcdWrysuOJGhLLPBVZrkbVzhH7N4OT8uhOSLDpjHYbYYuy0LGvG
         3/CD949TVZFgoyMm8aCg3DhT0djxBsjIaqVqM=
Received: by 10.142.223.20 with SMTP id v20mr914818wfg.336.1221667316579;
        Wed, 17 Sep 2008 09:01:56 -0700 (PDT)
Received: by 10.142.212.5 with HTTP; Wed, 17 Sep 2008 09:01:56 -0700 (PDT)
Message-ID: <69de18140809170901t63d6fd74i6ada644db2d3610@mail.gmail.com>
Date: Wed, 17 Sep 2008 21:31:56 +0530
From: "Shalin Shekhar Mangar" <shalinmangar@gmail.com>
To: solr-user@lucene.apache.org
Subject: Re: cron job update index
In-Reply-To: <19535082.post@talk.nabble.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_13177_21244269.1221667316565"
References: <19520468.post@talk.nabble.com>
	 <765002.85010.qm@web50306.mail.re2.yahoo.com>
	 <19527218.post@talk.nabble.com>
	 <69de18140809170201l47e7c8a9xc52ab9e4d0b8ba26@mail.gmail.com>
	 <19533680.post@talk.nabble.com>
	 <69de18140809170830t3eeb7f52w352a4654e0a5ce2c@mail.gmail.com>
	 <19535082.post@talk.nabble.com>
X-Virus-Checked: Checked by ClamAV on apache.org

------=_Part_13177_21244269.1221667316565
Content-Type: text/plain; charset=ISO-2022-JP
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

On Wed, Sep 17, 2008 at 9:14 PM, sunnyfr <johanna.34@gmail.com> wrote:

>
> Am I doing something wrong or not?
> Every time I start (manually) delta-import
> (.../dataimport?command=delta-import)
> and then I go back to check the statut : http://.../solr/books/dataimport,
> it's still running like it can't never ending :
>
> <str name="status">busy</str>
> <str name="importResponse">A command is still running...</str>
> −
> <lst name="statusMessages">
> <str name="Time Elapsed">0:13:54.194</str>
> <str name="Total Requests made to DataSource">881696</str>
> <str name="Total Rows Fetched">2418310</str>
> <str name="Total Documents Processed">125956</str>
> <str name="Total Documents Skipped">0</str>
> <str name="Delta Dump started">2008-09-17 17:24:07</str>
> <str name="Identifying Delta">2008-09-17 17:24:07</str>
> <str name="Deltas Obtained">2008-09-17 17:24:49</str>
> <str name="Building documents">2008-09-17 17:24:49</str>
> <str name="Total Changed Documents">390796</str>
> </lst>
>
>
> Even if I've just done a full-import, so, where can I check in stat or ???
> what did it just changed by delta-import ?
>
> Does it loop for checking cuz I have to admit I didn't put my
> parentDeltaQuery in data-config. Is it for that ?
>
>  <entity name="books"
>            pk="books.book_id"
>            transformer="RegexTransformer"
>            deltaQuery="SELECT book_id FROM book INNER JOIN user
> USING(user_id)
>                          WHERE book.modified >
> '${dataimporter.last_index_time}'
>                            OR user.modified  >
> '${dataimporter.last_index_time}'"
>            query="SELECT ..."
>  >
>  ....
>

When you give a delta-import command, first the deltaQuery is executed to
identify the primary keys of the rows which have changed since the last run
(through the use of the last_index_time variable. Then the main "query" is
executed for each primary key identified by the deltaQuery. This main query
is used to create the documents and index them.

In the output you pasted, it tells you the number of rows that have changed
and the number of documents it has indexed until now. Once it completes, it
will show the time at which it committed the changes to the index.

The parentDeltaQuery is needed only when you have nested entities and you
need to identify changes in the child entities.


>
> --
> View this message in context:
> http://www.nabble.com/cron-job-update-index-tp19520468p19535082.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>


-- 
Regards,
Shalin Shekhar Mangar.

------=_Part_13177_21244269.1221667316565--