Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of avlesh@gmail.com designates
 209.85.222.173 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=hhgytwwuXehff6QjsB9fX+gxuAJ8/r/uOIBCSMQQG9Hppn91n7WNaMEMxvcBcGF6U8
         1oU/6izKtrrYWvFXTlvWXekdhjFJC2Igl/3cETsnN1jh1T0ksGfg1vdI62WUZIJN6CYB
         4LD2dfTePFgQ01s0s1CVUy1+PnNLXZxHYAHaw=
MIME-Version: 1.0
In-Reply-To: <26213642.post@talk.nabble.com>
References: <26213642.post@talk.nabble.com>
Date: Thu, 5 Nov 2009 18:50:56 +0530
Message-ID: <f19741740911050520n553c1cc2m9a4b14fa055ab4ed@mail.gmail.com>
Subject: Re: DIH full-import with fetchSize(Integer.MIN_VALUE) taking long
	time to start processing rows
From: Avlesh Singh <avlesh@gmail.com>
To: solr-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=00504502cd11edc2d504779f98be

--00504502cd11edc2d504779f98be
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

>
> Parallelly I have another process wich is doing lots of inserts to that
> table (I also had it before but with less number of inserts). Could this =
be
> causing some bloking that makes the query take that long? In case not, an=
d
> advice what could make to take so long until I start see rows beeing
> processed?
>
Sounds scary! With innodb engine you are causing a table level lock with
each insert (assuming your table has an auto-increment column). With
frequent inserts you are of-course delaying the read time.
Why would you want to do this kind of an operation in the very first place?
Can't you use views for indexing?

Cheers
Avlesh

On Thu, Nov 5, 2009 at 6:18 PM, Marc Sturlese <marc.sturlese@gmail.com>wrot=
e:

>
> I have been using fetchSize(Integer.MIN_VALUE) for a long time and it was
> working perfect until now. I use MySQL, java 1.6,
> mysql-connector-java-5.1.7-bin.jar and InoDB tables.
> Since a month ago when the query is executed it will take a long time
> untill
> it starts processing the results from the resultSet. The query matches
> about
> 2M rows. It use to take 10 min untill rows processing started. Now it=92s
> taking about 2 hours.
> Parallelly I have another process wich is doing lots of inserts to that
> table (I also had it before but with less number of inserts). Could this =
be
> causing some bloking that makes the query take that long? In case not, an=
d
> advice what could make to take so long until I start see rows beeing
> processed?
> Thanks in advance.
> --
> View this message in context:
> http://old.nabble.com/DIH-full-import-with-fetchSize%28Integer.MIN_VALUE%=
29-taking-long-time-to-start-processing-rows-tp26213642p26213642.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>

--00504502cd11edc2d504779f98be--