lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexandre Rafalovitch <arafa...@gmail.com>
Subject Re: warning while indexing
Date Thu, 17 Dec 2015 05:24:37 GMT
Ah. Then it might be that DIH cannot be run in parallel. Though the
exception is much lower in the stack.

Not sure. Maybe somebody else with more knowledge in the commit path can
comment on it.
On 17 Dec 2015 12:21 pm, "Midas A" <test.midas@gmail.com> wrote:

> Alexandre,
>
> *Only two DIH, indexing different data.  *
>
> On Thu, Dec 17, 2015 at 10:46 AM, Alexandre Rafalovitch <
> arafalov@gmail.com>
> wrote:
>
> > How many? On the same node?
> >
> > I am not sure if running multiple DIH is a popular case.
> >
> > My theory, still, that you are running out of a pool size there. Though
> if
> > it happens with even just two DIH, it could be a different issue.
> > On 17 Dec 2015 12:01 pm, "Midas A" <test.midas@gmail.com> wrote:
> >
> > > Alexandre ,
> > >
> > > we are running multiple  DIH to index data.
> > >
> > > On Thu, Dec 17, 2015 at 12:40 AM, Alexandre Rafalovitch <
> > > arafalov@gmail.com>
> > > wrote:
> > >
> > > > Are you sending documents from one client or many?
> > > >
> > > > Looks like an exhaustion of some sort of pool related to Commit
> within,
> > > > which I assume you are using.
> > > >
> > > > Regards,
> > > >     Alex
> > > > On 16 Dec 2015 4:11 pm, "Midas A" <test.midas@gmail.com> wrote:
> > > >
> > > > > Getting following warning while indexing ..Anybody please tell me
> the
> > > > > reason .
> > > > >
> > > > >
> > > > > java.util.concurrent.RejectedExecutionException: Task
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@9916a67
> > > > > rejected from
> > java.util.concurrent.ScheduledThreadPoolExecutor@79f8b5f
> > > > > [Terminated,
> > > > > pool size = 0, active threads = 0, queued tasks = 0, completed
> tasks
> > =
> > > > > 2046]
> > > > >         at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
> > > > >         at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
> > > > >         at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:325)
> > > > >         at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.CommitTracker._scheduleCommitWithin(CommitTracker.java:150)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.CommitTracker._scheduleCommitWithinIfNeeded(CommitTracker.java:118)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.CommitTracker.addedDocument(CommitTracker.java:169)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:231)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:451)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:587)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:346)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
> > > > >         at
> > > > >
> > >
> org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:70)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:235)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:500)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:404)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:353)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:219)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:451)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:489)
> > > > >         at
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:468)
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message