lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aman Tandon <amantandon...@gmail.com>
Subject Re: Out of Memory when i downdload 5 Million records from sqlserver to solr
Date Tue, 01 Jul 2014 15:21:02 GMT
You can try gave some more memory to solr
On Jul 1, 2014 4:41 PM, "mskeerthi" <mskeerthi@gmail.com> wrote:

> I have to download my 5 million records from sqlserver to solr into one
> index. I am getting below exception after downloading 1 Million records. Is
> there any configuration or another to download from sqlserver to solr.
>
> Below is the exception i am getting in solr:
> org.apache.solr.common.SolrException; auto commit
> error...:java.lang.IllegalStateException: this writer hit an
> OutOfMemoryError; cannot commit
>         at
>
> org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2915)
>         at
> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3096)
>         at
> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3063)
>         at
>
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:578)
>         at org.apache.solr.update.CommitTracker.run(CommitTracker.java:216)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Unknown
> Source)
>         at java.util.concurrent.FutureTask.run(Unknown Source)
>         at
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown
> Source)
>         at
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
> Source)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>         at java.lang.Thread.run(Unknown Source)
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Out-of-Memory-when-i-downdload-5-Million-records-from-sqlserver-to-solr-tp4144949.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message