lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mskeerthi <mskeer...@gmail.com>
Subject Out of Memory when i downdload 5 Million records from sqlserver to solr
Date Tue, 01 Jul 2014 10:57:53 GMT
I have to download my 5 million records from sqlserver to solr into one
index. I am getting below exception after downloading 1 Million records. Is
there any configuration or another to download from sqlserver to solr.

Below is the exception i am getting in solr:
org.apache.solr.common.SolrException; auto commit
error...:java.lang.IllegalStateException: this writer hit an
OutOfMemoryError; cannot commit
	at
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2915)
	at
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3096)
	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3063)
	at
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:578)
	at org.apache.solr.update.CommitTracker.run(CommitTracker.java:216)
	at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown
Source)
	at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)



--
View this message in context: http://lucene.472066.n3.nabble.com/Out-of-Memory-when-i-downdload-5-Million-records-from-sqlserver-to-solr-tp4144949.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message