lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stockii <st...@shopgate.com>
Subject Re: DIH, Full-Import, DB and Performance.
Date Tue, 01 Jun 2010 11:44:19 GMT

do you think that the option 

responseBuffer="adaptive" 

should solve my problem ? 


>From DIH FAQ ...: 

I'm using DataImportHandler with MS SQL Server database with sqljdbc driver.
DataImportHandler is going out of memory. I tried adjustng the batchSize
values but they don't seem to make any difference. How do I fix this?

There's a connection property called responseBuffering in the sqljdbc driver
whose default value is "full" which causes the entire result set to be
fetched. See http://msdn.microsoft.com/en-us/library/ms378988.aspx for more
details. You can set this property to "adaptive" to keep the driver from
getting everything into memory. Connection properties like this can be set
as an attribute (responseBuffering="adaptive") in the dataSource
configuration OR directly in the jdbc url specified in DataImportHandler's
dataSource configuration.
-- 
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Full-Import-DB-and-Performance-tp861068p861134.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message