lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "keshari.prerna" <keshari.pre...@gmail.com>
Subject Re: Indexing logs files of thousands of GBs
Date Wed, 30 Oct 2013 13:55:40 GMT
Hello,

As suggested by Chris, now I am accessing the files using java program and
creating SolrInputDocument, but i ran into this exception while doing
server.add(document). When i tried to increase "ramBufferSizeMB", it doesn't
let me make it more than 2 gig.

org.apache.solr.client.solrj.SolrServerException: Server at
http://localhost:8983/solr/logsIndexing returned non ok status:500,
message:the request was rejected because its size (2097454) exceeds the
configured maximum (2097152) 
org.apache.commons.fileupload.FileUploadBase$SizeLimitExceededException: the
request was rejected because its size (2097454) exceeds the configured
maximum (2097152)  	at
org.apache.commons.fileupload.FileUploadBase$FileItemIteratorImpl$1.raiseError(FileUploadBase.java:902)
 
at
org.apache.commons.fileupload.util.LimitedInputStream.checkLimit(LimitedInputStream.java:71)
 
at
org.apache.commons.fileupload.util.LimitedInputStream.read(LimitedInputStream.java:128)  
at
org.apache.commons.fileupload.MultipartStream$ItemInputStream.makeAvailable(MultipartStream.java:977)
 
at
org.apache.commons.fileupload.MultipartStream$ItemInputStream.read(MultipartStream.java:887)
 
at java.io.InputStream.read(Unknown Source)  	at
org.apache.commons.fileupload.util.Streams.copy(Streams.java:94)  	at
org.apache.commons.fileupload.util.Streams.copy(Streams.java:64)  	at
org.apache.commons.fileupload.FileUploadBase.parseRequest(FileUploadBase.java:362)  
at
org.apache.commons.fileupload.servlet.ServletFileUpload.parseRequest(ServletFileUpload.java:126)
 
at
org.apache.solr.servlet.MultipartRequestParser.parseParamsAndFillStreams(SolrRequestParsers.java:344)
 
at
org.apache.solr.servlet.StandardRequestParser.parseParamsAndFillStreams(SolrRequestParsers.java:397)
 
at
org.apache.solr.servlet.SolrRequestParsers.parse(SolrRequestParsers.java:115)  
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:244)  
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)  
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)  
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)  
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)  
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)  
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)  
at org.mortbay.jetty.handler.ContextHand
	at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:328)
	at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:121)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:106)
	at Filewalker.walk(LogsIndexer.java:48)
	at Filewalker.main(LogsIndexer.java:69)

How do I get rid of this?

Thanks,
Prerna



--
View this message in context: http://lucene.472066.n3.nabble.com/Indexing-logs-files-of-thousands-of-GBs-tp4097073p4098438.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message