lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (LUCENE-1205) java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too many open files)
Date Fri, 07 Mar 2008 03:36:58 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yonik Seeley resolved LUCENE-1205.
----------------------------------

    Resolution: Invalid

Hi Rajesh, since you are using Solr, this should really have been opened as a Solr issue.
You are running out of descriptors... try setting the limit to something high like 10000.

> java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too
many open files)
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-1205
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1205
>             Project: Lucene - Java
>          Issue Type: Bug
>         Environment: Linux , Tomcat 5.5
>            Reporter: Rajesh Srinivasan
>            Priority: Blocker
>
> The below exception starts occuring when my application tries to update index of consumers.
> When all consumers are rebuild, the indexes are not updated and all threads of apache
is occupied by this error.
> So I need to restart my tomcat every time and this happens for every 4 hours.
> I saw some issues related in JIRA but when I used links to go to bugzilla it never works.

> It would be great if some explanation is given.
> For setting ulimit in linux it is told that it should be (1+mergeFactor) * FilesPerSegment.
> We have mergeFactor of 10.
> We are also not clear on what is FilesPerSegment
> Below is the stack trace which comes continuosly
> 06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update) com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer
[]:
> Got solr server exception:
> org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:
> Caused by:
> Server side exception, status = 1: java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm
(Too many open files)
> at java.io.RandomAccessFile.open(Native Method)
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
> at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
> at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
> at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
> at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
> at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
> at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
> at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
> at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
> at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
> at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
> at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
> at org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
> at org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
> at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
> at org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
> at org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
> at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
> at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
> at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
> at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
> at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
> at java.lang.Thread.run(Thread.java:595) 
> After sending request:
> <commit waitFlush="true" waitSearcher="true" />
> at org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
> at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
> at com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
> at java.lang.Thread.run(Thread.java:595)
> org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message