lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Srinivasan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (LUCENE-1205) java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too many open files)
Date Fri, 07 Mar 2008 02:40:58 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajesh Srinivasan updated LUCENE-1205:
--------------------------------------

    Description: 
The below exception starts occuring when my application tries to update index of consumers.
When all consumers are rebuild, the indexes are not updated and all threads of apache is occupied
by this error.
So I need to restart my tomcat every time and this happens for every 4 hours.

I saw some issues related in JIRA but when I used links to go to bugzilla it never works.

It would be great if some explanation is given.

For setting ulimit in linux it is told that it should be (1+mergeFactor) * FilesPerSegment.
We have mergeFactor of 10.
We are also not clear on what is FilesPerSegment

Below is the stack trace which comes continuosly

06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update) com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer
[]:
Got solr server exception:
org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:
Caused by:
Server side exception, status = 1: java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm
(Too many open files)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
at org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
at org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
at org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
at org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595) 
After sending request:
<commit waitFlush="true" waitSearcher="true" />
at org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
at com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
at java.lang.Thread.run(Thread.java:595)
org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:


  was:
06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update) com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer
[]:
Got solr server exception:
org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:
Caused by:
Server side exception, status = 1: java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm
(Too many open files)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
at org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
at org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
at org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
at org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595) 
After sending request:
<commit waitFlush="true" waitSearcher="true" />
at org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
at com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
at java.lang.Thread.run(Thread.java:595)
org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:


    Environment: Linux , Tomcat 5.5

> java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too
many open files)
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-1205
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1205
>             Project: Lucene - Java
>          Issue Type: Bug
>         Environment: Linux , Tomcat 5.5
>            Reporter: Rajesh Srinivasan
>            Priority: Blocker
>
> The below exception starts occuring when my application tries to update index of consumers.
> When all consumers are rebuild, the indexes are not updated and all threads of apache
is occupied by this error.
> So I need to restart my tomcat every time and this happens for every 4 hours.
> I saw some issues related in JIRA but when I used links to go to bugzilla it never works.

> It would be great if some explanation is given.
> For setting ulimit in linux it is told that it should be (1+mergeFactor) * FilesPerSegment.
> We have mergeFactor of 10.
> We are also not clear on what is FilesPerSegment
> Below is the stack trace which comes continuosly
> 06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update) com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer
[]:
> Got solr server exception:
> org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:
> Caused by:
> Server side exception, status = 1: java.io.FileNotFoundException: /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm
(Too many open files)
> at java.io.RandomAccessFile.open(Native Method)
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
> at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
> at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
> at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
> at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
> at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
> at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
> at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
> at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
> at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
> at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
> at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
> at org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
> at org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
> at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
> at org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
> at org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
> at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
> at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
> at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
> at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
> at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
> at java.lang.Thread.run(Thread.java:595) 
> After sending request:
> <commit waitFlush="true" waitSearcher="true" />
> at org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
> at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
> at com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
> at com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
> at java.lang.Thread.run(Thread.java:595)
> org.apache.solr.client.exception.SolrServerException: Server returned non-zero status:

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message