lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Too many open files when doing performance testing
Date Fri, 02 Sep 2005 03:08:39 GMT
How many files are in the index directory?
If your index is not optimized, try optimizing it first?
What's the max number of open files (ulimit -a)?  If it looks low,
increase it.
It looks like you have 20+ fields.  How many fields have you got? (just
curious)
It looks like you are not using the compound index format (it's the
default).  Consider using it - it uses less open file handles.

Otis


--- "jaina (sent by Nabble.com)" <lists@nabble.com> wrote:

> 
> Hi,
>    We are running into performace problem as we use lucene. 
> Everything worked fine till yesterday and today when we starte
> performance testing we saw an error.  Here are the details of the
> error
> 
> 54eda4e1 SystemErr     R From Faceted SearchImpl
> rlinksIndexReader.open(dir) failed
> [9/1/05 17:42:05:646 GMT] 54eda4e1 SystemErr     R
> java.io.FileNotFoundException:
>
/gsa/torgsa/.projects/p1/gsa_cdt_ods/projects/w3perf/datapersist/sales/support/skp/production/index/relatedlinks/secondary/_0.f20
> (Too many open files)
> [9/1/05 17:42:05:647 GMT] 54eda4e1 SystemErr     R              at
> java.io.RandomAccessFile.open(Native Method)
> [9/1/05 17:42:05:647 GMT] 54eda4e1 SystemErr     R              at
> java.io.RandomAccessFile. (RandomAccessFile.java(Compiled Code))
> [9/1/05 17:42:05:647 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.store.FSInputStream$Descriptor.
> (FSDirectory.java(Inlined Compiled Code))
> [9/1/05 17:42:05:647 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.store.FSInputStream. (FSDirectory.java(Inlined
> Compiled Code))
> [9/1/05 17:42:05:648 GMT] 54eda4e1 SystemErr     R              at
>
org.apache.lucene.store.FSDirectory.openFile(FSDirectory.java(Compiled
> Code))
> [9/1/05 17:42:05:648 GMT] 54eda4e1 SystemErr     R              at
>
org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java(Compiled
> Code))
> [9/1/05 17:42:05:648 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.index.SegmentReader. (SegmentReader.java:153)
> [9/1/05 17:42:05:648 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.index.SegmentReader. (SegmentReader.java:122)
> [9/1/05 17:42:05:648 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:118)
> [9/1/05 17:42:05:649 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.store.Lock$With.run(Lock.java(Compiled Code))
> [9/1/05 17:42:05:649 GMT] 54eda4e1 SystemErr     R              at
> org.apache.lucene.index.IndexReader.open(IndexReader.java(Compiled
> Code))
> [9/1/05 17:42:05:649 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.sales.support.skp.fsearch.search.FacetedSearchImpl.openRelatedLinksIndex(FacetedSearchImpl.java:1603)
> [9/1/05 17:42:05:649 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.sales.support.skp.fsearch.search.FacetedSearchImpl.getMatchingRelatedLinksDocs(FacetedSearchImpl.java:1071)
> [9/1/05 17:42:05:649 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.sales.support.skp.fsearch.search.FacetedSearchImpl.rlSearch(FacetedSearchImpl.java(Inlined
> Compiled Code))
> [9/1/05 17:42:05:650 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.sales.support.skp.fsearch.servicehandlers.SearchResultServiceHandler.processRequest(SearchResultServiceHandler.java(Compiled
> Code))
> [9/1/05 17:42:05:650 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.sales.support.skp.fsearch.servlets.SearchResultServlet.performTask(SearchResultServlet.java:144)
> [9/1/05 17:42:05:650 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.sales.support.skp.fsearch.servlets.SearchResultServlet.doGet(SearchResultServlet.java:75)
> [9/1/05 17:42:05:650 GMT] 54eda4e1 SystemErr     R              at
> javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
> [9/1/05 17:42:05:650 GMT] 54eda4e1 SystemErr     R              at
> javax.servlet.http.HttpServlet.service(HttpServlet.java(Compiled
> Code))
> [9/1/05 17:42:05:651 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.StrictServletInstance.doService(StrictServletInstance.java:110)
> [9/1/05 17:42:05:651 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.StrictLifecycleServlet._service(StrictLifecycleServlet.java:174)
> [9/1/05 17:42:05:651 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.IdleServletState.service(StrictLifecycleServlet.java:313)
> [9/1/05 17:42:05:651 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.StrictLifecycleServlet.service(StrictLifecycleServlet.java:116)
> [9/1/05 17:42:05:651 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.ServletInstance.service(ServletInstance.java:283)
> [9/1/05 17:42:05:652 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.ValidServletReferenceState.dispatch(ValidServletReferenceState.java:42)
> [9/1/05 17:42:05:652 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.servlet.ServletInstanceReference.dispatch(ServletInstanceReference.java:40)
> [9/1/05 17:42:05:652 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.handleWebAppDispatch(WebAppRequestDispatcher.java:983)
> [9/1/05 17:42:05:652 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.dispatch(WebAppRequestDispatcher.java:564)
> [9/1/05 17:42:05:652 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.forward(WebAppRequestDispatcher.java:200)
> [9/1/05 17:42:05:653 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.srt.WebAppInvoker.doForward(WebAppInvoker.java:119)
> [9/1/05 17:42:05:653 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.srt.WebAppInvoker.handleInvocationHook(WebAppInvoker.java:276)
> [9/1/05 17:42:05:653 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.cache.invocation.CachedInvocation.handleInvocation(CachedInvocation.java:71)
> [9/1/05 17:42:05:653 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.cache.invocation.CacheableInvocationContext.invoke(CacheableInvocationContext.java:116)
> [9/1/05 17:42:05:653 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.srp.ServletRequestProcessor.dispatchByURI(ServletRequestProcessor.java:186)
> [9/1/05 17:42:05:654 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.oselistener.OSEListenerDispatcher.service(OSEListener.java:334)
> [9/1/05 17:42:05:654 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.webcontainer.http.HttpConnection.handleRequest(HttpConnection.java:56)
> [9/1/05 17:42:05:654 GMT] 54eda4e1 SystemErr     R              at
>
com.ibm.ws.http.HttpConnection.readAndHandleRequest(HttpConnection.java:618)
> [9/1/05 17:42:05:654 GMT] 54eda4e1 SystemErr     R              at
> com.ibm.ws.http.HttpConnection.run(HttpConnection.java:443)
> [9/1/05 17:42:05:654 GMT] 54eda4e1 SystemErr     R              at
> com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:672)
> 
> Can someobody help with this?
> 
> Thanks.
> --
> Sent from the Lucene - Java Users forum at Nabble.com:
>
http://www.nabble.com/Too-many-open-files-when-doing-performance-testing-t272369.html#a766711
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message