lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: No space left on device - When I execute suggester component.
Date Wed, 20 Dec 2017 03:09:50 GMT
How much is "enough"? You're going to be building and storing the
resultant structure
on disk since you have suggest.build=true. It seems simple enough to
give yourself
some more disk space and try again. While you do that, monitor the
disk space while
the suggester builds and see.

Best,
Erick

On Tue, Dec 19, 2017 at 6:07 PM, Fiz Newyorker <fiznewyork@gmail.com> wrote:
> Hi ,
>
> Yes I checked the Disk usage. using this command
>
> du -sh
>
> and I have enough space on the Disk.
>
> I am using this Query :
> *http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry
> <http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry>*
>
>
> *I see in the solr logs *
>
> 2017-12-20 02:00:37.852 INFO  (qtp401424608-16) [   x:User]
> o.a.s.c.PluginBag Going to create a new requestHandler with {type =
> requestHandler,name = /suggest,class = solr.SearchHandler,attributes =
> {startup=lazy, name=/suggest, class=solr.SearchHandler},args =
> {defaults={suggest=true,suggest.dictionary=infixSuggester,suggest.dictionary=fuzzySuggester,suggest.count=10},components=[suggest]}}
>
> 2017-12-20 02:00:37.866 INFO  (qtp401424608-16) [   x:User]
> o.a.s.h.c.SuggestComponent SuggestComponent prepare with :
> suggest.build=true&suggest.q=Jerry&suggest.count=10&suggest=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.cfq=memory
>
> 2017-12-20 02:00:37.867 INFO  (qtp401424608-16) [   x:User]
> o.a.s.s.s.SolrSuggester SolrSuggester.build(fuzzySuggester)
>
>
> =========================================
>
>
>
> 2017-12-20 02:05:53.908 INFO  (qtp401424608-16) [   x:User_Data]
> o.a.s.c.S.Request [User]  webapp=/solr path=/suggest
> params={suggest.build=true&suggest.q=Jerry&suggest=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.cfq=memory}
> status=500 QTime=316057
>
> 2017-12-20 02:05:53.910 ERROR (qtp401424608-16) [   x:User_Data]
> o.a.s.s.HttpSolrCall null:java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
>
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
>
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>
> at java.nio.channels.Channels.writeFully(Channels.java:101)
>
> at java.nio.channels.Channels.access$000(Channels.java:61)
>
> at java.nio.channels.Channels$1.write(Channels.java:174)
>
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
>
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
>
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>
> at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
>
> at
> org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)
>
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:529)
>
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:504)
>
> at
> org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:389)
>
> at org.apache.lucene.util.OfflineSorter.sort(OfflineSorter.java:278)
>
> at
> org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:489)
>
> at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)
>
> at
> org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)
>
> at
> org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:179)
>
> at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
>
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
>
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)
>
> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)
>
> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)
>
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
>
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
>
> at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
>
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
>
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
>
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
>
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
>
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
>
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
>
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
>
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>
> at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
>
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
>
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>
> at
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
>
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>
> at org.eclipse.jetty.server.Server.handle(Server.java:534)
>
> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
>
> at
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
>
> at
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
>
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
>
> at
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
>
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
>
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
>
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
>
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
>
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
>
> at java.lang.Thread.run(Thread.java:748)
>
> Suppressed: java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
>
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
>
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>
> at java.nio.channels.Channels.writeFully(Channels.java:101)
>
> at java.nio.channels.Channels.access$000(Channels.java:61)
>
> at java.nio.channels.Channels$1.write(Channels.java:174)
>
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
>
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
>
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:68)
>
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.close(OfflineSorter.java:537)
>
> at
> org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:411)
>
> ... 39 more
>
> Suppressed: java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
>
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
>
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>
> at java.nio.channels.Channels.writeFully(Channels.java:101)
>
> at java.nio.channels.Channels.access$000(Channels.java:61)
>
> at java.nio.channels.Channels$1.write(Channels.java:174)
>
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
>
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
>
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>
> at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
>
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:70)
>
>
>
>
> Thanks
> Fiz Ahmed.
>
> On Tue, Dec 19, 2017 at 5:57 PM, Jamie Jackson <jamiejaxon@gmail.com> wrote:
>
>> Have you checked disk consumption on the box yet?
>>
>> On Dec 19, 2017 8:46 PM, "Fiz Newyorker" <fiznewyork@gmail.com> wrote:
>>
>> > Hello Solr Experts,
>> >
>> > Good Evening !
>> >
>> > I have an  issue , Whenever I run the Auto Suggest component ,
>> >
>> > http://lapp81.rno.com:8989/solr/Data/suggest?suggest=
>> > true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&
>> > suggest.q=Jerry
>> >
>> >
>> > I am getting the following Error .
>> >
>> > {"responseHeader":{"status":500,"QTime":341753},"error":{"msg":"No
>> > space left on device","trace":"java.io.IOException: No space left on
>> > device\n\tat sun.nio.ch.FileDispatcherImpl.write0(Native Method)\n\tat
>> > sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)\n\tat
>> > sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)\n\tat
>> > sun.nio.ch.IOUtil.write(IOUtil.java:65)\n\tat
>> > sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)\n\tat
>> > java.nio.channels.Channels.writeFullyImpl(Channels.java:78)\n\tat
>> > java.nio.channels.Channels.writeFully(Channels.java:101)\n\tat
>> > java.nio.channels.Channels.access$000(Channels.java:61)\n\tat
>> > java.nio.channels.Channels$1.write(Channels.java:174)\n\tat
>> > org.apache.lucene.store.FSDirectory$FSIndexOutput$1.
>> > write(FSDirectory.java:419)\n\tat
>> > java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)\
>> n\tat
>> > java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)\
>> > n\tat
>> > java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)\n\tat
>> > org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(
>> > OutputStreamIndexOutput.java:53)\n\tat
>> > org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(
>> > OfflineSorter.java:529)\n\tat
>> > org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(
>> > AnalyzingSuggester.java:480)\n\tat
>> > org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)\n\tat
>> > org.apache.solr.spelling.suggest.SolrSuggester.build(
>> > SolrSuggester.java:181)\n\tat
>> > org.apache.solr.handler.component.SuggestComponent.
>> > prepare(SuggestComponent.java:179)\n\tat
>> > org.apache.solr.handler.component.SearchHandler.handleRequestBody(
>> > SearchHandler.java:269)\n\tat
>> > org.apache.solr.handler.RequestHandlerBase.handleRequest(
>> > RequestHandlerBase.java:173)\n\tat
>> > org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)\n\tat
>> > org.apache.solr.servlet.HttpSolrCall.execute(
>> HttpSolrCall.java:723)\n\tat
>> > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat
>> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(
>> > SolrDispatchFilter.java:347)\n\tat
>> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(
>> > SolrDispatchFilter.java:298)\n\tat
>> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.
>> > doFilter(ServletHandler.java:1691)\n\tat
>> > org.eclipse.jetty.servlet.ServletHandler.doHandle(
>> > ServletHandler.java:582)\n\tat
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(
>> > ScopedHandler.java:143)\n\tat
>> > org.eclipse.jetty.security.SecurityHandler.handle(
>> > SecurityHandler.java:548)\n\tat
>> > org.eclipse.jetty.server.session.SessionHandler.
>> > doHandle(SessionHandler.java:226)\n\tat
>> > org.eclipse.jetty.server.handler.ContextHandler.
>> > doHandle(ContextHandler.java:1180)\n\tat
>> > org.eclipse.jetty.servlet.ServletHandler.doScope(
>> > ServletHandler.java:512)\n\tat
>> > org.eclipse.jetty.server.session.SessionHandler.
>> > doScope(SessionHandler.java:185)\n\tat
>> > org.eclipse.jetty.server.handler.ContextHandler.
>> > doScope(ContextHandler.java:1112)\n\tat
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(
>> > ScopedHandler.java:141)\n\tat
>> > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(
>> > ContextHandlerCollection.java:213)\n\tat
>> > org.eclipse.jetty.server.handler.HandlerCollection.
>> > handle(HandlerCollection.java:119)\n\tat
>> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(
>> > HandlerWrapper.java:134)\n\tat
>> > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(
>> > RewriteHandler.java:335)\n\tat
>> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(
>> > HandlerWrapper.java:134)\n\tat
>> > org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat
>> > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat
>> > org.eclipse.jetty.server.HttpConnection.onFillable(
>> > HttpConnection.java:251)\n\tat
>> > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(
>> > AbstractConnection.java:273)\n\tat
>> > org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat
>> > org.eclipse.jetty.io.SelectChannelEndPoint$2.run(
>> > SelectChannelEndPoint.java:93)\n\tat
>> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
>> > executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat
>> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
>> > produceConsume(ExecuteProduceConsume.java:148)\n\tat
>> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(
>> > ExecuteProduceConsume.java:136)\n\tat
>> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
>> > QueuedThreadPool.java:671)\n\tat
>> > org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
>> > QueuedThreadPool.java:589)\n\tat
>> > java.lang.Thread.run(Thread.java:748)\n","code":500}}
>> >
>> > Please share your thoughts .
>> >
>> > Thanks
>> >
>> > Fiz Ahmed.
>> >
>>

Mime
View raw message