lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: no segments* file found
Date Fri, 14 Dec 2018 16:07:51 GMT
You'd have to dive into the Lucene code and figure out the format,
offhand I don't know what it is.

However, there's no guarantee here that it'll result in a consistent index.
Consider merging two segments, seg1 and seg2. Here's the merge sequence:

1> merge the segments, At the end of this you have seg1, seg2, and
seg3. Segments_N points only go seg1 and seg2.
2> write a new segments_N+1 file that points _only_ to seg3
3> delete seg1 and seg2

So if you were part way through merging and had seg1, seg2, and seg3 on disk,
reconstructing the segments_N file from the available segments on disk
will result
duplicate documents in your index.

FWIW,
Erick
On Fri, Dec 14, 2018 at 3:27 AM Mahmoud Almokadem
<prog.mahmoud@gmail.com> wrote:
>
> Hello,
>
> I'm facing an issue that some shards of my SolrCloud collection is
> corrupted due to they don't have segments_N file but I think the whole
> segments are still available. Can I create a segment_N file from the
> available files?
>
> This is the stack trace:
>
> org.apache.solr.core.SolrCoreInitializationException: SolrCore
> 'my_collection_shard12_replica_n22' is not available due to init failure:
> Error opening new searcher
> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1495)
> at org.apache.solr.servlet.HttpSolrCall.init(HttpSolrCall.java:251)
> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:471)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:384)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
> at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1629)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:190)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
> at
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
> at org.eclipse.jetty.server.Server.handle(Server.java:530)
> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
> at
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
> at
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
> at
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
> at
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
> at
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
> at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
> at java.base/java.lang.Thread.run(Thread.java:844)
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1008)
> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:863)
> at
> org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
> at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:640)
> at
> com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> ... 1 more
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
> at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2095)
> at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2215)
> at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1091)
> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980)
> ... 9 more
> Caused by: org.apache.lucene.index.IndexNotFoundException: no segments*
> file found in
> LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/path/to/index/my_collection_shard12_replica_n22/data/index
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@659b5e1;
> maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [_11wv.cfe, _11wv.cfs, _11wv.si,
> _11wv_3b6.liv, _12zh.cfe, _12zh.cfs, _12zh.si, _12zh_2nv.liv, _13x.fdt,
> _13x.fdx, _13x.fnm, _13x.si, _13x.tvd, _13x.tvx, _13x_6j7.liv,
> _13x_Lucene50_0.doc, _13x_Lucene50_0.pos, _13x_Lucene50_0.tim,
> _13x_Lucene50_0.tip, _13x_Lucene70_0.dvd, _13x_Lucene70_0.dvm, _13z6.cfe,
> _13z6.cfs, _13z6.si, _13z6_36v.liv, _14yg.cfe, _14yg.cfs, _14yg.si,
> _14yg_27l.liv, _14yg_27m.liv, _166y.cfe, _166y.cfs, _166y.si,
> _166y_2rt.liv, _179l.cfe, _179l.cfs, _179l.si, _179l_2c3.liv, _18do.cfe,
> _18do.cfs, _18do.si, _18do_1z0.liv, _19io.cfe, _19io.cfs, _19io.si,
> _19io_29k.liv, _1axd.cfe, _1axd.cfs, _1axd.si, _1axd_2jt.liv, _1c6e.cfe,
> _1c6e.cfs, _1c6e.si, _1c6e_1y6.liv, _1dbq.cfe, _1dbq.cfs, _1dbq.si,
> _1dbq_1y8.liv, _1ei8.cfe, _1ei8.cfs, _1ei8.si, _1ei8_1w8.liv, _1heo.cfe,
> _1heo.cfs, _1heo.si, _1heo_4y2.liv, _1m13.cfe, _1m13.cfs, _1m13.si,
> _1m13_461.liv, _1rpy.cfe, _1rpy.cfs, _1rpy.si, _1rpy_1xg.liv, _1uqd.cfe,
> _1uqd.cfs, _1uqd.si, _1uqd_2ph.liv, _2a1.fdt, _2a1.fdx, _2a1.fnm, _2a1.si,
> _2a1.tvd, _2a1.tvx, _2a1_72s.liv, _2a1_Lucene50_0.doc, _2a1_Lucene50_0.pos,
> _2a1_Lucene50_0.tim, _2a1_Lucene50_0.tip, _2a1_Lucene70_0.dvd,
> _2a1_Lucene70_0.dvm, _2dmz.cfe, _2dmz.cfs, _2dmz.si, _2dmz_bzg.liv,
> _36h0.cfe, _36h0.cfs, _36h0.si, _36h0_nto.liv, _3a0.fdt, _3a0.fdx,
> _3a0.fnm, _3a0.si, _3a0.tvd, _3a0.tvx, _3a0_6yd.liv, _3a0_Lucene50_0.doc,
> _3a0_Lucene50_0.pos, _3a0_Lucene50_0.tim, _3a0_Lucene50_0.tip,
> _3a0_Lucene70_0.dvd, _3a0_Lucene70_0.dvm, _3s8r.cfe, _3s8r.cfs, _3s8r.si,
> _3s8r_jft.liv, _4em.fdt, _4em.fdx, _4em.fnm, _4em.si, _4em.tvd, _4em.tvx,
> _4em_7q6.liv, _4em_Lucene50_0.doc, _4em_Lucene50_0.pos,
> _4em_Lucene50_0.tim, _4em_Lucene50_0.tip, _4em_Lucene70_0.dvd,
> _4em_Lucene70_0.dvm, _4h26.cfe, _4h26.cfs, _4h26.si, _4h26_pt6.liv,
> _53ot.cfe, _53ot.cfs, _53ot.si, _53ot_jss.liv, _5qw6.cfe, _5qw6.cfs, _
> 5qw6.si, _5qw6_g6i.liv, _6or.fdt, _6or.fdx, _6or.fnm, _6or.si, _6or.tvd,
> _6or.tvx, _6or_5s9.liv, _6or_Lucene50_0.doc, _6or_Lucene50_0.pos,
> _6or_Lucene50_0.tim, _6or_Lucene50_0.tip, _6or_Lucene70_0.dvd,
> _6or_Lucene70_0.dvm, _6pvs.cfe, _6pvs.cfs, _6pvs.si, _6pvs_h1o.liv,
> _7bv9.cfe, _7bv9.cfs, _7bv9.si, _7bv9_nco.liv, _7se.fdt, _7se.fdx,
> _7se.fnm, _7se.si, _7se.tvd, _7se.tvx, _7se_52h.liv, _7se_Lucene50_0.doc,
> _7se_Lucene50_0.pos, _7se_Lucene50_0.tim, _7se_Lucene50_0.tip,
> _7se_Lucene70_0.dvd, _7se_Lucene70_0.dvm, _7y61.cfe, _7y61.cfs, _7y61.si,
> _7y61_jsn.liv, _8ptb.cfe, _8ptb.cfs, _8ptb.si, _8ptb_k12.liv, _90p.fdt,
> _90p.fdx, _90p.fnm, _90p.si, _90p.tvd, _90p.tvx, _90p_3ie.liv,
> _90p_Lucene50_0.doc, _90p_Lucene50_0.pos, _90p_Lucene50_0.tim,
> _90p_Lucene50_0.tip, _90p_Lucene70_0.dvd, _90p_Lucene70_0.dvm, _9gwe.cfe,
> _9gwe.cfs, _9gwe.si, _9gwe_ibd.liv, _a3t.fdt, _a3t.fdx, _a3t.fnm, _a3t.si,
> _a3t.tvd, _a3t.tvx, _a3t_2wq.liv, _a3t_Lucene50_0.doc, _a3t_Lucene50_0.pos,
> _a3t_Lucene50_0.tim, _a3t_Lucene50_0.tip, _a3t_Lucene70_0.dvd,
> _a3t_Lucene70_0.dvm, _a3zn.cfe, _a3zn.cfs, _a3zn.si, _a3zn_df2.liv,
> _avb7.cfe, _avb7.cfs, _avb7.si, _avb7_c36.liv, _bcm.fdt, _bcm.fdx,
> _bcm.fnm, _bcm.si, _bcm.tvd, _bcm.tvx, _bcm_3ev.liv, _bcm_Lucene50_0.doc,
> _bcm_Lucene50_0.pos, _bcm_Lucene50_0.tim, _bcm_Lucene50_0.tip,
> _bcm_Lucene70_0.dvd, _bcm_Lucene70_0.dvm, _biqs.cfe, _biqs.cfs, _biqs.si,
> _biqs_9lt.liv, _caf8.cfe, _caf8.cfs, _caf8.si, _caf8_83x.liv, _cjy.cfe,
> _cjy.cfs, _cjy.si, _cjy_2ta.liv, _d22z.cfe, _d22z.cfs, _d22z.si,
> _d22z_7ys.liv, _dmm.cfe, _dmm.cfs, _dmm.si, _dmm_2mt.liv, _duk0.cfe,
> _duk0.cfs, _duk0.si, _duk0_817.liv, _eq1d.cfe, _eq1d.cfs, _eq1d.si,
> _eq1d_8sg.liv, _ez9.cfe, _ez9.cfs, _ez9.si, _ez9_37p.liv, _fb5e.cfe,
> _fb5e.cfs, _fb5e.si, _fb5e_787.liv, _fiwi.cfe, _fiwi.cfs, _fiwi.si,
> _fiwi_3kb.liv, _g0u.cfe, _g0u.cfs, _g0u.si, _g0u_2g4.liv, _g9k1.cfe,
> _g9k1.cfs, _g9k1.si, _g9k1_43f.liv, _h1s.cfe, _h1s.cfs, _h1s.si,
> _h1s_2hx.liv, _h1s_2hy.liv, _h74d.cfe, _h74d.cfs, _h74d.si, _h74d_2lz.liv,
> _huhx.cfe, _huhx.cfs, _huhx.si, _huhx_g91.liv, _i31.cfe, _i31.cfs, _i31.si,
> _i31_2bx.liv, _iq63.cfe, _iq63.cfs, _iq63.si, _iq63_arj.liv, _j68.cfe,
> _j68.cfs, _j68.si, _j68_3c7.liv, _jaxx.cfe, _jaxx.cfs, _jaxx.si,
> _jaxx_da0.liv, _k1rv.cfe, _k1rv.cfs, _k1rv.si, _k1rv_hkw.liv, _k9v.cfe,
> _k9v.cfs, _k9v.si, _k9v_2wr.liv, _komf.cfe, _komf.cfs, _komf.si,
> _komf_2b8.liv, _laac.cfe, _laac.cfs, _laac.si, _laac_4ds.liv, _lgh.cfe,
> _lgh.cfs, _lgh.si, _lgh_2vn.liv, _lv8v.cfe, _lv8v.cfs, _lv8v.si,
> _lv8v_6iq.liv, _lx9s.cfe, _lx9s.cfs, _lx9s.si, _lx9s_13i.liv, _lz1r.cfe,
> _lz1r.cfs, _lz1r.si, _lz1r_wb.liv, _m1oe.cfe, _m1oe.cfs, _m1oe.si,
> _m1oe_ki.liv, _m633.cfe, _m633.cfs, _m633.si, _m633_12k.liv, _m6lb.cfe,
> _m6lb.cfs, _m6lb.si, _m6lb_b4.liv, _m72g.cfe, _m72g.cfs, _m72g.si,
> _m72g_3o.liv, _m7hn.cfe, _m7hn.cfs, _m7hn.si, _m7hn_32.liv, _m7ro.cfe,
> _m7ro.cfs, _m7ro.si, _m7ro_2h.liv, _m7ry.cfe, _m7ry.cfs, _m7ry.si,
> _m7ry_1f.liv, _m7ty.cfe, _m7ty.cfs, _m7ty.si, _m7ty_15.liv, _m7ut.cfe,
> _m7ut.cfs, _m7ut.si, _m7ut_w.liv, _m7v3.cfe, _m7v3.cfs, _m7v3.si,
> _m7v3_3u.liv, _m818.cfe, _m818.cfs, _m818.si, _m818_15.liv, _m86o.cfe,
> _m86o.cfs, _m86o.si, _m86o_1p.liv, _m8a7.cfe, _m8a7.cfs, _m8a7.si,
> _m8a7_q.liv, _m8d2.cfe, _m8d2.cfs, _m8d2.si, _m8d2_r.liv, _m8de.cfe,
> _m8de.cfs, _m8de.si, _m8de_16.liv, _m8dy.cfe, _m8dy.cfs, _m8dy.si,
> _m8dy_f.liv, _m8ei.cfe, _m8ei.cfs, _m8ei.si, _m8ei_k.liv, _m8es.cfe,
> _m8es.cfs, _m8es.si, _m8es_d.liv, _m8f4.cfe, _m8f4.cfs, _m8f4.si,
> _m8f4_d.liv, _m8fe.cfe, _m8fe.cfs, _m8fe.si, _m8fe_a.liv, _m8fq.cfe,
> _m8fq.cfs, _m8fq.si, _m8fr.fdt, _m8fr.fdx, _m8fr.fnm, _m8fr.si, _m8fr.tvd,
> _m8fr.tvx, _m8fr_2.liv, _m8fr_Lucene50_0.doc, _m8fr_Lucene50_0.pos,
> _m8fr_Lucene50_0.tim, _m8fr_Lucene50_0.tip, _m8fr_Lucene70_0.dvd,
> _m8fr_Lucene70_0.dvm, _m8fs.fdt, _m8fs.fdx, _m8fs.fnm, _m8fs.si, _m8fs.tvd,
> _m8fs.tvx, _m8fs_1.liv, _m8fs_Lucene50_0.doc, _m8fs_Lucene50_0.pos,
> _m8fs_Lucene50_0.tim, _m8fs_Lucene50_0.tip, _m8fs_Lucene70_0.dvd,
> _m8fs_Lucene70_0.dvm, _mcw.cfe, _mcw.cfs, _mcw.si, _mcw_2nm.liv, _oc2.cfe,
> _oc2.cfs, _oc2.si, _oc2_4uy.liv, _pfu.cfe, _pfu.cfs, _pfu.si, _pfu_23m.liv,
> _qg9.cfe, _qg9.cfs, _qg9.si, _qg9_24j.liv, _rt2.cfe, _rt2.cfs, _rt2.si,
> _rt2_2hx.liv, _uag.cfe, _uag.cfs, _uag.si, _uag_3nd.liv, _wmu.cfe,
> _wmu.cfs, _wmu.si, _wmu_2os.liv, _z56.cfe, _z56.cfs, _z56.si, _z56_2rk.liv,
> write.lock]
> at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1072)
> at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:119)
> at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:94)
> at
> org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:257)
> at
> org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:131)
> at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2056)
>
> Thanks,
> Mahmoud

Mime
View raw message