lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dawn breaks <2005dawnbre...@gmail.com>
Subject Re: Lucene OOM
Date Thu, 11 Jan 2018 14:59:20 GMT
Hi, Uwe
  Yes, All indexes running in the same JVM with 14GiB of heap space, but
the JVM heap usage is up to 95%.  I'am sue that all
IndexReaders/IndexSearchers has been closed properly.



On 11 January 2018 at 20:46, Uwe Schindler <uwe@thetaphi.de> wrote:

> Hi lubin,
>
> the terms dictionary is using the "tim" and "tip" files. It should be
> approximately in the dimension of the FST.
>
> Do you have all indexes running in the same JVM or is it 10 servers?
> Because then the numbers look correct. If you really want to have such an
> large index in a single machine using a single JVM, you should plan for
> more heap space. I'd start with 12 GiB of heap space to run this index.
>
> A last recommendation: If you update your index during runtime, make sure
> that you correctly close the outdated IndexReaders/IndexSearchers (e.g.
> using SearcherManager), so you don't have orphaned instances of IndexReader
> consuming heap space and disk space, because the files can't be fully
> deleted as long as those are open!
>
> Uwe
>
> -----
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
> > -----Original Message-----
> > From: dawn breaks [mailto:2005dawnbreaks@gmail.com]
> > Sent: Thursday, January 11, 2018 10:22 AM
> > To: java-user@lucene.apache.org
> > Subject: Re: Lucene OOM
> >
> > Hi, Uwe
> >   Thanks for your timely reply. Yes,  those documents are huge text. We
> > have ten indices, and each of them has approximate 75G index size on
> disk.
> > Following is the directory  content of one of the indices.
> >
> > Thanks & Best Regards!
> > lubin
> >
> > total 74G
> > -rw-r--r-- 1 root root  100K Jan 10 16:11 _2ncr_4k.del
> > -rw-r--r-- 1 root root  1.1G Aug  4 12:52 _2ncr.fdt
> > -rw-r--r-- 1 root root  468K Aug  4 12:52 _2ncr.fdx
> > -rw-r--r-- 1 root root  636K Aug  4 12:55 _2ncr.fnm
> > -rw-r--r-- 1 root root  398M Aug  4 12:53 _2ncr_Lucene41_0.doc
> > -rw-r--r-- 1 root root  712M Aug  4 12:53 _2ncr_Lucene41_0.pay
> > -rw-r--r-- 1 root root  744M Aug  4 12:53 _2ncr_Lucene41_0.pos
> > -rw-r--r-- 1 root root  129M Aug  4 12:53 _2ncr_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.1M Aug  4 12:53 _2ncr_Lucene41_0.tip
> > -rw-r--r-- 1 root root  822M Aug  4 12:54 _2ncr_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  210K Aug  4 12:54 _2ncr_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Aug  4 12:55 _2ncr.si
> > -rw-r--r-- 1 root root  1.5G Aug  4 12:55 _2ncr.tvd
> > -rw-r--r-- 1 root root  441K Aug  4 12:55 _2ncr.tvx
> > -rw-r--r-- 1 root root   98K Jan 11 11:43 _555c_5x.del
> > -rw-r--r-- 1 root root  1.1G Aug 25 12:51 _555c.fdt
> > -rw-r--r-- 1 root root  457K Aug 25 12:51 _555c.fdx
> > -rw-r--r-- 1 root root  872K Aug 25 12:54 _555c.fnm
> > -rw-r--r-- 1 root root  389M Aug 25 12:52 _555c_Lucene41_0.doc
> > -rw-r--r-- 1 root root  713M Aug 25 12:52 _555c_Lucene41_0.pay
> > -rw-r--r-- 1 root root  750M Aug 25 12:52 _555c_Lucene41_0.pos
> > -rw-r--r-- 1 root root  136M Aug 25 12:52 _555c_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.2M Aug 25 12:52 _555c_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.1G Aug 25 12:53 _555c_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  442K Aug 25 12:53 _555c_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Aug 25 12:54 _555c.si
> > -rw-r--r-- 1 root root  1.4G Aug 25 12:54 _555c.tvd
> > -rw-r--r-- 1 root root  422K Aug 25 12:54 _555c.tvx
> > -rw-r--r-- 1 root root   93K Jan 10 16:38 _790n_5s.del
> > -rw-r--r-- 1 root root  1.1G Sep  6 14:17 _790n.fdt
> > -rw-r--r-- 1 root root  438K Sep  6 14:17 _790n.fdx
> > -rw-r--r-- 1 root root  1.1M Sep  6 14:20 _790n.fnm
> > -rw-r--r-- 1 root root  380M Sep  6 14:18 _790n_Lucene41_0.doc
> > -rw-r--r-- 1 root root  684M Sep  6 14:18 _790n_Lucene41_0.pay
> > -rw-r--r-- 1 root root  746M Sep  6 14:18 _790n_Lucene41_0.pos
> > -rw-r--r-- 1 root root  141M Sep  6 14:18 _790n_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.5M Sep  6 14:18 _790n_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.2G Sep  6 14:20 _790n_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  550K Sep  6 14:20 _790n_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Sep  6 14:20 _790n.si
> > -rw-r--r-- 1 root root  1.4G Sep  6 14:20 _790n.tvd
> > -rw-r--r-- 1 root root  412K Sep  6 14:20 _790n.tvx
> > -rw-r--r-- 1 root root   82K Jan 10 16:38 _bv18_8d.del
> > -rw-r--r-- 1 root root  1.1G Oct 10 12:17 _bv18.fdt
> > -rw-r--r-- 1 root root  425K Oct 10 12:17 _bv18.fdx
> > -rw-r--r-- 1 root root  1.4M Oct 10 12:20 _bv18.fnm
> > -rw-r--r-- 1 root root  363M Oct 10 12:18 _bv18_Lucene41_0.doc
> > -rw-r--r-- 1 root root  622M Oct 10 12:18 _bv18_Lucene41_0.pay
> > -rw-r--r-- 1 root root  728M Oct 10 12:18 _bv18_Lucene41_0.pos
> > -rw-r--r-- 1 root root  133M Oct 10 12:18 _bv18_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.4M Oct 10 12:18 _bv18_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.9G Oct 10 12:20 _bv18_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  724K Oct 10 12:20 _bv18_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Oct 10 12:20 _bv18.si
> > -rw-r--r-- 1 root root  1.3G Oct 10 12:20 _bv18.tvd
> > -rw-r--r-- 1 root root  380K Oct 10 12:20 _bv18.tvx
> > -rw-r--r-- 1 root root   36K Jan 10 16:11 _c1uj_4k.del
> > -rw-r--r-- 1 root root  650M Oct 10 22:42 _c1uj.fdt
> > -rw-r--r-- 1 root root  227K Oct 10 22:42 _c1uj.fdx
> > -rw-r--r-- 1 root root  1.3M Oct 10 22:43 _c1uj.fnm
> > -rw-r--r-- 1 root root  177M Oct 10 22:42 _c1uj_Lucene41_0.doc
> > -rw-r--r-- 1 root root  412M Oct 10 22:42 _c1uj_Lucene41_0.pay
> > -rw-r--r-- 1 root root  428M Oct 10 22:42 _c1uj_Lucene41_0.pos
> > -rw-r--r-- 1 root root   54M Oct 10 22:42 _c1uj_Lucene41_0.tim
> > -rw-r--r-- 1 root root  1.6M Oct 10 22:42 _c1uj_Lucene41_0.tip
> > -rw-r--r-- 1 root root  385M Oct 10 22:43 _c1uj_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  390K Oct 10 22:43 _c1uj_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Oct 10 22:43 _c1uj.si
> > -rw-r--r-- 1 root root  776M Oct 10 22:43 _c1uj.tvd
> > -rw-r--r-- 1 root root  173K Oct 10 22:43 _c1uj.tvx
> > -rw-r--r-- 1 root root   64K Jan 10 16:11 _dz32_75.del
> > -rw-r--r-- 1 root root  1.1G Oct 21 02:30 _dz32.fdt
> > -rw-r--r-- 1 root root  415K Oct 21 02:30 _dz32.fdx
> > -rw-r--r-- 1 root root  1.6M Oct 21 02:34 _dz32.fnm
> > -rw-r--r-- 1 root root  313M Oct 21 02:31 _dz32_Lucene41_0.doc
> > -rw-r--r-- 1 root root  741M Oct 21 02:31 _dz32_Lucene41_0.pay
> > -rw-r--r-- 1 root root  791M Oct 21 02:31 _dz32_Lucene41_0.pos
> > -rw-r--r-- 1 root root  100M Oct 21 02:31 _dz32_Lucene41_0.tim
> > -rw-r--r-- 1 root root  2.7M Oct 21 02:31 _dz32_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.3G Oct 21 02:33 _dz32_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  898K Oct 21 02:33 _dz32_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Oct 21 02:34 _dz32.si
> > -rw-r--r-- 1 root root  1.4G Oct 21 02:34 _dz32.tvd
> > -rw-r--r-- 1 root root  319K Oct 21 02:34 _dz32.tvx
> > -rw-r--r-- 1 root root   71K Jan 11 15:27 _gll0_7p.del
> > -rw-r--r-- 1 root root  1.1G Nov  3 10:36 _gll0.fdt
> > -rw-r--r-- 1 root root  398K Nov  3 10:36 _gll0.fdx
> > -rw-r--r-- 1 root root  1.7M Nov  3 10:40 _gll0.fnm
> > -rw-r--r-- 1 root root  340M Nov  3 10:37 _gll0_Lucene41_0.doc
> > -rw-r--r-- 1 root root  684M Nov  3 10:37 _gll0_Lucene41_0.pay
> > -rw-r--r-- 1 root root  769M Nov  3 10:37 _gll0_Lucene41_0.pos
> > -rw-r--r-- 1 root root  121M Nov  3 10:37 _gll0_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.2M Nov  3 10:37 _gll0_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.5G Nov  3 10:40 _gll0_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  1.1M Nov  3 10:40 _gll0_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Nov  3 10:40 _gll0.si
> > -rw-r--r-- 1 root root  1.4G Nov  3 10:40 _gll0.tvd
> > -rw-r--r-- 1 root root  340K Nov  3 10:40 _gll0.tvx
> > -rw-r--r-- 1 root root   77K Jan 11 13:59 _itwn_7f.del
> > -rw-r--r-- 1 root root  1.1G Nov 13 13:57 _itwn.fdt
> > -rw-r--r-- 1 root root  425K Nov 13 13:57 _itwn.fdx
> > -rw-r--r-- 1 root root  1.8M Nov 13 14:01 _itwn.fnm
> > -rw-r--r-- 1 root root  336M Nov 13 13:58 _itwn_Lucene41_0.doc
> > -rw-r--r-- 1 root root  674M Nov 13 13:58 _itwn_Lucene41_0.pay
> > -rw-r--r-- 1 root root  748M Nov 13 13:58 _itwn_Lucene41_0.pos
> > -rw-r--r-- 1 root root  122M Nov 13 13:58 _itwn_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.2M Nov 13 13:58 _itwn_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.5G Nov 13 14:01 _itwn_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  1.1M Nov 13 14:01 _itwn_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Nov 13 14:01 _itwn.si
> > -rw-r--r-- 1 root root  1.4G Nov 13 14:01 _itwn.tvd
> > -rw-r--r-- 1 root root  367K Nov 13 14:01 _itwn.tvx
> > -rw-r--r-- 1 root root  6.4K Jan 11 16:42 _lyq2_68.del
> > -rw-r--r-- 1 root root  981M Nov 29 04:11 _lyq2.fdt
> > -rw-r--r-- 1 root root  400K Nov 29 04:11 _lyq2.fdx
> > -rw-r--r-- 1 root root  2.0M Nov 29 04:15 _lyq2.fnm
> > -rw-r--r-- 1 root root  347M Nov 29 04:12 _lyq2_Lucene41_0.doc
> > -rw-r--r-- 1 root root  581M Nov 29 04:12 _lyq2_Lucene41_0.pay
> > -rw-r--r-- 1 root root  715M Nov 29 04:12 _lyq2_Lucene41_0.pos
> > -rw-r--r-- 1 root root  137M Nov 29 04:12 _lyq2_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.6M Nov 29 04:12 _lyq2_Lucene41_0.tip
> > -rw-r--r-- 1 root root  2.2G Nov 29 04:14 _lyq2_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  1.2M Nov 29 04:14 _lyq2_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Nov 29 04:15 _lyq2.si
> > -rw-r--r-- 1 root root  1.3G Nov 29 04:15 _lyq2.tvd
> > -rw-r--r-- 1 root root  360K Nov 29 04:15 _lyq2.tvx
> > -rw-r--r-- 1 root root  4.6K Jan 11 15:27 _o16w_4h.del
> > -rw-r--r-- 1 root root 1009M Dec  7 16:21 _o16w.fdt
> > -rw-r--r-- 1 root root  411K Dec  7 16:21 _o16w.fdx
> > -rw-r--r-- 1 root root  2.1M Dec  7 16:26 _o16w.fnm
> > -rw-r--r-- 1 root root  357M Dec  7 16:23 _o16w_Lucene41_0.doc
> > -rw-r--r-- 1 root root  594M Dec  7 16:23 _o16w_Lucene41_0.pay
> > -rw-r--r-- 1 root root  693M Dec  7 16:23 _o16w_Lucene41_0.pos
> > -rw-r--r-- 1 root root  135M Dec  7 16:23 _o16w_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.7M Dec  7 16:23 _o16w_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.9G Dec  7 16:26 _o16w_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  1.3M Dec  7 16:26 _o16w_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Dec  7 16:26 _o16w.si
> > -rw-r--r-- 1 root root  1.3G Dec  7 16:26 _o16w.tvd
> > -rw-r--r-- 1 root root  411K Dec  7 16:26 _o16w.tvx
> > -rw-r--r-- 1 root root   80K Jan 11 15:51 _qi1i_6v.del
> > -rw-r--r-- 1 root root  962M Dec 19 14:39 _qi1i.fdt
> > -rw-r--r-- 1 root root  400K Dec 19 14:39 _qi1i.fdx
> > -rw-r--r-- 1 root root  2.3M Dec 19 14:44 _qi1i.fnm
> > -rw-r--r-- 1 root root  346M Dec 19 14:41 _qi1i_Lucene41_0.doc
> > -rw-r--r-- 1 root root  581M Dec 19 14:41 _qi1i_Lucene41_0.pay
> > -rw-r--r-- 1 root root  738M Dec 19 14:41 _qi1i_Lucene41_0.pos
> > -rw-r--r-- 1 root root  143M Dec 19 14:41 _qi1i_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.8M Dec 19 14:41 _qi1i_Lucene41_0.tip
> > -rw-r--r-- 1 root root  2.2G Dec 19 14:44 _qi1i_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  1.4M Dec 19 14:44 _qi1i_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Dec 19 14:44 _qi1i.si
> > -rw-r--r-- 1 root root  1.3G Dec 19 14:44 _qi1i.tvd
> > -rw-r--r-- 1 root root  351K Dec 19 14:44 _qi1i.tvx
> > -rw-r--r-- 1 root root  1.5K Jan 11 16:42 segments_d5g
> > -rw-r--r-- 1 root root    20 Jan 11 16:42 segments.gen
> > -rw-r--r-- 1 root root  4.2K Jan 11 16:19 _sinq_4l.del
> > -rw-r--r-- 1 root root  959M Dec 27 21:08 _sinq.fdt
> > -rw-r--r-- 1 root root  340K Dec 27 21:08 _sinq.fdx
> > -rw-r--r-- 1 root root  2.3M Dec 27 21:11 _sinq.fnm
> > -rw-r--r-- 1 root root  302M Dec 27 21:09 _sinq_Lucene41_0.doc
> > -rw-r--r-- 1 root root  571M Dec 27 21:09 _sinq_Lucene41_0.pay
> > -rw-r--r-- 1 root root  687M Dec 27 21:09 _sinq_Lucene41_0.pos
> > -rw-r--r-- 1 root root  134M Dec 27 21:09 _sinq_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.6M Dec 27 21:09 _sinq_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.7G Dec 27 21:11 _sinq_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  1.4M Dec 27 21:11 _sinq_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Dec 27 21:11 _sinq.si
> > -rw-r--r-- 1 root root  1.2G Dec 27 21:11 _sinq.tvd
> > -rw-r--r-- 1 root root  300K Dec 27 21:11 _sinq.tvx
> > drwxr-xr-x 2 root root  4.0K Jan 11 16:42 taxo
> > -rw-r--r-- 1 root root  2.4K Jan 11 15:27 _tkvb_3e.del
> > -rw-r--r-- 1 root root  1.1G Jan  1 10:01 _tkvb.fdt
> > -rw-r--r-- 1 root root  417K Jan  1 10:01 _tkvb.fdx
> > -rw-r--r-- 1 root root  2.3M Jan  1 10:05 _tkvb.fnm
> > -rw-r--r-- 1 root root  327M Jan  1 10:02 _tkvb_Lucene41_0.doc
> > -rw-r--r-- 1 root root  732M Jan  1 10:02 _tkvb_Lucene41_0.pay
> > -rw-r--r-- 1 root root  763M Jan  1 10:02 _tkvb_Lucene41_0.pos
> > -rw-r--r-- 1 root root  108M Jan  1 10:02 _tkvb_Lucene41_0.tim
> > -rw-r--r-- 1 root root  3.0M Jan  1 10:02 _tkvb_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.2G Jan  1 10:05 _tkvb_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  831K Jan  1 10:05 _tkvb_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan  1 10:05 _tkvb.si
> > -rw-r--r-- 1 root root  1.4G Jan  1 10:05 _tkvb.tvd
> > -rw-r--r-- 1 root root  323K Jan  1 10:05 _tkvb.tvx
> > -rw-r--r-- 1 root root  2.5K Jan 11 15:51 _tl5a_1n.del
> > -rw-r--r-- 1 root root   39M Jan  1 11:35 _tl5a.fdt
> > -rw-r--r-- 1 root root   16K Jan  1 11:35 _tl5a.fdx
> > -rw-r--r-- 1 root root  1.4M Jan  1 11:35 _tl5a.fnm
> > -rw-r--r-- 1 root root  9.3M Jan  1 11:35 _tl5a_Lucene41_0.doc
> > -rw-r--r-- 1 root root   24M Jan  1 11:35 _tl5a_Lucene41_0.pay
> > -rw-r--r-- 1 root root   29M Jan  1 11:35 _tl5a_Lucene41_0.pos
> > -rw-r--r-- 1 root root  8.2M Jan  1 11:35 _tl5a_Lucene41_0.tim
> > -rw-r--r-- 1 root root  460K Jan  1 11:35 _tl5a_Lucene41_0.tip
> > -rw-r--r-- 1 root root   14M Jan  1 11:35 _tl5a_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  121K Jan  1 11:35 _tl5a_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan  1 11:35 _tl5a.si
> > -rw-r--r-- 1 root root   49M Jan  1 11:35 _tl5a.tvd
> > -rw-r--r-- 1 root root   13K Jan  1 11:35 _tl5a.tvx
> > -rw-r--r-- 1 root root  3.2K Jan 10 20:13 _u20o_1t.del
> > -rw-r--r-- 1 root root   47M Jan  3 21:03 _u20o.fdt
> > -rw-r--r-- 1 root root   17K Jan  3 21:03 _u20o.fdx
> > -rw-r--r-- 1 root root  2.0M Jan  3 21:04 _u20o.fnm
> > -rw-r--r-- 1 root root   14M Jan  3 21:03 _u20o_Lucene41_0.doc
> > -rw-r--r-- 1 root root   14M Jan  3 21:03 _u20o_Lucene41_0.pay
> > -rw-r--r-- 1 root root   51M Jan  3 21:03 _u20o_Lucene41_0.pos
> > -rw-r--r-- 1 root root   20M Jan  3 21:03 _u20o_Lucene41_0.tim
> > -rw-r--r-- 1 root root  875K Jan  3 21:03 _u20o_Lucene41_0.tip
> > -rw-r--r-- 1 root root   35M Jan  3 21:04 _u20o_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  365K Jan  3 21:04 _u20o_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan  3 21:04 _u20o.si
> > -rw-r--r-- 1 root root   59M Jan  3 21:04 _u20o.tvd
> > -rw-r--r-- 1 root root   14K Jan  3 21:04 _u20o.tvx
> > -rw-r--r-- 1 root root  7.6K Jan 11 15:05 _ug4w_2f.del
> > -rw-r--r-- 1 root root  105M Jan  5 15:42 _ug4w.fdt
> > -rw-r--r-- 1 root root   37K Jan  5 15:42 _ug4w.fdx
> > -rw-r--r-- 1 root root  2.2M Jan  5 15:42 _ug4w.fnm
> > -rw-r--r-- 1 root root   36M Jan  5 15:42 _ug4w_Lucene41_0.doc
> > -rw-r--r-- 1 root root   33M Jan  5 15:42 _ug4w_Lucene41_0.pay
> > -rw-r--r-- 1 root root  105M Jan  5 15:42 _ug4w_Lucene41_0.pos
> > -rw-r--r-- 1 root root   37M Jan  5 15:42 _ug4w_Lucene41_0.tim
> > -rw-r--r-- 1 root root  1.3M Jan  5 15:42 _ug4w_Lucene41_0.tip
> > -rw-r--r-- 1 root root  124M Jan  5 15:42 _ug4w_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  813K Jan  5 15:42 _ug4w_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan  5 15:42 _ug4w.si
> > -rw-r--r-- 1 root root  129M Jan  5 15:42 _ug4w.tvd
> > -rw-r--r-- 1 root root   34K Jan  5 15:42 _ug4w.tvx
> > -rw-r--r-- 1 root root   914 Jan 11 16:05 _v5sg_1l.del
> > -rw-r--r-- 1 root root  148M Jan  9 17:58 _v5sg.fdt
> > -rw-r--r-- 1 root root   51K Jan  9 17:58 _v5sg.fdx
> > -rw-r--r-- 1 root root  2.2M Jan  9 17:58 _v5sg.fnm
> > -rw-r--r-- 1 root root   49M Jan  9 17:58 _v5sg_Lucene41_0.doc
> > -rw-r--r-- 1 root root   51M Jan  9 17:58 _v5sg_Lucene41_0.pay
> > -rw-r--r-- 1 root root  140M Jan  9 17:58 _v5sg_Lucene41_0.pos
> > -rw-r--r-- 1 root root   49M Jan  9 17:58 _v5sg_Lucene41_0.tim
> > -rw-r--r-- 1 root root  1.5M Jan  9 17:58 _v5sg_Lucene41_0.tip
> > -rw-r--r-- 1 root root  182M Jan  9 17:58 _v5sg_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  926K Jan  9 17:58 _v5sg_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan  9 17:58 _v5sg.si
> > -rw-r--r-- 1 root root  183M Jan  9 17:58 _v5sg.tvd
> > -rw-r--r-- 1 root root   46K Jan  9 17:58 _v5sg.tvx
> > -rw-r--r-- 1 root root  2.4K Jan 11 16:29 _v8qv_16.del
> > -rw-r--r-- 1 root root   33M Jan 10 01:01 _v8qv.fdt
> > -rw-r--r-- 1 root root   12K Jan 10 01:01 _v8qv.fdx
> > -rw-r--r-- 1 root root  1.6M Jan 10 01:01 _v8qv.fnm
> > -rw-r--r-- 1 root root  8.6M Jan 10 01:01 _v8qv_Lucene41_0.doc
> > -rw-r--r-- 1 root root   11M Jan 10 01:01 _v8qv_Lucene41_0.pay
> > -rw-r--r-- 1 root root   31M Jan 10 01:01 _v8qv_Lucene41_0.pos
> > -rw-r--r-- 1 root root   13M Jan 10 01:01 _v8qv_Lucene41_0.tim
> > -rw-r--r-- 1 root root  617K Jan 10 01:01 _v8qv_Lucene41_0.tip
> > -rw-r--r-- 1 root root   20M Jan 10 01:01 _v8qv_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  236K Jan 10 01:01 _v8qv_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 10 01:01 _v8qv.si
> > -rw-r--r-- 1 root root   39M Jan 10 01:01 _v8qv.tvd
> > -rw-r--r-- 1 root root   11K Jan 10 01:01 _v8qv.tvx
> > -rw-r--r-- 1 root root  1.5K Jan 11 16:29 _vbsm_19.del
> > -rw-r--r-- 1 root root   23M Jan 10 10:57 _vbsm.fdt
> > -rw-r--r-- 1 root root  8.4K Jan 10 10:57 _vbsm.fdx
> > -rw-r--r-- 1 root root  1.6M Jan 10 10:57 _vbsm.fnm
> > -rw-r--r-- 1 root root  5.4M Jan 10 10:57 _vbsm_Lucene41_0.doc
> > -rw-r--r-- 1 root root  8.7M Jan 10 10:57 _vbsm_Lucene41_0.pay
> > -rw-r--r-- 1 root root   22M Jan 10 10:57 _vbsm_Lucene41_0.pos
> > -rw-r--r-- 1 root root   11M Jan 10 10:57 _vbsm_Lucene41_0.tim
> > -rw-r--r-- 1 root root  548K Jan 10 10:57 _vbsm_Lucene41_0.tip
> > -rw-r--r-- 1 root root   11M Jan 10 10:57 _vbsm_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  167K Jan 10 10:57 _vbsm_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 10 10:57 _vbsm.si
> > -rw-r--r-- 1 root root   28M Jan 10 10:57 _vbsm.tvd
> > -rw-r--r-- 1 root root  6.9K Jan 10 10:57 _vbsm.tvx
> > -rw-r--r-- 1 root root   35M Jan 10 17:23 _vez4.fdt
> > -rw-r--r-- 1 root root   13K Jan 10 17:23 _vez4.fdx
> > -rw-r--r-- 1 root root  1.8M Jan 10 17:23 _vez4.fnm
> > -rw-r--r-- 1 root root  9.1M Jan 10 17:23 _vez4_Lucene41_0.doc
> > -rw-r--r-- 1 root root   13M Jan 10 17:23 _vez4_Lucene41_0.pay
> > -rw-r--r-- 1 root root   34M Jan 10 17:23 _vez4_Lucene41_0.pos
> > -rw-r--r-- 1 root root   15M Jan 10 17:23 _vez4_Lucene41_0.tim
> > -rw-r--r-- 1 root root  715K Jan 10 17:23 _vez4_Lucene41_0.tip
> > -rw-r--r-- 1 root root   22M Jan 10 17:23 _vez4_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  262K Jan 10 17:23 _vez4_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 10 17:23 _vez4.si
> > -rw-r--r-- 1 root root   43M Jan 10 17:23 _vez4.tvd
> > -rw-r--r-- 1 root root   12K Jan 10 17:23 _vez4.tvx
> > -rw-r--r-- 1 root root  2.4K Jan 11 16:29 _vez4_w.del
> > -rw-r--r-- 1 root root   291 Jan 11 13:59 _vfkt_d.del
> > -rw-r--r-- 1 root root  3.8M Jan 10 18:38 _vfkt.fdt
> > -rw-r--r-- 1 root root  1.4K Jan 10 18:38 _vfkt.fdx
> > -rw-r--r-- 1 root root  807K Jan 10 18:38 _vfkt.fnm
> > -rw-r--r-- 1 root root  799K Jan 10 18:38 _vfkt_Lucene41_0.doc
> > -rw-r--r-- 1 root root  263K Jan 10 18:38 _vfkt_Lucene41_0.pay
> > -rw-r--r-- 1 root root  5.0M Jan 10 18:38 _vfkt_Lucene41_0.pos
> > -rw-r--r-- 1 root root  3.4M Jan 10 18:38 _vfkt_Lucene41_0.tim
> > -rw-r--r-- 1 root root  237K Jan 10 18:38 _vfkt_Lucene41_0.tip
> > -rw-r--r-- 1 root root  831K Jan 10 18:38 _vfkt_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   69K Jan 10 18:38 _vfkt_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 10 18:38 _vfkt.si
> > -rw-r--r-- 1 root root  4.6M Jan 10 18:38 _vfkt.tvd
> > -rw-r--r-- 1 root root  1.1K Jan 10 18:38 _vfkt.tvx
> > -rw-r--r-- 1 root root  9.1M Jan 11 00:07 _vhjn.fdt
> > -rw-r--r-- 1 root root  3.1K Jan 11 00:07 _vhjn.fdx
> > -rw-r--r-- 1 root root  1.3M Jan 11 00:07 _vhjn.fnm
> > -rw-r--r-- 1 root root   595 Jan 11 15:51 _vhjn_g.del
> > -rw-r--r-- 1 root root  1.9M Jan 11 00:07 _vhjn_Lucene41_0.doc
> > -rw-r--r-- 1 root root  1.1M Jan 11 00:07 _vhjn_Lucene41_0.pay
> > -rw-r--r-- 1 root root   12M Jan 11 00:07 _vhjn_Lucene41_0.pos
> > -rw-r--r-- 1 root root  7.9M Jan 11 00:07 _vhjn_Lucene41_0.tim
> > -rw-r--r-- 1 root root  415K Jan 11 00:07 _vhjn_Lucene41_0.tip
> > -rw-r--r-- 1 root root  3.0M Jan 11 00:07 _vhjn_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  127K Jan 11 00:07 _vhjn_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 00:07 _vhjn.si
> > -rw-r--r-- 1 root root   11M Jan 11 00:07 _vhjn.tvd
> > -rw-r--r-- 1 root root  2.8K Jan 11 00:07 _vhjn.tvx
> > -rw-r--r-- 1 root root   22M Jan 11 12:08 _vkt2.fdt
> > -rw-r--r-- 1 root root  8.0K Jan 11 12:08 _vkt2.fdx
> > -rw-r--r-- 1 root root  1.8M Jan 11 12:08 _vkt2.fnm
> > -rw-r--r-- 1 root root  1.6K Jan 11 16:29 _vkt2_h.del
> > -rw-r--r-- 1 root root  5.9M Jan 11 12:08 _vkt2_Lucene41_0.doc
> > -rw-r--r-- 1 root root  3.8M Jan 11 12:08 _vkt2_Lucene41_0.pay
> > -rw-r--r-- 1 root root   26M Jan 11 12:08 _vkt2_Lucene41_0.pos
> > -rw-r--r-- 1 root root   15M Jan 11 12:08 _vkt2_Lucene41_0.tim
> > -rw-r--r-- 1 root root  668K Jan 11 12:08 _vkt2_Lucene41_0.tip
> > -rw-r--r-- 1 root root   14M Jan 11 12:08 _vkt2_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  255K Jan 11 12:08 _vkt2_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 12:08 _vkt2.si
> > -rw-r--r-- 1 root root   27M Jan 11 12:08 _vkt2.tvd
> > -rw-r--r-- 1 root root  7.2K Jan 11 12:08 _vkt2.tvx
> > -rw-r--r-- 1 root root   266 Jan 11 16:29 _vljq_c.del
> > -rw-r--r-- 1 root root  3.3M Jan 11 14:01 _vljq.fdt
> > -rw-r--r-- 1 root root  1.2K Jan 11 14:01 _vljq.fdx
> > -rw-r--r-- 1 root root  957K Jan 11 14:01 _vljq.fnm
> > -rw-r--r-- 1 root root  672K Jan 11 14:01 _vljq_Lucene41_0.doc
> > -rw-r--r-- 1 root root  275K Jan 11 14:01 _vljq_Lucene41_0.pay
> > -rw-r--r-- 1 root root  4.6M Jan 11 14:01 _vljq_Lucene41_0.pos
> > -rw-r--r-- 1 root root  3.9M Jan 11 14:01 _vljq_Lucene41_0.tim
> > -rw-r--r-- 1 root root  277K Jan 11 14:01 _vljq_Lucene41_0.tip
> > -rw-r--r-- 1 root root  822K Jan 11 14:01 _vljq_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   73K Jan 11 14:01 _vljq_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 14:01 _vljq.si
> > -rw-r--r-- 1 root root  4.2M Jan 11 14:01 _vljq.tvd
> > -rw-r--r-- 1 root root  1.1K Jan 11 14:01 _vljq.tvx
> > -rw-r--r-- 1 root root   306 Jan 11 16:29 _vm0z_8.del
> > -rw-r--r-- 1 root root  3.7M Jan 11 14:58 _vm0z.fdt
> > -rw-r--r-- 1 root root  1.3K Jan 11 14:58 _vm0z.fdx
> > -rw-r--r-- 1 root root  872K Jan 11 14:58 _vm0z.fnm
> > -rw-r--r-- 1 root root  824K Jan 11 14:58 _vm0z_Lucene41_0.doc
> > -rw-r--r-- 1 root root  303K Jan 11 14:58 _vm0z_Lucene41_0.pay
> > -rw-r--r-- 1 root root  5.0M Jan 11 14:58 _vm0z_Lucene41_0.pos
> > -rw-r--r-- 1 root root  3.6M Jan 11 14:58 _vm0z_Lucene41_0.tim
> > -rw-r--r-- 1 root root  254K Jan 11 14:58 _vm0z_Lucene41_0.tip
> > -rw-r--r-- 1 root root  940K Jan 11 14:58 _vm0z_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   74K Jan 11 14:58 _vm0z_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 14:58 _vm0z.si
> > -rw-r--r-- 1 root root  4.6M Jan 11 14:58 _vm0z.tvd
> > -rw-r--r-- 1 root root  1.1K Jan 11 14:58 _vm0z.tvx
> > -rw-r--r-- 1 root root   222 Jan 11 16:29 _vmbk_3.del
> > -rw-r--r-- 1 root root  2.3M Jan 11 15:32 _vmbk.fdt
> > -rw-r--r-- 1 root root   805 Jan 11 15:32 _vmbk.fdx
> > -rw-r--r-- 1 root root  624K Jan 11 15:32 _vmbk.fnm
> > -rw-r--r-- 1 root root  464K Jan 11 15:32 _vmbk_Lucene41_0.doc
> > -rw-r--r-- 1 root root  263K Jan 11 15:32 _vmbk_Lucene41_0.pay
> > -rw-r--r-- 1 root root  2.9M Jan 11 15:32 _vmbk_Lucene41_0.pos
> > -rw-r--r-- 1 root root  2.3M Jan 11 15:32 _vmbk_Lucene41_0.tim
> > -rw-r--r-- 1 root root  175K Jan 11 15:32 _vmbk_Lucene41_0.tip
> > -rw-r--r-- 1 root root  442K Jan 11 15:32 _vmbk_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   48K Jan 11 15:32 _vmbk_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 15:32 _vmbk.si
> > -rw-r--r-- 1 root root  2.9M Jan 11 15:32 _vmbk.tvd
> > -rw-r--r-- 1 root root   758 Jan 11 15:32 _vmbk.tvx
> > -rw-r--r-- 1 root root   146 Jan 11 16:42 _vmj2_3.del
> > -rw-r--r-- 1 root root  1.7M Jan 11 15:56 _vmj2.fdt
> > -rw-r--r-- 1 root root   575 Jan 11 15:56 _vmj2.fdx
> > -rw-r--r-- 1 root root  517K Jan 11 15:56 _vmj2.fnm
> > -rw-r--r-- 1 root root  280K Jan 11 15:56 _vmj2_Lucene41_0.doc
> > -rw-r--r-- 1 root root  129K Jan 11 15:56 _vmj2_Lucene41_0.pay
> > -rw-r--r-- 1 root root  2.3M Jan 11 15:56 _vmj2_Lucene41_0.pos
> > -rw-r--r-- 1 root root  1.9M Jan 11 15:56 _vmj2_Lucene41_0.tim
> > -rw-r--r-- 1 root root  145K Jan 11 15:56 _vmj2_Lucene41_0.tip
> > -rw-r--r-- 1 root root  212K Jan 11 15:56 _vmj2_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   39K Jan 11 15:56 _vmj2_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 15:56 _vmj2.si
> > -rw-r--r-- 1 root root  2.1M Jan 11 15:56 _vmj2.tvd
> > -rw-r--r-- 1 root root   494 Jan 11 15:56 _vmj2.tvx
> > -rw-r--r-- 1 root root   164 Jan 11 16:29 _vmom_2.del
> > -rw-r--r-- 1 root root  2.0M Jan 11 16:13 _vmom.fdt
> > -rw-r--r-- 1 root root   704 Jan 11 16:13 _vmom.fdx
> > -rw-r--r-- 1 root root  458K Jan 11 16:13 _vmom.fnm
> > -rw-r--r-- 1 root root  335K Jan 11 16:13 _vmom_Lucene41_0.doc
> > -rw-r--r-- 1 root root  424K Jan 11 16:13 _vmom_Lucene41_0.pay
> > -rw-r--r-- 1 root root  2.5M Jan 11 16:13 _vmom_Lucene41_0.pos
> > -rw-r--r-- 1 root root  2.0M Jan 11 16:13 _vmom_Lucene41_0.tim
> > -rw-r--r-- 1 root root  134K Jan 11 16:13 _vmom_Lucene41_0.tip
> > -rw-r--r-- 1 root root  217K Jan 11 16:13 _vmom_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   32K Jan 11 16:13 _vmom_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 16:13 _vmom.si
> > -rw-r--r-- 1 root root  2.5M Jan 11 16:13 _vmom.tvd
> > -rw-r--r-- 1 root root   592 Jan 11 16:13 _vmom.tvx
> > -rw-r--r-- 1 root root  7.6M Jan 11 16:41 _vmx8.fdt
> > -rw-r--r-- 1 root root  2.8K Jan 11 16:41 _vmx8.fdx
> > -rw-r--r-- 1 root root  899K Jan 11 16:41 _vmx8.fnm
> > -rw-r--r-- 1 root root  1.4M Jan 11 16:41 _vmx8_Lucene41_0.doc
> > -rw-r--r-- 1 root root  2.4M Jan 11 16:41 _vmx8_Lucene41_0.pay
> > -rw-r--r-- 1 root root  8.3M Jan 11 16:41 _vmx8_Lucene41_0.pos
> > -rw-r--r-- 1 root root  5.2M Jan 11 16:41 _vmx8_Lucene41_0.tim
> > -rw-r--r-- 1 root root  279K Jan 11 16:41 _vmx8_Lucene41_0.tip
> > -rw-r--r-- 1 root root  1.6M Jan 11 16:41 _vmx8_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   74K Jan 11 16:41 _vmx8_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 16:41 _vmx8.si
> > -rw-r--r-- 1 root root  9.2M Jan 11 16:41 _vmx8.tvd
> > -rw-r--r-- 1 root root  2.3K Jan 11 16:41 _vmx8.tvx
> > -rw-r--r-- 1 root root   15K Jan 11 16:42 _vmxa.fdt
> > -rw-r--r-- 1 root root    46 Jan 11 16:42 _vmxa.fdx
> > -rw-r--r-- 1 root root  6.2K Jan 11 16:42 _vmxa.fnm
> > -rw-r--r-- 1 root root  1.8K Jan 11 16:42 _vmxa_Lucene41_0.doc
> > -rw-r--r-- 1 root root   197 Jan 11 16:42 _vmxa_Lucene41_0.pay
> > -rw-r--r-- 1 root root   25K Jan 11 16:42 _vmxa_Lucene41_0.pos
> > -rw-r--r-- 1 root root   19K Jan 11 16:42 _vmxa_Lucene41_0.tim
> > -rw-r--r-- 1 root root  1.6K Jan 11 16:42 _vmxa_Lucene41_0.tip
> > -rw-r--r-- 1 root root    97 Jan 11 16:42 _vmxa_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   438 Jan 11 16:42 _vmxa_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   502 Jan 11 16:42 _vmxa.si
> > -rw-r--r-- 1 root root   20K Jan 11 16:42 _vmxa.tvd
> > -rw-r--r-- 1 root root    46 Jan 11 16:42 _vmxa.tvx
> > -rw-r--r-- 1 root root   14K Jan 11 16:42 _vmxd.fdt
> > -rw-r--r-- 1 root root    46 Jan 11 16:42 _vmxd.fdx
> > -rw-r--r-- 1 root root  9.2K Jan 11 16:42 _vmxd.fnm
> > -rw-r--r-- 1 root root    67 Jan 11 16:42 _vmxd_Lucene41_0.doc
> > -rw-r--r-- 1 root root    34 Jan 11 16:42 _vmxd_Lucene41_0.pay
> > -rw-r--r-- 1 root root   28K Jan 11 16:42 _vmxd_Lucene41_0.pos
> > -rw-r--r-- 1 root root   24K Jan 11 16:42 _vmxd_Lucene41_0.tim
> > -rw-r--r-- 1 root root  2.3K Jan 11 16:42 _vmxd_Lucene41_0.tip
> > -rw-r--r-- 1 root root   101 Jan 11 16:42 _vmxd_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   586 Jan 11 16:42 _vmxd_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   502 Jan 11 16:42 _vmxd.si
> > -rw-r--r-- 1 root root   20K Jan 11 16:42 _vmxd.tvd
> > -rw-r--r-- 1 root root    47 Jan 11 16:42 _vmxd.tvx
> > -rw-r--r-- 1 root root   21K Jan 11 16:42 _vmxi.fdt
> > -rw-r--r-- 1 root root    47 Jan 11 16:42 _vmxi.fdx
> > -rw-r--r-- 1 root root   34K Jan 11 16:42 _vmxi.fnm
> > -rw-r--r-- 1 root root  1.3K Jan 11 16:42 _vmxi_Lucene41_0.doc
> > -rw-r--r-- 1 root root    34 Jan 11 16:42 _vmxi_Lucene41_0.pay
> > -rw-r--r-- 1 root root   21K Jan 11 16:42 _vmxi_Lucene41_0.pos
> > -rw-r--r-- 1 root root   67K Jan 11 16:42 _vmxi_Lucene41_0.tim
> > -rw-r--r-- 1 root root  8.2K Jan 11 16:42 _vmxi_Lucene41_0.tip
> > -rw-r--r-- 1 root root   657 Jan 11 16:42 _vmxi_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  2.1K Jan 11 16:42 _vmxi_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 16:42 _vmxi.si
> > -rw-r--r-- 1 root root   25K Jan 11 16:42 _vmxi.tvd
> > -rw-r--r-- 1 root root    51 Jan 11 16:42 _vmxi.tvx
> > -rw-r--r-- 1 root root   25K Jan 11 16:42 _vmxn.fdt
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxn.fdx
> > -rw-r--r-- 1 root root  4.6K Jan 11 16:42 _vmxn.fnm
> > -rw-r--r-- 1 root root    67 Jan 11 16:42 _vmxn_Lucene41_0.doc
> > -rw-r--r-- 1 root root  7.7K Jan 11 16:42 _vmxn_Lucene41_0.pay
> > -rw-r--r-- 1 root root   72K Jan 11 16:42 _vmxn_Lucene41_0.pos
> > -rw-r--r-- 1 root root   15K Jan 11 16:42 _vmxn_Lucene41_0.tim
> > -rw-r--r-- 1 root root  1.3K Jan 11 16:42 _vmxn_Lucene41_0.tip
> > -rw-r--r-- 1 root root    69 Jan 11 16:42 _vmxn_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   324 Jan 11 16:42 _vmxn_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   502 Jan 11 16:42 _vmxn.si
> > -rw-r--r-- 1 root root   44K Jan 11 16:42 _vmxn.tvd
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxn.tvx
> > -rw-r--r-- 1 root root   16K Jan 11 16:42 _vmxr.fdt
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxr.fdx
> > -rw-r--r-- 1 root root  3.0K Jan 11 16:42 _vmxr.fnm
> > -rw-r--r-- 1 root root    67 Jan 11 16:42 _vmxr_Lucene41_0.doc
> > -rw-r--r-- 1 root root  3.3K Jan 11 16:42 _vmxr_Lucene41_0.pay
> > -rw-r--r-- 1 root root   30K Jan 11 16:42 _vmxr_Lucene41_0.pos
> > -rw-r--r-- 1 root root   11K Jan 11 16:42 _vmxr_Lucene41_0.tim
> > -rw-r--r-- 1 root root   845 Jan 11 16:42 _vmxr_Lucene41_0.tip
> > -rw-r--r-- 1 root root    58 Jan 11 16:42 _vmxr_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   238 Jan 11 16:42 _vmxr_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   502 Jan 11 16:42 _vmxr.si
> > -rw-r--r-- 1 root root   22K Jan 11 16:42 _vmxr.tvd
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxr.tvx
> > -rw-r--r-- 1 root root   38K Jan 11 16:42 _vmxs.fdt
> > -rw-r--r-- 1 root root    52 Jan 11 16:42 _vmxs.fdx
> > -rw-r--r-- 1 root root   38K Jan 11 16:42 _vmxs.fnm
> > -rw-r--r-- 1 root root  1.1K Jan 11 16:42 _vmxs_Lucene41_0.doc
> > -rw-r--r-- 1 root root    34 Jan 11 16:42 _vmxs_Lucene41_0.pay
> > -rw-r--r-- 1 root root   46K Jan 11 16:42 _vmxs_Lucene41_0.pos
> > -rw-r--r-- 1 root root   84K Jan 11 16:42 _vmxs_Lucene41_0.tim
> > -rw-r--r-- 1 root root  9.3K Jan 11 16:42 _vmxs_Lucene41_0.tip
> > -rw-r--r-- 1 root root   692 Jan 11 16:42 _vmxs_Lucene45_0.dvd
> > -rw-r--r-- 1 root root  2.3K Jan 11 16:42 _vmxs_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   540 Jan 11 16:42 _vmxs.si
> > -rw-r--r-- 1 root root   44K Jan 11 16:42 _vmxs.tvd
> > -rw-r--r-- 1 root root    53 Jan 11 16:42 _vmxs.tvx
> > -rw-r--r-- 1 root root  1.9K Jan 11 16:42 _vmxt.fdt
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxt.fdx
> > -rw-r--r-- 1 root root  1.6K Jan 11 16:42 _vmxt.fnm
> > -rw-r--r-- 1 root root    67 Jan 11 16:42 _vmxt_Lucene41_0.doc
> > -rw-r--r-- 1 root root    34 Jan 11 16:42 _vmxt_Lucene41_0.pay
> > -rw-r--r-- 1 root root  1.5K Jan 11 16:42 _vmxt_Lucene41_0.pos
> > -rw-r--r-- 1 root root  4.1K Jan 11 16:42 _vmxt_Lucene41_0.tim
> > -rw-r--r-- 1 root root   386 Jan 11 16:42 _vmxt_Lucene41_0.tip
> > -rw-r--r-- 1 root root    49 Jan 11 16:42 _vmxt_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   110 Jan 11 16:42 _vmxt_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   502 Jan 11 16:42 _vmxt.si
> > -rw-r--r-- 1 root root  1.9K Jan 11 16:42 _vmxt.tvd
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxt.tvx
> > -rw-r--r-- 1 root root  1.9K Jan 11 16:42 _vmxu.fdt
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxu.fdx
> > -rw-r--r-- 1 root root  3.0K Jan 11 16:42 _vmxu.fnm
> > -rw-r--r-- 1 root root    67 Jan 11 16:42 _vmxu_Lucene41_0.doc
> > -rw-r--r-- 1 root root    34 Jan 11 16:42 _vmxu_Lucene41_0.pay
> > -rw-r--r-- 1 root root  1.4K Jan 11 16:42 _vmxu_Lucene41_0.pos
> > -rw-r--r-- 1 root root  5.1K Jan 11 16:42 _vmxu_Lucene41_0.tim
> > -rw-r--r-- 1 root root   720 Jan 11 16:42 _vmxu_Lucene41_0.tip
> > -rw-r--r-- 1 root root    58 Jan 11 16:42 _vmxu_Lucene45_0.dvd
> > -rw-r--r-- 1 root root   240 Jan 11 16:42 _vmxu_Lucene45_0.dvm
> > -rw-r--r-- 1 root root   502 Jan 11 16:42 _vmxu.si
> > -rw-r--r-- 1 root root  1.9K Jan 11 16:42 _vmxu.tvd
> > -rw-r--r-- 1 root root    45 Jan 11 16:42 _vmxu.tvx
> >
> >
> >
> >
> > On 11 January 2018 at 16:31, Uwe Schindler <uwe@thetaphi.de> wrote:
> >
> > > Hi,
> > >
> > > If the index size on disk is about 750 GiB then a memory usage of 2.3 G
> > > heap space for the FST seems fine. It's just a bit strange that you
> only
> > > have 10 million documents!
> > >
> > > Are those documents huge and have lots of indexed text content,
> possibly
> > > OCR/scanned stuff? If this is the case, the term dictionary may get
> huge
> > > because of many terms with incorrect spelling.
> > >
> > > Please also give us a "ls -lh" of your index directory to make a guess.
> > >
> > > Uwe
> > >
> > > -----
> > > Uwe Schindler
> > > Achterdiek 19, D-28357 Bremen
> > > http://www.thetaphi.de
> > > eMail: uwe@thetaphi.de
> > >
> > > > -----Original Message-----
> > > > From: dawn breaks [mailto:2005dawnbreaks@gmail.com]
> > > > Sent: Thursday, January 11, 2018 3:40 AM
> > > > To: java-user@lucene.apache.org
> > > > Subject: Lucene OOM
> > > >
> > > > Hi, all
> > > >   We have a search engine service built with lucene 4.7,  it seem
> that
> > > > lucene eat too much momery, and we have approximate 10 million
> > > > document´╝îthe
> > > > index size on disk is approximate 750G.  My question is why the
> FST$Arc
> > > > objects consume so much memory?  please refer to the following histo
> > stat
> > > > of jmap. Hope anybody can give me some suggestion.
> > > >
> > > >  num     #instances         #bytes  class name
> > > > ----------------------------------------------
> > > >    1:       4346283     2294837424  [Lorg.apache.lucene.util.fst.
> > > FST$Arc;
> > > >    2:      25918804     2023475632  [C
> > > >    3:      17450041     1014051416  [B
> > > >    4:      25878734      621089616  java.lang.String
> > > >    5:      18634803      596313696  java.util.HashMap$Node
> > > >    6:      14039862      561594480  java.util.TreeMap$Entry
> > > >    7:       4346283      452013432  org.apache.lucene.util.fst.FST
> > > >    8:       4522836      424741520  [Ljava.util.HashMap$Node;
> > > >    9:       4346283      347702640
> > > > org.apache.lucene.codecs.BlockTreeTermsReader$FieldReader
> > > >   10:       4683616      337220352  org.apache.lucene.util.fst.
> FST$Arc
> > > >   11:      12947467      310739208  org.apache.lucene.util.BytesRef
> > > >   12:        790283      280383040  [J
> > > >   13:       4359111      245496264  [Ljava.lang.Object;
> > > >   14:       4545337      218176176  java.util.HashMap
> > > >   15:       4510384      216498432  org.apache.lucene.index.
> FieldInfo
> > > >   16:       4359066      199713232  [I
> > > >   17:       4346283      173851320  org.apache.lucene.util.fst.
> > > BytesStore
> > > >   18:       4510400      144332800  java.util.Collections$
> > > UnmodifiableMap
> > > >   19:       4354347      104504328  java.util.ArrayList
> > > >   20:       5736589       91785424  java.lang.Integer
> > > >   21:        822685       59233320
> > > >
> > org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer$NumericE
> > > > ntry
> > > >   22:        428313       13706016
> > > > org.apache.lucene.facet.taxonomy.writercache.CollisionMap$Entry
> > > >   23:        420547       13457504  org.wltea.analyzer.dic.
> DictSegment
> > > >   24:        177039        5665248  [Lorg.wltea.analyzer.dic.
> > > DictSegment;
> > > >   25:            20        5112128
> > > > [Lorg.apache.lucene.facet.taxonomy.writercache.CollisionMap$Entry;
> > > >   26:         42454        2377424  org.apache.lucene.store.
> > > RAMInputStream
> > > >   27:         50054        2002160  org.apache.lucene.util.packed.
> > > Packed64
> > > >   28:         44036        1761440
> > > > org.apache.lucene.util.packed.DirectPackedReader
> > > >   29:         33013        1056416
> > > > java.util.concurrent.ConcurrentHashMap$Node
> > > >   30:         43957        1054968
> > > > org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer$2
> > > >
> > > >
> > > >
> > > >
> > > > Thanks & Best Regards!
> > > > lubin
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > > For additional commands, e-mail: java-user-help@lucene.apache.org
> > >
> > >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message