Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of arunk786@gmail.com designates
 209.85.210.177 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOdYfZUBvD3tL1RhBHWwqM2r47f9fKfeRVBG4_ed8DBpx-LPmA@mail.gmail.com>
References: 
 <CAO7gJeizV5m43D_QaQaho24PjawfC217PeMwqD+KF-01UY26HA@mail.gmail.com>
 <CAEY5pxXtJCFrPgk8SkdK9ivuxZst-4eOvVNM4=0xsgcEgDJGzA@mail.gmail.com>
 <CAO7gJeg3AGsN=+GcKwpPdFyTTvAUku9bgPwQgP_JE6-p+HXyEw@mail.gmail.com>
 <CAEY5pxVUEM5NPgYfH=d7WCapL=ZfYxOjTy2yr1tNbqskBwSudw@mail.gmail.com>
 <CAPsWd+NPdvXeqot_hTvad-15VfFZC-whjUivbRSHCGC=Qsy3UA@mail.gmail.com>
 <CAO7gJehnBhiLvX6kZzBAE4W7-GS3i4kmZxnD1KN8-az9aFj3Rw@mail.gmail.com>
 <CAPsWd+OSLhNY9WYQ2h8QPr-xT+1k0Oo5dnEjc40a5JRndthL4w@mail.gmail.com>
 <CAO7gJej5L5wAj62KvBGyuVobnh9cQQ9xZwuttHvG=KCtk8Kf4A@mail.gmail.com>
 <005101cdfee1$6d99dff0$48cd9fd0$@thetaphi.de>
 <CAO7gJehOZm8Cs7wpPfq-cApdGzkNpy78WWez1dok8K+LzKC6Rw@mail.gmail.com>
 <CAOdYfZUBvD3tL1RhBHWwqM2r47f9fKfeRVBG4_ed8DBpx-LPmA@mail.gmail.com>
From: arun k <arunk786@gmail.com>
Date: Fri, 1 Feb 2013 11:18:22 +0530
Message-ID: 
 <CAO7gJegD=3OXgrKBDzGQYmQrSVZx=t46Wpg_1dPwOeJttGeN+g@mail.gmail.com>
Subject: Re: CompressingStoredFieldsFormat doesn't show improvement
To: java-user <java-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=14dae9341255bb75a204d4a34b0a

--14dae9341255bb75a204d4a34b0a
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Hi,

Random data was indexed. I wanted to see the worst case where little data
is same across documents and  which in most of my cases is.
So, i guess in these scenarios compression becomes an overhead.

Arun


On Thu, Jan 31, 2013 at 8:00 PM, Robert Muir <rcmuir@gmail.com> wrote:

> The top method here is your random string generation.
>
> are you indexing random data?
>
> On Thu, Jan 31, 2013 at 12:46 AM, arun k <arunk786@gmail.com> wrote:
> > Hi,
> >
> > Please find the snapshots here.
> > http://picpaste.com/Lucene3.0.2-G00Z5FfX.png
> > http://picpaste.com/Lucene4.1-LsxpcQk0.png
> >
> > Arun
> >
> >
> > On Wed, Jan 30, 2013 at 5:30 PM, Uwe Schindler <uwe@thetaphi.de> wrote:
> >
> >> Hi,
> >>
> >>
> >>
> >> there is nothing attached to your mail; maybe the mailing list softwar=
e
> >> removed it. Can you place it somewhere on the web (e.g. pastebin,=85)?
> >>
> >>
> >>
> >> Uwe
> >>
> >>
> >>
> >> -----
> >>
> >> Uwe Schindler
> >>
> >> H.-H.-Meier-Allee 63, D-28213 Bremen
> >>
> >>  <http://www.thetaphi.de/> http://www.thetaphi.de
> >>
> >> eMail: uwe@thetaphi.de
> >>
> >>
> >>
> >> From: arun k [mailto:arunk786@gmail.com]
> >> Sent: Wednesday, January 30, 2013 12:04 PM
> >> To: java-user
> >> Subject: Re: CompressingStoredFieldsFormat doesn't show improvement
> >>
> >>
> >>
> >> Adrein,
> >> Please find the attached profilers report.
> >>
> >>
> >>
> >> On Wed, Jan 30, 2013 at 3:35 PM, Adrien Grand <jpountz@gmail.com>
> wrote:
> >>
> >> On Wed, Jan 30, 2013 at 8:08 AM, arun k <arunk786@gmail.com> wrote:
> >> > Adrein,
> >> >
> >> > I have created an index of size 370M of 1 million docs of 40 fields
> of 40
> >> > chars and did the profiling.
> >> > I see that the indexing and in particular the addDocument &
> >> > ConcurrentMergeScheduler in 4.1 takes double the time compared to
> 3.0.2.
> >>
> >> Can you provide me with the detailed profiles?
> >>
> >>
> >> > Looks like CompressionStoredFieldsFormat is of little use in my
> scenario.
> >>
> >> You can can disable stored fields compression and use another
> >> StoredFieldsFormat by defining a custom codec
> >> (
> >>
> http://lucene.apache.org/core/4_1_0/core/org/apache/lucene/codecs/package=
-summary.html#package_description
> >> ).
> >>
> >>
> >> --
> >> Adrien
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >>
> >>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--14dae9341255bb75a204d4a34b0a--