Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CALGoTy18houaWnV9c97ZWvVgLJh2QnscJt+H0H1tEnR2mhtB_g@mail.gmail.com>
References: 
 <CAHLJZxOo8oM_5sZiDZfZ0-g9GqAVwd66q+vjvfnOX73cet4xZQ@mail.gmail.com>
 <56C058C9.9050807@hoplahup.net>
 <CAHLJZxN7ORvV3-ELJAFT80mT-AYHV2yPw58wjVQDehCRkfxSdA@mail.gmail.com>
 <CALGoTy0LfR7iBRV0Nrzk0He5okrssDYhx76Kzn0oqjr6pf8mtg@mail.gmail.com>
 <CAHLJZxPiQ6EFrH0RDyL8Zs9M_z6_gGE5TM5kpUAL=esp1u4kdA@mail.gmail.com>
 <CALGoTy3qeOsRTPhs2initBD1i3tEZnpjH+nAQUKkS2wKdapH6w@mail.gmail.com>
 <CAHLJZxOLL7YiJ9++3HcBpnKdANyRfX=6oY97Z=sZv-hiXw90vA@mail.gmail.com>
 <CALGoTy0gR_eE7nLLBUSqx3W1sNKTR22pZ-htUqhb07kw87QSJA@mail.gmail.com>
 <CAHLJZxMyuuVZm7839gc4eKh+f1f1=7hJYyAadFMxLp=qGXQGbg@mail.gmail.com>
 <CALGoTy18houaWnV9c97ZWvVgLJh2QnscJt+H0H1tEnR2mhtB_g@mail.gmail.com>
From: "Evert R." <evert.ramos@gmail.com>
Date: Mon, 15 Feb 2016 08:06:05 -0200
Message-ID: 
 <CAHLJZxNE_gteSLFcS0vDgU5W9V2C4fK92PCE4mus9eg_v5nbVA@mail.gmail.com>
Subject: Re: Highlight brings the content from the first pages of pdf
To: solr-user <solr-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=001a1140aefc9988f4052bcc2c62

--001a1140aefc9988f4052bcc2c62
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Binoy,

Thank you very much for you reply and explanation.

Best regards,


*--Evert*

2016-02-14 23:28 GMT-02:00 Binoy Dalal <binoydalal93@gmail.com>:

> What you've done so far will highlight every instance of "nietava" found =
in
> the field, and return it, i.e., your entire field will return with all th=
e
> "nietava"s in <em> tags.
> If you do not want the entire field, only portions of your field containi=
ng
> the matched terms, then use hl.snippets parameter =3D the number of snipp=
ets
> you want, in this particular case 3, along with the hl.fragsize parameter
> set to the same number as your hl.mazAnalyzedChars (or a really large
> number).
>
> I suggest you go through the wiki documentation for highlighting once (
> https://wiki.apache.org/solr/HighlightingParameters). It should answer al=
l
> of your questions regarding the use of the standard highlighter that you
> might have.
>
> As an additional note, I also suggest that you look into the
> PostingsHighlighter (
> https://cwiki.apache.org/confluence/display/solr/Postings+Highlighter),
> since you seem to be running highlighting on pretty big fields and postin=
gs
> is much more efficient at highlighting huge fields as compared to the
> standard highlighter.
>
> On Mon, Feb 15, 2016 at 4:15 AM Evert R. <evert.ramos@gmail.com> wrote:
>
> > Binoy,
> >
> > You are the man! =3D)
> >
> > Thank you very much!
> >
> > Would you by chance know how could I get the second highlight of the sa=
me
> > word in the same file?
> >
> > Like: file_1.pdf (has three words "nietava") so..., how can I bring the
> > highlighs for the three occurrences?
> >
> > I am pretty new around, should I send (open) another subject?
> >
> > Thanks again!
> >
> >
> > *--Evert*
> >
> > 2016-02-14 16:40 GMT-02:00 Binoy Dalal <binoydalal93@gmail.com>:
> >
> > > Are you sure you've typed in the parameters correctly?
> > > In your response it says flagsize instead of fragsize and
> > maxanalzyedchars
> > > instead of maxanalyzedchars.
> > >
> > > Ohh wait, I see that I made the analyzed typo. Awfully sorry for that=
,
> > I'm
> > > using my phone to send the mail out.
> > >
> > > On Sun, 14 Feb 2016, 23:53 Evert R. <evert.ramos@gmail.com> wrote:
> > >
> > > > Hi Binoy,
> > > >
> > > > thanks!
> > > >
> > > > Still not working, check the output:
> > > >
> > > > {
> > > >   "responseHeader":{
> > > >     "status":0,
> > > >     "QTime":58,
> > > >     "params":{
> > > >       "q":"nietava",
> > > >       "hl":"true",
> > > >       "hl.simple.post":"</em>",
> > > >       "indent":"true",
> > > >       "fl":"id",
> > > >       "hl.flagsize":"0",
> > > >       "hl.fl":"content",
> > > >       "hl.maxAnalzyedChars":"208400",
> > > >       "wt":"json",
> > > >       "hl.simple.pre":"<em>"}},
> > > >   "response":{"numFound":1,"start":0,"docs":[
> > > >       {
> > > >         "id":"/home/solr/dados/teste/Emmanuel.pdf"}]
> > > >   },
> > > >   "highlighting":{
> > > >     "/home/solr/dados/teste/Emmanuel.pdf":{}}}
> > > >
> > > >
> > > >
> > > > *--Evert*
> > > >
> > > > 2016-02-14 14:31 GMT-02:00 Binoy Dalal <binoydalal93@gmail.com>:
> > > >
> > > > > Don't add this parameter to the searchComponent definition, becau=
se
> > the
> > > > > components where you've added it, GapFragmenter and
> RegexFragmenter,
> > > > simply
> > > > > don't use it.
> > > > > Instead, add it to your request handler (/select etc.) if you've
> > > > configured
> > > > > highlighting in the handler or append it to your query:
> > > > > *&hl.maxAnalzyedChars=3D<some_really_big_number>*.
> > > > > Additionally also set the *hl.fragsize parameter to 0*, if your
> text
> > is
> > > > > larger than 51200 chars which it mostly is, in a similar fashion.
> > > > >
> > > > >
> > > > > On Sun, Feb 14, 2016 at 9:02 PM Evert R. <evert.ramos@gmail.com>
> > > wrote:
> > > > >
> > > > > > Hi Binoy,
> > > > > >
> > > > > > I could not find this option in my solrconfig.xml file. ]
> > > > > >
> > > > > > I tryied to add this setting and nothing changed...
> > > > > >
> > > > > > Here is the code, I might miss placed:
> > > > > >
> > > > > > <code>
> > > > > > <searchComponent class=3D"solr.HighlightComponent"
> name=3D"highlight">
> > > > > >     <highlighting>
> > > > > >       <!-- Configure the standard fragmenter -->
> > > > > >       <!-- This could most likely be commented out in the
> "default"
> > > > case
> > > > > > -->
> > > > > >       <fragmenter name=3D"gap"
> > > > > >                   default=3D"true"
> > > > > >                   class=3D"solr.highlight.GapFragmenter">
> > > > > >         <lst name=3D"defaults">
> > > > > >           <int name=3D"hl.fragsize">400</int>
> > > > > >           <int name=3D"hl.maxAnalyzedChars">409600</int>
> > > > > >         </lst>
> > > > > >       </fragmenter>
> > > > > >
> > > > > >       <!-- A regular-expression-based fragmenter
> > > > > >            (for sentence extraction)
> > > > > >         -->
> > > > > >       <fragmenter name=3D"regex"
> > > > > >                   class=3D"solr.highlight.RegexFragmenter">
> > > > > >         <lst name=3D"defaults">
> > > > > >           <!-- slightly smaller fragsizes work better because o=
f
> > slop
> > > > -->
> > > > > >           <int name=3D"hl.fragsize">200</int>
> > > > > >           <int name=3D"hl.maxAnalyzedChars">409600</int>
> > > > > >           <!-- allow 50% slop on fragment sizes -->
> > > > > >           <float name=3D"hl.regex.slop">0.5</float>
> > > > > >           <!-- a basic sentence pattern -->
> > > > > >           <str name=3D"hl.regex.pattern">[-\w
> > > > > > ,/\n\&quot;&apos;]{20,200}</str>
> > > > > >         </lst>
> > > > > >       </fragmenter>
> > > > > >
> > > > > > </code>
> > > > > >
> > > > > > thanks!
> > > > > >
> > > > > >
> > > > > > *--Evert*
> > > > > >
> > > > > > 2016-02-14 12:14 GMT-02:00 Binoy Dalal <binoydalal93@gmail.com>=
:
> > > > > >
> > > > > > > From the solr wiki:
> > > > > > > hl.maxAnalyzedChars
> > > > > > >
> > > > > > > How many characters into a document to look for suitable
> > > > > > > snippets =EF=BF=BC Solr1.3. This parameter makes sense for th=
e original
> > > > > > Highlighter
> > > > > > > only.
> > > > > > >
> > > > > > > The default value is "51200".
> > > > > > >
> > > > > > > You can assign a large value to this parameter and use
> > > hl.fragsize=3D0
> > > > to
> > > > > > > return highlighting in large fields that have size greater th=
an
> > > 51200
> > > > > > > characters.
> > > > > > >
> > > > > > > I think this might be your hiccup.
> > > > > > >
> > > > > > > On Sun, 14 Feb 2016, 17:11 Evert R. <evert.ramos@gmail.com>
> > wrote:
> > > > > > >
> > > > > > > > Hi Paul,
> > > > > > > >
> > > > > > > > Sorry my late reply.
> > > > > > > >
> > > > > > > > All the content is inside de docs. It brings the docs and t=
he
> > pdf
> > > > > file
> > > > > > > that
> > > > > > > > has the search word in it. But the highlight is not showing
> if
> > > the
> > > > > > search
> > > > > > > > word is after a few pages.
> > > > > > > >
> > > > > > > > Evert
> > > > > > > >
> > > > > > > >
> > > > > > > > *--Evert*
> > > > > > > >
> > > > > > > > 2016-02-14 8:36 GMT-02:00 Paul Libbrecht <paul@hoplahup.net
> >:
> > > > > > > >
> > > > > > > > > This looks like the stored content is shortened. Can it b=
e?
> > > > > > > > > Can you see that inside the docs?
> > > > > > > > >
> > > > > > > > > paul
> > > > > > > > >
> > > > > > > > > > Evert R. <mailto:evert.ramos@gmail.com>
> > > > > > > > > > 14 February 2016 at 11:26
> > > > > > > > > > Hi There,
> > > > > > > > > >
> > > > > > > > > > I have a situation where started a techproducts, withou=
t
> > any
> > > > > > > > > modification,
> > > > > > > > > > post a pdf file. When searching as:
> > > > > > > > > >
> > > > > > > > > > q=3Dtext:search_word
> > > > > > > > > > hl=3Dtrue
> > > > > > > > > > hl.fl=3Dcontent
> > > > > > > > > >
> > > > > > > > > > It show the highlight accordingly! =3D)
> > > > > > > > > >
> > > > > > > > > > BUT... *if the "search_word" is after the first pages* =
in
> > my
> > > > pdf
> > > > > > > file,
> > > > > > > > > > such
> > > > > > > > > > as page 15...
> > > > > > > > > >
> > > > > > > > > > It simply *does not show* *the HIGHLIGHT*...
> > > > > > > > > >
> > > > > > > > > > Does anyone has faced this situation before?
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Thanks!
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > *--Evert*
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > --
> > > > > > > Regards,
> > > > > > > Binoy Dalal
> > > > > > >
> > > > > >
> > > > > --
> > > > > Regards,
> > > > > Binoy Dalal
> > > > >
> > > >
> > > --
> > > Regards,
> > > Binoy Dalal
> > >
> >
> --
> Regards,
> Binoy Dalal
>

--001a1140aefc9988f4052bcc2c62--