Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=GvF0ALboozp7dTfG5wYe72RRx6PHlX0dNLIK6xmhwDaGbyT5qHaDXNFSYHKKZXbOIMMa4jzqh5WDJEQ+5P8Zh1k0a+OiwJ/lx1+zr6b/2Pb0GMZMEPN0IvZntPJdP0QEgCeP7MzaonjYw0MjfPHnUe42dfTOA20MD6xF8Df+oNk=;
References: 
 <CALd5WP8Eb9wM1O3LozC3SebsqQezADyc662XP8PphjByET2Weg@mail.gmail.com>
Message-ID: <1386316101.30429.YahooMailNeo@web125306.mail.ne1.yahoo.com>
Date: Thu, 5 Dec 2013 23:48:21 -0800 (PST)
From: Ahmet Arslan <iorixxx@yahoo.com>
Reply-To: Ahmet Arslan <iorixxx@yahoo.com>
Subject: Re: Bad fieldNorm when using morphologic synonyms
To: "solr-user@lucene.apache.org" <solr-user@lucene.apache.org>
In-Reply-To: 
 <CALd5WP8Eb9wM1O3LozC3SebsqQezADyc662XP8PphjByET2Weg@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="-2016055526-1055035004-1386316101=:30429"

---2016055526-1055035004-1386316101=:30429
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Isaac,=0A=0ADid you consider omitting norms completely for that field? o=
mitNorms=3D"true"=0AAre you using=A0solr.RemoveDuplicatesTokenFilterFactory=
?=0A=0A=0A=0AOn Thursday, December 5, 2013 8:55 PM, Isaac Hebsh <isaac.hebs=
h@gmail.com> wrote:=0A =0AHi,=0Awe implemented a morphologic analyzer, whic=
h stems words on index time.=0AFor some reasons, we index both the original=
 word and the stem (on the same=0Aposition, of course).=0AThe stemming is d=
one on a specific language, so other languages are not=0Astemmed at all.=0A=
=0ABecause of that, two documents with the same amount of terms, may have=
=0Adifferent termVector size. document which contains many words that being=
=0Astemmed, will have a double sized termVector. This behaviour affects the=
=0Arelevance score in a BAD way. the fieldNorm of these documents reduces=
=0Athier score. This is NOT the wanted behaviour in our case.=0A=0AWe are l=
ooking for a way to "mark" the stemmed words (on index time, of=0Acourse) s=
o they won't affect the fieldNorm. Do such a way exist?=0A=0ADo you have an=
other idea?
---2016055526-1055035004-1386316101=:30429--