Mailing-List: contact mahout-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mahout-user@lucene.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.co.uk;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=FSjd8Oja6WXXEd9BetCa0YvjHQS1Y0XHHRcjAmvFPCu0RfuiQtyBZ+VvHwEnU6vxqc72oaqmFjt+zSp/wuzaIaX13qn97mxeTJ1nSHzuOyZ1UNv6N+jIpGkoQw5GnQKvxhAue7Lq9pLETc7+d9AqAqnKsrbBc++k75iUvIyap20=;
Message-ID: <379622.20816.qm@web24606.mail.ird.yahoo.com>
References: <361287.67300.qm@web24613.mail.ird.yahoo.com>
 <286DF62E-3DCF-49AB-8AA1-9A0B29C9971A@apache.org>
  <448825.32301.qm@web24605.mail.ird.yahoo.com>
 <c7d45fc70906231000w4824d644idb4830a3e1f313f7@mail.gmail.com>
 <23093.42755.qm@web24605.mail.ird.yahoo.com>
 <770A3644-4DFB-4863-9E09-692276C0498C@gmail.com>
Date: Tue, 23 Jun 2009 16:56:32 -0700 (PDT)
From: Paul Jones <paul_jonez99@yahoo.co.uk>
Subject: Re: mahout PLSI (with some lucene, thrown in)
To: mahout-user@lucene.apache.org
In-Reply-To: <770A3644-4DFB-4863-9E09-692276C0498C@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="0-132036741-1245801392=:20816"

--0-132036741-1245801392=:20816
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Yup, I see that wordnet has also been "ported" to a lucene index, and hence=
 pulling the hyponyms works great.=0A=0Atks=0A=0APaul=0A=0A=0A=0A=0A_______=
_________________________=0AFrom: Tommy Chheng <tommy@peoplejar.com>=0ATo: =
mahout-user@lucene.apache.org=0ASent: Tuesday, 23 June, 2009 23:19:25=0ASub=
ject: Re: mahout PLSI (with some lucene, thrown in)=0A=0AHave you looked at=
 WordNet to get the hypohyms?=0A=0ATommy=0A=0AOn Jun 23, 2009, at 3:09 PM, =
Paul Jones wrote:=0A=0A> Okay, have seen the difficulty (apart from the mat=
hs :-)).=0A> =0A> I guess "similar" can mean many things, i.e hypohyms, but=
 also words such as hot...cold are also "related", hence to solve my little=
 problem I am wondering if there is a easier way, i.e to use things like ex=
isting hyponyms relations which exist (wordnet and the like) , and/or if th=
ey do not then I guess using something similar to a "google distance measur=
e" may help in "adding" new words to the system....=0A> =0A> Paul=0A> =0A> =
=0A> =0A> =0A> ________________________________=0A> From: Ted Dunning <ted.=
dunning@gmail.com>=0A> To: mahout-user@lucene.apache.org=0A> Sent: Tuesday,=
 23 June, 2009 18:00:12=0A> Subject: Re: mahout PLSI (with some lucene, thr=
own in)=0A> =0A> Yes.  This can be done.  It isn't necessarily real simple =
to do.=0A> =0A> See http://citeseerx.ist.psu.edu/viewdoc/summary?doi=3D10.1=
.1.56.7275 for an=0A> old (but still pretty good) example.=0A> =0A> On Tue,=
 Jun 23, 2009 at 6:45 AM, Paul Jones <paul_jonez99@yahoo.co.uk>wrote:=0A> =
=0A>> Imagine we have crawled 100K webpages, and we have 100 pages which sh=
ow=0A>> "red" and 100 which show "crimson" and then 100 which show both "re=
d and=0A>> crimson" is there a way to deduce that there maybe (albeit weak)=
=0A>> relationship between red AND crimson. Of course we can pre-seed this =
info,=0A>> which then gets weighted by actual results.=0A>> =0A> =0A> =0A> =
=0A=0A=0A      
--0-132036741-1245801392=:20816--