Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of earwin@gmail.com designates
 209.85.216.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=NvYvcb3hzbRilFomP2A5QfD7Pmsb87wwoxQQA6zLrVYZMKYfSeSGEJ7nhc7vinlce9
         buFcKLeLOg4cSejdB6LwNMxbaLXtIhZbkFBpSj8cydRLPJhAlg8alRmW5/kQ20s6x0uE
         koNIsZLSYDktwtWxa6zpGxFT8v4+x7SdrlZvw=
MIME-Version: 1.0
In-Reply-To: <4DA41E2F.1020408@arbylon.net>
References: <4DA41E2F.1020408@arbylon.net>
Date: Tue, 12 Apr 2011 15:21:00 +0400
Message-ID: <BANLkTimaYYmfc=o4DkMQf33swfCFgYTqNw@mail.gmail.com>
Subject: Re: Numerical ids for terms?
From: Earwin Burrfoot <earwin@gmail.com>
To: dev@lucene.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Tue, Apr 12, 2011 at 13:41, Gregor Heinrich <gregor@arbylon.net> wrote:
> Hi -- has there been any effort to create a numerical representation of
> Lucene indices. That is, to use the Lucene Directory backend as a large
> term-document matrix at index level. As this would require bijective mapp=
ing
> between terms (per-field, as customary in Lucene) and a numerical index
> (integer, monotonous from 0 to numTerms()-1), I guess this requires some
> some special modifications to the Lucene core.
Lucene index already provides term <-> id mapping in some form.

> Another interesting feature would be to use Lucene's Directory backend fo=
r
> storage of large dense matrices, for instance to data-mining tasks from
> within Lucene.
Lucene's Directory is a dumb abstraction for random-access named
write-once byte streams.
It doesn't add /any/ value over mmap.

> Any suggestions?
*troll mode on* Use numpy/scipy? :)

--=20
Kirill Zakharenko/=D0=9A=D0=B8=D1=80=D0=B8=D0=BB=D0=BB =D0=97=D0=B0=D1=85=
=D0=B0=D1=80=D0=B5=D0=BD=D0=BA=D0=BE
E-Mail/Jabber: earwin@gmail.com
Phone: +7 (495) 683-567-4
ICQ: 104465785

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org