Mailing-List: contact lucy-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: lucy-dev@incubator.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Date: Mon, 6 Dec 2010 15:26:33 -0800
To: lucy-dev@incubator.apache.org
Message-ID: <20101206232633.GA12499@rectangular.com>
References: <4CFD334A.8070309@peknet.com>
 <20101206191659.GA11876@rectangular.com> <4CFD36FC.30800@peknet.com>
 <20101206225432.GB22686@rot13.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20101206225432.GB22686@rot13.org>
User-Agent: Mutt/1.5.13 (2006-08-11)
From: Marvin Humphrey <marvin@rectangular.com>
Subject: Re: [lucy-dev] ElasticSearch

On Mon, Dec 06, 2010 at 11:54:32PM +0100, Dobrica Pavlinusic wrote:
> Which leads me to practical question: what's current state of schema in
> KinoSearch and/or lucy?
> 
> I seems to remember API for adding fields on the fly while indexing in
> older version of KinoSearch, but I can't find anything similar in
> documentation for 0.31.
> 
> I would love to index CouchDB _changes feed with (much like
> ElasticSearch CouchDB river) but I don't really know schema in advance.

Dynamic schemas are supported, same as in KS 0.2x.  Supplying a document with
an unknown field still triggers an exception, so you just have to iterate over
all fields in the unknown document and call spec_field() for anything which
hasn't been seen before.

    while (my $doc = get_next_doc_from_somewhere()) {
        for my $field (keys %$doc) {
            next if $schema->fetch_type($field);
            $schema->spec_field(name => $field, type => $type);
        }
        $indexer->add_doc($doc);
    }
    $indexer->commit;

Marvin Humphrey