Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Message-ID: <20080508225915.lj9tujs5wk4cogsk@webmail.hullegard.com>
Date: Thu, 08 May 2008 22:59:15 +0200
From: solr@hullegard.com
To: solr-user@lucene.apache.org
Subject: Re: ERROR:unknown field, but what document was it?
References: <20080501190544.2ggderi8mckck48o@webmail.hullegard.com>
	<Pine.LNX.4.62.0805080607330.9253@radix.cryptio.net>
In-Reply-To: <Pine.LNX.4.62.0805080607330.9253@radix.cryptio.net>
MIME-Version: 1.0
Content-Type: text/plain;
	charset=ISO-8859-1;
	DelSp="Yes";
	format="flowed"
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
User-Agent: Internet Messaging Program (IMP) H3 (4.1.4)

Quoting Chris Hostetter <hossman_lucene@fucit.org>:

>
> : The way I understand it, having multiple documents in a single xml file =
and
> : posting that to solr is faster then posting a single xml for each docume=
nt
> : (even with a single commit after all separate xml files). It makes =20
>  sence, and
> : some simple tests indicates that this is true. However, if one of the
>
> For the record: people say this every now and then, but I don't think
> anyone has ever posted any specific numbers comparing multiple docs in a
> single add, vs multiple seperate requests using "Keep-Alive" ... there
> shouldn't be any fundemental difference.

My tests showed that it was a big difference. It took about 1.2 =20
seconds to index 500 separate adds in separate xml files (with a =20
single commit afterwards), compared to about 200 milliseconds when =20
sending a single xml with 500 adds. And according to the documentation =20
java automatically uses keep-alive (I found no way to force it myself).

> : schema.xml. When I tried to make solr index this xml I got the error:
> : ERROR:unknown field 'myNonExistantField'
> : And that is just great. But what document was it? I need to know  =20
> this, because
> : the next step is to log an error like "document with id 251" could not b=
e
> : indexed, error: unknown field 'myNonExistantField'". Then I want  =20
> to continue
>
> i thought we added something like this ... but i guess not.
>
> feel free to file a feature request in Jira.

ah, but I guess it is only awailable in a nightly build? Do you know a =20
jira issue number I can look at? I didn't find anything related to this.

Regards
/Jimi