Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 6225 invoked from network); 27 Feb 2007 16:02:20 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 27 Feb 2007 16:02:20 -0000 Received: (qmail 12084 invoked by uid 500); 27 Feb 2007 16:02:19 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 12036 invoked by uid 500); 27 Feb 2007 16:02:19 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 11999 invoked by uid 99); 27 Feb 2007 16:02:19 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Feb 2007 08:02:19 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (herse.apache.org: domain of karl.wettin@gmail.com designates 64.233.182.184 as permitted sender) Received: from [64.233.182.184] (HELO nf-out-0910.google.com) (64.233.182.184) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Feb 2007 08:02:05 -0800 Received: by nf-out-0910.google.com with SMTP id i2so203176nfe for ; Tue, 27 Feb 2007 08:01:44 -0800 (PST) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:mime-version:in-reply-to:references:content-type:message-id:content-transfer-encoding:from:subject:date:to:x-mailer; b=bg4qKJEjBJgVM3Nuy3CsnRRsSjSAoleENxE2pEPOKJn5HzE8NJ9l0xWmPNYs/o953zcDlbiZSOrSvBKNeb31VlTesZn0wAeRWVFngenZJ9JSl2iHNtB7n1WprQhySVUjQkHOH6cw9IVqtICIxo/3V34ZjUTj2SGtUNVlS1dTgpw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:mime-version:in-reply-to:references:content-type:message-id:content-transfer-encoding:from:subject:date:to:x-mailer; b=Uh7JYmM/i8YU7kjylaX18lq8uDyXgajwRuCx/qVG+jIPiFjVlzkAjttUXKBzns/KJ5n5Jy+o+QmvqgsyGejcSDL/hTcFYQE/dWzoshKBHd8Ctmf8jLaCdbXfsKoTwqF2F3sDIgNOoLUFjFhH9+7vTgYaP/b76Hu8b+V7rgBtoZQ= Received: by 10.48.220.15 with SMTP id s15mr1386009nfg.1172592104383; Tue, 27 Feb 2007 08:01:44 -0800 (PST) Received: from ?10.0.1.12? ( [212.162.171.110]) by mx.google.com with ESMTP id q28sm2321526nfc.2007.02.27.08.01.43; Tue, 27 Feb 2007 08:01:43 -0800 (PST) Mime-Version: 1.0 (Apple Message framework v752.3) In-Reply-To: References: <359a92830702270634l4512ff07jded8e215a188a796@mail.gmail.com> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: karl wettin Subject: Re: indexing performance Date: Tue, 27 Feb 2007 16:59:42 +0100 To: java-user@lucene.apache.org X-Mailer: Apple Mail (2.752.3) X-Virus-Checked: Checked by ClamAV on apache.org 27 feb 2007 kl. 16.49 skrev Saravana: > I am trying to index the syslogs generated from one of my busy ftp > server so > that I can get counts specific to an user with the given time > frame. Since > my ftp server is very busy it can generate so much syslogs per > second. And > the important point here is I do not need any ranking etc.. My immediate thought when reading this is if it really is a text search engine you want to use for this? If it is, how do you process the log? What fields to you split it up in and what analyzsers do you use? Optimizing the use of that is probably you best way to achieve better speed when appending documents to the index. -- karl --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org