Return-Path: Delivered-To: apmail-jakarta-lucene-user-archive@www.apache.org Received: (qmail 88796 invoked from network); 16 Dec 2003 12:31:23 -0000 Received: from daedalus.apache.org (HELO mail.apache.org) (208.185.179.12) by minotaur-2.apache.org with SMTP; 16 Dec 2003 12:31:23 -0000 Received: (qmail 45849 invoked by uid 500); 16 Dec 2003 12:31:12 -0000 Delivered-To: apmail-jakarta-lucene-user-archive@jakarta.apache.org Received: (qmail 45812 invoked by uid 500); 16 Dec 2003 12:31:12 -0000 Mailing-List: contact lucene-user-help@jakarta.apache.org; run by ezmlm Precedence: bulk List-Unsubscribe: List-Subscribe: List-Help: List-Post: List-Id: "Lucene Users List" Reply-To: "Lucene Users List" Delivered-To: mailing list lucene-user@jakarta.apache.org Received: (qmail 45771 invoked from network); 16 Dec 2003 12:31:11 -0000 Received: from unknown (HELO c000.snv.cp.net) (209.228.32.65) by daedalus.apache.org with SMTP; 16 Dec 2003 12:31:11 -0000 Received: (cpmta 22809 invoked from network); 16 Dec 2003 04:31:11 -0800 Received: from 24.51.109.181 (HELO ehatchersolutions.com) by smtp.hatcher.net (209.228.32.65) with SMTP; 16 Dec 2003 04:31:11 -0800 X-Sent: 16 Dec 2003 12:31:11 GMT Date: Tue, 16 Dec 2003 07:31:09 -0500 Subject: Re: Disabling modifiers? Content-Type: text/plain; charset=US-ASCII; format=flowed Mime-Version: 1.0 (Apple Message framework v553) From: Erik Hatcher To: "Lucene Users List" Content-Transfer-Encoding: 7bit In-Reply-To: <58BDB148-2FC3-11D8-9DF3-000393A564E6@ehatchersolutions.com> Message-Id: X-Mailer: Apple Mail (2.553) X-Spam-Rating: daedalus.apache.org 1.6.2 0/1000/N X-Spam-Rating: minotaur-2.apache.org 1.6.2 0/1000/N On Tuesday, December 16, 2003, at 07:28 AM, Erik Hatcher wrote: > And yes, if you are using StandardTokenizer, you are probably not > tokenizing COBOL quite like you expect. Is there a COBOL parser you > could tap into that could give you the tokens you want? Ummm..... nevermind that last question... I just realized where you work! :) So, my recommendation would be to tap into some parser for the COBOL language that you have handy and have it feed your Analyzer appropriately. Or, use something very very simple like the WhitespaceAnalyzer as a first try. Erik --------------------------------------------------------------------- To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org For additional commands, e-mail: lucene-user-help@jakarta.apache.org