Return-Path: Delivered-To: apmail-jakarta-lucene-dev-archive@www.apache.org Received: (qmail 829 invoked from network); 2 Aug 2004 23:35:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur-2.apache.org with SMTP; 2 Aug 2004 23:35:12 -0000 Received: (qmail 72693 invoked by uid 500); 2 Aug 2004 23:35:09 -0000 Delivered-To: apmail-jakarta-lucene-dev-archive@jakarta.apache.org Received: (qmail 72669 invoked by uid 500); 2 Aug 2004 23:35:09 -0000 Mailing-List: contact lucene-dev-help@jakarta.apache.org; run by ezmlm Precedence: bulk List-Unsubscribe: List-Subscribe: List-Help: List-Post: List-Id: "Lucene Developers List" Reply-To: "Lucene Developers List" Delivered-To: mailing list lucene-dev@jakarta.apache.org Received: (qmail 72655 invoked by uid 99); 2 Aug 2004 23:35:09 -0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [209.228.34.190] (HELO c000.snv.cp.net) (209.228.34.190) by apache.org (qpsmtpd/0.27.1) with SMTP; Mon, 02 Aug 2004 16:35:07 -0700 Received: (cpmta 25141 invoked from network); 2 Aug 2004 16:35:04 -0700 Received: from 24.51.109.181 (HELO ?192.168.1.101?) by smtp.hatcher.net (209.228.34.190) with SMTP; 2 Aug 2004 16:35:04 -0700 X-Sent: 2 Aug 2004 23:35:04 GMT Mime-Version: 1.0 (Apple Message framework v618) In-Reply-To: <7f5f89bf04080212306553f8d1@mail.gmail.com> References: <7f5f89bf04080212306553f8d1@mail.gmail.com> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <9A1403B2-E4DC-11D8-8AAE-000393A564E6@ehatchersolutions.com> Content-Transfer-Encoding: 7bit From: Erik Hatcher Subject: Re: Is the latest StandardTokenizer.jj corrupted? Date: Mon, 2 Aug 2004 19:35:13 -0400 To: "Lucene Developers List" X-Mailer: Apple Mail (2.618) X-Virus-Checked: Checked X-Spam-Rating: minotaur-2.apache.org 1.6.2 0/1000/N Roy, I've committed a fix that fixes the import statement issues (Otis - what happened? - I guess you didn't try regenerating from the JavaCC .jj files) All seems to be well now. Let me know if you still have issues. Erik On Aug 2, 2004, at 3:30 PM, Roy wrote: > The latest StandardTokenizer.jj in cvs repository seems to be > corrupted. > > I used ant javacc-StandardAnalyzer to regenerate the java code, then > tried to rebuild the lucene package but got some strange errors as > follows. It seems javacc didn't generated correct code against the > latest jj file: the last two errors indicate there are some characters > missing from those symbols. I checked out the 1.4 jj file and did the > same thing again. It works! So I think there's some problems with the > latest version. The diff shows the change is minor. I didn't figure > the cause. Maybe somebody in the core team can look into this? > > My purpose is to modify the StandardTokenizer.jj to build my own. But > I didn't succeed. Then I found out even the vanilla jj has some > problems. > > compile-core: > [javac] Compiling 160 source files to > /home/roy/jakarta-lucene/build/classes/java > [javac] > /home/roy/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/ > StandardTokenizer.java:15: > cannot resolve symbol > [javac] symbol : class Reader > [javac] location: class > org.apache.lucene.analysis.standard.StandardTokenizer > [javac] public StandardTokenizer(Reader reader) { > [javac] ^ > [javac] > /home/roy/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/ > StandardTokenizer.java:24: > cannot resolve symbol > [javac] symbol : class IOException > [javac] location: class > org.apache.lucene.analysis.standard.StandardTokenizer > [javac] final public org.apache.lucene.analysis.Token next() > throws ParseException, IOException { > [javac] > ^ > [javac] > /home/roy/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/ > StandardTokenizer.java:15: > recursive constructor invocation > [javac] public StandardTokenizer(Reader reader) { > [javac] ^ > [javac] > /home/roy/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/ > StandardTokenizerTokenManager.java:493: > cannot resolve symbol > [javac] symbol : method jCheckNAdd (int) > [javac] location: class > org.apache.lucene.analysis.standard.StandardTokenizerTokenManager > [javac] jCheckNAdd(25); > [javac] ^ > [javac] > /home/roy/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/ > StandardTokenizerTokenManager.java:942: > cannot resolve symbol > [javac] symbol : variable ind > [javac] location: class > org.apache.lucene.analysis.standard.StandardTokenizerTokenManager > [javac] ind = 4; > [javac] ^ > [javac] 5 errors > > BUILD FAILED > /home/roy/jakarta-lucene/build.xml:140: Compile failed; see the > compiler error output for details. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org > For additional commands, e-mail: lucene-dev-help@jakarta.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org For additional commands, e-mail: lucene-dev-help@jakarta.apache.org