Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (hermes.apache.org: domain of eric138@gmail.com designates
 64.233.170.198 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type:content-transfer-encoding;
        b=TCMFI8cBjIwfUjc3nh0UWziILD4y/ErQRBZMKvtYwMchgJCFJ4DBynp5HBogP0Pl8jUSuCKHXvXPQt+bUtQsgpdsa9o4RXAEk8ciM0J2gz1D18HvdeWAhOrpcxsJej65uhMwGB6EtXFd9gIPYNOMAZle4iHRKbeKeSGW1bir7xQ=
Message-ID: <f472e9a0050411030169072793@mail.gmail.com>
Date: Mon, 11 Apr 2005 18:01:50 +0800
From: Eric Chow <eric138@gmail.com>
Reply-To: Eric Chow <eric138@gmail.com>
To: java-user@lucene.apache.org
Subject: Urgent, please help, index/search in UTF-8 ???
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Hello,

I am a beginner in using Lucene.

My files are contains different language (English, Chinese,
Portuguese, Japanese and some Asian languages, non-latin languages).
They always contain in one file.
Therefore, I have to use UTF-8 to save the contents.

I am now developing a web-based search engine. I use Lucene to create
index for those files and search it in web. The charset of the web
page is UTF-8, but it cannot search anything.

I try to use some Analyser (CJKAnalyser, ChineseAnalyser,
StandardAnalyser, SimpleAnalyser), still failed.

Finally, I tested to use original charset, for example, the Chinese
contents I used BIG5, and I can search it very well. For those
English, of couse, no problem.

But I can't use UTF-8 as the charset for documents. Any suggest and examples ?

Best regards,
Eric

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org