Mailing-List: contact nutch-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: nutch-dev@lucene.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Message-ID: <46C2EAD9.5010603@michael-baessler.de>
Date: Wed, 15 Aug 2007 14:00:25 +0200
From: Michael Baessler <mba@michael-baessler.de>
User-Agent: Thunderbird 1.5.0.12 (Windows/20070509)
MIME-Version: 1.0
To: nutch-dev@lucene.apache.org
Subject: Using Nutch LanguageIdentifierPlugin in Apache UIMA
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi,

I'm one of the Apache UIMA committers and while searching for an open 
source language detection technology I found the
Nutch LanguageIdentifierPlugin.

First a short introduction what UIMA is:
UIMA stands for Unstructured Information Management Architecture and is 
a component architecture and software framework implementation
for the analysis of unstructured content like text, video and audio 
data. The framework has a pluggable architecture to build a chain of
analysis engines to analyze the content. For further and more detailed 
information about UIMA, please refer to the Apache UIMA homepage:
http://incubator.apache.org/uima/

We are interested in such a language identifier technology to wrap it as 
UIMA analysis engine, so that it can be used to build an analysis chain 
to analyze text content.
We created an UIMA sandbox to host such analysis engines that everybody 
can use these engines he is interested in to build an analysis chain for 
his needs.

Now my questions:
Is there a place where I can find some more details about how your 
language identification works?
Will it be possible to share the language identification technology so 
that we can wrap it as UIMA analysis engine? My current understanding 
is, that it is only available within Nutch but not separately.

Since both projects are hosted on Apache, I don't see any license issues 
when using your technology. :-)

Thanks for your answers in advance!

-- Michael