Return-Path: 
 <dev-return-52923-apmail-lucene-dev-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-dev-archive@www.apache.org
Received: (qmail 33288 invoked from network); 30 Jun 2010 20:43:48 -0000
Received: from unknown (HELO mail.apache.org) (140.211.11.3)
  by 140.211.11.9 with SMTP; 30 Jun 2010 20:43:48 -0000
Received: (qmail 32720 invoked by uid 500); 30 Jun 2010 20:43:46 -0000
Delivered-To: apmail-lucene-dev-archive@lucene.apache.org
Received: (qmail 32524 invoked by uid 500); 30 Jun 2010 20:43:45 -0000
Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@lucene.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@lucene.apache.org>
List-Post: <mailto:dev@lucene.apache.org>
List-Id: <dev.lucene.apache.org>
Reply-To: dev@lucene.apache.org
Delivered-To: mailing list dev@lucene.apache.org
Received: (qmail 32517 invoked by uid 99); 30 Jun 2010 20:43:45 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jun 2010 20:43:45 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=10.0
	tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jun 2010 20:43:43 +0000
Received: from thor (localhost [127.0.0.1])
	by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o5UKZq9r017369
	for <dev@lucene.apache.org>; Wed, 30 Jun 2010 20:35:52 GMT
Message-ID: <16277383.141111277930152259.JavaMail.jira@thor>
Date: Wed, 30 Jun 2010 16:35:52 -0400 (EDT)
From: =?utf-8?Q?Jan_H=C3=B8ydahl_=28JIRA=29?= <jira@apache.org>
To: dev@lucene.apache.org
Subject: [jira] Created: (SOLR-1979) Create
 LanguageIdentifierUpdateProcessor
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org

Create LanguageIdentifierUpdateProcessor
----------------------------------------

                 Key: SOLR-1979
                 URL: https://issues.apache.org/jira/browse/SOLR-1979
             Project: Solr
          Issue Type: New Feature
          Components: update
            Reporter: Jan H=C3=B8ydahl
            Priority: Minor


We need the ability to detect language of some random text in order to act =
upon it, such as indexing the content into language aware fields. Another u=
secase is to be able to filter/facet on language on random unstructured con=
tent.

To do this, we should wrap the [Nutch LanguageIdentifier|http://nutch.apach=
e.org/apidocs-1.1/org/apache/nutch/analysis/lang/LanguageIdentifier.html"] =
in an UpdateProcessor. The processor should be configured like this:

{{monospaced}}
  <processor class=3D"org.apache.solr.update.processor.LanguageIdentifierUp=
dateProcessorFactory">
    <str name=3D"inputFields">title,teaser,body</str>
    <str name=3D"isoOutputField">language</str>
    <str name=3D"fullOutputField">language_display</str>
  </processor> =20
{{monospaced}}

--=20
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org