Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=s0zvYp64N9Fvr0mL76U5LTtwik0qaTqG6V5QoESPo2/cyHD7p2vW86sOfOzQ8aUdMF653KWFirof3VdzQ4J+plGR/M2fhyRcqRfph4PsPVPVr/Dz0MW8T1LbPTwRSVk6e+8zNO53Zn22efVhGDigp9vJKRiLH2S/RfoZTizohx0=;
Message-ID: <648018.31297.qm@web50305.mail.re2.yahoo.com>
References: <860544ed0908061246h49485a65se5b1acc5719343e9@mail.gmail.com>
Date: Thu, 6 Aug 2009 20:51:48 -0700 (PDT)
From: Otis Gospodnetic <otis_gospodnetic@yahoo.com>
Subject: Re: Language Detection for Analysis?
To: java-user@lucene.apache.org, solr-user@lucene.apache.org
In-Reply-To: <860544ed0908061246h49485a65se5b1acc5719343e9@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii

Bradford,

If I may:

Have a look at http://www.sematext.com/products/language-identifier/index.html
And/or http://www.sematext.com/products/multilingual-indexer/index.html

 Otis
--
Sematext is hiring -- http://sematext.com/about/jobs.html?mls
Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR


----- Original Message ----
> From: Bradford Stephens <bradfordstephens@gmail.com>
> To: solr-user@lucene.apache.org; java-user@lucene.apache.org
> Sent: Thursday, August 6, 2009 3:46:21 PM
> Subject: Language Detection for Analysis?
> 
> Hey there,
> 
> We're trying to add foreign language support into our new search
> engine -- languages like Arabic, Farsi, and Urdu (that don't work with
> standard analyzers). But our data source doesn't tell us which
> languages we're actually collecting -- we just get blocks of text. Has
> anyone here worked on language detection so we can figure out what
> analyzers to use? Are there commercial solutions?
> 
> Much appreciated!
> 
> -- 
> http://www.roadtofailure.com -- The Fringes of Scalability, Social
> Media, and Computer Science
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org