Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-user@lucene.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns;
	h=message-id:date:from:organization:user-agent:
	x-accept-language:mime-version:to:subject:references:in-reply-to:
	content-type:content-transfer-encoding;
	b=NmmUQW2g9OgtaKVZcj/w1P/2SSnuarUfgVLJt6T620iEHsbcCl4dm8nmWRxe347j
Message-ID: <46C40813.3020704@yahoo-inc.com>
Date: Thu, 16 Aug 2007 13:47:23 +0530
From: Arun C Murthy <arunc@yahoo-inc.com>
Organization: Yahoo! Inc.
User-Agent: Mozilla Thunderbird 0.7.3 (X11/20040929)
MIME-Version: 1.0
To: hadoop-user@lucene.apache.org
Subject: Re: How to integrate C/C++ library in Hadoop Map/Reduce
References: <12176819.post@talk.nabble.com>
In-Reply-To: <12176819.post@talk.nabble.com>
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit

Hi,

ChaoChun Liang wrote:
> Hello, 
>   We had text processing libraries, which developed by C/C++, and would like
> to
>   use Hadoop to process large data set. It looks like not much talking about
> this issue
>   (to call C/C++ library under Hadoop Map/Reduce Java codes)
>   Any comment(or examples) to share how to do that?  Thanks for your help.
> 

I believe the hadoop *pipes* is what you need... it's coming up in the 
0.14.0 release in next few days:

http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/pipes/package.html

Here is some context: http://issues.apache.org/jira/browse/HADOOP-234

Arun

> ChaoChun