hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <ar...@yahoo-inc.com>
Subject Re: How to integrate C/C++ library in Hadoop Map/Reduce
Date Thu, 16 Aug 2007 08:17:23 GMT
Hi,

ChaoChun Liang wrote:
> Hello, 
>   We had text processing libraries, which developed by C/C++, and would like
> to
>   use Hadoop to process large data set. It looks like not much talking about
> this issue
>   (to call C/C++ library under Hadoop Map/Reduce Java codes)
>   Any comment(or examples) to share how to do that?  Thanks for your help.
> 

I believe the hadoop *pipes* is what you need... it's coming up in the 
0.14.0 release in next few days:

http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/pipes/package.html

Here is some context: http://issues.apache.org/jira/browse/HADOOP-234

Arun

> ChaoChun


Mime
View raw message