hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Y Z <zhaoyansw...@gmail.com>
Subject Re: C++ development framework under Hadoop
Date Wed, 15 Oct 2014 03:33:03 GMT
Thanks, Azuryy!

I found some examples about Pipes. Is Hadoop Pipes still support in 
Hadoop 2.2?

Sincerely,
Yongan

On 10/14/2014 11:20 PM, Azuryy Yu wrote:
> Hadoop streaming is the best option for you. It doesn't  has high I/O 
> overhead if you don't add a high I/O in your c++ code.
>
> hadoop streaming use buidin MapReduce, it just redirect input/out 
> stream for your c++ application.
>
>
> On Tue, Oct 14, 2014 at 10:33 PM, Y. Z. <zhaoyanswill@gmail.com 
> <mailto:zhaoyanswill@gmail.com>> wrote:
>
>     Hi Experts,
>
>     I'm going to to do some computation-intensive operation under
>     Hadoop framework. I'm wondering which is the best way to code in
>     C++ under Hadoop framework? I'm aware of three options: Hadoop
>     Streaming, Hadoop Pipes, and Hadoop C++ Extension. I heard that
>     Hadoop Pipes has/would be deprecated in Hadoop 2.*. I'm also not
>     sure if Hadoop C++ Extension is still well maintained. Meanwhile,
>     Hadoop Streaming has high I/O overhead.
>
>     What are your opinions? Thanks!
>
>     -- 
>     Sincerely,
>     Y. Z.
>
>


Mime
View raw message