hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Azuryy Yu <azury...@gmail.com>
Subject Re: C++ development framework under Hadoop
Date Wed, 15 Oct 2014 03:20:23 GMT
Hadoop streaming is the best option for you. It doesn't  has high I/O
overhead if you don't add a high I/O in your c++ code.

hadoop streaming use buidin MapReduce, it just redirect input/out stream
for your c++ application.


On Tue, Oct 14, 2014 at 10:33 PM, Y. Z. <zhaoyanswill@gmail.com> wrote:

> Hi Experts,
>
> I'm going to to do some computation-intensive operation under Hadoop
> framework. I'm wondering which is the best way to code in C++ under Hadoop
> framework? I'm aware of three options: Hadoop Streaming, Hadoop Pipes, and
> Hadoop C++ Extension. I heard that Hadoop Pipes has/would be deprecated in
> Hadoop 2.*. I'm also not sure if Hadoop C++ Extension is still well
> maintained. Meanwhile, Hadoop Streaming has high I/O overhead.
>
> What are your opinions? Thanks!
>
> --
> Sincerely,
> Y. Z.
>
>

Mime
View raw message