hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Y Z <zhaoyansw...@gmail.com>
Subject Re: C++ development framework under Hadoop
Date Wed, 15 Oct 2014 03:40:12 GMT
Thanks!:)

Sincerely,
Yongan

On 10/14/2014 11:38 PM, Azuryy Yu wrote:
> yes. it always supports hadoop pipe in v2.
>
> On Wed, Oct 15, 2014 at 11:33 AM, Y Z <zhaoyanswill@gmail.com 
> <mailto:zhaoyanswill@gmail.com>> wrote:
>
>     Thanks, Azuryy!
>
>     I found some examples about Pipes. Is Hadoop Pipes still support
>     in Hadoop 2.2?
>
>     Sincerely,
>     Yongan
>
>     On 10/14/2014 11:20 PM, Azuryy Yu wrote:
>>     Hadoop streaming is the best option for you. It doesn't  has high
>>     I/O overhead if you don't add a high I/O in your c++ code.
>>
>>     hadoop streaming use buidin MapReduce, it just redirect input/out
>>     stream for your c++ application.
>>
>>
>>     On Tue, Oct 14, 2014 at 10:33 PM, Y. Z. <zhaoyanswill@gmail.com
>>     <mailto:zhaoyanswill@gmail.com>> wrote:
>>
>>         Hi Experts,
>>
>>         I'm going to to do some computation-intensive operation under
>>         Hadoop framework. I'm wondering which is the best way to code
>>         in C++ under Hadoop framework? I'm aware of three options:
>>         Hadoop Streaming, Hadoop Pipes, and Hadoop C++ Extension. I
>>         heard that Hadoop Pipes has/would be deprecated in Hadoop
>>         2.*. I'm also not sure if Hadoop C++ Extension is still well
>>         maintained. Meanwhile, Hadoop Streaming has high I/O overhead.
>>
>>         What are your opinions? Thanks!
>>
>>         -- 
>>         Sincerely,
>>         Y. Z.
>>
>>
>
>


Mime
View raw message