hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prakhar Sharma <prakhar.sha...@gmail.com>
Subject Re: writing files to HDFS (from c++/pipes)
Date Mon, 07 Dec 2009 18:44:03 GMT
Hi Horson,
Quite unfortunately, there is no documentation available for PIpes
API. Its not just that, the API itself is quite weak and unstable.
Only few examples given in PIpes distro work. And it appears there are
very few ppl who use Hadoop Map/Reduce through the PIpes API. I have
myself been hacking my way around the Pipes API for quite some time
now and I guess that's the only way around it.


On Mon, Dec 7, 2009 at 1:38 PM, horson <Too-much-extreme@gmx.de> wrote:
> Hi,
> i want to write a file to hdfs, using hadoop pipes. can anyone tell me how
> to do that?
> Im using an external library that writes its output to disk, so probably i
> have to read that output and write it to the distributed filesystem?
> I found only FSDataOutputStream, a java class.
> Can anyone help?
> Moreover, can anyone tell me where i can find goot documentation about
> hadoop pipes? Nearly everything i find is java specific or general
> information about MapReduce. I looked at the hadoop pipes source and it
> looked very restricted, can i do everything in hadoop pipes that possible in
> java?
> Thank for your help
> horson
> --
> View this message in context: http://old.nabble.com/writing-files-to-HDFS-%28from-c%2B%2B-pipes%29-tp26681351p26681351.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.

View raw message