avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John Mcgibbney <lewis.mcgibb...@gmail.com>
Subject Re: How to write a "custom" file name in the Hadoop's MapReduce with Avro format
Date Thu, 20 Mar 2014 02:39:24 GMT

This is a rather troublesome email with lots of unnecessary material
included. I think you may get more help if you try and refine your

On Tue, Mar 18, 2014 at 1:27 AM, Phan, Truong Q <
Troung.Phan@team.telstra.com> wrote:

> Questions:
> 1)      Can I control the filename

> and location to put our Avro's files in the HDFS?

Yes. FileOutputFormat defines a #setOutputPath method which enables you to
define the location the file is written to. You can use this through

> 2)      The Hadoop's MapReduce Streaming project has a MapDebug (-mapdebug)
> and ReduceDebug (-reducedebug) options but I can't get any debug message
> for my Map's debug

Please go to Hadoop lists for this.
hope this helps a bit

View raw message