hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Botelho, Andrew" <Andrew.Bote...@emc.com>
Subject RE: Make job output be a comma separated file
Date Thu, 18 Jul 2013 18:02:05 GMT
I believe that mapred.textoutputformat.separator is from the old API, but now the field is
mapreduce.output.textoutputformat.separator in the new API.
So I ran this code in my driver class, but it is making no difference:

Configuration conf = new Configuration();
conf.set("mapreduce.output.textoutputformat.separator", ",");

Am I changing the field right?


From: Ravi Kiran [mailto:ravikiranmagham@gmail.com]
Sent: Thursday, July 18, 2013 1:45 PM
To: user@hadoop.apache.org
Subject: Re: Make job output be a comma separated file

Hi Andrew,

    You can pass change the default keyValueSeparator of the output format from a "\t" to
a "," by
setting the following property mapred.textoutputformat.separator to Configuration of the job.

   You will face difficulties if this output is an input to another job as you wouldn't know
what part of the row data is a key and what is the value.

Ravi M.

On Thu, Jul 18, 2013 at 10:46 PM, Botelho, Andrew <Andrew.Botelho@emc.com<mailto:Andrew.Botelho@emc.com>>
What is the best way to make the output of my Hadoop job be comma separated?  Basically, how
can I have the keys and values be separated by a comma?
My keys are Text objects, and some of them have actual commas within the field.  Will this



View raw message