hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: is there a standard way to set a custom FileOutputCommitter?
Date Sun, 08 May 2011 04:41:58 GMT
It is available as part of the JobConf API (Job as well):

http://hadoop.apache.org/common/docs/r0.20.0/api/org/apache/hadoop/mapred/JobConf.html#setOutputCommitter(java.lang.Class)

On Sun, May 8, 2011 at 9:40 AM, JunYoung Kim <juneng603@gmail.com> wrote:
> Hi,
>
> I want to set my custom (overried) FileOutputCommitter because it provides the method
named 'rename'.
> This method has a role to move an output dir in temp output to a real output dir.
>
> but, it checks output file is existed or not before moving it.
> this logic is not proper in my case.
>
> I want to concatenate it if output file is already existed.
>
> Is this possible? If it it possible, how could I set it properly?
>
> thanks.



-- 
Harsh J

Mime
View raw message