hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: is there a standard way to set a custom FileOutputCommitter?
Date Sun, 08 May 2011 04:41:58 GMT
It is available as part of the JobConf API (Job as well):


On Sun, May 8, 2011 at 9:40 AM, JunYoung Kim <juneng603@gmail.com> wrote:
> Hi,
> I want to set my custom (overried) FileOutputCommitter because it provides the method
named 'rename'.
> This method has a role to move an output dir in temp output to a real output dir.
> but, it checks output file is existed or not before moving it.
> this logic is not proper in my case.
> I want to concatenate it if output file is already existed.
> Is this possible? If it it possible, how could I set it properly?
> thanks.

Harsh J

View raw message