hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Regarding Hadoop Log Retention for Hadoop 0.20.2
Date Wed, 07 Dec 2011 08:58:44 GMT
Sahana,

IIRC, "mapred.userlog.retain.hours" (24h default) controls this in my
environment and it seems to work fine on my cluster. Are you sure you
have tasklogs older than 24h lying around? It might even be a bug that
may have been fixed in the subsequent 0.20 releases that went out
recently.

On Wed, Dec 7, 2011 at 1:53 PM, Sahana Bhat <sana.bhat@gmail.com> wrote:
> Hi,
>
>         We use Hadoop 0.20.2 version.The log4j.properties file has a
> property hadoop.tasklog.logsRetainHours (mentioned as 24 hours by
> default) which we have set to 12.Despite this property being set we still
> have old userlogs in the system.Any idea why the attempt directories (that
> have the syserr/sysout files) have not been cleaned up? Are we missing any
> other configuration?
>
> Any help on this topic would be great.
>
> Regards,
> Sahana



-- 
Harsh J

Mime
View raw message