hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-5022) [HOD] logcondense should delete all hod logs for a user, including jobtracker logs
Date Sat, 17 Jan 2009 00:49:59 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Hemanth Yamijala resolved HADOOP-5022.

       Resolution: Fixed
    Fix Version/s:     (was: 0.18.3)
     Hadoop Flags: [Incompatible change, Reviewed]

I just committed this to trunk. Thanks, Peeyush !

> [HOD] logcondense should delete all hod logs for a user, including jobtracker logs
> ----------------------------------------------------------------------------------
>                 Key: HADOOP-5022
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5022
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>            Reporter: Hemanth Yamijala
>            Assignee: Peeyush Bishnoi
>            Priority: Blocker
>             Fix For: 0.21.0
>         Attachments: hadoop-5022-1.txt, hadoop-5022-2.txt, hadoop-5022-3.txt, hadoop-5022.txt
> Currently, logcondense.py does not delete jobtracker logs that it uploads to the DFS
when the HOD cluster is deallocated. This will result in the hod-logs directory to slowly
accumulate a whole bunch of jobtracker logs. Particularly for users who run a lot of user
jobs, this could fill up the namespace.  Further these directories will cause the logcondense
program to keep repeatedly looking at these directories stressing out the namenode. So, logcondense.py
should optionally also delete the jobtracker logs.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message