Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 5346 invoked from network); 17 Jan 2009 00:50:27 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 17 Jan 2009 00:50:27 -0000 Received: (qmail 58721 invoked by uid 500); 17 Jan 2009 00:50:20 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 58680 invoked by uid 500); 17 Jan 2009 00:50:20 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 58658 invoked by uid 99); 17 Jan 2009 00:50:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Jan 2009 16:50:20 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 17 Jan 2009 00:50:19 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 9536F234C48D for ; Fri, 16 Jan 2009 16:49:59 -0800 (PST) Message-ID: <249336048.1232153399610.JavaMail.jira@brutus> Date: Fri, 16 Jan 2009 16:49:59 -0800 (PST) From: "Hemanth Yamijala (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Resolved: (HADOOP-5022) [HOD] logcondense should delete all hod logs for a user, including jobtracker logs In-Reply-To: <516268182.1231868401665.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Yamijala resolved HADOOP-5022. -------------------------------------- Resolution: Fixed Fix Version/s: (was: 0.18.3) 0.21.0 Hadoop Flags: [Incompatible change, Reviewed] I just committed this to trunk. Thanks, Peeyush ! > [HOD] logcondense should delete all hod logs for a user, including jobtracker logs > ---------------------------------------------------------------------------------- > > Key: HADOOP-5022 > URL: https://issues.apache.org/jira/browse/HADOOP-5022 > Project: Hadoop Core > Issue Type: Bug > Components: contrib/hod > Reporter: Hemanth Yamijala > Assignee: Peeyush Bishnoi > Priority: Blocker > Fix For: 0.21.0 > > Attachments: hadoop-5022-1.txt, hadoop-5022-2.txt, hadoop-5022-3.txt, hadoop-5022.txt > > > Currently, logcondense.py does not delete jobtracker logs that it uploads to the DFS when the HOD cluster is deallocated. This will result in the hod-logs directory to slowly accumulate a whole bunch of jobtracker logs. Particularly for users who run a lot of user jobs, this could fill up the namespace. Further these directories will cause the logcondense program to keep repeatedly looking at these directories stressing out the namenode. So, logcondense.py should optionally also delete the jobtracker logs. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.