Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CEEA31098C for ; Sat, 26 Oct 2013 01:22:31 +0000 (UTC) Received: (qmail 39436 invoked by uid 500); 26 Oct 2013 01:22:31 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 39391 invoked by uid 500); 26 Oct 2013 01:22:31 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 39383 invoked by uid 99); 26 Oct 2013 01:22:31 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Oct 2013 01:22:31 +0000 Date: Sat, 26 Oct 2013 01:22:31 +0000 (UTC) From: "Robert Kanter (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (MAPREDUCE-4680) Job history cleaner should only check timestamps of files in old enough directories MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4680: ------------------------------------- Attachment: MAPREDUCE-4680.patch Uploading same patch to kick off the build again. The test failed because something was already using port 10020; I think the actual test is fine (it works on my computer). > Job history cleaner should only check timestamps of files in old enough directories > ----------------------------------------------------------------------------------- > > Key: MAPREDUCE-4680 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4680 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: jobhistoryserver > Affects Versions: 2.0.0-alpha > Reporter: Sandy Ryza > Assignee: Robert Kanter > Attachments: MAPREDUCE-4680.patch, MAPREDUCE-4680.patch, MAPREDUCE-4680.patch, MAPREDUCE-4680.patch, MAPREDUCE-4680.patch > > > Job history files are stored in yyyy/mm/dd folders. Currently, the job history cleaner checks the modification date of each file in every one of these folders to see whether it's past the maximum age. The load on HDFS could be reduced by only checking the ages of files in directories that are old enough, as determined by their name. -- This message was sent by Atlassian JIRA (v6.1#6144)