Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 3743 invoked from network); 28 May 2010 18:49:02 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 28 May 2010 18:49:02 -0000 Received: (qmail 464 invoked by uid 500); 28 May 2010 18:49:02 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 418 invoked by uid 500); 28 May 2010 18:49:02 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 410 invoked by uid 99); 28 May 2010 18:49:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 May 2010 18:49:02 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 May 2010 18:49:00 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o4SImdV5012287 for ; Fri, 28 May 2010 18:48:39 GMT Message-ID: <22428258.56131275072519026.JavaMail.jira@thor> Date: Fri, 28 May 2010 14:48:39 -0400 (EDT) From: "Scott Chen (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Created: (MAPREDUCE-1823) Reduce the number of calls of HarFileSystem.getFileStatus in RaidNode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Reduce the number of calls of HarFileSystem.getFileStatus in RaidNode --------------------------------------------------------------------- Key: MAPREDUCE-1823 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1823 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 RaidNode makes lots of calls of HarFileSystem.getFileStatus. This method fetches information from DataNode so it is slow. It becomes the bottleneck of the RaidNode. It will be nice if we can make this more efficient. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.