Mailing-List: contact dev-help@pig.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@pig.apache.org
Date: Tue, 3 Mar 2015 01:19:04 +0000 (UTC)
From: "Chris Nauroth (JIRA)" <jira@apache.org>
To: pig-dev@hadoop.apache.org
Message-ID: <JIRA.12778930.1425345508000.58715.1425345544809@Atlassian.JIRA>
In-Reply-To: <JIRA.12778930.1425345508000@Atlassian.JIRA>
References: <JIRA.12778930.1425345508000@Atlassian.JIRA>
 <JIRA.12778930.1425345508465@arcas>
Subject: [jira] [Created] (PIG-4442) Eliminate redundant RPC call to get
 file information in HPath.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Chris Nauroth created PIG-4442:
----------------------------------

             Summary: Eliminate redundant RPC call to get file information in HPath.
                 Key: PIG-4442
                 URL: https://issues.apache.org/jira/browse/PIG-4442
             Project: Pig
          Issue Type: Improvement
    Affects Versions: 0.13.0
            Reporter: Chris Nauroth
            Assignee: Chris Nauroth
            Priority: Minor


The {{HPath}} class makes 2 separate calls to {{FileSystem#getFileStatus}} to get the block size and replication.  In the case of HDFS, this results in 2 separate but identical RPC transactions with the NameNode.  The situation is the same for many other alternative {{FileSystem}} implementations too.  We can get a minor latency improvement and lighten some RPC load on the remote services by using a single call and getting the block size and replication from the same response.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)