hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yong Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8598) Add and optimize for get LocatedFileStatus in DFSClient
Date Thu, 18 Jun 2015 04:22:02 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Yong Zhang updated HDFS-8598:
    Attachment: HDFS-8598.001.patch

initial patch

> Add and optimize for get LocatedFileStatus  in DFSClient
> --------------------------------------------------------
>                 Key: HDFS-8598
>                 URL: https://issues.apache.org/jira/browse/HDFS-8598
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Yong Zhang
>            Assignee: Yong Zhang
>         Attachments: HDFS-8598.001.patch
> If we want to get all files block locations in one directory, we have to call getFileBlockLocations
for each file, it will take long time because of too many request. 
> LocatedFileStatus has block location, but we can find it also call getFileBlockLocations
 for each file in DFSClient. this jira is trying to optimize with only one RPC. 

This message was sent by Atlassian JIRA

View raw message