hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yong Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8598) Add and optimize for get LocatedFileStatus in DFSClient
Date Tue, 30 Jun 2015 01:24:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606798#comment-14606798

Yong Zhang commented on HDFS-8598:

Hi [~andrew.wang], thanks for your comment, I will close it.

> Add and optimize for get LocatedFileStatus  in DFSClient
> --------------------------------------------------------
>                 Key: HDFS-8598
>                 URL: https://issues.apache.org/jira/browse/HDFS-8598
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Yong Zhang
>            Assignee: Yong Zhang
>         Attachments: HDFS-8598.001.patch, HDFS-8598.002.patch
> If we want to get all files block locations in one directory, we have to call getFileBlockLocations
for each file, it will take long time because of too many request. 
> LocatedFileStatus has block location, but we can find it also call getFileBlockLocations
 for each file in DFSClient. this jira is trying to optimize with only one RPC. 

This message was sent by Atlassian JIRA

View raw message