hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Juan Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation
Date Thu, 26 May 2016 00:01:21 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Juan Yu updated HDFS-10466:
    Attachment: HDFS-10466.patch

> DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of
> --------------------------------------------------------------------------------------------------
>                 Key: HDFS-10466
>                 URL: https://issues.apache.org/jira/browse/HDFS-10466
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs
>            Reporter: Juan Yu
>            Assignee: Juan Yu
>            Priority: Minor
>         Attachments: HDFS-10466.patch
> https://issues.apache.org/jira/browse/HDFS-202 added a new API listLocatedStatus() to
get all files' status with block locations for a directory. This is great that we don't need
to call FileSystem.getFileBlockLocations() for each file. it's much faster (about 8-10 times).
> However, the returned LocatedFileStatus only contains basic BlockLocation instead of
HdfsBlockLocation, the LocatedBlock details are stripped out.
> It should do the similar as DFSClient.getBlockLocations(), return HdfsBlockLocation which
provide full block location details.
> The implementation of DistributedFileSystem. listLocatedStatus() retrieves HdfsLocatedFileStatus
which contains all information, but when convert it to LocatedFileStatus, it doesn't keep
LocatedBlock data. It's a simple (and compatible) change to make to keep the LocatedBlock

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message