hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11812) Implement listLocatedStatus for ViewFileSystem to speed up split calculation
Date Mon, 20 Apr 2015 18:45:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503395#comment-14503395
] 

Chris Nauroth commented on HADOOP-11812:
----------------------------------------

[~jira.shegalov], thanks for adding the new test in v005.  It looks good.  However, comparing
to v004, it also looks like Laurent's earlier feedback on the {{fixFileStatus}} method got
dropped.  Was that intentional?

> Implement listLocatedStatus for ViewFileSystem to speed up split calculation
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-11812
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11812
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 2.7.0
>            Reporter: Gera Shegalov
>            Assignee: Gera Shegalov
>            Priority: Blocker
>              Labels: performance
>         Attachments: HADOOP-11812.001.patch, HADOOP-11812.002.patch, HADOOP-11812.003.patch,
HADOOP-11812.004.patch, HADOOP-11812.005.patch
>
>
> ViewFileSystem is currently not taking advantage of MAPREDUCE-1981. This causes several
x of RPC overhead and added latency.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message