hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12172) Reduce EZ lookup overhead
Date Fri, 04 Aug 2017 23:52:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Xiao Chen updated HDFS-12172:
    Attachment: HDFS-12172.01.patch

To keep this rolling, I went ahead and made my suggested fixes on top of the patch, and rebased
to latest trunk. Minor conflict due to HDFS-12171, which is also a Daryn patch.

> Reduce EZ lookup overhead
> -------------------------
>                 Key: HDFS-12172
>                 URL: https://issues.apache.org/jira/browse/HDFS-12172
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 2.7.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>         Attachments: HDFS-12172.01.patch, HDFS-12172.patch
> A number of inefficiencies exist in EZ lookups.  These are amplified by frequent operations
like list status.  Once one encryption zone exists, all operations take the performance penalty.
> Ex. Operations should not perform redundant lookups.  EZ path reconstruction should be
lazy since it's not required in the common case.  Renames do not need to reallocate new IIPs
to check parent dirs for EZ.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message