hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12882) Support full open(PathHandle) contract in HDFS
Date Sun, 03 Dec 2017 22:15:01 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Douglas updated HDFS-12882:
    Attachment: HDFS-12882.00.patch

First pass of the implementation. This enables and extends the contract tests added in HDFS-7878.
It does the constraint enforcement on the client by checking {{HdfsFileStatus}} metadata saved
in the {{PathHandle}} against the status returned by NN.

The patch adds {{DFSClient::open(HdfsPathHandle, ...)}} that uses an extended {{getFileInfo}}
call requesting block locations in the response, rather than calling {{getBlockLocations}}.
Most of the changes are plumbing the {{needLocation}} flag through the NN and through the
unit tests. By including an overloads, as in {{NameNodeAdapter::getFileInfo}}, the patch could
be smaller, but that doesn't seem consistent with the intent of the class.

Before commit, this needs to verify that the audit log is still correct i.e., that calls to
{{open}} are not logged as {{getFileStatus}} calls.

> Support full open(PathHandle) contract in HDFS
> ----------------------------------------------
>                 Key: HDFS-12882
>                 URL: https://issues.apache.org/jira/browse/HDFS-12882
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>            Reporter: Chris Douglas
>            Assignee: Chris Douglas
>         Attachments: HDFS-12882.00.patch
> HDFS-7878 added support for {{open(PathHandle)}}, but it only partially implemented the
semantics specified in the contract (i.e., open-by-inodeID). HDFS should implement all permutations
of the default options for {{PathHandle}}.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message