hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients
Date Mon, 26 Jun 2017 18:17:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Andrew Wang updated HDFS-11956:
    Release Note: Hadoop 2.x clients do not pass the storage ID or target storage IDs when
writing a block. For backwards compatibility, the DataNode will not require the presence of
these fields. This means older clients are unable to write to a particular storage as chosen
by the NameNode (e.g. HDFS-9806).  (was: Introduce dfs.block.access.token.storageid.enable
which will be false by default. When it's turned on, the BlockTokenSecretManager.checkAccess
will consider the storage ID when verifying the request. This allows for backwards compatibility
all the way back to 2.6.x.)

> Fix BlockToken compatibility with Hadoop 2.x clients
> ----------------------------------------------------
>                 Key: HDFS-11956
>                 URL: https://issues.apache.org/jira/browse/HDFS-11956
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 3.0.0-alpha4
>            Reporter: Andrew Wang
>            Assignee: Ewan Higgs
>            Priority: Blocker
>         Attachments: HDFS-11956.001.patch, HDFS-11956.002.patch, HDFS-11956.003.patch,
> Seems like HDFS-9807 broke backwards compatibility with Hadoop 2.x clients. When talking
to a 3.0.0-alpha4 DN with security on:
> {noformat}
> 2017-06-06 23:27:22,568 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Block token
verification failed: op=WRITE_BLOCK, remoteAddress=/, message=Block token
with StorageIDs [DS-c0f24154-a39b-4941-93cd-5b8323067ba2] not valid for access with StorageIDs
> {noformat}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message