hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5448) Datanode should generate its ID on first registration
Date Tue, 05 Nov 2013 01:14:19 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813511#comment-13813511

Arpit Agarwal commented on HDFS-5448:

storageID was generated by the NameNode in {{DatanodeManager#registerDatanode}}

>From trunk
      // this is a new datanode serving a new data storage
      if ("".equals(nodeReg.getStorageID())) {
        // this data storage has never been registered
        // it is either empty or was created by pre-storageID version of DFS

> Datanode should generate its ID on first registration
> -----------------------------------------------------
>                 Key: HDFS-5448
>                 URL: https://issues.apache.org/jira/browse/HDFS-5448
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: Heterogeneous Storage (HDFS-2832)
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: Heterogeneous Storage (HDFS-2832)
>         Attachments: h5448.01.patch, h5448.03.patch, h5448.04.addendum.patch, h5448.04.patch
> Prior to the heterogeneous storage feature, each Datanode had a single storage ID which
was generated by the Namenode on first registration. The storage ID used fixed Datanode identifiers
like IP address and port, so that in a federated cluster, for example, all NameNodes would
generate the same storage ID.
> With Heterogeneous storage, we have replaced the storage ID with a per-datanode identifier
called the Datanode-UUID. The Datanode UUID is also assigned by a NameNode on first registration.
In a federated cluster with multiple namenodes, there are two ways to ensure a unique Datanode
UUID allocation:
> # Synchronize initial registration requests from the BPServiceActors. If a Datanode UUID
is already assigned we don't need to synchronize.
> # The datanode assigns itself a UUID on initialization.

This message was sent by Atlassian JIRA

View raw message