hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ewan Higgs (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks
Date Wed, 28 Mar 2018 23:22:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418235#comment-16418235
] 

Ewan Higgs commented on HDFS-13310:
-----------------------------------

Submitting an updated patch (002) that adds offset and length to the MULTIPART_PUT_PART command.
This is so the blocks in HDFS don't need to be tied 1-1 to the parts being written to the
backing store.

There is only 1 offset and 1 length despite taking a list of LocatedBlocks because we assume
the part is contiguous.

> [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks
> -----------------------------------------------------------------------
>
>                 Key: HDFS-13310
>                 URL: https://issues.apache.org/jira/browse/HDFS-13310
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Ewan Higgs
>            Assignee: Ewan Higgs
>            Priority: Major
>         Attachments: HDFS-13310-HDFS-12090.001.patch, HDFS-13310-HDFS-12090.002.patch
>
>
> As part of HDFS-12090, Datanodes should be able to receive DatanodeCommands in the heartbeat
response that instructs it to backup a block.
> This should take the form of two sub commands: PUT_FILE (when the file is <=1 block
in size) and MULTIPART_PUT_PART when part of a Multipart Upload (see HDFS-13186).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message