hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2521) Remove custom checksum headers from data transfer protocol
Date Tue, 01 Nov 2011 01:03:32 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140752#comment-13140752

Todd Lipcon commented on HDFS-2521:

Failed tests seem unrelated - TestHDFSCLI has been failing a long time. The other two fail
with a "locked namedir" error right after the Avro test timed out (assumedly leaving a namedir

I will commit this tonight or tomorrow unless there is any other comment.
> Remove custom checksum headers from data transfer protocol
> ----------------------------------------------------------
>                 Key: HDFS-2521
>                 URL: https://issues.apache.org/jira/browse/HDFS-2521
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node, hdfs client
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hdfs-2521-on-2512.txt, hdfs-2521.txt
> Most of the data transfer protocol has been converted over to protobufs, but we still
send the checksum header with ad-hoc serialization in a few places. This is self-inconsistent
and also makes wire protocol compatibility more difficult. This JIRA does the following:
> - introduce a new protobuf message to describe a checksum
> - include the "requested checksum" with the block operation (instead of coming separately
after it)
> - include the "required checksum" with the block operation response, for write operations
(instead of coming first in the BlockSender stream)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message