hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data
Date Sat, 11 Jul 2015 00:16:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623112#comment-14623112
] 

Jing Zhao commented on HDFS-8744:
---------------------------------

But I think this is the format of the current packet:
{code}
  /**
   * buf is pointed into like follows:
   *  (C is checksum data, D is payload data)
   *
   * [_________CCCCCCCCC________________DDDDDDDDDDDDDDDD___]
   *           ^        ^               ^               ^
   *           |        checksumPos     dataStart       dataPos
   *           checksumStart
   *
   * Right before sending, we move the checksum data to immediately precede
   * the actual data, and then insert the header into the buffer immediately
   * preceding the checksum data, so we make sure to keep enough space in
   * front of the checksum data to support the largest conceivable header.
   */
{code}

> Erasure Coding: the number of chunks in packet is not updated when writing parity data
> --------------------------------------------------------------------------------------
>
>                 Key: HDFS-8744
>                 URL: https://issues.apache.org/jira/browse/HDFS-8744
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: HDFS-8744-HDFS-7285-001.patch, HDFS-8744-HDFS-7285-002.patch
>
>
> The member {{numChunks}} in {{DFSPacket}} is always zero if this packet contains parity
data. The calling of {{getNumChunks}} may  cause potential errors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message