hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-284) Interleaving CRC for ChunksData
Date Mon, 23 Jul 2018 17:19:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553137#comment-16553137
] 

Bharat Viswanadham commented on HDDS-284:
-----------------------------------------

Attached the design document from [~anu] for reference.

> Interleaving CRC for ChunksData
> -------------------------------
>
>                 Key: HDDS-284
>                 URL: https://issues.apache.org/jira/browse/HDDS-284
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>            Reporter: Bharat Viswanadham
>            Assignee: Shashikant Banerjee
>            Priority: Major
>         Attachments: Interleaving CRC and Error Detection for Containers.pdf
>
>
> This Jira is to add CRC for chunks data.
> Right now, in chunkInfo, data is just byte array. We want to change this as below:
> _message Data {_
> _required string magic =”Tullys00” = 1;_
>  _required CRCTYPE crcType =_ _2__;_
> _optional String LegacyMetadata = 3; // Fields to support inplace data migration_
> _optional String LegacyData = 4;_
> _optional ushort ChecksumblockSize = 5; // Size of the block used to compute the checksums_
> _repeated uint32 checksums = 6 ; // Set of Checksums_ 
> *_repeated byte data = 6;_*  _// Actual Data stream_
>  
> _}_
>  
> _This will help in error detection for containers during container scanner._
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message