hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-284) Interleaving CRC for ChunksData
Date Mon, 23 Jul 2018 17:18:00 GMT
Bharat Viswanadham created HDDS-284:
---------------------------------------

             Summary: Interleaving CRC for ChunksData
                 Key: HDDS-284
                 URL: https://issues.apache.org/jira/browse/HDDS-284
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
            Reporter: Bharat Viswanadham
            Assignee: Shashikant Banerjee


This Jira is to add CRC for chunks data.

Right now, in chunkInfo, data is just byte array. We want to change this as below:

_message Data {_

_required string magic =”Tullys00” = 1;_

 _required CRCTYPE crcType =_ _2__;_

_optional String LegacyMetadata = 3; // Fields to support inplace data migration_

_optional String LegacyData = 4;_

_optional ushort ChecksumblockSize = 5; // Size of the block used to compute the checksums_

_repeated uint32 checksums = 6 ; // Set of Checksums_ 

*_repeated byte data = 6;_*  _// Actual Data stream_

 

_}_

 

_This will help in error detection for containers during container scanner._

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message