hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-284) Interleaving CRC for ChunksData
Date Mon, 23 Jul 2018 17:18:00 GMT
Bharat Viswanadham created HDDS-284:

             Summary: Interleaving CRC for ChunksData
                 Key: HDDS-284
                 URL: https://issues.apache.org/jira/browse/HDDS-284
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
            Reporter: Bharat Viswanadham
            Assignee: Shashikant Banerjee

This Jira is to add CRC for chunks data.

Right now, in chunkInfo, data is just byte array. We want to change this as below:

_message Data {_

_required string magic =”Tullys00” = 1;_

 _required CRCTYPE crcType =_ _2__;_

_optional String LegacyMetadata = 3; // Fields to support inplace data migration_

_optional String LegacyData = 4;_

_optional ushort ChecksumblockSize = 5; // Size of the block used to compute the checksums_

_repeated uint32 checksums = 6 ; // Set of Checksums_ 

*_repeated byte data = 6;_*  _// Actual Data stream_




_This will help in error detection for containers during container scanner._


This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message