hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2154) Non-interleaved checksums would optimize block transfers.
Date Tue, 06 Nov 2007 01:54:50 GMT
Non-interleaved checksums would optimize block transfers.

                 Key: HADOOP-2154
                 URL: https://issues.apache.org/jira/browse/HADOOP-2154
             Project: Hadoop
          Issue Type: Improvement
          Components: dfs
    Affects Versions: 0.14.0
            Reporter: Konstantin Shvachko
             Fix For: 0.16.0

Currently when a block is transfered to a data-node the client interleaves data chunks with
the respective checksums. 
This requires creating an extra copy of the original data in a new buffer interleaved with
the crcs.
We can avoid extra copying if the data and the crc are fed to the socket one after another.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message