hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2154) Non-interleaved checksums would optimize block transfers.
Date Tue, 06 Nov 2007 01:54:50 GMT
Non-interleaved checksums would optimize block transfers.
---------------------------------------------------------

                 Key: HADOOP-2154
                 URL: https://issues.apache.org/jira/browse/HADOOP-2154
             Project: Hadoop
          Issue Type: Improvement
          Components: dfs
    Affects Versions: 0.14.0
            Reporter: Konstantin Shvachko
             Fix For: 0.16.0


Currently when a block is transfered to a data-node the client interleaves data chunks with
the respective checksums. 
This requires creating an extra copy of the original data in a new buffer interleaved with
the crcs.
We can avoid extra copying if the data and the crc are fed to the socket one after another.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message