hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2154) Non-interleaved checksums would optimize block transfers.
Date Tue, 29 Jan 2008 22:20:33 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12563695#action_12563695

Raghu Angadi commented on HADOOP-2154:

Rajgopal, I am planning to implement this. Let me know if you have already made progress.
My  approach to to have multiple "checksum chunks" in each DATA_CHUNK as discussed in multiple
comments above.

> Non-interleaved checksums would optimize block transfers.
> ---------------------------------------------------------
>                 Key: HADOOP-2154
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2154
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: dfs
>    Affects Versions: 0.14.0
>            Reporter: Konstantin Shvachko
>            Assignee: Rajagopal Natarajan
> Currently when a block is transfered to a data-node the client interleaves data chunks
with the respective checksums. 
> This requires creating an extra copy of the original data in a new buffer interleaved
with the crcs.
> We can avoid extra copying if the data and the crc are fed to the socket one after another.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message