hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Thomas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10838) Byte array native checksumming
Date Fri, 18 Jul 2014 01:53:31 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065887#comment-14065887
] 

James Thomas commented on HADOOP-10838:
---------------------------------------

Todd, did what you suggested and compared the differences between 512 MB and 1 GB puts to
eliminate the impact of cluster startup/shutdown overheads. We now see a 34% improvement in
CPU cycles and a 5% improvement in wall time.

> Byte array native checksumming
> ------------------------------
>
>                 Key: HADOOP-10838
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10838
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: performance
>            Reporter: James Thomas
>            Assignee: James Thomas
>         Attachments: HADOOP-10838.2.patch, HADOOP-10838.patch, HDFS-3528.patch, HDFS-6560.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message