hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6166) Improve PureJavaCrc32
Date Wed, 19 Aug 2009 16:15:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745100#action_12745100

Todd Lipcon commented on HADOOP-6166:

Personally, I'm satisfied at this point :) But, if others feel like squeezing that last ounce
out, I'm happy to rerun the tests when you have some new candidates. Just let me know.

Regarding the importance of the different sizes, I think the next step is to instrument the
CRC32 to log every invocation to a file and run some single-node wordcounts or something.
With a histogram of the results it should be easy to see whether the small-buffer case matters
at all in real scenarios.

> Improve PureJavaCrc32
> ---------------------
>                 Key: HADOOP-6166
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6166
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: util
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: c6166_20090722.patch, c6166_20090722_benchmark_32VM.txt, c6166_20090722_benchmark_64VM.txt,
c6166_20090727.patch, c6166_20090728.patch, c6166_20090810.patch, c6166_20090811.patch, graph.r,
graph.r, Rplots-laptop.pdf, Rplots-nehalem32.pdf, Rplots-nehalem64.pdf, Rplots.pdf, Rplots.pdf,
> Got some ideas to improve CRC32 calculation.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message