hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2705) io.file.buffer.size should default to a value larger than 4k
Date Fri, 25 Jan 2008 23:22:34 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562757#action_12562757
] 

Doug Cutting commented on HADOOP-2705:
--------------------------------------

I think it is too late in the 0.16 cycle for this change.  We should make it in 0.17, since
it is not a bug fix, but a potentially incompatible, minor performance enhancement.  In my
original comment, above, I did not notice that it was targetted at 0.16.0.  I should have
commented then.  Sorry!

> io.file.buffer.size should default to a value larger than 4k
> ------------------------------------------------------------
>
>                 Key: HADOOP-2705
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2705
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: conf
>            Reporter: Chris Douglas
>            Assignee: Chris Douglas
>            Priority: Minor
>             Fix For: 0.16.0
>
>         Attachments: 2705-0.patch
>
>
> Tests using HADOOP-2406 suggest that increasing this to 32k from 4k improves read times
for block, lzo compressed SequenceFiles by over 40%; 32k is a relatively conservative bump.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message