hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Wagner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4551) Change WebHDFS buffersize behavior to improve default performance
Date Thu, 07 Mar 2013 02:58:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595481#comment-13595481

Mark Wagner commented on HDFS-4551:

I'm not sure what's best, but io.file.buffer.size=64KB is the setting that I first noticed
this on. Although it defaults to 4KB, everything I've seen recommended values from 16KB to
128KB, so I don't think 64KB is an unusual choice.
> Change WebHDFS buffersize behavior to improve default performance
> -----------------------------------------------------------------
>                 Key: HDFS-4551
>                 URL: https://issues.apache.org/jira/browse/HDFS-4551
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: webhdfs
>    Affects Versions: 1.1.2
>            Reporter: Mark Wagner
>            Assignee: Mark Wagner
>         Attachments: HDFS-4551.1.patch
> Currently on 1.X branch, the buffer size used to copy bytes to network defaults to io.file.buffer.size.
This causes performance problems if that buffersize is large.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message