hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-962) Make DFSOutputStream MAX_PACKETS configurable
Date Sat, 03 Sep 2011 06:57:15 GMT

    [ https://issues.apache.org/jira/browse/HDFS-962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13096600#comment-13096600
] 

Tsz Wo (Nicholas), SZE commented on HDFS-962:
---------------------------------------------

The new patch looks good.  Could you try to see if you can add a new test?

> Make DFSOutputStream MAX_PACKETS configurable
> ---------------------------------------------
>
>                 Key: HDFS-962
>                 URL: https://issues.apache.org/jira/browse/HDFS-962
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs client
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>            Assignee: Justin Joseph
>            Priority: Minor
>         Attachments: HDFS-962.1.patch, HDFS-962.patch
>
>
> HDFS-959 suggests that the MAX_PACKETS variable (which determines how many outstanding
data packets the DFSOutputStream will permit) may have an impact on performance. If so, we
should make it configurable to trade off between memory and performance. I think it ought
to be a secret/undocumented config for now - this will make it easier to benchmark without
confusing users.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message