hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10339) Set io.sort.mb to 10 for distcp jobs
Date Wed, 12 Feb 2014 22:56:22 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13899719#comment-13899719
] 

Sandy Ryza commented on HADOOP-10339:
-------------------------------------

Right

> Set io.sort.mb to 10 for distcp jobs
> ------------------------------------
>
>                 Key: HADOOP-10339
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10339
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Siqi Li
>         Attachments: HADOOP-10339.v1.patch
>
>
> For distcp we don't emit anything, it's a map-only job with no output (just side-effects).
> In that case we can set io.sort.mb to 10.
> This way we don't waste the default memory in a buffer that is not needed.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message