hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-653) distcp can support bandwidth limiting
Date Mon, 08 Mar 2010 05:41:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12842549#action_12842549

Ravi Gummadi commented on MAPREDUCE-653:

Current proposal does not impose restriction on the number of slots(number of maps) used by
distcp job based on the bandwidth limit provided by user.
 Each map task tries to adjust the bandwidth usage of the whole job by adjusting its own bandwidth
usage by sleeping for calculated amount of time(this sleep time is calculated based on the
current bandwidth usage by this map task and the bandwidth limit specified by user and the
number of currently running map tasks in this distcp job).

> distcp can support bandwidth limiting
> -------------------------------------
>                 Key: MAPREDUCE-653
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-653
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: distcp
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>         Attachments: d_bw.patch, d_bw.v1.patch, d_bw.v2.patch
> distcp should support an option for user to specify the bandwidth limit for the distcp

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message