hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11203) Allow ditscp to accept bandwitdh in fraction MegaBytes
Date Fri, 26 Jun 2015 12:00:06 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602758#comment-14602758
] 

Hudson commented on HADOOP-11203:
---------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #970 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/970/])
HADOOP-11203. Allow ditscp to accept bandwitdh in fraction MegaBytes. Contributed by Raju
Bairishetti (amareshwari: rev 8ef07f767f0421b006b0fc77e5daf36c7b06abf1)
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/ThrottledInputStream.java
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/RetriableFileCopyCommand.java
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/OptionsParser.java
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpConstants.java
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptions.java
* hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java
* hadoop-common-project/hadoop-common/CHANGES.txt
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java


> Allow ditscp to accept bandwitdh in fraction MegaBytes
> ------------------------------------------------------
>
>                 Key: HADOOP-11203
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11203
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Raju Bairishetti
>            Assignee: Raju Bairishetti
>             Fix For: 3.0.0
>
>         Attachments: HADOOP-11203.001.patch, HADOOP-11203.patch
>
>
> DistCp uses ThrottleInputStream, which  provides a bandwidth throttling on a specified
stream. Currently, Distcp allows the max bandwidth value in Mega Bytes, which does not accept
fractional values. It would be better if it accepts the Max Bandwitdh in fractional MegaBytes.
> Due to this we are not able to throttle the bandwidth in KBs in our prod setup.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message