hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: using distcp v2 on mapreduce V1?
Date Mon, 12 May 2014 04:11:05 GMT
Have you looked at MAPREDUCE-5081. Backport DistCpV2 ?

Cheers


On Wed, May 7, 2014 at 5:46 PM, Tianying Chang <tychang@gmail.com> wrote:

> Hi,
>
> I am trying to use the throttle feature of distcp V2. But we are not using
> YARN, we are using cdh4.2, which is MapReduce V1.  I replaced the
> hadoop-tool.jar to point to hadoop-distcp-2.0.3-alpha.jar. But it seems
> still complain about NoSuchMethodError.
>
> Anyone know if we can use distcp v2 without upgrading to YARN?
>
> Thanks
> Tian-Ying
>
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(Lorg/apache/hadoop/mapreduce/Cluster;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/Path;
>
> at org.apache.hadoop.tools.DistCp.createMetaFolderPath(DistCp.java:352)
>
> at org.apache.hadoop.tools.DistCp.execute(DistCp.java:146)
>
> at org.apache.hadoop.tools.DistCp.run(DistCp.java:118)
>
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>
> at org.apache.hadoop.tools.DistCp.main(DistCp.java:374)
>

Mime
View raw message