Return-Path: 
 <user-return-15293-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1734C11A95
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Sun, 11 May 2014 06:13:52 +0000 (UTC)
Received: (qmail 25286 invoked by uid 500); 10 May 2014 23:28:11 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 61725 invoked by uid 500); 10 May 2014 23:16:09 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 45239 invoked by uid 99); 10 May 2014 22:59:12 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 May 2014 22:59:12 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of tychang@gmail.com designates
 209.85.213.41 as permitted sender)
Received: from [209.85.213.41] (HELO mail-yh0-f41.google.com) (209.85.213.41)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 May 2014 00:46:50 +0000
Received: by mail-yh0-f41.google.com with SMTP id f73so1706377yha.28
        for <user@hadoop.apache.org>; Wed, 07 May 2014 17:46:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=G72Wz51ftm1gcCaMSXsLju2DLKQzfEbfB7FvA4A9jNU=;
        b=J3HTwEUq2r/ijgGyyknfq/IB2bXuAd6rxel16NPqlTFO+W1jH2f1jOO6cNo+ukS99y
         LijRk7M5rvnsRfe8gQO4q6dDDF+QoWXeZCCInmTnqNuVNmGVATYE7dWMOB/CmihaMCBC
         Kz2S0VPewxG2p2yrosn1ohz8NWTv7sma2OGsh/RaAQXxQh+Jh1bt00ZToJYed4WlqpfX
         HY4MeSgzXsEAIHOC/fdOxIxn6VT/ElJNFY7/SuMl+9OtUeY0mzMe0Wlt7jLf/6zrG9hx
         05INCXQqaqFngvLuoF/plCJMtuqv5QRfTTaA/Z8Pa3p8H1XY3Gwu5gtyfJppT7VaxL97
         c2+w==
MIME-Version: 1.0
X-Received: by 10.236.91.170 with SMTP id h30mr321803yhf.143.1399509989759;
 Wed, 07 May 2014 17:46:29 -0700 (PDT)
Received: by 10.170.166.67 with HTTP; Wed, 7 May 2014 17:46:29 -0700 (PDT)
Date: Wed, 7 May 2014 17:46:29 -0700
Message-ID: 
 <CAHpPDZ5g8X61NTu8VawH2-ckC02H5kaJwrU=_RGQv+yccuM59Q@mail.gmail.com>
Subject: using distcp v2 on mapreduce V1?
From: Tianying Chang <tychang@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf3011ddf9cc9f0504f8d8cf8e
X-Virus-Checked: Checked by ClamAV on apache.org

--20cf3011ddf9cc9f0504f8d8cf8e
Content-Type: text/plain; charset=UTF-8

Hi,

I am trying to use the throttle feature of distcp V2. But we are not using
YARN, we are using cdh4.2, which is MapReduce V1.  I replaced the
hadoop-tool.jar to point to hadoop-distcp-2.0.3-alpha.jar. But it seems
still complain about NoSuchMethodError.

Anyone know if we can use distcp v2 without upgrading to YARN?

Thanks
Tian-Ying

Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(Lorg/apache/hadoop/mapreduce/Cluster;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/Path;

at org.apache.hadoop.tools.DistCp.createMetaFolderPath(DistCp.java:352)

at org.apache.hadoop.tools.DistCp.execute(DistCp.java:146)

at org.apache.hadoop.tools.DistCp.run(DistCp.java:118)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

at org.apache.hadoop.tools.DistCp.main(DistCp.java:374)

--20cf3011ddf9cc9f0504f8d8cf8e
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,=C2=A0<div><br></div><div>I am trying to use the thrott=
le feature of distcp V2. But we are not using YARN, we are using cdh4.2, wh=
ich is MapReduce V1. =C2=A0I replaced the hadoop-tool.jar to point to hadoo=
p-distcp-2.0.3-alpha.jar. But it seems still complain about NoSuchMethodErr=
or.=C2=A0</div>
<div><br></div><div>Anyone know if we can use distcp v2 without upgrading t=
o YARN?=C2=A0</div><div><br></div><div>Thanks</div><div>Tian-Ying</div><div=
><br></div><div>







<p class=3D"">Exception in thread &quot;main&quot; java.lang.NoSuchMethodEr=
ror: org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(Lorg/apac=
he/hadoop/mapreduce/Cluster;Lorg/apache/hadoop/conf/Configuration;)Lorg/apa=
che/hadoop/fs/Path;</p>

<p class=3D""><span class=3D"">	</span>at org.apache.hadoop.tools.DistCp.cr=
eateMetaFolderPath(DistCp.java:352)</p>
<p class=3D""><span class=3D"">	</span>at org.apache.hadoop.tools.DistCp.ex=
ecute(DistCp.java:146)</p>
<p class=3D""><span class=3D"">	</span>at org.apache.hadoop.tools.DistCp.ru=
n(DistCp.java:118)</p>
<p class=3D""><span class=3D"">	</span>at org.apache.hadoop.util.ToolRunner=
.run(ToolRunner.java:70)</p>
<p class=3D""><span class=3D"">	</span>at org.apache.hadoop.tools.DistCp.ma=
in(DistCp.java:374)</p></div>







</div>

--20cf3011ddf9cc9f0504f8d8cf8e--