Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of Stanley.Burnitt@huawei.com
 designates 206.16.17.72 as permitted sender)
From: "Stanley.Burnitt" <Stanley.Burnitt@huawei.com>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Subject: Yarn -> job.jar not found in yarn staging dir  (works with
  TestDFSIO but not ImportTsv )
Thread-Topic: Yarn -> job.jar not found in yarn staging dir  (works with
  TestDFSIO but not ImportTsv )
Thread-Index: AQHPaJ+xWeggNP4dAESAmq9gLsYSgw==
Date: Mon, 5 May 2014 20:22:09 +0000
Message-ID: 
 <B69F7652F420124985E39C73DA5B61D79A1736@SJCEML703-CHM.china.huawei.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_B69F7652F420124985E39C73DA5B61D79A1736SJCEML703CHMchina_"
MIME-Version: 1.0

--_000_B69F7652F420124985E39C73DA5B61D79A1736SJCEML703CHMchina_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hello,

I am trying to run HBase's ImportTsv against Yarn (Hadoop 2.2.0).

I can run the Hadoop TestDFSIO Yarn job with no problems:
hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-jobc=
lient-2.2.0-tests.jar TestDFSIO -write -nrFiles 20 -fileSize 10

I cannot run the HBase ImportTsv job:

hadoop jar $HBASE_HOME/lib/hbase-server-0.96.0-hadoop2.jar importtsv |
 -Dimporttsv.separator=3D               \
 -Dimporttsv.columns=3D$IMPORTTSV_COLUMNS \
 -Dimporttsv.bulk.output=3Dhdfs://$HADOOP_NAMENODE:54310/user/bihadoop/impo=
rttsv-output \
 bulkloaded-xdremail  \
 hdfs://$HADOOP_NAMENODE:54310/user/bihadoop/kv-data-files

... because the job.jar file is never successfully downloaded to any yarn n=
ode:

2014-05-05 19:44:06,641 INFO org.apache.hadoop.yarn.server.nodemanager.cont=
ainermanager.localizer.ResourceLocalizationService: Writing credentials to =
the nmPrivate file /tmp/hadoop-bihadoop/nm-local-dir/nmPrivate/container_13=
99316513410_0007_01_000001.tokens. Credentials list:
2014-05-05 19:44:06,642 INFO org.apache.hadoop.yarn.server.nodemanager.Defa=
ultContainerExecutor: Initializing user bihadoop
2014-05-05 19:44:06,690 INFO org.apache.hadoop.yarn.server.nodemanager.Defa=
ultContainerExecutor: Copying from /tmp/hadoop-bihadoop/nm-local-dir/nmPriv=
ate/container_1399316513410_0007_01_000001.tokens to /tmp/hadoop-bihadoop/n=
m-local-dir/usercache/bihadoop/appcache/application_1399316513410_0007/cont=
ainer_1399316513410_0007_01_000001.tokens
2014-05-05 19:44:06,690 INFO org.apache.hadoop.yarn.server.nodemanager.Defa=
ultContainerExecutor: CWD set to /tmp/hadoop-bihadoop/nm-local-dir/usercach=
e/bihadoop/appcache/application_1399316513410_0007 =3D file:/tmp/hadoop-bih=
adoop/nm-local-dir/usercache/bihadoop/appcache/application_1399316513410_00=
07
2014-05-05 19:44:06,791 ERROR org.apache.hadoop.security.UserGroupInformati=
on: PriviledgedActionException as:bihadoop (auth:SIMPLE) cause:java.io.File=
NotFoundException: File file:/tmp/hadoop-yarn/staging/bihadoop/.staging/job=
_1399316513410_0007/job.jar does not exist
2014-05-05 19:44:06,810 INFO org.apache.hadoop.yarn.server.nodemanager.cont=
ainermanager.localizer.ResourceLocalizationService: DEBUG: FAILED { file:/t=
mp/hadoop-yarn/staging/bihadoop/.staging/job_1399316513410_0007/job.jar, 13=
99319045000, PATTERN, (?:classes/|lib/).* }, File file:/tmp/hadoop-yarn/sta=
ging/bihadoop/.staging/job_1399316513410_0007/job.jar does not exist
2014-05-05 19:44:06,812 INFO org.apache.hadoop.yarn.server.nodemanager.cont=
ainermanager.localizer.LocalizedResource: Resource file:/tmp/hadoop-yarn/st=
aging/bihadoop/.staging/job_1399316513410_0007/job.jar transitioned from DO=
WNLOADING to FAILED


I have also tried running importtsv from the hbase script, i.e.:
hbase  org.apache.hadoop.hbase.mapreduce.ImportTsv \
...
...

The end result is the same: job.jar not found in staging dir.  (The job.jar=
 is found on the master node, where I run the job.)

There seems to be no problems distributing job.jar to the staging dirs when=
 I run the TestDFSIO job.
But the job.jar containing ImportTsv is never distributed.

Very frustrating,  time eating... ;/

Does anyone have any suggestions?  I am runinng Hadoop 2.2.0 w/ HBase 0.96.=
0

Thanks,
Stan


--_000_B69F7652F420124985E39C73DA5B61D79A1736SJCEML703CHMchina_--