Return-Path: 
 <user-return-16346-apmail-hive-user-archive=hive.apache.org@hive.apache.org>
X-Original-To: apmail-hive-user-archive@www.apache.org
Delivered-To: apmail-hive-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 2808C11870
	for <apmail-hive-user-archive@www.apache.org>;
 Sun, 11 May 2014 12:37:07 +0000 (UTC)
Received: (qmail 70586 invoked by uid 500); 10 May 2014 23:24:49 -0000
Delivered-To: apmail-hive-user-archive@hive.apache.org
Received: (qmail 25658 invoked by uid 500); 10 May 2014 23:13:18 -0000
Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hive.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hive.apache.org>
List-Post: <mailto:user@hive.apache.org>
List-Id: <user.hive.apache.org>
Reply-To: user@hive.apache.org
Delivered-To: mailing list user@hive.apache.org
Received: (qmail 11873 invoked by uid 99); 10 May 2014 22:57:11 -0000
Received: from Unknown (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 May 2014 22:57:11 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=AC_DIV_BONANZA,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of archit279thakur@gmail.com
 designates 209.85.217.178 as permitted sender)
Received: from [209.85.217.178] (HELO mail-lb0-f178.google.com)
 (209.85.217.178)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 May 2014 11:41:55 +0000
Received: by mail-lb0-f178.google.com with SMTP id w7so3367318lbi.9
        for <user@hive.apache.org>; Thu, 08 May 2014 04:41:32 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=4eSNVY7jnUtFkHQDVjyUmYlYAB7TlcmQhM0sFVdaWPc=;
        b=FVmG8pdd8mddsRNs/+OPGFmgOg7k83u/a4+gZLEGjCLPQoagt8xFsoWo8gMhK+3Jap
         UKOIEF5aUkY48NcgGkR0YmMVJ808iI7AlUNZh000yxTk8LQUu63nwxyskmkySuI0wU5U
         x5lkYymbv8l688JCa38K9g38TeJFmY7JEWI0PsR5gpdiIByQcMfpy1Ivf8Bw2iu6eOTA
         T7Eyv2A2QiHxkEESIyVDr+uuPPn3VxMIxasCAG3tBfm5AaB+c+meB63b4v3oCXVyM2u1
         dJIoZhRBcjJw6lToIzZhi+lssbhxS0GAn7ZxNDk5hLj0UDf3bEnTWNXbnKxzSk0nb+fA
         QncA==
MIME-Version: 1.0
X-Received: by 10.112.118.236 with SMTP id kp12mr1801863lbb.56.1399549291864;
 Thu, 08 May 2014 04:41:31 -0700 (PDT)
Received: by 10.112.139.228 with HTTP; Thu, 8 May 2014 04:41:31 -0700 (PDT)
Date: Thu, 8 May 2014 17:11:31 +0530
Message-ID: 
 <CA+KkaUbGLiH92aihMH8=oBMkL0m46gH1ZTiK1kzYfMd8Oen+RQ@mail.gmail.com>
Subject: Tez HIve problems.
From: Archit Thakur <archit279thakur@gmail.com>
To: user@hive.apache.org, user@tez.incubator.apache.org
Content-Type: multipart/alternative; boundary=e89a8f6472cb63a89604f8e1f663
X-Virus-Checked: Checked by ClamAV on apache.org

--e89a8f6472cb63a89604f8e1f663
Content-Type: text/plain; charset=UTF-8

Hi,

I am facing few problems while using Tez on Hive.
I am able to run Tez through YARN submitting independent MR procesing job.

Also, when I run SELECT query on hive shell by setting



*set hive.execution.engine=mr;*
but setting

*mapreduce.framework.name <http://mapreduce.framework.name>=yarn-tez*
This launches tez job, I checked by seeing AM's UI of machine.

But when I

*set hive.execution.engine=tez;*


*It gives me *Query ID =
admin_20140508112525_37cf7b55-75ac-408c-b96f-8e40ba2f8e2b
Total jobs = 1
Launching Job 1 out of 1
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.tez.TezTask

*I checked the hive logs:*

exec.Task (TezTask.java:execute(185)) - Failed to execute tez graph.
java.io.FileNotFoundException: File does not exist: hdfs:/user/admin
        at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1110)
        at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
        at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
        at
org.apache.hadoop.hive.ql.exec.tez.DagUtils.getDefaultDestDir(DagUtils.java:638)
        at
org.apache.hadoop.hive.ql.exec.tez.DagUtils.getHiveJarDirectory(DagUtils.java:728)
        at
org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createJarLocalResource(TezSessionState.java:314)
        at
org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:169)
        at
org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:153)
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1504)
        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1271)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1089)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:912)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:902)
        at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
        at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
        at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)


Am I doing something wrong? The Tez I am running by setting*
hive.execution.engine=mr;* but setting
*mapreduce.framework.name <http://mapreduce.framework.name>=yarn-tez. is it
correct? Does it launches Tez job or is it MR?*

Thanks and Regards,
Archit Thakur.

--e89a8f6472cb63a89604f8e1f663
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div><div><div><div><div><div><div><div>Hi,=
<br><br></div>I am facing few problems while using Tez on Hive.<br></div>I =
am able to run Tez through YARN submitting independent MR procesing job.<br=
>
<br></div>Also, when I run SELECT query on hive shell by setting<br><br><b>=
set hive.execution.engine=3Dmr;<br><br></b></div>but setting <b><a href=3D"=
http://mapreduce.framework.name">mapreduce.framework.name</a>=3Dyarn-tez<br=
><br>
</b></div>This launches tez job, I checked by seeing AM&#39;s UI of machine=
.<b><br><br></b></div>But when I <b>set hive.execution.engine=3Dtez;<br><br=
></b></div><b>It gives me <br><br></b>Query ID =3D admin_20140508112525_37c=
f7b55-75ac-408c-b96f-8e40ba2f8e2b<br>
Total jobs =3D 1<br>Launching Job 1 out of 1<br>FAILED: Execution Error, re=
turn code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask<br><b><br></b><=
/div><b>I checked the hive logs:</b><br><br>exec.Task (TezTask.java:execute=
(185)) - Failed to execute tez graph.<br>
java.io.FileNotFoundException: File does not exist: hdfs:/user/admin<br>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.Distribut=
edFileSystem$17.doCall(DistributedFileSystem.java:1110)<br>=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.DistributedFileSystem=
$17.doCall(DistributedFileSystem.java:1102)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.fs.FileSyst=
emLinkResolver.resolve(FileSystemLinkResolver.java:81)<br>=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.DistributedFileSystem=
.getFileStatus(DistributedFileSystem.java:1102)<br>=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.tez.DagUtils.getDefaul=
tDestDir(DagUtils.java:638)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exe=
c.tez.DagUtils.getHiveJarDirectory(DagUtils.java:728)<br>=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.tez.TezSessionSt=
ate.createJarLocalResource(TezSessionState.java:314)<br>=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.tez.TezSessionSt=
ate.open(TezSessionState.java:169)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exe=
c.tez.TezTask.execute(TezTask.java:153)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:1=
53)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive=
.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.Dri=
ver.launchTask(Driver.java:1504)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0 at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1271)<br>=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.Driver.ru=
nInternal(Driver.java:1089)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.Dri=
ver.run(Driver.java:912)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at o=
rg.apache.hadoop.hive.ql.Driver.run(Driver.java:902)<br>=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.cli.CliDriver.processLoc=
alCmd(CliDriver.java:268)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.cli.Cl=
iDriver.processCmd(CliDriver.java:220)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0 at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.jav=
a:423)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.h=
ive.cli.CliDriver.executeDriver(CliDriver.java:792)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.cli.Cl=
iDriver.run(CliDriver.java:686)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0 at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)<br>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.NativeMethodAccessor=
Impl.invoke0(Native Method)<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.NativeMethodAcces=
sorImpl.invoke(Unknown Source)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)<br>=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.reflect.Method.invo=
ke(Unknown Source)<br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apa=
che.hadoop.util.RunJar.main(RunJar.java:212)<br>
<br><br></div>Am I doing something wrong? The Tez I am running by setting<b=
> hive.execution.engine=3Dmr;</b> but setting <b><a href=3D"http://mapreduc=
e.framework.name">mapreduce.framework.name</a>=3Dyarn-tez. is it correct? D=
oes it launches Tez job or is it MR?<br>
</b><br><br></div>Thanks and Regards,<br></div>Archit Thakur.<br></div>

--e89a8f6472cb63a89604f8e1f663--