Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 285D211EBA for ; Mon, 12 May 2014 18:34:40 +0000 (UTC) Received: (qmail 60722 invoked by uid 500); 12 May 2014 18:06:39 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 60570 invoked by uid 500); 12 May 2014 18:06:39 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 60486 invoked by uid 99); 12 May 2014 18:06:39 -0000 Received: from Unknown (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 May 2014 18:06:39 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=AC_DIV_BONANZA,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of vikram@hortonworks.com designates 209.85.219.44 as permitted sender) Received: from [209.85.219.44] (HELO mail-oa0-f44.google.com) (209.85.219.44) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 May 2014 18:06:35 +0000 Received: by mail-oa0-f44.google.com with SMTP id o6so1733575oag.31 for ; Mon, 12 May 2014 11:06:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=k0jS7am/MxZre7HPNu3YU38Kgthvm02qcv7TzBgT3dk=; b=ZM7qLpDEWsnI6nih9GkSGQMGqLILcxCxOuyx7nxlym5KQXGuMDRFfL0KwZy97h2Siw G5O3PsVU2YpGq2reKmjdp9TnZdvqpB+aYrSrekWujUbOPivapsmWFB/VP3pgKGNG3Ud+ NQXxa+HKeprlIKFjUdUag8NoDQeaYgehNelZh88fjzluU3tm6FKd+GQQyXThT06Rqj4+ sZYbojx0I2dzv3awfT+wtnW2LhzeonhFphUmVBay6EftIpHuFPuIuT/3Q3YVFp7vAkZb kFGIN+EcgvTpZE3y6RzCfkDeoUROUk/t+Yf44tRKPDUqxIEbKpI0cnqqLLHV5+4dC6pr Zpyg== X-Gm-Message-State: ALoCoQkEDrPUVB5Mo+quRh5fnvgXhHBZrhOgnZwwFbMwCHvTx3Qs92/b1YV+ur75uug6v3CRUU3qzXzToodsYfE3m2Qj0W+Xyxk/H0tUKs10+IjxUEue8Ns= MIME-Version: 1.0 X-Received: by 10.182.219.167 with SMTP id pp7mr5670448obc.85.1399917971466; Mon, 12 May 2014 11:06:11 -0700 (PDT) Received: by 10.76.175.193 with HTTP; Mon, 12 May 2014 11:06:11 -0700 (PDT) In-Reply-To: References: Date: Mon, 12 May 2014 11:06:11 -0700 Message-ID: Subject: Re: Tez HIve problems. From: Vikram Dixit To: "user@hive.apache.org" Cc: user@tez.incubator.apache.org Content-Type: multipart/alternative; boundary=089e0141ab8267814a04f937cde0 X-Virus-Checked: Checked by ClamAV on apache.org --089e0141ab8267814a04f937cde0 Content-Type: text/plain; charset=UTF-8 Hi Archit, You can take a look at the application logs to see if there are any failures/stack traces in there. I can also take a look if you could post the hive.log and application logs to this email or a jira. Thanks Vikram. On Sun, May 11, 2014 at 9:59 PM, Archit Thakur wrote: > Hi Bikas, > > I was able to resolve this issue, by copying hive-exec.jar to > hdfs://user/admin/, It was not able to localize it while running Tez. > > Though, I am facing some other problem now. My Tez job is not progressing, > > My Tez job doesn't progress, it just keeps printing: > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > Map 1: 0/2 Map 5: 0/2 Reducer 2: 0/1 Reducer 3: 0/1 Reducer 4: > 0/1 > > In hive logs also, it keeps on printing the same. > > Any idea, where should I look into or how should I debug the problem. Or > pointers on problem itself would help. > Thanks Archit. > > > On Sun, May 11, 2014 at 7:28 AM, Bikas Saha wrote: > >> Setting execution engine to mr and framework name to yarn = Hive compiles >> to MR and runs on MR. >> >> Setting execution engine to mr and framework name to yarn-tez = Hive >> compiles to MR and runs on Tez. >> >> Setting execution engine to tez = Hive compiles to Tez and runs on Tez. >> >> >> >> Did you change the execution engine in the same shell that was earlier >> running with execution engine set to mr? If yes, then try and set the >> execution engine in hive-site.xml and use a new hive shell. >> >> Have you set all required hive configurations? >> >> >> >> If you can still reproduce the issue, then you should create a jira in >> the Apache hive project to track the bug. >> >> >> >> Bikas >> >> >> >> *From:* Archit Thakur [mailto:archit279thakur@gmail.com] >> *Sent:* Thursday, May 08, 2014 4:42 AM >> *To:* user@hive.apache.org; user@tez.incubator.apache.org >> *Subject:* Tez HIve problems. >> >> >> >> Hi, >> >> I am facing few problems while using Tez on Hive. >> >> I am able to run Tez through YARN submitting independent MR procesing job. >> >> Also, when I run SELECT query on hive shell by setting >> >> *set hive.execution.engine=mr;* >> >> but setting *mapreduce.framework.name >> =yarn-tez* >> >> This launches tez job, I checked by seeing AM's UI of machine. >> >> But when I *set hive.execution.engine=tez;* >> >> >> >> *It gives me *Query ID = >> admin_20140508112525_37cf7b55-75ac-408c-b96f-8e40ba2f8e2b >> Total jobs = 1 >> Launching Job 1 out of 1 >> FAILED: Execution Error, return code 1 from >> org.apache.hadoop.hive.ql.exec.tez.TezTask >> >> *I checked the hive logs:* >> >> exec.Task (TezTask.java:execute(185)) - Failed to execute tez graph. >> java.io.FileNotFoundException: File does not exist: hdfs:/user/admin >> at >> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1110) >> at >> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102) >> at >> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) >> at >> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102) >> at >> org.apache.hadoop.hive.ql.exec.tez.DagUtils.getDefaultDestDir(DagUtils.java:638) >> at >> org.apache.hadoop.hive.ql.exec.tez.DagUtils.getHiveJarDirectory(DagUtils.java:728) >> at >> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createJarLocalResource(TezSessionState.java:314) >> at >> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:169) >> at >> org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:153) >> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153) >> at >> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85) >> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1504) >> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1271) >> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1089) >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:912) >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:902) >> at >> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268) >> at >> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220) >> at >> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423) >> at >> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792) >> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) >> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) >> at java.lang.reflect.Method.invoke(Unknown Source) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >> >> Am I doing something wrong? The Tez I am running by setting* >> hive.execution.engine=mr;* but setting >> >> *mapreduce.framework.name =yarn-tez. is >> it correct? Does it launches Tez job or is it MR? * >> >> Thanks and Regards, >> >> Archit Thakur. >> >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > > > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --089e0141ab8267814a04f937cde0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Archit,

You can take a look at t= he application logs to see if there are any failures/stack traces in there.= I can also take a look if you could post the hive.log and application logs= to this email or a jira.

Thanks
Vikram.


On Sun, May 11, 2014 at 9:59 PM, Archit Thakur <archit279thakur@gmail.com> wrote:
Hi Bikas,

=
I was able to resolve this issue, by copying hive-exec.jar to hdfs://= user/admin/, It was not able to localize it while running Tez.

Though, I am facing some other problem now. My Tez job is no= t progressing,

My Tez job doesn't progress, it just keeps printing:
Map 1: 0/2= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Red= ucer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Reducer 2= : 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 Reducer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1
Map 1: 0= /2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Map 5: 0/2=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 R= educer 2: 0/1=C2=A0 Reducer 3: 0/1=C2=A0 Reducer 4: 0/1

I= n hive logs also, it keeps on printing the same.

Any idea, where should I look into or how should I debug the= problem. Or
pointers on problem itself would help.
Thank= s Archit.


On Sun, May 11, 2014 at 7:28 AM, Bikas Saha <bikas@hortonworks.com> wrote:

Setting execution engine to mr and framework= name to yarn =3D Hive compiles to MR and runs on MR.

Setting execution engine = to mr and framework name to yarn-tez =3D Hive compiles to MR and runs on Te= z.

Setting execution engine = to tez =3D Hive compiles to Tez and runs on Tez.

=C2=A0

Did you change the execution engine in the same shell th= at was earlier running with execution engine set to mr? If yes, then try an= d set the execution engine in hive-site.xml and use a new hive shell.

Have you set all required= hive configurations?

=C2=A0

If you can still reproduc= e the issue, then you should create a jira in the Apache hive project to tr= ack the bug.

=C2=A0

Bikas

=C2=A0

From: Archit Thakur = [mailto:arch= it279thakur@gmail.com]
Sent: Thursday, May 08, 2014 4:42 AM
To: user@hive.apache.org; user@tez.incuba= tor.apache.org
Subject: Tez HIve problems.

=C2=A0

Hi,=

I am facing few problems while using Tez o= n Hive.

I am able to ru= n Tez through YARN submitting independent MR procesing job.

Also, when I run SELECT que= ry on hive shell by setting

set hive.execution.engine=3Dmr;

but setting mapreduce.framework.name=3Dyarn-tez

This launches tez job, I checked by seeing AM's UI of machine.

But when I set hi= ve.execution.engine=3Dtez;

It gives me

Query ID =3D admin_20140508112525_37cf7b55-75ac-= 408c-b96f-8e40ba2f8e2b
Total jobs =3D 1
Launching Job 1 out of 1
F= AILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.t= ez.TezTask

I checked th= e hive logs:

exec.Task (TezTask.java:execute(185)) - Failed to e= xecute tez graph.
java.io.FileNotFoundException: File does not exist: hd= fs:/user/admin
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.Distri= butedFileSystem$17.doCall(DistributedFileSystem.java:1110)
=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.DistributedFileSys= tem$17.doCall(DistributedFileSystem.java:1102)
=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(F= ileSystemLinkResolver.java:81)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.Distri= butedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.tez.Dag= Utils.getDefaultDestDir(DagUtils.java:638)
=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.tez.DagUtils.getHiveJarDi= rectory(DagUtils.java:728)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exe= c.tez.TezSessionState.createJarLocalResource(TezSessionState.java:314)
= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exe= c.tez.TezSessionState.open(TezSessionState.java:169)
=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exec.tez.TezTask.exec= ute(TezTask.java:153)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.exe= c.Task.executeTask(Task.java:153)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunne= r.java:85)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hado= op.hive.ql.Driver.launchTask(Driver.java:1504)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.Dri= ver.execute(Driver.java:1271)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1089)
=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.ql.Driver= .run(Driver.java:912)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.= apache.hadoop.hive.ql.Driver.run(Driver.java:902)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.cli.Cl= iDriver.processLocalCmd(CliDriver.java:268)
=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDrive= r.java:220)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.had= oop.hive.cli.CliDriver.processLine(CliDriver.java:423)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.cli.Cl= iDriver.executeDriver(CliDriver.java:792)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686= )
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.c= li.CliDriver.main(CliDriver.java:625)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.NativeMethodAcces= sorImpl.invoke0(Native Method)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.DelegatingMethodAcce= ssorImpl.invoke(Unknown Source)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.reflect.Method.invo= ke(Unknown Source)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apa= che.hadoop.util.RunJar.main(RunJar.java:212)

Am I doing something wrong? The Te= z I am running by setting hive.execution.engine=3Dmr; but setting mapreduce.fr= amework.name=3Dyarn-tez. is it correct? Does it launches Tez job or is = it MR?

Thanks and Regards,

Archit Thakur.


CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u.



CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u. --089e0141ab8267814a04f937cde0--