Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1725D10ED4 for ; Thu, 19 Dec 2013 00:39:01 +0000 (UTC) Received: (qmail 52917 invoked by uid 500); 19 Dec 2013 00:38:59 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 52841 invoked by uid 500); 19 Dec 2013 00:38:59 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 52833 invoked by uid 99); 19 Dec 2013 00:38:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Dec 2013 00:38:59 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of leftyleverenz@gmail.com designates 209.85.214.52 as permitted sender) Received: from [209.85.214.52] (HELO mail-bk0-f52.google.com) (209.85.214.52) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Dec 2013 00:38:52 +0000 Received: by mail-bk0-f52.google.com with SMTP id u14so465027bkz.39 for ; Wed, 18 Dec 2013 16:38:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=rjeolfd8pFGlJAlinsKDk+g8TzSNNKTS96kFWKaUYUc=; b=nYtM7veBvqLhmbdSX0oDX0gLjxEbIPwrfwrrtW2Qjk0mTzPzhF2uWPIvlbVUMSu+v8 N+w9VXr+oZ6lScdjJ8m7UGkiBJY2099asGVcegUCZRJdkjOfZf/k+vevcDpTPuxTv5E1 QnuPPmzJC9s2GfO50ZGnPN+QK/Q7fkMrZuPyxc+n9BtczbMApGR/zTlxRm4zpdU2OsVt nAhk4Mx7l0VAKAFlxZppou2t4FvkUzXRNqkC2WLd1nMkNiflljgUP6ih5+OOxj8pKRLF zHwmcaMpZvvQgTp1SgF4815ZgLNjPESWRqUVpADnLnBnYe/vBGI0d46QgxHA7WskfqQY 8y/A== MIME-Version: 1.0 X-Received: by 10.205.18.73 with SMTP id qf9mr8880587bkb.12.1387413511819; Wed, 18 Dec 2013 16:38:31 -0800 (PST) Received: by 10.205.90.66 with HTTP; Wed, 18 Dec 2013 16:38:31 -0800 (PST) In-Reply-To: References: Date: Wed, 18 Dec 2013 16:38:31 -0800 Message-ID: Subject: Re: Question about running Hive on Tez From: Lefty Leverenz To: user@hive.apache.org Content-Type: multipart/alternative; boundary=20cf302239298781a104edd86198 X-Virus-Checked: Checked by ClamAV on apache.org --20cf302239298781a104edd86198 Content-Type: text/plain; charset=ISO-8859-1 Should hive-on-tez-conf.txt be added to the wiki, or is it not soup yet? -- Lefty On Mon, Dec 16, 2013 at 10:25 AM, Cheolsoo Park wrote: > Closing the loop. We identified the issue with help from the Tez team. It > was mis-configured mapreduce.reduce.cpu.vcores that caused problems. > > If anyone who tries Hive on Tez with EMR Hadoop and sees that reducers are > stuck, this might > be helpful. > > Thanks, > Cheolsoo > > On Fri, Dec 13, 2013 at 4:51 PM, Gunther Hagleitner < > ghagleitner@hortonworks.com> wrote: > >> dev on bcc >> >> Zhenxiao, >> >> Cool you got it set up. >> >> The query runs a full order by before the limit - are you sure it's not >> just still running? Hive on Tez prints "total tasks/completed tasks", so no >> update may mean none of the reduce tasks have finished yet. >> >> If not, it'd be great to see the yarn logs (yarn logs -applicationId) and >> get more info about the table you're using (size, file format, etc). If the >> logs are really big you might want to consider opening/attaching them to a >> jira (issues.apache.org) (or send them directly to me). >> >> There are a bunch of settings that might be of interest to you (in >> general not just for this query) - I've attached a text doc with some >> details. >> >> Thanks, >> Gunther. >> >> >> >> >> On Fri, Dec 13, 2013 at 1:12 PM, Zhenxiao Luo wrote: >> >>> Hi, >>> >>> Excuse me. May I ask a question about running Hive on Tez? >>> >>> I've installed Hive on Tez, and running a simple query from hiveCli, >>> >>> hive> set hive.optimize.tez=true; >>> hive> select * from table order by title_id limit 5; >>> >>> While, each time, I could see from the TezJobMonitor that, all the map >>> jobs are done, but the reducer never get started, and the job is >>> running forever there. >>> >>> I tried a number of times, and each time the same failure(job running >>> hangs) happens again and again. >>> Does anyone successfully running queries using Hive on Tez? Are there >>> any tips or suggestions? >>> >>> Here is my job log: >>> >>> 13/12/13 20:57:31 INFO client.TezSession: Submitting dag to >>> TezSession, sessionName=HIVE-365b35bc-2461-4e2f-83f9-8da1fa356a86, >>> applicationId=application_1386896881353_0027 >>> 13/12/13 20:57:33 INFO client.TezSession: Submitted dag to TezSession, >>> sessionName=HIVE-365b35bc-2461-4e2f-83f9-8da1fa356a86, >>> applicationId=application_1386896881353_0027, >>> dagId=dag_1386896881353_0027_1 >>> 13/12/13 20:57:33 INFO client.RMProxy: Connecting to ResourceManager >>> at /10.183.195.180:9022 >>> 13/12/13 20:57:33 INFO log.PerfLogger: >> start=1386968251250 end=1386968253338 duration=2088 >>> from=org.apache.hadoop.hive.ql.exec.tez.TezTask> >>> >>> >>> 13/12/13 20:57:33 INFO tez.TezJobMonitor: >>> >>> 13/12/13 20:57:33 INFO log.PerfLogger: >> from=org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> >>> 13/12/13 20:57:33 INFO log.PerfLogger: >> method=TezSubmitToRunningDag >>> from=org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> >>> 13/12/13 20:57:33 INFO log.PerfLogger: >> method=TezSubmitToRunningDag start=1386968253341 end=1386968253402 >>> duration=61 from=org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> >>> Status: Running (application id: application_1386896881353_0027) >>> >>> 13/12/13 20:57:33 INFO tez.TezJobMonitor: Status: Running (application >>> id: application_1386896881353_0027) >>> >>> 13/12/13 20:57:33 INFO log.PerfLogger: >> method=TezRunVertex.Reducer 2 >>> from=org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> >>> 13/12/13 20:57:33 INFO log.PerfLogger: >> method=TezRunVertex.Map 1 >>> from=org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> >>> Map 1: -/- Reducer 2: -/- >>> 13/12/13 20:57:33 INFO tez.TezJobMonitor: Map 1: -/- Reducer 2: -/- >>> Map 1: -/- Reducer 2: 0/1 >>> 13/12/13 20:57:33 INFO tez.TezJobMonitor: Map 1: -/- Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:34 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:37 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:40 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:43 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:46 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:49 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:52 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 0/16 Reducer 2: 0/1 >>> 13/12/13 20:57:55 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1 >>> Map 1: 1/16 Reducer 2: 0/1 >>> 13/12/13 20:57:56 INFO tez.TezJobMonitor: Map 1: 1/16 Reducer 2: 0/1 >>> Map 1: 2/16 Reducer 2: 0/1 >>> 13/12/13 20:57:58 INFO tez.TezJobMonitor: Map 1: 2/16 Reducer 2: 0/1 >>> Map 1: 3/16 Reducer 2: 0/1 >>> 13/12/13 20:57:58 INFO tez.TezJobMonitor: Map 1: 3/16 Reducer 2: 0/1 >>> Map 1: 5/16 Reducer 2: 0/1 >>> 13/12/13 20:57:59 INFO tez.TezJobMonitor: Map 1: 5/16 Reducer 2: 0/1 >>> Map 1: 8/16 Reducer 2: 0/1 >>> 13/12/13 20:57:59 INFO tez.TezJobMonitor: Map 1: 8/16 Reducer 2: 0/1 >>> Map 1: 12/16 Reducer 2: 0/1 >>> 13/12/13 20:57:59 INFO tez.TezJobMonitor: Map 1: 12/16 Reducer 2: 0/1 >>> Map 1: 15/16 Reducer 2: 0/1 >>> 13/12/13 20:58:00 INFO tez.TezJobMonitor: Map 1: 15/16 Reducer 2: 0/1 >>> 13/12/13 20:58:00 INFO log.PerfLogger: >> method=TezRunVertex.Map 1 start=1386968253402 end=1386968280223 >>> duration=26821 from=org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:00 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:03 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:06 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:09 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:12 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:15 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:18 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:21 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:24 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:27 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:30 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:33 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:36 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:39 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:42 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:45 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:48 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:51 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:54 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:58:57 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:00 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:03 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:06 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:09 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:12 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:15 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:18 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:21 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:24 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:27 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:30 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:33 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:36 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:39 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:42 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:45 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:48 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:52 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:55 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 20:59:58 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 21:00:01 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 21:00:04 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 21:00:07 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 21:00:10 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> Map 1: 16/16 Reducer 2: 0/1 >>> 13/12/13 21:00:13 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1 >>> >>> Thanks, >>> Zhenxiao >>> >> >> >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > > > --20cf302239298781a104edd86198 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Should hive-on-tez-conf.txt be added to the wiki, or is it= not soup yet?

-- Lefty


On Mon, Dec 16, 2013 at 10:25 AM, Cheols= oo Park <piaozhexiu@gmail.com> wrote:
Closing the loop. We identified the issue with help from t= he Tez team. It was mis-configured=A0m= apreduce.reduce.cpu.vcores that caused problems.

If anyone who tries Hive on Tez with EMR Hadoop and sees tha= t reducers are stuck, this=A0might be helpful.

Thanks,
Cheolsoo
<= div class=3D"h5">

= On Fri, Dec 13, 2013 at 4:51 PM, Gunther Hagleitner <<= a href=3D"mailto:ghagleitner@hortonworks.com" target=3D"_blank">ghagleitner= @hortonworks.com> wrote:
dev on bcc

Zhenxiao,

Cool you got it set up.
The query runs a full order by before the limit - are you sure it'= s not just still running? Hive on Tez prints "total tasks/completed ta= sks", so no update may mean none of the reduce tasks have finished yet= .

If not, it'd be great to see the yarn logs (yarn lo= gs -applicationId) and get more info about the table you're using (size= , file format, etc). If the logs are really big you might want to consider = opening/attaching them to a jira (issues.apache.org) (or send them directly to me).

There are a bunch of settings that might be of interest= to you (in general not just for this query) - I've attached a text doc= with some details.

Thanks,
Gunther.



On Fri, Dec 13, 2013 at 1:12 PM, Zhenxiao Luo <= span dir=3D"ltr"><= zluo@netflix.com> wrote:
Hi,

Excuse me. May I ask a question about running Hive on Tez?

I've installed Hive on Tez, and running a simple query from hiveCli,
hive> set hive.optimize.tez=3Dtrue;
hive> select * from table order by title_id limit 5;

While, each time, I could see from the TezJobMonitor that, all the map
jobs are done, but the reducer never get started, and the job is
running forever there.

I tried a number of times, and each time the same failure(job running
hangs) happens again and again.
Does anyone successfully running queries using Hive on Tez? Are there
any tips or suggestions?

Here is my job log:

13/12/13 20:57:31 INFO client.TezSession: Submitting dag to
TezSession, sessionName=3DHIVE-365b35bc-2461-4e2f-83f9-8da1fa356a86,
applicationId=3Dapplication_1386896881353_0027
13/12/13 20:57:33 INFO client.TezSession: Submitted dag to TezSession,
sessionName=3DHIVE-365b35bc-2461-4e2f-83f9-8da1fa356a86,
applicationId=3Dapplication_1386896881353_0027,
dagId=3Ddag_1386896881353_0027_1
13/12/13 20:57:33 INFO client.RMProxy: Connecting to ResourceManager
at /10.183.195.180= :9022
13/12/13 20:57:33 INFO log.PerfLogger: </PERFLOG method=3DTezSubmitDag start=3D1386968251250 end=3D1386968253338 duration=3D2088
from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezTask>


13/12/13 20:57:33 INFO tez.TezJobMonitor:

13/12/13 20:57:33 INFO log.PerfLogger: <PERFLOG method=3DTezRunDag
from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezJobMonitor>
13/12/13 20:57:33 INFO log.PerfLogger: <PERFLOG
method=3DTezSubmitToRunningDag
from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezJobMonitor>
13/12/13 20:57:33 INFO log.PerfLogger: </PERFLOG
method=3DTezSubmitToRunningDag start=3D1386968253341 end=3D1386968253402 duration=3D61 from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezJobMonitor> Status: Running (application id: application_1386896881353_0027)

13/12/13 20:57:33 INFO tez.TezJobMonitor: Status: Running (application
id: application_1386896881353_0027)

13/12/13 20:57:33 INFO log.PerfLogger: <PERFLOG
method=3DTezRunVertex.Reducer 2
from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezJobMonitor>
13/12/13 20:57:33 INFO log.PerfLogger: <PERFLOG
method=3DTezRunVertex.Map 1
from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezJobMonitor>
Map 1: -/- Reducer 2: -/-
13/12/13 20:57:33 INFO tez.TezJobMonitor: Map 1: -/- Reducer 2: -/-
Map 1: -/- Reducer 2: 0/1
13/12/13 20:57:33 INFO tez.TezJobMonitor: Map 1: -/- Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:34 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:37 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:40 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:43 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:46 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:49 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:52 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 0/16 Reducer 2: 0/1
13/12/13 20:57:55 INFO tez.TezJobMonitor: Map 1: 0/16 Reducer 2: 0/1
Map 1: 1/16 Reducer 2: 0/1
13/12/13 20:57:56 INFO tez.TezJobMonitor: Map 1: 1/16 Reducer 2: 0/1
Map 1: 2/16 Reducer 2: 0/1
13/12/13 20:57:58 INFO tez.TezJobMonitor: Map 1: 2/16 Reducer 2: 0/1
Map 1: 3/16 Reducer 2: 0/1
13/12/13 20:57:58 INFO tez.TezJobMonitor: Map 1: 3/16 Reducer 2: 0/1
Map 1: 5/16 Reducer 2: 0/1
13/12/13 20:57:59 INFO tez.TezJobMonitor: Map 1: 5/16 Reducer 2: 0/1
Map 1: 8/16 Reducer 2: 0/1
13/12/13 20:57:59 INFO tez.TezJobMonitor: Map 1: 8/16 Reducer 2: 0/1
Map 1: 12/16 Reducer 2: 0/1
13/12/13 20:57:59 INFO tez.TezJobMonitor: Map 1: 12/16 Reducer 2: 0/1
Map 1: 15/16 Reducer 2: 0/1
13/12/13 20:58:00 INFO tez.TezJobMonitor: Map 1: 15/16 Reducer 2: 0/1
13/12/13 20:58:00 INFO log.PerfLogger: </PERFLOG
method=3DTezRunVertex.Map 1 start=3D1386968253402 end=3D1386968280223
duration=3D26821 from=3Dorg.apache.hadoop.hive.ql.exec.tez.TezJobMonitor>= ;
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:00 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:03 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:06 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:09 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:12 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:15 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:18 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:21 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:24 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:27 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:30 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:33 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:36 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:39 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:42 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:45 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:48 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:51 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:54 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:58:57 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:00 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:03 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:06 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:09 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:12 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:15 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:18 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:21 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:24 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:27 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:30 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:33 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:36 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:39 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:42 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:45 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:48 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:52 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:55 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 20:59:58 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 21:00:01 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 21:00:04 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 21:00:07 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 21:00:10 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1
Map 1: 16/16 Reducer 2: 0/1
13/12/13 21:00:13 INFO tez.TezJobMonitor: Map 1: 16/16 Reducer 2: 0/1

Thanks,
Zhenxiao


CONFIDENTIALITY NOTICE
NOTICE: This= message is intended for the use of the individual or entity to which it is= addressed and may contain information that is confidential, privileged and= exempt from disclosure under applicable law. If the reader of this message= is not the intended recipient, you are hereby notified that any printing, = copying, dissemination, distribution, disclosure or forwarding of this comm= unication is strictly prohibited. If you have received this communication i= n error, please contact the sender immediately and delete it from your syst= em. Thank You.


--20cf302239298781a104edd86198--