Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0B0969AF2 for ; Wed, 19 Oct 2011 14:48:16 +0000 (UTC) Received: (qmail 69244 invoked by uid 500); 19 Oct 2011 14:48:15 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 69216 invoked by uid 500); 19 Oct 2011 14:48:15 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 69208 invoked by uid 99); 19 Oct 2011 14:48:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Oct 2011 14:48:15 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of vikas.srivastava@one97.net designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vx0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Oct 2011 14:48:06 +0000 Received: by vcdn13 with SMTP id n13so2303223vcd.35 for ; Wed, 19 Oct 2011 07:47:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.73.7 with SMTP id h7mr1032311obv.51.1319035665131; Wed, 19 Oct 2011 07:47:45 -0700 (PDT) Received: by 10.182.10.33 with HTTP; Wed, 19 Oct 2011 07:47:45 -0700 (PDT) X-Originating-IP: [125.63.68.99] In-Reply-To: References: <1486140993-1319034118-cardhu_decombobulator_blackberry.rim.net-1945339846-@b27.c2.bise7.blackberry> Date: Wed, 19 Oct 2011 20:17:45 +0530 Message-ID: Subject: Re: Hive query failing on group by From: Vikas Srivastava To: user@hive.apache.org Cc: bejoy_ks@yahoo.com Content-Type: multipart/alternative; boundary=f46d04462c2a44275a04afa7ec09 X-Virus-Checked: Checked by ClamAV on apache.org --f46d04462c2a44275a04afa7ec09 Content-Type: text/plain; charset=ISO-8859-1 install hive with RPM this is correpted!!!!!! On Wed, Oct 19, 2011 at 8:01 PM, Mark Kerzner wrote: > Here is what my hive logs say > > hive -hiveconf hive.root.logger=DEBUG > > 2011-10-19 09:24:35,148 ERROR DataNucleus.Plugin > (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires > "org.eclipse.core.resources" but it cannot be resolved. > 2011-10-19 09:24:35,150 ERROR DataNucleus.Plugin > (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires > "org.eclipse.core.runtime" but it cannot be resolved. > 2011-10-19 09:24:35,150 ERROR DataNucleus.Plugin > (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires > "org.eclipse.text" but it cannot be resolved. > > > On Wed, Oct 19, 2011 at 9:21 AM, wrote: > >> ** Hi Mark >> What does your Map reduce job logs say? Try figuring out the error form >> there. From hive CLI you could hardly find out the root cause of your >> errors. From job tracker web UI < http://hostname:50030/jobtracker.jsp> >> you can easily browse to failed tasks and get the actual exception from >> there. If you are not able to figure out from there then please post in >> those logs with your table schema. >> >> Regards >> Bejoy K S >> ------------------------------ >> *From: * Mark Kerzner >> *Date: *Wed, 19 Oct 2011 09:06:13 -0500 >> *To: *Hive user >> *ReplyTo: * user@hive.apache.org >> *Subject: *Hive query failing on group by >> >> HI, >> >> I am trying to figure out what I am doing wrong with this query and the >> unusual error I am getting. Also suspicious is the reduce % going up and >> down. >> >> select trans.property_id, day(trans.log_timestamp) from trans JOIN opts on >> trans.ext_booking_id["ext_booking_id"] = opts.ext_booking_id group by >> day(trans.log_timestamp), trans.property_id; >> >> 2011-10-19 08:55:19,778 Stage-1 map = 0%, reduce = 0% >> 2011-10-19 08:55:22,786 Stage-1 map = 100%, reduce = 0% >> 2011-10-19 08:55:29,804 Stage-1 map = 100%, reduce = 33% >> 2011-10-19 08:55:32,811 Stage-1 map = 100%, reduce = 0% >> 2011-10-19 08:55:39,829 Stage-1 map = 100%, reduce = 33% >> 2011-10-19 08:55:43,839 Stage-1 map = 100%, reduce = 0% >> 2011-10-19 08:55:50,855 Stage-1 map = 100%, reduce = 33% >> 2011-10-19 08:55:54,864 Stage-1 map = 100%, reduce = 0% >> 2011-10-19 08:56:00,878 Stage-1 map = 100%, reduce = 33% >> 2011-10-19 08:56:04,887 Stage-1 map = 100%, reduce = 0% >> 2011-10-19 08:56:05,891 Stage-1 map = 100%, reduce = 100% >> Ended Job = job_201110111849_0024 with errors >> FAILED: Execution Error, return code 2 from >> org.apache.hadoop.hive.ql.exec.MapRedTask >> >> Thank you, >> Mark >> > > -- With Regards Vikas Srivastava DWH & Analytics Team Mob:+91 9560885900 One97 | Let's get talking ! --f46d04462c2a44275a04afa7ec09 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable install hive with RPM this is correpted!!!!!!

On Wed, Oct 19, 2011 at 8:01 PM, Mark Ker= zner <mark= .kerzner@shmsoft.com> wrote:
Here is what my hive logs say

hive -= hiveconf hive.root.logger=3DDEBUG

2011-10-19 09:24:35,148 ERROR Data= Nucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt= .core" requires "org.eclipse.core.resources" but it cannot b= e resolved.
2011-10-19 09:24:35,150 ERROR DataNucleus.Plugin (Log4JLogger.java:error(11= 5)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.co= re.runtime" but it cannot be resolved.
2011-10-19 09:24:35,150 ERRO= R DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclip= se.jdt.core" requires "org.eclipse.text" but it cannot be re= solved.


On Wed, Oct 19, 2011 at 9:21 AM, <bejoy_= ks@yahoo.com> wrote:
Hi Mark
What does your Map reduce job logs say? Try figur= ing out the error form there. From hive CLI you could hardly find out the r= oot cause of your errors. From job tracker web UI < http://hostname:50030/jobtra= cker.jsp> you can easily browse to failed tasks and get the actual e= xception from there. If you are not able to figure out from there then plea= se post in those logs with your table schema.

Regards
Bejoy K S

From: Mark Kerzner <mark.kerzner@shms= oft.com>
Date: Wed, 19 Oct 2011 09:06:13 -0500
To: Hive user<us= er@hive.apache.org>
Subject: Hive query failing on group by

HI,

I am trying to figure out what I am doin= g wrong with this query and the unusual error I am getting. Also suspicious= is the reduce % going up and down.

select trans.property_id, day(trans.log_timestamp) from trans JOIN opts= on trans.ext_booking_id["ext_booking_id"] =3D opts.ext_booking_i= d group by day(trans.log_timestamp), trans.property_id;

2011-10-19 08:55:19,778 Stage-1 map =3D 0%,=A0 reduce =3D 0%
2011-10= -19 08:55:22,786 Stage-1 map =3D 100%,=A0 reduce =3D 0%
2011-10-19 08:55= :29,804 Stage-1 map =3D 100%,=A0 reduce =3D 33%
2011-10-19 08:55:32,811 = Stage-1 map =3D 100%,=A0 reduce =3D 0%
2011-10-19 08:55:39,829 Stage-1 map =3D 100%,=A0 reduce =3D 33%
2011-10-= 19 08:55:43,839 Stage-1 map =3D 100%,=A0 reduce =3D 0%
2011-10-19 08:55:= 50,855 Stage-1 map =3D 100%,=A0 reduce =3D 33%
2011-10-19 08:55:54,864 S= tage-1 map =3D 100%,=A0 reduce =3D 0%
2011-10-19 08:56:00,878 Stage-1 map =3D 100%,=A0 reduce =3D 33%
2011-10-= 19 08:56:04,887 Stage-1 map =3D 100%,=A0 reduce =3D 0%
2011-10-19 08:56:= 05,891 Stage-1 map =3D 100%,=A0 reduce =3D 100%
Ended Job =3D job_201110= 111849_0024 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.= MapRedTask

Thank you,
Mark




--
With Regards
Vikas Srivastava

DWH & Ana= lytics Team
Mob:+91 9560885900
One97 | Let's get talking= !

--f46d04462c2a44275a04afa7ec09--