Mailing-List: contact hive-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hive-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of athusoo@facebook.com
 designates 69.63.179.25 as permitted sender)
From: Ashish Thusoo <athusoo@facebook.com>
To: "hive-user@hadoop.apache.org" <hive-user@hadoop.apache.org>
Date: Thu, 21 May 2009 11:28:27 -0700
Subject: RE: jobtracker deadlock immediately when I launch hive query
Thread-Topic: jobtracker deadlock immediately when I launch hive query
Thread-Index: AcnZ+shf2S7l16SyQg67EJVU3j5rOwARwY/Q
Message-ID: 
 <68B7689C98024D43B4C2709456F0B52009766241F3@SC-MBXC1.TheFacebook.com>
References: <4A1524CA.4030609@alibaba-inc.com>
 <34fd060d0905210258u690e64ft2fa13b9c55d5fa88@mail.gmail.com>
In-Reply-To: <34fd060d0905210258u690e64ft2fa13b9c55d5fa88@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: multipart/alternative;
	boundary="_000_68B7689C98024D43B4C2709456F0B52009766241F3SCMBXC1TheFac_"
MIME-Version: 1.0

--_000_68B7689C98024D43B4C2709456F0B52009766241F3SCMBXC1TheFac_
Content-Type: text/plain; charset="gb2312"
Content-Transfer-Encoding: base64

QWxzbyB5b3UgY291bGQgYWxzbyBqdXN0IHVzZSB0aGUgcHJlYnVpbHQgYmluYXJpZXMgZm9yIHRo
b3NlIHZlcnNpb25zIHRoYXQgYXJlIGF2YWlsYWJsZSBmcm9tIHRoZSBhc2YgZG93bmxvYWQgc2l0
ZXMgdG8ga2VlcCBpdCBzaW1wbGUuDQoNCkFzaGlzaA0KDQpfX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fXw0KRnJvbTogWmhlbmcgU2hhbyBbbWFpbHRvOnpzaGFvOUBnbWFpbC5jb21dDQpT
ZW50OiBUaHVyc2RheSwgTWF5IDIxLCAyMDA5IDI6NTkgQU0NClRvOiBoaXZlLXVzZXJAaGFkb29w
LmFwYWNoZS5vcmcNClN1YmplY3Q6IFJlOiBqb2J0cmFja2VyIGRlYWRsb2NrIGltbWVkaWF0ZWx5
IHdoZW4gSSBsYXVuY2ggaGl2ZSBxdWVyeQ0KDQpUaGlzIHByb2JsZW0gaXMgbW9zdGx5IGxpa2Vs
eSB0byBiZSBjYXVzZWQgYnkgaW5jb25zaXN0ZW50IGhhZG9vcCB2ZXJzaW9ucy4NCg0KV2hpY2gg
dmVyc2lvbiBvZiBoYWRvb3AgZG8geW91IHVzZSBvbiB0aGUgY2x1c3Rlcj8NCk1ha2Ugc3VyZSB5
b3UgcnVuICJhbnQgY2xlYW4gcGFja2FnZSAtRGhhZG9vcC52ZXJzaW9uPTAuMTguMycgd2hlcmUg
MC4xOC4zIGlzIHlvdXIgaGFkb29wIHZlcnNpb24gb24gdGhlIGNsdXN0ZXIuDQoNCkxldCB1cyBr
bm93IHdoYXQgaGFkb29wIHZlcnNpb25zIHlvdSBhcmUgdXNpbmcsIGFuZCB3aGV0aGVyIHRoYXQg
aGVscHMuDQoNClpoZW5nDQoNCk9uIFRodSwgTWF5IDIxLCAyMDA5IGF0IDI6NTQgQU0sIMLewO4g
PGxpLmx1b2xAYWxpYmFiYS1pbmMuY29tPG1haWx0bzpsaS5sdW9sQGFsaWJhYmEtaW5jLmNvbT4+
IHdyb3RlOg0KSGkgYWxsOg0KICBJIGdvdCBhIHByb2JsZW0gd2hlbiBJIHVzZSBIaXZlICByZWxl
YXNlLTAuMy4wLXJjMSBvbiB0b3Agb2YgSGFkb29wLTAuMTkuMSwgV2hlbiBJIGZvbGxvd2VkIHRo
ZSBIaXZlR2V0aW5nU3RhcnRlZCAgdG8gdGhlIHN0ZXAgb2YNCiINCg0KU0VMRUNUIGEuZm9vIEZS
T00gaW52aXRlcyBhIFdIRVJFIGEuZHM9JzxEQVRFPic7DQoNCiINCkkgZ290IG5vIHJlc3BvbnNl
IGZyb20gaGFkb29wLCBhbmQgdGhlIGpvYnRyYWNrZXIgc2VlbSBhYm5vcm1hbCB3aGVuIEkgdHJ5
IHRvIGZyZXNoIHRoZSBwYWdlIG9mIGpvYnRyYWNrZXIuanNwLiBJIHVzZSB0aGUganN0YWNrIHRv
b2wgdG8gZ2V0IHRoZSBzdGFjayBpbmZvcm1hdGlvbiBvZiB0aGUgam9idHJhY2tlciBwcm9jZXNz
LGFuZCBJIGdvdCB0aGUgZm9sbG93Og0KDQpGb3VuZCBvbmUgSmF2YS1sZXZlbCBkZWFkbG9jazoN
Cj09PT09PT09PT09PT09PT09PT09PT09PT09PT09DQoiU29ja2V0TGlzdGVuZXIwLTciOg0KIHdh
aXRpbmcgdG8gbG9jayBtb25pdG9yIDB4MDAwMDAwMmMxNmY0MjBkMCAob2JqZWN0IDB4MDAwMDAw
MmE5ZWVkZGU2MCwgYSBvcmcuYXBhY2hlLmhhZG9vcC5tYXByZWQuSm9iVHJhY2tlciksDQogd2hp
Y2ggaXMgaGVsZCBieSAiSVBDIFNlcnZlciBoYW5kbGVyIDYgb24gOTAwMSINCiJJUEMgU2VydmVy
IGhhbmRsZXIgNiBvbiA5MDAxIjoNCiB3YWl0aW5nIHRvIGxvY2sgbW9uaXRvciAweDAwMDAwMDJj
MWE1ZGZkYzAgKG9iamVjdCAweDAwMDAwMDJhYTA1MGNlODgsIGEgb3JnLmFwYWNoZS5oYWRvb3Au
bWFwcmVkLkpvYkluUHJvZ3Jlc3MpLA0KIHdoaWNoIGlzIGhlbGQgYnkgImluaXRKb2JzIg0KImlu
aXRKb2JzIjoNCiB3YWl0aW5nIHRvIGxvY2sgbW9uaXRvciAweDAwMDAwMDJjMTZmNDIwZDAgKG9i
amVjdCAweDAwMDAwMDJhOWVlZGRlNjAsIGEgb3JnLmFwYWNoZS5oYWRvb3AubWFwcmVkLkpvYlRy
YWNrZXIpLA0KIHdoaWNoIGlzIGhlbGQgYnkgIklQQyBTZXJ2ZXIgaGFuZGxlciA2IG9uIDkwMDEi
DQoNCkV2ZXJ5dGltZSBJIHRyeSB0byBsYXVuY2ggYSBoaXZlIHF1ZXJ5ICx0aGlzIHNpdHVhdGlv
biBoYXBwZW5lZC4gSWYgSSBzd2l0Y2ggdG8gdGhlIHRydW5rIHZlcnNpb24gb2YgaGl2ZSwgdGhp
cyBzaXR1YXRpb24gZGlzYXBwZWFyZWQuDQpQbGVhc2UgaGVscCBtZSAhDQoNCmx1b2xpDQo8aHR0
cDovL3N2bi5hcGFjaGUub3JnL3JlcG9zL2FzZi9oYWRvb3AvaGl2ZS90YWdzL3JlbGVhc2UtMC4z
LjAtcmMwLz4NCg0KDQoNCi0tDQpZb3VycywNClpoZW5nDQo=

--_000_68B7689C98024D43B4C2709456F0B52009766241F3SCMBXC1TheFac_
Content-Type: text/html; charset="gb2312"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=3DContent-Type content=3D"text/html; charset=3Dgb2312">
<META content=3D"MSHTML 6.00.6000.16544" name=3DGENERATOR></HEAD>
<BODY>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D113332718-21052009><FONT face=3DA=
rial=20
color=3D#0000ff size=3D2>Also you could also just use the prebuilt binaries=
 for=20
those versions that are available from the asf download sites to keep it=20
simple.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D113332718-21052009><FONT face=3DA=
rial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D113332718-21052009><FONT face=3DA=
rial=20
color=3D#0000ff size=3D2>Ashish</FONT></SPAN></DIV><BR>
<DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft>
<HR tabIndex=3D-1>
<FONT face=3DTahoma size=3D2><B>From:</B> Zheng Shao [mailto:zshao9@gmail.c=
om]=20
<BR><B>Sent:</B> Thursday, May 21, 2009 2:59 AM<BR><B>To:</B>=20
hive-user@hadoop.apache.org<BR><B>Subject:</B> Re: jobtracker deadlock=20
immediately when I launch hive query<BR></FONT><BR></DIV>
<DIV></DIV>This problem is mostly likely to be caused by inconsistent hadoo=
p=20
versions.<BR><BR>Which version of hadoop do you use on the cluster?<BR>Make=
 sure=20
you run "ant clean package -Dhadoop.version=3D0.18.3' where 0.18.3 is your =
hadoop=20
version on the cluster.<BR><BR>Let us know what hadoop versions you are usi=
ng,=20
and whether that helps.<BR><BR>Zheng<BR><BR>
<DIV class=3Dgmail_quote>On Thu, May 21, 2009 at 2:54 AM, =C2=DE=C0=EE <SPA=
N dir=3Dltr>&lt;<A=20
href=3D"mailto:li.luol@alibaba-inc.com">li.luol@alibaba-inc.com</A>&gt;</SP=
AN>=20
wrote:<BR>
<BLOCKQUOTE class=3Dgmail_quote=20
style=3D"PADDING-LEFT: 1ex; MARGIN: 0pt 0pt 0pt 0.8ex; BORDER-LEFT: rgb(204=
,204,204) 1px solid">Hi=20
  all:<BR>&nbsp; I got a problem when I use Hive &nbsp;release-0.3.0-rc1 on=
 top=20
  of Hadoop-0.19.1, When I followed the HiveGetingStarted &nbsp;to the step=
=20
  of<BR>"<BR><BR>SELECT a.foo FROM invites a WHERE=20
  a.ds=3D'&lt;DATE&gt;';<BR><BR>"<BR>I got no response from hadoop, and the=
=20
  jobtracker seem abnormal when I try to fresh the page of jobtracker.jsp. =
I use=20
  the jstack tool to get the stack information of the jobtracker process,an=
d I=20
  got the follow:<BR><BR>Found one Java-level=20
  deadlock:<BR>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D<BR>"SocketListener0-7":<BR>&nbsp;waiting=20
  to lock monitor 0x0000002c16f420d0 (object 0x0000002a9eedde60, a=20
  org.apache.hadoop.mapred.JobTracker),<BR>&nbsp;which is held by "IPC Serv=
er=20
  handler 6 on 9001"<BR>"IPC Server handler 6 on 9001":<BR>&nbsp;waiting to=
 lock=20
  monitor 0x0000002c1a5dfdc0 (object 0x0000002aa050ce88, a=20
  org.apache.hadoop.mapred.JobInProgress),<BR>&nbsp;which is held by=20
  "initJobs"<BR>"initJobs":<BR>&nbsp;waiting to lock monitor 0x0000002c16f4=
20d0=20
  (object 0x0000002a9eedde60, a=20
  org.apache.hadoop.mapred.JobTracker),<BR>&nbsp;which is held by "IPC Serv=
er=20
  handler 6 on 9001"<BR><BR>Everytime I try to launch a hive query ,this=20
  situation happened. If I switch to the trunk version of hive, this situat=
ion=20
  disappeared.<BR>Please help me !<BR><BR>luoli<BR>&lt;<A=20
  href=3D"http://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.3.0-rc=
0/"=20
  target=3D_blank>http://svn.apache.org/repos/asf/hadoop/hive/tags/release-=
0.3.0-rc0/</A>&gt;<BR></BLOCKQUOTE></DIV><BR><BR=20
clear=3Dall><BR>-- <BR>Yours,<BR>Zheng<BR></BODY></HTML>

--_000_68B7689C98024D43B4C2709456F0B52009766241F3SCMBXC1TheFac_--