Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EC26DE6E7 for ; Thu, 7 Feb 2013 11:34:05 +0000 (UTC) Received: (qmail 28141 invoked by uid 500); 7 Feb 2013 11:34:04 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 28060 invoked by uid 500); 7 Feb 2013 11:34:03 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 28037 invoked by uid 99); 7 Feb 2013 11:34:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Feb 2013 11:34:02 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of viral.bajaria@gmail.com designates 209.85.216.43 as permitted sender) Received: from [209.85.216.43] (HELO mail-qa0-f43.google.com) (209.85.216.43) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Feb 2013 11:33:54 +0000 Received: by mail-qa0-f43.google.com with SMTP id dx4so2766998qab.2 for ; Thu, 07 Feb 2013 03:33:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:from:date:message-id:subject:to :content-type; bh=079kVD76etI0CeBOdWv5vtPg2FBKt8JqKXy8cEn/gow=; b=OFpIJxlb7xNcRGfDUbBKUFIpx+YE3Tdr6rFJKoOv7ezFvZPhuGYoDdqMcYvnAs7s+M U6FAY+ND9XIxkk5GdRnH89wauhuoEVIPemri8yxFArPTYxVj4/IHBnrVI8qHtt1T2kKY CW9fdpuyTQQGH9b0R/ARpua+sST1mLvVbUtY76gOkxpFcYrke2kjsRRf/AJTk20cIHmI 309m+DrI4Ug5k0//kwy8sgDsAayiJioxDkGbdcLtT/YAgqAFG4wIyDYfWV6+tyvaWsM1 RjwSIVZYGiPUFp7vZHsyhNbUB5JPpbT4Hh5TCn2cz6UKNz7ZS0qEXlcdCPnFUZzbovlb baYg== X-Received: by 10.49.61.102 with SMTP id o6mr413068qer.41.1360236813454; Thu, 07 Feb 2013 03:33:33 -0800 (PST) MIME-Version: 1.0 From: Viral Bajaria Date: Thu, 7 Feb 2013 03:33:33 -0800 Message-ID: <8466496664401979760@unknownmsgid> Subject: RE: NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil To: Krishna Rao , "user@hive.apache.org" Content-Type: multipart/alternative; boundary=047d7bdc0e7e138bbb04d520d041 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc0e7e138bbb04d520d041 Content-Type: text/plain; charset=ISO-8859-1 Are you seeing this after a few of the jobs have finished or on the first stage itself ? Also is this error on all boxes or just a few ? You can check MR logs and see which box or boxes are the culprits and debug from there. Viral ------------------------------ From: Krishna Rao Sent: 2/7/2013 2:46 AM To: user@hive.apache.org Subject: NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil Hi all, I'm occasionally getting the following error, usually after running an expensive Hive query (creating 20 or so MR jobs): *** Error during job, obtaining debugging information... Examining task ID: task_201301291405_1640_r_000001 (and more) from job job_201301291405_1640 Exception in thread "Thread-29" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil at org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:51) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.util.HostUtil at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 4 more CmdRunner::runCmd: Error running cmd in script, error: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask *** Any ideas on what's causing it? How can I find out more info on this error? Cheers, Krishna --047d7bdc0e7e138bbb04d520d041 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Are you seeing this after a few of the jobs have finished or = on the first stage itself ? Also is this error on all boxes or just a few ?= You can check MR logs and see which box or boxes are the culprits and debu= g from there.

Viral
From: Krishna Rao
Sent: 2/7/2013 2:46 AM
To: = user@hive.apache.org
= Subject: NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil=

Hi all,

I'm= occasionally getting the following error, usually after running an expensi= ve Hive query (creating 20 or so MR jobs):

***
Error during job, obtaining debugging information... =A0= =A0
Examining task ID: task_201301291405_1640_r_000001 (and more) from job job_= 201301291405_1640
Exception in thread "Thread-= 29" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/util/H= ostUtil
=A0 =A0 =A0 =A0 at org.apache.hadoop.hive.shims.Hadoop23= Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:51)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabb= er.getTaskInfos(JobDebugger.java:186)
=A0 =A0 =A0 = =A0 at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDe= bugger.java:142)
=A0 =A0 =A0 =A0 at java.lang.Thread.run(Thread.java:662)=
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.ut= il.HostUtil
=A0 =A0 =A0 =A0 at java.net.URLClassLoa= der$1.run(URLClassLoader.java:202)
=A0 =A0 =A0 =A0 at java.security.AccessController.doPriv= ileged(Native Method)
=A0 =A0 =A0 =A0 at java.net.URLClassLoader.findClass(URLClassLoader.java:19= 0)
=A0 =A0 =A0 =A0 at java.lang.ClassLoader.loadCla= ss(ClassLoader.java:306)
=A0 =A0 =A0 =A0 at sun.misc.Launcher$AppClassLoader.load= Class(Launcher.java:301)
=A0 =A0 =A0 =A0 at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
=A0 =A0 =A0 =A0 ... 4 more
CmdRunner::runCmd: Error running cmd in script, error: FAILED: Execution Er= ror, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
***

Any ideas on what'= ;s causing it?
How can I find out more info on this error?

=
Cheers,

Krishna
=
--047d7bdc0e7e138bbb04d520d041--