Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ABA5B188A3 for ; Tue, 15 Dec 2015 11:45:56 +0000 (UTC) Received: (qmail 2520 invoked by uid 500); 15 Dec 2015 11:45:52 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 2337 invoked by uid 500); 15 Dec 2015 11:45:52 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 2326 invoked by uid 99); 15 Dec 2015 11:45:52 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Dec 2015 11:45:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9DB48C3163 for ; Tue, 15 Dec 2015 11:45:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.898 X-Spam-Level: ** X-Spam-Status: No, score=2.898 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id DTm5NBmC00jL for ; Tue, 15 Dec 2015 11:45:50 +0000 (UTC) Received: from mail-pf0-f169.google.com (mail-pf0-f169.google.com [209.85.192.169]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 11AEC2673A for ; Tue, 15 Dec 2015 11:45:50 +0000 (UTC) Received: by mail-pf0-f169.google.com with SMTP id u66so3577918pfb.3 for ; Tue, 15 Dec 2015 03:45:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=7beG+sHqGaoVr/DT7mI8s/an+XqNV9YxQOmiOAAfMfg=; b=IvfuwBYnIl4sz7+jQhCXXKWlOi4EJn5oa+FCjtTLfOOEpqOb1c2kpyYXER7MUBFWx8 WSfaH2I/y97Z1DTWuNsEzKcO7WetbHrniV1JHpGpP8Purgm91VZXbq1yhRYuKnTk0NNS 7btf4u+wL8nRRl/oeU4ZNA7xtcPVRHM+aVTjpFjqmvWfX9S/xCsjqR53Z18tkTYyhQES X4WWA+UG4e6l1f3eMiTdCYl+D4UoAlJQcMQmO0idSUdvX3mNki6G5CEv8XhWM1dVfurP 6+PJyhv+qtYYjdFi5TmIcocJxDCn7h68PUPshzYYWsS8TVW22NcxWrA7kc4NWn2TJYOn 1IUA== X-Received: by 10.98.79.25 with SMTP id d25mr30640680pfb.58.1450179949673; Tue, 15 Dec 2015 03:45:49 -0800 (PST) Received: from [192.168.1.66] (host86-185-220-207.range86-185.btcentralplus.com. [86.185.220.207]) by smtp.gmail.com with ESMTPSA id uz4sm1813130pac.39.2015.12.15.03.45.48 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 15 Dec 2015 03:45:49 -0800 (PST) Content-Type: multipart/alternative; boundary="Apple-Mail=_21502631-2FE6-42F6-8B46-C2A585395419" Mime-Version: 1.0 (Mac OS X Mail 9.0 \(3094\)) Subject: Re: GridMix doesn't run ClassNotFoundException Rumen From: Wellington Chevreuil In-Reply-To: <566E925E.6070408@yahoo.com> Date: Tue, 15 Dec 2015 11:45:46 +0000 Cc: user@hadoop.apache.org Message-Id: References: <566E925E.6070408@yahoo.com> To: siscia X-Mailer: Apple Mail (2.3094) --Apple-Mail=_21502631-2FE6-42F6-8B46-C2A585395419 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi Simone, You should make sure to include hadoop-rumen-2.6.0.jar on the classpath = for the Nodemanagers, or include it on the classpath of your job. > On 14 Dec 2015, at 09:56, siscia = wrote: >=20 > Hello folks, >=20 > I am trying to run a simulation with GridMix but the simulation fails = every time. >=20 > If I inspect the log I find the error with looks like this: >=20 > "Error:=20 > java.lang.ClassNotFoundException: = org.apache.hadoop.tools.rumen.ResourceUsageMetrics\n\tat >=20 > java.net.URLClassLoader$1.run(URLClassLoader.java:366)\n\tat = java.net.URLClassLoader$1.run(URLClassLoader.java:355)\n\tat = java.security.AccessController.doPrivileged(Native Method)\n\tat = java.net.URLClassLoader.findClass(URLClassLoader.java:354)\n\tat = java.lang.ClassLoader.loadClass(ClassLoader.java:425)\n\tat = sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)\n\tat = java.lang.ClassLoader.loadClass(ClassLoader.java:358)\n\tat = java.lang.Class.getDeclaredConstructors0(Native Method)\n\tat = java.lang.Class.privateGetDeclaredConstructors(Class.java:2595)\n\tat = java.lang.Class.getConstructor0(Class.java:2895)\n\tat = java.lang.Class.getDeclaredConstructor(Class.java:2066)\n\tat = org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:12= 5)\n\tat = org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer= .deserialize(WritableSerialization.java:66)\n\tat = org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer= .deserialize(WritableSerialization.java:42)\n\tat = org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)\n\tat = org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751)\n\tat = org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)\n\tat = org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)\n\tat = java.security.AccessController.doPrivileged(Native Method)\n\tat = javax.security.auth.Subject.doAs(Subject.java:415)\n\tat = org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.= java:1656)\n\tat = org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)\n", >=20 > The error is pretty clear, but I have no idea how to fix it. >=20 > I run GridMix by command line with: >=20 > bin/hadoop jar share/hadoop/tools/lib/hadoop-gridmix-2.6.1.jar iopath = trace.json >=20 > Any hits ? >=20 > Cheers :) >=20 > Simone --Apple-Mail=_21502631-2FE6-42F6-8B46-C2A585395419 Content-Transfer-Encoding: 7bit Content-Type: text/html; charset=us-ascii Hi Simone,

You should make sure to include hadoop-rumen-2.6.0.jar on the classpath for the Nodemanagers, or include it on the classpath of your job.

On 14 Dec 2015, at 09:56, siscia <sisciamirror@yahoo.com.INVALID> wrote:

Hello folks,

I am trying to run a simulation with GridMix but the simulation fails every time.

If I inspect the log I find the error with looks like this:

"Error:
java.lang.ClassNotFoundException: org.apache.hadoop.tools.rumen.ResourceUsageMetrics\n\tat

java.net.URLClassLoader$1.run(URLClassLoader.java:366)\n\tat java.net.URLClassLoader$1.run(URLClassLoader.java:355)\n\tat java.security.AccessController.doPrivileged(Native Method)\n\tat java.net.URLClassLoader.findClass(URLClassLoader.java:354)\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:425)\n\tat sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:358)\n\tat java.lang.Class.getDeclaredConstructors0(Native Method)\n\tat java.lang.Class.privateGetDeclaredConstructors(Class.java:2595)\n\tat java.lang.Class.getConstructor0(Class.java:2895)\n\tat java.lang.Class.getDeclaredConstructor(Class.java:2066)\n\tat org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)\n\tat org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:66)\n\tat org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)\n\tat org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)\n\tat org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751)\n\tat org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)\n\tat org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)\n\tat java.security.AccessController.doPrivileged(Native Method)\n\tat javax.security.auth.Subject.doAs(Subject.java:415)\n\tat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656)\n\tat org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)\n",


The error is pretty clear, but I have no idea how to fix it.

I run GridMix by command line with:

bin/hadoop jar share/hadoop/tools/lib/hadoop-gridmix-2.6.1.jar iopath trace.json

Any hits ?

Cheers :)

Simone

--Apple-Mail=_21502631-2FE6-42F6-8B46-C2A585395419--