Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ADDFFDF3A for ; Thu, 4 Oct 2012 21:19:26 +0000 (UTC) Received: (qmail 12740 invoked by uid 500); 4 Oct 2012 21:19:26 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 12714 invoked by uid 500); 4 Oct 2012 21:19:26 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 12706 invoked by uid 99); 4 Oct 2012 21:19:26 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Oct 2012 21:19:26 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of eric.newton@gmail.com designates 209.85.223.169 as permitted sender) Received: from [209.85.223.169] (HELO mail-ie0-f169.google.com) (209.85.223.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Oct 2012 21:19:19 +0000 Received: by mail-ie0-f169.google.com with SMTP id 10so2451483ied.0 for ; Thu, 04 Oct 2012 14:18:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=nCIgwJd/sKtk95G7I/oCISCx7buDlk6bIYmEQIogEWE=; b=PiL6ft5XxBlOD7DrA1F471o6lwbFs4fjOBPzH7QpIrs7D0p/oHHDNXmZwpxI9GKLEI 5kH93JN8qOq31asKMMfS+c6+pakxS64aNvTSGdZUJVn4JL4tynNf4pjTJuktIkFFqBPJ oLgIWjSgbf3/99KV0x9QAfO4Rr/5mL4iCI86efQP673N94qu5nqEc09wGNtmSZANtaX2 ifkCe4YAoE0Yg111otj8Mun3rLaKWzwl2uA5je4pJIBzWTMldKJfXu3cukqxEKfquvG/ NWBXbUXB/ZHgcIaoo9VyPH6+nGNz34gICodu29y/8ENxrurllT/jCjUTiTEvNXFo6pME JL2Q== MIME-Version: 1.0 Received: by 10.50.57.130 with SMTP id i2mr17049874igq.56.1349385539385; Thu, 04 Oct 2012 14:18:59 -0700 (PDT) Received: by 10.50.55.65 with HTTP; Thu, 4 Oct 2012 14:18:59 -0700 (PDT) In-Reply-To: References: Date: Thu, 4 Oct 2012 17:18:59 -0400 Message-ID: Subject: Re: Problem with CloudStone4 benchmark in accumulo-1.4.1 From: Eric Newton To: user@accumulo.apache.org, markus.mock@gmail.com Content-Type: multipart/alternative; boundary=14dae93403b7bd7a3d04cb424db1 X-Virus-Checked: Checked by ClamAV on apache.org --14dae93403b7bd7a3d04cb424db1 Content-Type: text/plain; charset=ISO-8859-1 It's not a known issue, but the benchmarks don't get the love they should. Please make a ticket. Thanks! -Eric On Thu, Oct 4, 2012 at 2:04 PM, Markus Mock wrote: > Hi I am running into this problem with the CloudStone4 benchmark: > > the mapreduce job it launches fails with: > > > java.lang.RuntimeException: java.lang.ClassNotFoundException: > org.apache.accumulo.core.clien\ > t.mapreduce.AccumuloOutputFormat^M > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1004)^M > at > org.apache.hadoop.mapreduce.JobContext.getOutputFormatClass(JobContext.java:253)^\ > M > at org.apache.hadoop.mapred.Task.initialize(Task.java:509)^M > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:306)^M > at org.apache.hadoop.mapred.Child$4.run(Child.java:266)^M > at java.security.AccessController.doPrivileged(Native Method)^M > at javax.security.auth.Subject.doAs(Subject.java:396)^M > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:12\ > 78)^M > at org.apache.hadoop.mapred.Child.main(Child.java:260)^M > Caused by: java.lang.ClassNotFoundException: > org.apache.accumulo.core.client.mapreduce.Accum\ > uloOutputFormat^M > > I added some printout to the code to see how it invokes / launches that > job: > > > Running TeraSortIngest > about to call runner.start > running: ['/usr/lib/hadoop-0.20/accumulo/accumulo-1.4.1/bin/accumulo', > 'org.apache.accumulo\ > .examples.simple.mapreduce.TeraSortIngest', '-libjars', > '/usr/lib/hadoop-0.20/accumulo/accum\ > > ulo-1.4.1/lib/accumulo-core-1.4.1.jar,/usr/lib/hadoop-0.20/accumulo/accumulo-1.4.1/lib/libth\ > > rift-0.6.1.jar,/usr/lib/hadoop/accumulo/zookeeper-3.3.6/zookeeper-3.3.6.jar,/usr/lib/hadoop-\ > 0.20/accumulo/accumulo-1.4.1/lib/accumulo-start-1.4.1.jar', > '10000000000', '10', '10', '78',\ > '78', 'CloudIngestTest', 'markus-dist-test', '', > 'root', 'secret', '400']^M > > Is this a known issue? What would be the workaround? It seems that the > tasks cannot find the > AccumuloOutputFormat class, however, it is on the -libjars line and I > also checked the task trackers > and the jar files seem to be in the distributed cache, so any idea why > the tasks don't find them? > Is that benchmark broken? > > Thanks. > > -- Markus > --14dae93403b7bd7a3d04cb424db1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable It's not a known issue, but the benchmarks don't get the love they = should. =A0Please make a ticket.

Thanks!

<= /div>
-Eric

On Thu, Oct 4, 2012 = at 2:04 PM, Markus Mock <markus.mock@gmail.com> wrote:
Hi I am running into this problem with the C= loudStone4 =A0benchmark:

the mapreduce job it launches fails with:


java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.accumulo.core.clien\
t.mapreduce.AccumuloOutputFormat^M
=A0 =A0 =A0 =A0 at org.apache.hadoop.conf.Configuration.getClass(Configurat= ion.java:1004)^M
=A0 =A0 =A0 =A0 at org.apache.hadoop.mapreduce.JobContext.getOutputFormatCl= ass(JobContext.java:253)^\
M
=A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.Task.initialize(Task.java:509)^= M
=A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:306)^M=
=A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.Child$4.run(Child.java:266)^M =A0 =A0 =A0 =A0 at java.security.AccessController.doPrivileged(Native Metho= d)^M
=A0 =A0 =A0 =A0 at javax.security.auth.Subject.doAs(Subject.java:396)^M
=A0 =A0 =A0 =A0 at org.apache.hadoop.security.UserGroupInformation.doAs(Use= rGroupInformation.java:12\
78)^M
=A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.Child.main(Child.java:260)^M Caused by: java.lang.ClassNotFoundException:
org.apache.accumulo.core.client.mapreduce.Accum\
uloOutputFormat^M

I added some printout to the code to see how it invokes / launches that job= :


Running TeraSortIngest
about to call runner.start
running: =A0['/usr/lib/hadoop-0.20/accumulo/accumulo-1.4.1/bin/accumulo= ',
'org.apache.accumulo\
.examples.simple.mapreduce.TeraSortIngest', '-libjars',
'/usr/lib/hadoop-0.20/accumulo/accum\
ulo-1.4.1/lib/accumulo-core-1.4.1.jar,/usr/lib/hadoop-0.20/accumulo/accumul= o-1.4.1/lib/libth\
rift-0.6.1.jar,/usr/lib/hadoop/accumulo/zookeeper-3.3.6/zookeeper-3.3.6.jar= ,/usr/lib/hadoop-\
0.20/accumulo/accumulo-1.4.1/lib/accumulo-start-1.4.1.jar',
'10000000000', '10', '10', '78',\
=A0'78', 'CloudIngestTest', 'markus-dist-test', = 9;<IP edited out>',
'root', 'secret', '400']^M

Is this a known issue? What would be the workaround? It seems that the
tasks cannot find the
AccumuloOutputFormat class, however, it is on the -libjars line and I
also checked the task trackers
and the jar files seem to be in the distributed cache, so any idea why
the tasks don't find them?
Is that benchmark broken?

Thanks.

=A0-- Markus

--14dae93403b7bd7a3d04cb424db1--