Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3108711E56 for ; Thu, 20 Feb 2014 17:43:23 +0000 (UTC) Received: (qmail 83391 invoked by uid 500); 20 Feb 2014 17:43:22 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 83310 invoked by uid 500); 20 Feb 2014 17:43:21 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 83301 invoked by uid 99); 20 Feb 2014 17:43:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Feb 2014 17:43:21 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of Stefan.Beskow@sas.com designates 216.32.181.181 as permitted sender) Received: from [216.32.181.181] (HELO ch1outboundpool.messaging.microsoft.com) (216.32.181.181) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Feb 2014 17:43:17 +0000 Received: from mail149-ch1-R.bigfish.com (10.43.68.252) by CH1EHSOBE006.bigfish.com (10.43.70.56) with Microsoft SMTP Server id 14.1.225.22; Thu, 20 Feb 2014 17:42:55 +0000 Received: from mail149-ch1 (localhost [127.0.0.1]) by mail149-ch1-R.bigfish.com (Postfix) with ESMTP id DD1AA401DD for ; Thu, 20 Feb 2014 17:42:55 +0000 (UTC) X-Forefront-Antispam-Report: CIP:149.173.6.153;KIP:(null);UIP:(null);IPV:NLI;H:mercav03r.na.sas.com;RD:mercav03r.na.sas.com;EFVD:NLI X-SpamScore: -4 X-BigFish: S-4(z579ehz98dI9371IfecI7eaI542I1432I4015Izz1f42h2148h208ch1ee6h1de0h1fdah2073h2146h1202h1e76h2189h1d1ah1d2ah21bch1fc6hzz1de098h8275bh8275dh1de097h186068hz2fh109h2a8h839h944hcf6hd24hf0ah1220h1288h12a5h12a9h12bdh137ah13b6h1441h1504h1537h153bh162dh1631h1758h18e1h1946h19b5h1b0ah224fh1d0ch1d2eh1d3fh1dfeh1dffh1e1dh1fe8h1ff5h2216h22d0h2336h2461h2487h24d7h2516h2545h255eh1c22i9a9j1155h) Received-SPF: pass (mail149-ch1: domain of sas.com designates 149.173.6.153 as permitted sender) client-ip=149.173.6.153; envelope-from=Stefan.Beskow@sas.com; helo=mercav03r.na.sas.com ;r.na.sas.com ; Received: from mail149-ch1 (localhost.localdomain [127.0.0.1]) by mail149-ch1 (MessageSwitch) id 1392918173769766_2134; Thu, 20 Feb 2014 17:42:53 +0000 (UTC) Received: from CH1EHSMHS036.bigfish.com (snatpool1.int.messaging.microsoft.com [10.43.68.240]) by mail149-ch1.bigfish.com (Postfix) with ESMTP id AE1E44C0081 for ; Thu, 20 Feb 2014 17:42:53 +0000 (UTC) Received: from mercav03r.na.sas.com (149.173.6.153) by CH1EHSMHS036.bigfish.com (10.43.69.245) with Microsoft SMTP Server (TLS) id 14.16.227.3; Thu, 20 Feb 2014 17:42:53 +0000 X-TM-IMSS-Message-ID: Received: from MERCMBX21R.na.SAS.com ([10.16.10.2]) by mercav03R.na.sas.com ([10.19.10.56]) with ESMTP (TREND IMSS SMTP Service 7.1; TLSv1/SSLv3 AES128-SHA (128/128)) id d3d9fb8900052af5 ; Thu, 20 Feb 2014 12:42:52 -0500 Received: from MERCMBX25R.na.SAS.com (fd07:af30:a3fc:a10:dd8d:bae7:7f9b:c636) by MERCMBX21R.na.SAS.com (fd07:af30:a3fc:a10:21f9:88ed:e4e8:9a0b) with Microsoft SMTP Server (TLS) id 15.0.775.38; Thu, 20 Feb 2014 12:42:46 -0500 Received: from MERCMBX25R.na.SAS.com ([fe80::dc7a:4da6:4fa5:7efc]) by MERCMBX25R.na.SAS.com ([fe80::dc7a:4da6:4fa5:7efc%16]) with mapi id 15.00.0775.031; Thu, 20 Feb 2014 12:42:45 -0500 From: Stefan Beskow To: "user@giraph.apache.org" Subject: RE: Problem running SimpleShortestPathsComputation on CDH5 with Hadoop 2.2.0 Thread-Topic: Problem running SimpleShortestPathsComputation on CDH5 with Hadoop 2.2.0 Thread-Index: Ac8ttz2bT7xNDUaMS0W2ILSgsy2ZwwALituAAAjwMtA= Date: Thu, 20 Feb 2014 17:42:45 +0000 Message-ID: <32c1ea4f88ec4fd2bc0815b012c0de48@MERCMBX25R.na.SAS.com> References: <50d24338c9164ee2929995e22f532a96@MERCMBX25R.na.SAS.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.28.11.233] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: sas.com X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn% X-Virus-Checked: Checked by ClamAV on apache.org Thanks Roman for getting back to me so quickly. I checked with Cloudera and= they have a maven repository for CDH5 (version 2.2.0-cdh5.0.0-beta-2) as s= hown below: cloudera https://repository.cloudera.com/artifactory/cloudera-repos/ I added that to the pom.xml file and ran a new build using the following co= mmand: mvn -Phadoop_yarn -Dhadoop.version=3D2.2.0-cdh5.0.0-beta-2 clean package -D= skipTests The program now gets further, but throws the following exception: Container: container_1392713839733_0017_01_000002 on el01cn04.unx.sas.com_8= 041 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D LogType: task-2-stderr.log LogLength: 637 Log Contents: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/girap= h/yarn/GiraphYarnTask Caused by: java.lang.ClassNotFoundException: org.apache.giraph.yarn.GiraphY= arnTask at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.giraph.yarn.GiraphYarnTask. Prog= ram will exit. Do you have any additional suggestions for what I should try? Thanks for your help. Stefan -----Original Message----- From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman= Shaposhnik Sent: Wednesday, February 19, 2014 4:43 PM To: user@giraph.apache.org Subject: Re: Problem running SimpleShortestPathsComputation on CDH5 with Ha= doop 2.2.0 On Wed, Feb 19, 2014 at 1:12 PM, Stefan Beskow wrot= e: > Hi. > > I checked out and built Giraph for Cloudera CDH5 with Hadoop 2.2.0=20 > using the > following: > > git clone git://git.apache.org/giraph.git snapshot_from_git cd=20 > snapshot_from_git mvn -Phadoop_yarn -Dhadoop.version=3D2.2.0 clean=20 > package -DskipTests It may help to build against CDH5 directly by: * manually adding repository.cloudera.com to the set of repos * specifying -Dhadoop.version=3D2.2.0-cdh5.0.0-beta-2 > When I run the sample application > org.apache.giraph.examples.SimpleShortestPathsComputation I get the=20 > following exception: You need to provide way more logs from the YARN side for us to make sense o= f it. Thanks, Roman.