Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9749410D7F for ; Mon, 19 Aug 2013 15:45:47 +0000 (UTC) Received: (qmail 80096 invoked by uid 500); 19 Aug 2013 15:45:47 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 79320 invoked by uid 500); 19 Aug 2013 15:45:15 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 79147 invoked by uid 99); 19 Aug 2013 15:45:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Aug 2013 15:45:10 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: local policy) Received: from [209.85.212.172] (HELO mail-wi0-f172.google.com) (209.85.212.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Aug 2013 15:45:05 +0000 Received: by mail-wi0-f172.google.com with SMTP id hj13so3245419wib.17 for ; Mon, 19 Aug 2013 08:44:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=/g3k5urm3OR2madgYNFIxU9SbZ4fw/QyYgjEyVqJ9mI=; b=MGjWPetjtrzvj1oFQtONL13q4o0DiFijR1JS207rmhYEwGWahU4vJ+OgOJClz/H9mK yq4D0Yfi/3g1vPh/a1XhwvAExNVep62nwC7p9quC7JAVG58IQSwH+OwIuO/Z4d+NwD6p 6+KpnrpdrM0tq8v4q4CbbFRZAEyT5FwXcTnLq8eCG4M1WIwBnK1dQwCqqceWd2O3K+p/ WT2QHGGssva3CIUXremlpALsqYE8nL+YXgDDPFLxmPzGJhKraaQsJ2O5VEAHAwu+fwB4 Z8I8ywZoXX/ZXDauUl6IecPqlqVKNeVdzktSzIaHjFWwv8LNvGiC0tsj4y6QfCyavkWe abNQ== X-Gm-Message-State: ALoCoQlRmMfnliaBH0a0IXZdqYC0CEBWRpr9YMTe6HDsNEMDkOaYnWfb6voR+12mdVaeXvlQBNuF MIME-Version: 1.0 X-Received: by 10.180.36.169 with SMTP id r9mr8801435wij.20.1376927064425; Mon, 19 Aug 2013 08:44:24 -0700 (PDT) Received: by 10.194.171.194 with HTTP; Mon, 19 Aug 2013 08:44:24 -0700 (PDT) In-Reply-To: References: Date: Mon, 19 Aug 2013 11:44:24 -0400 Message-ID: Subject: Re: Running Giraph on YARN From: Milinda Pathirage To: user@giraph.apache.org, dev@giraph.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Hi Devs, I was able to get Giraph running on Yarn by creating Yarn specific configuration programmatically. I think that it's better if we can have some shell scripts specific to Yarn (or may be modifications to existing shell scripts), so that we can easily deploy Giraph jobs on Yarn clusters. Please let me know if anyone is working on this. If no one is working on that, I would like to work on that. Thanks Milinda On Tue, Aug 13, 2013 at 2:33 PM, Milinda Pathirage wrote: > Hi, > > I'm trying to get Giraph running on YARN based on TestYarnJob test > case. But having issues with moving required jars to YARN environment. > I'm using single node YARN setup. I can see the job in YARN, but with > following error. > > "Error: Could not find or load main class > org.apache.giraph.yarn.GiraphApplicationMaster" > > I found that FileSystem.get(giraphConf) returns LocalFS inside > resource copy methods by debugging. Can someone please point me to a > doc or some writeup which describes how to properly configure > GiraphYarnClient? > > Thanks > Milinda > > -- > Milinda Pathirage > > twitter: milindalakmal > skype: milinda.pathirage > blog: http://milinda.pathirage.org -- Milinda Pathirage twitter: milindalakmal skype: milinda.pathirage blog: http://milinda.pathirage.org