giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Milinda Pathirage <mpath...@umail.iu.edu>
Subject Re: Running Giraph on YARN
Date Mon, 19 Aug 2013 15:44:24 GMT
Hi Devs,

I was able to get Giraph running on Yarn by creating Yarn specific
configuration programmatically. I think that it's better if we can
have some shell scripts specific to Yarn (or may be modifications to
existing shell scripts), so that we can easily deploy Giraph jobs on
Yarn clusters. Please let me know if anyone is working on this. If no
one is working on that, I would like to work on that.

Thanks
Milinda

On Tue, Aug 13, 2013 at 2:33 PM, Milinda Pathirage
<mpathira@umail.iu.edu> wrote:
> Hi,
>
> I'm trying to get Giraph running on YARN based on TestYarnJob test
> case. But having issues with moving required jars to YARN environment.
> I'm using single node YARN setup. I can see the job in YARN, but with
> following error.
>
> "Error: Could not find or load main class
> org.apache.giraph.yarn.GiraphApplicationMaster"
>
> I found that FileSystem.get(giraphConf) returns LocalFS inside
> resource copy methods by debugging. Can someone please point me to a
> doc or some writeup which describes how to properly configure
> GiraphYarnClient?
>
> Thanks
> Milinda
>
> --
> Milinda Pathirage
>
> twitter: milindalakmal
> skype: milinda.pathirage
> blog: http://milinda.pathirage.org



-- 
Milinda Pathirage

twitter: milindalakmal
skype: milinda.pathirage
blog: http://milinda.pathirage.org

Mime
View raw message