giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jan van der Lugt <janl...@gmail.com>
Subject Re: Problem occurs when I increase the number of workers
Date Tue, 09 Jul 2013 10:30:21 GMT
Could be something with memory. Are the workers running on the same
machine? How much memory has been allocated to each mapper slot? How much
physical memory is in the machine(s)?

- Jan


On Tue, Jul 9, 2013 at 12:15 PM, Wonbae Kim <zwigul@gmail.com> wrote:

> When running SimpleShortesPath example, it completed well if the number of
> worker is 1.
>
> hadoop jar \
> /home/wb/giraph-1.0.0/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> \
> org.apache.giraph.GiraphRunner \
> org.apache.giraph.examples.SimpleShortestPathsVertex \
> -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat \
> -vip /in/input \
> -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat \
> -op /outShortest \
> -w 1
>
>
> However, when I increase the number of workers , like 2, map tasks were
> killed.
>
> hadoop jar \
> /home/wb/giraph-1.0.0/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> \
> org.apache.giraph.GiraphRunner \
> org.apache.giraph.examples.SimpleShortestPathsVertex \
> -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat \
> -vip /in/input \
> -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat \
> -op /outShortest \
> -w 2
>
>
> How can I increase the number of workers?
>

Mime
View raw message