giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wonbae Kim <zwi...@gmail.com>
Subject Re: Problem occurs when I increase the number of workers
Date Wed, 17 Jul 2013 01:15:38 GMT
How can I check what you asked ? I'm too newbie sorry...


2013/7/9 Jan van der Lugt <janlugt@gmail.com>

> Could be something with memory. Are the workers running on the same
> machine? How much memory has been allocated to each mapper slot? How much
> physical memory is in the machine(s)?
>
> - Jan
>
>
> On Tue, Jul 9, 2013 at 12:15 PM, Wonbae Kim <zwigul@gmail.com> wrote:
>
>> When running SimpleShortesPath example, it completed well if the number
>> of worker is 1.
>>
>> hadoop jar \
>> /home/wb/giraph-1.0.0/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> \
>> org.apache.giraph.GiraphRunner \
>> org.apache.giraph.examples.SimpleShortestPathsVertex \
>> -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat \
>> -vip /in/input \
>> -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat \
>> -op /outShortest \
>> -w 1
>>
>>
>> However, when I increase the number of workers , like 2, map tasks were
>> killed.
>>
>> hadoop jar \
>> /home/wb/giraph-1.0.0/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> \
>> org.apache.giraph.GiraphRunner \
>> org.apache.giraph.examples.SimpleShortestPathsVertex \
>> -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat \
>> -vip /in/input \
>> -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat \
>> -op /outShortest \
>> -w 2
>>
>>
>> How can I increase the number of workers?
>>
>
>

Mime
View raw message