Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@giraph.apache.org
Received-SPF: pass (athena.apache.org: domain of claudio.martella@gmail.com
 designates 209.85.216.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <52FB38C4.5050002@apache.org>
References: 
 <CA+ULb+u-Mz=jW0A8jfZno4OHUcJszViyo+Fk-yEr34PuHbY5sg@mail.gmail.com>
 <52FAB4BE.2000005@apache.org>
 <CAFJOoJcQVjNhQtHO37JLE6FjWyewPhT9fcwfpWFBjsK5o+gQ3Q@mail.gmail.com>
 <52FB38C4.5050002@apache.org>
From: Claudio Martella <claudio.martella@gmail.com>
Date: Wed, 12 Feb 2014 10:26:12 +0100
Message-ID: 
 <CAFJOoJcc7dzz0=oeVJthXW=-2M821+Ti04gYNNZjtJdEdQM7HA@mail.gmail.com>
Subject: Re: GIRAPH-825 and GIRAPH-840
To: Sebastian Schelter <ssc@apache.org>
Cc: "dev@giraph.apache.org" <dev@giraph.apache.org>
Content-Type: multipart/alternative; boundary=047d7bdc78102654cd04f2322b33

--047d7bdc78102654cd04f2322b33
Content-Type: text/plain; charset=ISO-8859-1

the problem is that you're running with more threads than in-memory
partitions. increase the number of partitions in memory to be at least the
number of threads. i have no time right now to check the latest code, but
you should not set the number of stickypartitions by hand.


On Wed, Feb 12, 2014 at 10:03 AM, Sebastian Schelter <ssc@apache.org> wrote:

> I ran a first test with the new DiskBackedPartitionStore and it didn't
> work for me unfortunately. The job never leaves the input phase (superstep
> -1). I sshd onto one of the workers and it seems to wait forever on
> DiskBackedPartitionStore.getOrCreatePartition:
>
>    java.lang.Thread.State: BLOCKED (on object monitor)
>         at org.apache.giraph.partition.DiskBackedPartitionStore.
> getOrCreatePartition(DiskBackedPartitionStore.java:226)
>         - waiting to lock <0x00000000aeb757c8> (a
> org.apache.giraph.partition.DiskBackedPartitionStore$MetaPartition)
>
> Here are the custom arguments for my run, let me know if I should do
> another run with a different config.
>
> giraph.oneToAllMsgSending=true
> giraph.isStaticGraph=true
> giraph.numComputeThreads=15
> giraph.numInputThreads=15
> giraph.numOutputThreads=15
> giraph.maxNumberOfSupersteps=30
> giraph.useOutOfCoreGraph=true
> giraph.stickyPartitions=5
>
> I also ran the job without using oneToAllMsgSending and saw the same
> behavior.
>
> Best,
> Sebastian
>
>
>
> On 02/12/2014 12:44 AM, Claudio Martella wrote:
>
>> please give it a test. i've been working on this with armando. i'll give a
>> review, but we have been testing it for while. we'd really appreciate if
>> somebody else could run some additional tests as well. thanks!
>>
>>
>> On Wed, Feb 12, 2014 at 12:39 AM, Sebastian Schelter <ssc@apache.org>
>> wrote:
>>
>>  I'll test the patch from GIRAPH-825 this week.
>>>
>>>
>>> On 02/12/2014 12:10 AM, Roman Shaposhnik wrote:
>>>
>>>  Hi!
>>>>
>>>> Given how big the diff here are:
>>>>       https://issues.apache.org/jira/browse/GIRAPH-825
>>>>       https://issues.apache.org/jira/browse/GIRAPH-840
>>>> I am wondering whether it is realistic
>>>> to have them in 1.1.0.
>>>>
>>>> Would appreciate folks chiming in.
>>>>
>>>> Thanks,
>>>> Roman.
>>>>
>>>>
>>>>
>>>
>>
>>
>


-- 
   Claudio Martella

--047d7bdc78102654cd04f2322b33--