Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 425EA1819C for ; Thu, 30 Jul 2015 17:23:21 +0000 (UTC) Received: (qmail 23241 invoked by uid 500); 30 Jul 2015 17:23:21 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 23173 invoked by uid 500); 30 Jul 2015 17:23:21 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 23161 invoked by uid 99); 30 Jul 2015 17:23:20 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Jul 2015 17:23:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5BC791A8BD7 for ; Thu, 30 Jul 2015 17:23:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.9 X-Spam-Level: ** X-Spam-Status: No, score=2.9 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id yd098OEYzp-T for ; Thu, 30 Jul 2015 17:23:13 +0000 (UTC) Received: from mail-oi0-f45.google.com (mail-oi0-f45.google.com [209.85.218.45]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 785B720F20 for ; Thu, 30 Jul 2015 17:23:13 +0000 (UTC) Received: by oihq81 with SMTP id q81so25551754oih.2 for ; Thu, 30 Jul 2015 10:23:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=l0axMilasZ/ViCR3ueJKkRI+Juj6hQWxqTqeVGSqK+E=; b=Jc98YVtS0JLHTlb/Ko0bBANLkes2KRpEQ/c3vySxIIsxSDjvxYzvGfOoIP+cvOWjTn WBQGGmkw+mGHHST51Xo6SW5WSLm9nyMXtD6Uu7FUGlsEMTDd/vk85R1D2pZl1JbBvzVK LRzVSpbe18VQ8UupL5PPnvuqo0/KF0244uofBjhFwRCgmnzpThGSuwLgGFRWuMeiJGeg uDWXxr33n02iHQWrW7bKrZcoetr4/GE61gHIF94WGusyMXVKVt/Fslsg+LZjt9+mxT6C Q3TQhrgNKeyCl9Eg6UK+mwJ49mzRdlKhAjmLgN2ib3O/bGnfNF0VsQfxTEHyrx4oiIRa S8ZQ== MIME-Version: 1.0 X-Received: by 10.202.136.139 with SMTP id k133mr45491425oid.7.1438276992848; Thu, 30 Jul 2015 10:23:12 -0700 (PDT) Received: by 10.202.172.211 with HTTP; Thu, 30 Jul 2015 10:23:12 -0700 (PDT) In-Reply-To: References: Date: Thu, 30 Jul 2015 19:23:12 +0200 Message-ID: Subject: Re: A soft reminder From: Andra Lungu To: dev@flink.apache.org Content-Type: multipart/alternative; boundary=001a113e12b83f58bb051c1af5c0 --001a113e12b83f58bb051c1af5c0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Could you try adding the following lines to your code? VertexCentricConfiguration parameters =3D new VertexCentricConfiguration(); parameters.setSolutionSetUnmanagedMemory(true); return graphWithScoredVertices.runVertexCentricIteration(new VertexLabelUpdater(delta), new LabelMessenger(), maxIterations, parameters); Change the functions appropriately in the runVertexCentricIteration call. The error seems to be caused by this CompactingHashTable and this parameter deactivates its usage. I am very curious what happens in your case. If you could tell us the outcome, I'd greately appreciate it. On Thu, Jul 30, 2015 at 7:17 PM, G=C3=A1bor G=C3=A9vay w= rote: > Yes, in a VertexCentricIteration with a few million nodes, running > locally on my laptop with about 10 GB of memory given to java. > > Best, > Gabor > > > > 2015-07-30 18:32 GMT+02:00 Andra Lungu : > > Hi Gabor, > > > > Within a delta iteration right? > > > > On Thu, Jul 30, 2015 at 6:31 PM, G=C3=A1bor G=C3=A9vay wrote: > > > >> Hi, > >> > >> I have also run into this problem just now. It only happens with much > data. > >> > >> Best regards, > >> Gabor > >> > >> > >> > >> 2015-07-27 11:35 GMT+02:00 Felix Neutatz : > >> > Hi, > >> > > >> > I also encountered the EOF exception for a delta iteration with "mor= e > >> > data". With less data it works ... > >> > > >> > Best regards, > >> > Felix > >> > Am 27.07.2015 10:25 vorm. schrieb "Andra Lungu" < > lungu.andra@gmail.com>: > >> > > >> >> Hi Stephan, > >> >> > >> >> I tried to debug a bit around the EOF Exception. It seems that I am > >> pretty > >> >> useless on my own. I have no idea how to fix it. And it occurs in > quite > >> a > >> >> lot of experiments... I believe it's something behind a delta > iteration > >> >> [this is the common point between my experiments and the others' > code]. > >> >> > >> >> Some pointers would be greatly appreciated :) > >> >> Thanks! > >> >> Andra > >> >> > >> >> On Mon, Jul 27, 2015 at 9:32 AM, Stephan Ewen > wrote: > >> >> > >> >> > Hey! > >> >> > > >> >> > It is pretty much as you said: No one had the time to fix this so > far. > >> >> They > >> >> > are on the list, though, > >> >> > > >> >> > Do you want to pick up one of them? > >> >> > > >> >> > Greetings, > >> >> > Stephan > >> >> > > >> >> > > >> >> > On Fri, Jul 24, 2015 at 6:56 PM, Andra Lungu < > lungu.andra@gmail.com> > >> >> > wrote: > >> >> > > >> >> > > Hi guys, > >> >> > > > >> >> > > I opened these JIRAs a while ago and, unfortunately, no one had > >> time to > >> >> > > look at them :|. > >> >> > > > >> >> > > [1] https://issues.apache.org/jira/browse/FLINK-2361 > >> >> > > [2] https://issues.apache.org/jira/browse/FLINK-2360 > >> >> > > > >> >> > > [1] could probably be hacked, but [2] is a huge problem that wa= s > >> >> > > encountered by other people outside of Gelly. > >> >> > > > >> >> > > Thanks for the help! > >> >> > > Andra > >> >> > > > >> >> > > >> >> > >> > --001a113e12b83f58bb051c1af5c0--