Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BC87617417 for ; Fri, 10 Jul 2015 08:48:09 +0000 (UTC) Received: (qmail 12556 invoked by uid 500); 10 Jul 2015 08:48:04 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 12512 invoked by uid 500); 10 Jul 2015 08:48:04 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 12502 invoked by uid 99); 10 Jul 2015 08:48:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jul 2015 08:48:04 +0000 Date: Fri, 10 Jul 2015 08:48:04 +0000 (UTC) From: "Stephan Ewen (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-2293) Division by Zero Exception MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FLINK-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621997#comment-14621997 ] Stephan Ewen commented on FLINK-2293: ------------------------------------- No worries, just glad the bug is fixed :-) > Division by Zero Exception > -------------------------- > > Key: FLINK-2293 > URL: https://issues.apache.org/jira/browse/FLINK-2293 > Project: Flink > Issue Type: Bug > Components: Local Runtime > Affects Versions: 0.9, 0.10 > Reporter: Andra Lungu > Assignee: Stephan Ewen > Priority: Critical > Fix For: 0.10, 0.9.1 > > > I am basically running an algorithm that simulates a Gather Sum Apply Iteration that performs Traingle Count (Why simulate it? Because you just need a superstep -> useless overhead if you use the runGatherSumApply function in Graph). > What happens, at a high level: > 1). Select neighbors with ID greater than the one corresponding to the current vertex; > 2). Propagate the received values to neighbors with higher ID; > 3). compute the number of triangles by checking whether > trgVertex.getValue().get(srcVertex.getId()); > As you can see, I *do not* perform any division at all; > code is here: https://github.com/andralungu/gelly-partitioning/blob/master/src/main/java/example/GSATriangleCount.java > Now for small graphs, 50MB max, the computation finishes nicely with the correct result. For a 10GB graph, however, I got this: > java.lang.ArithmeticException: / by zero > at org.apache.flink.runtime.operators.hash.MutableHashTable.insertIntoTable(MutableHashTable.java:836) > at org.apache.flink.runtime.operators.hash.MutableHashTable.buildTableFromSpilledPartition(MutableHashTable.java:819) > at org.apache.flink.runtime.operators.hash.MutableHashTable.prepareNextPartition(MutableHashTable.java:508) > at org.apache.flink.runtime.operators.hash.MutableHashTable.nextRecord(MutableHashTable.java:544) > at org.apache.flink.runtime.operators.hash.NonReusingBuildFirstHashMatchIterator.callWithNextKey(NonReusingBuildFirstHashMatchIterator.java:104) > at org.apache.flink.runtime.operators.MatchDriver.run(MatchDriver.java:173) > at org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496) > at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) > at java.lang.Thread.run(Thread.java:722) > see the full log here: https://gist.github.com/andralungu/984774f6348269df7951 -- This message was sent by Atlassian JIRA (v6.3.4#6332)