Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3F81D18050 for ; Mon, 27 Jul 2015 23:21:14 +0000 (UTC) Received: (qmail 30058 invoked by uid 500); 27 Jul 2015 23:21:04 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 30009 invoked by uid 500); 27 Jul 2015 23:21:04 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 29994 invoked by uid 500); 27 Jul 2015 23:21:04 -0000 Delivered-To: apmail-incubator-giraph-dev@incubator.apache.org Received: (qmail 29991 invoked by uid 99); 27 Jul 2015 23:21:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Jul 2015 23:21:04 +0000 Date: Mon, 27 Jul 2015 23:21:04 +0000 (UTC) From: "Hassan Eslami (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (GIRAPH-1023) Adding out-of-core messages to the newly added adaptive out-of-core mechanism MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643596#comment-14643596 ] Hassan Eslami commented on GIRAPH-1023: --------------------------------------- https://reviews.facebook.net/D42897 > Adding out-of-core messages to the newly added adaptive out-of-core mechanism > ----------------------------------------------------------------------------- > > Key: GIRAPH-1023 > URL: https://issues.apache.org/jira/browse/GIRAPH-1023 > Project: Giraph > Issue Type: New Feature > Components: graph > Reporter: Hassan Eslami > Assignee: Hassan Eslami > > GIRAPH-1022 implements an adaptive mechanism for out-of-core capable of handling graph data structure (in input/output and compute superstep). This diff, adds capability of handling out-of-core messages as well. This is useful specially in the case where message combiner is not used and large amount of messages may cause the job to either fail due to OOM (or its related exception), or run with a very slow performance due to extensive GC calls. -- This message was sent by Atlassian JIRA (v6.3.4#6332)