Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A299A10445 for ; Wed, 16 Jul 2014 18:02:06 +0000 (UTC) Received: (qmail 64207 invoked by uid 500); 16 Jul 2014 18:02:06 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 64165 invoked by uid 500); 16 Jul 2014 18:02:06 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 64150 invoked by uid 500); 16 Jul 2014 18:02:06 -0000 Delivered-To: apmail-incubator-giraph-dev@incubator.apache.org Received: (qmail 64146 invoked by uid 99); 16 Jul 2014 18:02:06 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Jul 2014 18:02:06 +0000 Date: Wed, 16 Jul 2014 18:02:06 +0000 (UTC) From: "Hudson (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (GIRAPH-921) Create ByteValueVertex to store vertex values as bytes without object instance MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063811#comment-14063811 ] Hudson commented on GIRAPH-921: ------------------------------- FAILURE: Integrated in Giraph-trunk-Commit #1466 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1466/]) GIRAPH-921: Create ByteValueVertex to store vertex values as bytes without object instance (akyrola via majakabiljo) (majakabiljo: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=0a90177161d65ff2802d3926599561adc985dc65) * giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java * giraph-core/src/main/java/org/apache/giraph/utils/ConfigurationUtils.java * giraph-core/src/main/java/org/apache/giraph/conf/GiraphTypes.java * giraph-core/src/test/java/org/apache/giraph/graph/TestByteValueVertex.java * giraph-core/src/main/java/org/apache/giraph/graph/ByteValueVertex.java * giraph-core/src/main/java/org/apache/giraph/conf/ImmutableClassesGiraphConfiguration.java * giraph-core/src/test/java/org/apache/giraph/graph/TestVertexAndEdges.java * CHANGELOG * giraph-core/src/main/java/org/apache/giraph/conf/GiraphClasses.java * giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java > Create ByteValueVertex to store vertex values as bytes without object instance > ------------------------------------------------------------------------------ > > Key: GIRAPH-921 > URL: https://issues.apache.org/jira/browse/GIRAPH-921 > Project: Giraph > Issue Type: Improvement > Components: graph > Affects Versions: 1.1.0 > Reporter: Aapo Kyrola > Priority: Minor > Attachments: 0001-Created-ByteValueVertex-and-two-byte-to-value-conver.patch > > > Facebook task (bootcamped) #4320492 > This modification creates an alternative to DefaultVertex that stores the vertex value as raw bytes and only realizes the object when getValue() is called. The purpose of this change is to reduce memory consumption when vertex values are large. > User must define their own BytesToValueConverter class to translate the object type to bytes and back. I created ones for float and doubles. Using Java's serialization is bad idea as it adds a lot of overhead (for example full class names). However, one could easily create a generic bytevalueconverter that uses java serialization. > Configuration -vcl is used to define the vertex class and -bc the converter. For example: > -vcl org.apache.giraph.graph.ByteValueVertex -bc org.apache.giraph.graph.byteconverters.DoubleConverter -- This message was sent by Atlassian JIRA (v6.2#6252)