giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aapo Kyrola (JIRA)" <j...@apache.org>
Subject [jira] [Created] (GIRAPH-921) Create ByteValueVertex to store vertex values as bytes without object instance
Date Wed, 18 Jun 2014 12:46:12 GMT
Aapo Kyrola created GIRAPH-921:
----------------------------------

             Summary: Create ByteValueVertex to store vertex values as bytes without object
instance
                 Key: GIRAPH-921
                 URL: https://issues.apache.org/jira/browse/GIRAPH-921
             Project: Giraph
          Issue Type: Improvement
          Components: graph
            Reporter: Aapo Kyrola
            Priority: Minor


Facebook task (bootcamped) #4320492

This modification creates an alternative to DefaultVertex that stores the vertex value as
raw bytes and only realizes the object when getValue() is called. The purpose of this change
is to reduce memory consumption when vertex values are large.

User must define their own BytesToValueConverter class to translate the object type to bytes
and back.  I created ones for float and doubles. Using Java's serialization is bad idea as
it adds a lot of overhead (for example full class names). However, one could easily create
a generic bytevalueconverter that uses java serialization.

Configuration -vcl is used to define the vertex class and -bc the converter. For example:
 -vcl org.apache.giraph.graph.ByteValueVertex -bc org.apache.giraph.graph.byteconverters.DoubleConverter




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message