giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-564) Input/output formats and readers/writers should implement ImmutableClassesGiraphConfigurable
Date Sat, 06 Apr 2013 00:41:16 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13624240#comment-13624240
] 

Hudson commented on GIRAPH-564:
-------------------------------

Integrated in Giraph-trunk-Commit #884 (See [https://builds.apache.org/job/Giraph-trunk-Commit/884/])
    GIRAPH-564: Input/output formats and readers/writers should implement (Revision 84cdd9f839e1336f4ee92891a457b5d007920e4c)

     Result = SUCCESS
aching : http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=84cdd9f839e1336f4ee92891a457b5d007920e4c
Files : 
* giraph-core/src/main/java/org/apache/giraph/io/formats/TextEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/VertexInputFormat.java
* giraph-accumulo/src/main/java/org/apache/giraph/io/accumulo/AccumuloVertexOutputFormat.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/io/VertexOutputFormat.java
* giraph-accumulo/src/test/java/org/apache/giraph/io/accumulo/edgemarker/AccumuloEdgeOutputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/HiveVertexOutputFormat.java
* giraph-core/src/main/java/org/apache/giraph/aggregators/TextAggregatorWriter.java
* giraph-core/src/main/java/org/apache/giraph/utils/InMemoryVertexInputFormat.java
* giraph-hbase/src/main/java/org/apache/giraph/io/hbase/HBaseVertexInputFormat.java
* giraph-hcatalog/src/main/java/org/apache/giraph/io/hcatalog/HCatalogVertexInputFormat.java
* giraph-examples/src/main/java/org/apache/giraph/examples/SimplePageRankVertex.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/AdjacencyListTextVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/VertexValueReader.java
* giraph-hbase/src/main/java/org/apache/giraph/io/hbase/HBaseVertexOutputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/SequenceFileVertexOutputFormat.java
* giraph-hcatalog/src/main/java/org/apache/giraph/io/hcatalog/HCatalogEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/aggregators/AggregatorWriter.java
* giraph-accumulo/src/test/java/org/apache/giraph/io/accumulo/edgemarker/AccumuloEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/iterables/EdgeReaderWrapper.java
* giraph-core/src/main/java/org/apache/giraph/worker/EdgeInputSplitsCallable.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/HiveVertexWriter.java
* giraph-hbase/src/test/java/org/apache/giraph/io/hbase/edgemarker/TableEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/IdWithValueTextOutputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveVertexReader.java
* giraph-core/src/main/java/org/apache/giraph/io/superstep_output/SynchronizedSuperstepOutput.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveEdgeReader.java
* giraph-hbase/src/test/java/org/apache/giraph/io/hbase/TestHBaseRootMarkerVertextFormat.java
* giraph-core/src/main/java/org/apache/giraph/worker/VertexInputSplitsCallable.java
* giraph-examples/src/main/java/org/apache/giraph/examples/SimpleSuperstepVertex.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/IntNullReverseTextEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/VertexWriter.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/BasicVertexValueReader.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/AdjacencyListTextVertexOutputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/EdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/TextVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/iterables/VertexReaderWrapper.java
* giraph-core/src/main/java/org/apache/giraph/io/superstep_output/MultiThreadedSuperstepOutput.java
* giraph-core/src/main/java/org/apache/giraph/io/VertexReader.java
* giraph-accumulo/src/main/java/org/apache/giraph/io/accumulo/AccumuloVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomVertexInputFormat.java
* giraph-examples/src/main/java/org/apache/giraph/examples/GeneratedVertexReader.java
* giraph-core/src/test/java/org/apache/giraph/io/TestTextDoubleDoubleAdjacencyListVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/TextVertexOutputFormat.java
* giraph-core/src/test/java/org/apache/giraph/io/TestAdjacencyListTextVertexOutputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveEdgeInputFormat.java
* giraph-core/src/test/java/org/apache/giraph/io/TestIdWithValueTextOutputFormat.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/io/ReverseEdgeDuplicator.java
* giraph-core/src/main/java/org/apache/giraph/io/EdgeReader.java
* giraph-examples/src/main/java/org/apache/giraph/examples/SimpleAggregatorWriter.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/SequenceFileVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/GiraphInputFormat.java
* giraph-hcatalog/src/main/java/org/apache/giraph/io/hcatalog/HCatalogVertexOutputFormat.java
* giraph-core/src/test/java/org/apache/giraph/io/TestLongDoubleDoubleAdjacencyListVertexInputFormat.java

                
> Input/output formats and readers/writers should implement ImmutableClassesGiraphConfigurable
> --------------------------------------------------------------------------------------------
>
>                 Key: GIRAPH-564
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-564
>             Project: Giraph
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Avery Ching
>            Assignee: Avery Ching
>         Attachments: GIRAPH-564.patch
>
>
> Context is a MapReduce Context that input classes have to explicitly create a ImmutableGiraphClassesConfiguration
from (which is not intuitive).  It would be better to provide a GiraphContext that would provide
a ImmutableGiraphClassesConfiguration directly for the user, while still providing the user
access to the MapReduce Context if really necessary.  This might also help with the YARN port?
 Not sure.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message