giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-693) Giraph-Hive check user code as soon as possible
Date Wed, 26 Jun 2013 05:10:20 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13693642#comment-13693642
] 

Hudson commented on GIRAPH-693:
-------------------------------

Integrated in Giraph-trunk-Commit #1054 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1054/])
    GIRAPH-693: Giraph-Hive check user code as soon as possible (nitay) (Revision 8fbade6a7801afd6065007473585d9d2a761818a)

     Result = FAILURE
nitay : http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=8fbade6a7801afd6065007473585d9d2a761818a
Files : 
* giraph-hive/src/test/java/org/apache/giraph/hive/input/HiveEdgeInputTest.java
* giraph-core/src/main/java/org/apache/giraph/utils/InMemoryVertexInputFormat.java
* giraph-hive/src/test/java/org/apache/giraph/hive/output/CheckOutputTest.java
* giraph-core/src/main/java/org/apache/giraph/utils/InternalVertexRunner.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/examples/HiveIntNullNullVertex.java
* giraph-accumulo/src/test/java/org/apache/giraph/io/accumulo/edgemarker/AccumuloEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/internal/WrappedEdgeInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/SimpleVertexToHive.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/HiveVertexOutputFormat.java
* giraph-hbase/src/test/java/org/apache/giraph/io/hbase/edgemarker/TableEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/GeneratedVertexInputFormat.java
* giraph-hive/src/test/java/org/apache/giraph/hive/input/CheckInputTest.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/TextEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveVertexReader.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/SequenceFileVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/common/HiveInputOptions.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/examples/HiveIntNullEdge.java
* giraph-hive/src/main/java/org/apache/giraph/hive/common/HiveParsing.java
* giraph-hive/src/test/java/org/apache/giraph/hive/output/HiveOutputTest.java
* giraph-hive/src/test/java/org/apache/giraph/hive/Helpers.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/HiveVertexWriter.java
* giraph-hive/src/test/java/org/apache/giraph/hive/GiraphHiveTestBase.java
* giraph-hive/src/test/java/org/apache/giraph/hive/input/HiveVertexInputTest.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/HiveInputChecker.java
* CHANGELOG
* giraph-examples/src/main/java/org/apache/giraph/examples/AggregatorsTestComputation.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveEdgeInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/TextVertexValueInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/examples/HiveOutputIntIntVertex.java
* pom.xml
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/HiveToVertex.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/TextVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/examples/HiveIntDoubleEdge.java
* giraph-hive/src/main/java/org/apache/giraph/hive/output/VertexToHive.java
* giraph-core/src/main/java/org/apache/giraph/io/internal/WrappedVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/multi/MultiVertexInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/common/HiveUtils.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveEdgeReader.java
* giraph-core/src/main/java/org/apache/giraph/io/GiraphInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/edge/HiveToEdge.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/PseudoRandomIntNullVertexInputFormat.java
* giraph-core/src/main/java/org/apache/giraph/io/formats/multi/MultiEdgeInputFormat.java
* giraph-hive/src/main/java/org/apache/giraph/hive/input/vertex/examples/HiveIntDoubleDoubleVertex.java

                
> Giraph-Hive check user code as soon as possible
> -----------------------------------------------
>
>                 Key: GIRAPH-693
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-693
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Nitay Joffe
>            Assignee: Nitay Joffe
>
> We have a lot of cases of users running long jobs and then failing at the Hive output
step because of some misconfigured schema or type mismatch. We'd like to move these errors
as soon as possible.
> To make this happen I am adding check<In,Out>put methods to the HiveTo<Edge,Vertex>
and VertexToHive API and letting the user do their checks. Look at the diff for examples and
tests.
> https://reviews.apache.org/r/12080/

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message