hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-774) CompositeInputFormat in Hama
Date Wed, 04 Dec 2013 05:34:36 GMT

    [ https://issues.apache.org/jira/browse/HAMA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838616#comment-13838616
] 

Hudson commented on HAMA-774:
-----------------------------

SUCCESS: Integrated in Hama-Nightly-for-Hadoop-2.x #110 (See [https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/110/])
HAMA-774: CompositeInputFormat in Hama (millecker: rev 1546951)
* /hama/trunk/CHANGES.txt
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJobClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/ComposableInputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/ComposableRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/CompositeInputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/CompositeInputSplit.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/CompositeRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/InnerJoinRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/JoinRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/MultiFilterRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/OuterJoinRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/OverrideRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/Parser.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/ResetableIterator.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/StreamBackedIterator.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/TupleWritable.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/join/WrappedRecordReader.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestCompositeInputFormat.java


> CompositeInputFormat in Hama
> ----------------------------
>
>                 Key: HAMA-774
>                 URL: https://issues.apache.org/jira/browse/HAMA-774
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core
>    Affects Versions: 0.6.2
>            Reporter: Martin Illecker
>            Assignee: Martin Illecker
>            Priority: Minor
>             Fix For: 0.7.0
>
>         Attachments: HAMA-774.patch, HAMA-774_v02.patch
>
>
> *Adapting Hadoop CompositeInputFormat to Hama.*
> Adapt the CompositeInputFormat from Hadoop and integrate it into Hama.
> e.g., Useful for matrix multiplication example by doing a inner join of two matrices.
> Therefore the Hadoop join package has been adapted within *org.apache.hama.bsp.join*.
> Finally I would need some help to integrate the CompositeInputFormat into Hama by using
> {code} 
> job.setInputFormat(CompositeInputFormat.class);
> job.set("bsp.join.expr", CompositeInputFormat.compose("inner",
>    SequenceFileInputFormat.class, aPath, bPath));
> {code}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message