hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-619) Hama Pipes
Date Wed, 10 Apr 2013 03:46:17 GMT

    [ https://issues.apache.org/jira/browse/HAMA-619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627434#comment-13627434
] 

Hudson commented on HAMA-619:
-----------------------------

Integrated in Hama-Nightly #880 (See [https://builds.apache.org/job/Hama-Nightly/880/])
    HAMA-619: Hama Pipes (Revision 1465852)

     Result = SUCCESS
edwardyoon : 
Files : 
* /hama/trunk/CHANGES.txt
* /hama/trunk/bin/hama
* /hama/trunk/c++
* /hama/trunk/c++/pipes
* /hama/trunk/c++/pipes/.autom4te.cfg
* /hama/trunk/c++/pipes/Makefile.am
* /hama/trunk/c++/pipes/Makefile.in
* /hama/trunk/c++/pipes/aclocal.m4
* /hama/trunk/c++/pipes/api
* /hama/trunk/c++/pipes/api/hama
* /hama/trunk/c++/pipes/api/hama/Pipes.hh
* /hama/trunk/c++/pipes/api/hama/TemplateFactory.hh
* /hama/trunk/c++/pipes/compile
* /hama/trunk/c++/pipes/config.guess
* /hama/trunk/c++/pipes/config.sub
* /hama/trunk/c++/pipes/configure
* /hama/trunk/c++/pipes/configure.ac
* /hama/trunk/c++/pipes/debug
* /hama/trunk/c++/pipes/debug/pipes-default-gdb-commands.txt
* /hama/trunk/c++/pipes/debug/pipes-default-script
* /hama/trunk/c++/pipes/depcomp
* /hama/trunk/c++/pipes/impl
* /hama/trunk/c++/pipes/impl/HamaPipes.cc
* /hama/trunk/c++/pipes/impl/config.h.in
* /hama/trunk/c++/pipes/install-sh
* /hama/trunk/c++/pipes/ltmain.sh
* /hama/trunk/c++/pipes/missing
* /hama/trunk/c++/utils
* /hama/trunk/c++/utils/.autom4te.cfg
* /hama/trunk/c++/utils/Makefile.am
* /hama/trunk/c++/utils/Makefile.in
* /hama/trunk/c++/utils/aclocal.m4
* /hama/trunk/c++/utils/api
* /hama/trunk/c++/utils/api/hadoop
* /hama/trunk/c++/utils/api/hadoop/SerialUtils.hh
* /hama/trunk/c++/utils/api/hadoop/Splitter.hh
* /hama/trunk/c++/utils/api/hadoop/StringUtils.hh
* /hama/trunk/c++/utils/config.guess
* /hama/trunk/c++/utils/config.sub
* /hama/trunk/c++/utils/configure
* /hama/trunk/c++/utils/configure.ac
* /hama/trunk/c++/utils/depcomp
* /hama/trunk/c++/utils/impl
* /hama/trunk/c++/utils/impl/SerialUtils.cc
* /hama/trunk/c++/utils/impl/Splitter.cc
* /hama/trunk/c++/utils/impl/StringUtils.cc
* /hama/trunk/c++/utils/impl/config.h.in
* /hama/trunk/c++/utils/install-sh
* /hama/trunk/c++/utils/ltmain.sh
* /hama/trunk/c++/utils/m4
* /hama/trunk/c++/utils/m4/hadoop_utils.m4
* /hama/trunk/c++/utils/missing
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJob.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJobClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPTask.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/KeyValueLineRecordReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/KeyValueTextInputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/TaskLog.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/Application.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/BinaryProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/DownwardProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/PipesApplicable.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/PipesApplication.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/PipesBSP.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/PipesPartitioner.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/StreamingProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/Submitter.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/DownwardProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/MessageType.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/UplinkReader.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/util
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/util/DistributedCacheUtil.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/util/SequenceFileDumper.java
* /hama/trunk/pom.xml

                
> Hama Pipes
> ----------
>
>                 Key: HAMA-619
>                 URL: https://issues.apache.org/jira/browse/HAMA-619
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core, messaging
>    Affects Versions: 0.6.0
>            Reporter: Martin Illecker
>            Assignee: Martin Illecker
>             Fix For: 0.7.0
>
>         Attachments: HAMA-619.patch, HAMA-619.patch
>
>
> *Adapting Hadoop Pipes to Hama for C++ integration.*
> The package *org.apache.hama.pipes* contains all pipes specific code. The C++ implementation
is located in the *c++* folder under *pipes* and *utils*. There are also some minor modifications
in other packages but you can checkout the full Hama source here: [https://svn.illecker.at/hadoop/hama-0.5.0-gpu/]
> The changelog can be found here: [here|http://hadoop.illecker.at/?page_id=6]
> Hama Pipes: [https://svn.illecker.at/hadoop/hama-0.5.0-gpu/core/src/main/java/org/apache/hama/pipes/]
> Hama Pipes C++: [https://svn.illecker.at/hadoop/hama-0.5.0-gpu/c++/pipes/]
> Hama Pipes provides the following methods for C++ integration: (similar to Hama BSP)

> *{{virtual void sendMessage(const string& peerName, const string& msg) = 0;}}*
> bq. Send a data with a tag to another BSPSlave corresponding to hostname. Messages sent
by this method are not guaranteed to be received in a sent order.
> *{{virtual const string& getCurrentMessage() = 0;}}*
> bq. Returns a message from the peer's received messages queue (a FIFO).
> *{{virtual int getNumCurrentMessages() = 0;}}*
> bq. Returns the number of messages in the peer's received messages queue.
> *{{virtual void sync() = 0;}}*
> {quote}
> Barrier Synchronization. 
> Sends all the messages in the outgoing message queues to the corresponding remote peers.
> {quote}
> *{{virtual long getSuperstepCount() = 0;}}*
> bq. Returns the count of current super-step
>      
> *{{virtual const string& getPeerName() = 0;}}*
> bq. Returns the name of this peer in the format "hostname:port".
>     
> *{{virtual const string& getPeerName(int index) = 0;}}*
> bq. Returns the name of n-th peer from sorted array by name.
>     
> *{{virtual int getPeerIndex() = 0;}}*
> bq. Returns the index of this peer from sorted array by name.
> *{{virtual vector<string> getAllPeerNames() = 0;}}*
> bq. Returns the names of all the peers executing tasks from the same job (including this
peer).
>     
> *{{virtual int getNumPeers() = 0;}}*
> bq. Returns the number of peers
>     
> *{{virtual void clear() = 0;}}*
> bq. Clears all queues entries.
>     
> *{{virtual void write(const string& key, const string& value) = 0;}}*
> bq. Writes a key/value pair to the output collector
>     
> *{{virtual bool readNext(string& key, string& value) = 0;}}*
> bq. Deserializes the next input key value into the given objects;
> *{{virtual void reopenInput() = 0;}}*
> bq. Closes the input and opens it right away, so that the file pointer is at the beginning
again.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message