hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-234) Hadoop Pipes for writing map/reduce jobs in C++ and python
Date Fri, 20 Apr 2007 21:27:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12490454

Doug Cutting commented on HADOOP-234:

A few quick comments:

- the pipes package should have a package.html file
- only Submitter.java should be public, right?
- one must 'chmod +x' the configure scripts
- the create-c++-configure task fails for me on Ubuntu w/ 'Can't exec "aclocal"'
- 'bin/hadoop pipes' should print a helpful message
- a README.txt file in src/examples/pipes telling how to run things would go a long way

> Hadoop Pipes for writing map/reduce jobs in C++ and python
> ----------------------------------------------------------
>                 Key: HADOOP-234
>                 URL: https://issues.apache.org/jira/browse/HADOOP-234
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Sanjay Dahiya
>         Assigned To: Owen O'Malley
>         Attachments: Hadoop MaReduce Developer doc.pdf, hadoop-pipes.html, pipes.patch
> MapReduce C++ support
> Requirements 
> 1. Allow users to write Map, Reduce, RecordReader, and RecordWriter functions in C++,
rest of the infrastructure already present in Java should be reused. 
> 2. Avoid users having to write both Java and C++ for this to work. 
> 3. Avoid users having to work with JNI methods directly by wrapping them in helper functions.

> 4. The interface should be SWIG'able.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message