hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Dunning (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1849) Implement a FlumeJava-like library for operations over parallel collections using Hadoop MapReduce
Date Wed, 04 Aug 2010 16:44:24 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895314#action_12895314
] 

Ted Dunning commented on MAPREDUCE-1849:
----------------------------------------

The github implementation of Plume now supports local evaluation in an eager as opposed to
lazy fashion.  Avro file reading is working in at least one example.  The execution plan optimizer
is beginning to work.  We have an emulated map-reduce framework working to support mocking
up the full map-reduce execution.  Nobody is working on the Hadoop interface yet so if there
is a volunteer for that, they would be very welcome.

Anybody who would like to contribute is welcome as long as they are willing to Apache license
their contributions.

See http://github.com/tdunning/Plume for the source,  http://tdunning.blogspot.com/2010/07/new-grool.html
for some discussion.

> Implement a FlumeJava-like library for operations over parallel collections using Hadoop
MapReduce
> --------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1849
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1849
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Jeff Hammerbacher
>
> The API used internally at Google is described in great detail at http://portal.acm.org/citation.cfm?id=1806596.1806638.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message