crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charles Pritchard (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CRUNCH-474) Reduce dependencies on MapReduce library in standard MemPipeline
Date Mon, 06 Oct 2014 17:59:35 GMT
Charles Pritchard created CRUNCH-474:
----------------------------------------

             Summary: Reduce dependencies on MapReduce library in standard MemPipeline
                 Key: CRUNCH-474
                 URL: https://issues.apache.org/jira/browse/CRUNCH-474
             Project: Crunch
          Issue Type: Bug
            Reporter: Charles Pritchard


There are currently dependencies on the MapReduce library that could be removed or otherwise
re-wired in the MemPipeline method.

Currently MemPipeline relies on setting up tasks to match Hadoop libraries without using any
of their functionality, beyond the counters. Crunch may be useful in areas where data is processed
without Hadoop.

As an aside, the Avro writables have completely unused references to Hadoop in their import
statements.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message