hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-798) MRUnit should be able to test a succession of MapReduce passes
Date Thu, 23 Jul 2009 21:47:14 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734804#action_12734804
] 

Aaron Kimball commented on MAPREDUCE-798:
-----------------------------------------

According to the comments in the ChainMapper source, it allows you to run jobs of the form
{{M+RM*}}. This is designed to test pipelines of the form  {{(MR)+}}. Can you elaborate a
bit more on how you think ChainMapper / ChainReducer fits here?

> MRUnit should be able to test a succession of MapReduce passes
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-798
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-798
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-798.patch
>
>
> MRUnit can currently test that the inputs to a given (mapper, reducer) "job" produce
certain outputs at the end of the reducer. It would be good to support more end-to-end tests
of a series of MapReduce jobs that form a longer pipeline surrounding some data.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message