hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohith (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6332) Provide facility to users for writting custom MergeManager implementation when custom shuffleconsumerPluggin is used
Date Wed, 10 Jun 2015 05:59:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580072#comment-14580072
] 

Rohith commented on MAPREDUCE-6332:
-----------------------------------

[~devaraj.k] Kindly review the updated patch.
-1 for whitespace, this line is not modified in the patch but still QA reports -1.

> Provide facility to users for writting custom MergeManager implementation when custom
shuffleconsumerPluggin is used
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6332
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6332
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Rohith
>            Assignee: Rohith
>         Attachments: 0001-MAPREDUCE-6332.patch, 0002-MAPREDUCE-6332.patch, 0003-MAPREDUCE-6332.patch,
0004-MAPREDUCE-6332.patch
>
>
> MR provides ability to the user for plugin custom ShuffleConsumerPlugin using *mapreduce.job.reduce.shuffle.consumer.plugin.class*.
 When the user is allowed to use this configuration as plugin, user also interest in implementing
his own MergeManagerImpl. 
> But now , user is forced to use MR provided MergeManagerImpl instead of custom MergeManagerImpl
when user is using shuffle.consumer.plugin class. There should be well defined API's in MergeManager
that can be used for any implementation without much effort to user for custom implementation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message