hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-279) Map-Reduce 2.0
Date Sun, 20 Mar 2011 05:32:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008881#comment-13008881
] 

Todd Lipcon commented on MAPREDUCE-279:
---------------------------------------

Looking through the code a bit more I came across Hamlet. It seems you've written your own
MVC framework and Java implementation of Haml as part of Yarn.

Can you shed some light on why existing web frameworks were found to be insufficient? Do we
really want a custom HTML generation framework as part of a resource scheduler?

I don't have much experience with web programming in Java, but I can't imagine we have any
use cases that are _that_ unique that they couldn't be satisfied using a popular framework
like Spring MVC. I also have strong doubts that a bunch of systems hackers like we have in
our community can do a better job at designing and implementing a web framework compared to
people who do web programming all day long (witness the completely incorrect job we do of
input parameter escaping we do in the current webapps)

> Map-Reduce 2.0
> --------------
>
>                 Key: MAPREDUCE-279
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-279
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker, tasktracker
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.0
>
>         Attachments: MR-279.patch, MR-279.patch, MR-279.sh, MR-279_MR_files_to_move.txt
>
>
> Re-factor MapReduce into a generic resource scheduler and a per-job, user-defined component
that manages the application execution. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message