hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <ma...@eecs.berkeley.edu>
Subject Re: Content request for 0.20.205 Sustaining Release
Date Sat, 03 Sep 2011 00:55:18 GMT
Hi Matt,

I'd like to propose backporting some of the new fair scheduler features that have been out
for almost 2 years now (in the 0.21 branch and trunk) into 0.20.205, especially https://issues.apache.org/jira/browse/MAPREDUCE-551
and https://issues.apache.org/jira/browse/MAPREDUCE-706. I will try to put together a patch
for this. It should be a matter of taking the trunk fairscheduler directory and just tweaking
anything that might be required to compile on 0.20.205; I don't think there are other major
differences.

Matei

On Sep 1, 2011, at 11:48 AM, Arun C Murthy wrote:

> Thanks for the input guys - I'll look at MAPREDUCE-2601,MAPREDUCE-2779 & HADOOP-7602.
> 
> Arun
> 
> On Sep 1, 2011, at 11:02 AM, John George wrote:
> 
>> Hi Matt,
>> I would like to bring HADOOP-7602 to your attention. I just filed it today
>> and have a patch uploaded, but I think it should go in to 205.
>> Thank you for considering.
>> 
>> Regads,
>> John George
>> 
>> 
>> On 9/1/11 11:08 AM, "Rottinghuis, Joep" <jrottinghuis@ebay.com> wrote:
>> 
>>> Could you please add MAPREDUCE-2779 to the list as well?
>>> This one has a patch as well.
>>> 
>>> Thanks,
>>> 
>>> Joep
>>> ________________________________________
>>> From: Rottinghuis, Joep [jrottinghuis@ebay.com]
>>> Sent: Thursday, September 01, 2011 9:04 AM
>>> To: general@hadoop.apache.org
>>> Subject: RE: Content request for 0.20.205 Sustaining Release
>>> 
>>> Hi Matt,
>>> 
>>> IMHO MAPREDUCE-2610 should be included in 205 as well.
>>> We applied it to our branch because our users had problems with getting queue
>>> information.
>>> 
>>> Thanks,
>>> 
>>> Joep
>>> ________________________________________
>>> From: Matt Foley [mfoley@hortonworks.com]
>>> Sent: Wednesday, August 31, 2011 11:16 AM
>>> To: general@hadoop.apache.org
>>> Subject: Re: Content request for 0.20.205 Sustaining Release
>>> 
>>> Thank you, Nathan.  And thanks for combining these requests, it's much
>>> easier to review a single list than 10 or more emails.
>>> 
>>> Does anyone else have requests for items to include in 0.20.205 - either
>>> already submitted to 0.20-security, or pending work?
>>> 
>>> Thanks,
>>> --Matt
>>> 
>>> On Wed, Aug 31, 2011 at 8:25 AM, Nathan Roberts <nroberts@yahoo-inc.com>wrote:
>>> 
>>>> Hi Matt,
>>>> 
>>>> My colleagues with experience running 0.20.203 (as well as many previous
>>>> releases of Hadoop) in Yahoo!'s production environment are requesting that
>>>> the following items be included as high priority sustaining improvements
in
>>>> 0.20.205.  Rather than contributors sending in several separate requests
to
>>>> this mailing list, this email aggregates contributions from the following
>>>> individuals: Daryn Sharp, Jeffrey Naisbitt, Kihwal Lee, Sherry Chen, Thomas
>>>> Graves, Bharath Mundlapudi, Robert Joseph Evans, Anupam Seth, Eric Payne,
>>>> John George.
>>>> 
>>>> Recommendations and suggestions for this list of jiras came from folks with
>>>> significant experience working with large scale Hadoop clusters within
>>>> Yahoo! production environments, including Service Engineering teams, Quality
>>>> Engineering teams, Solutions Engineering teams, and Development teams.
>>>> 
>>>> Notes on the items listed below:
>>>> 
>>>> *   All the Jiras listed with the exception of HADOOP-7510,
>>>> MAPREDUCE-2764, MAPREDUCE-2915, and HDFS-2257 have been committed to
>>>> 0.20-security. These remaining four jiras are in-progress and should wrap
up
>>>> over the next few days.
>>>> *   All of the jiras listed have been fixed in trunk with the following
>>>> exceptions:
>>>>  *   The four jiras listed above which are still being worked
>>>>  *   MAPREDUCE-2780 - Similar to previous bullet. In progress now.
>>>>  *   MAPREDUCE-2324 - Has a strong interaction with MR279 so filed
>>>> MAPREDUCE-2723 to make sure this is handled correctly in yarn
>>>>  *   MAPREDUCE-2729, MAPREDUCE-2621 - Don't make sense after integration
>>>> of MR279
>>>> 
>>>> Thank you for considering this list of Jiras for inclusion in 0.20.205.
>>>> Nathan Roberts
>>>> 
>>>> ====
>>>> [list elided, please see archives at http://tinyurl.com/3k537hs ] 
>> 
> 


Mime
View raw message