hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karthik Kambatla <ka...@cloudera.com>
Subject [VOTE] Merge feature branch YARN-4752. FairScheduler preemption overhaul
Date Thu, 17 Nov 2016 05:17:10 GMT
Hi folks,

Based on the positive feedback on the DISCUSS thread [1], I would like to
start a formal vote to merge feature branch YARN-4752 to trunk. The
cumulative patch is posted to YARN-4752, and squashed into one commit here
[2].

The changes include:

   1. Preemption considers individual ResourceRequests to satisfy.
   (YARN-5605)
   2. Preemption now works within a leaf queue and across sibling leaf
   queues. (YARN-5605)
   3. Comprehensive unit tests for app starvation and preemption - minshare
   and fairshare. (YARN-5783 and YARN-5819)
   4. Follow up JIRAs for further improvements, also annotated in the code.
   (YARN-5885). Will continue working on these improvements post merge.

These changes are strictly internal to the scheduler, mostly FairScheduler.
The branch followed RTC.

Thanks to Arun for the initial design recommendations, Daniel for his
diligent reviews of sub-tasks, Arun and Sangjin for a high-level review of
the branch in its entirety.

The vote will run for 7 days, and will end on Nov 23.

Thanks
Karthik

[1]
http://mail-archives.apache.org/mod_mbox/hadoop-yarn-dev/201611.mbox/%3CCALwhT97kAO6zuUjXTsmHgw_j-q-M9t9Gm9Vf11aogD%2B%2Bqgp2jQ%40mail.gmail.com%3E
[2]
https://github.com/apache/hadoop/commit/386f3a2af749bc96bdca1dc2302a3589773091dc

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message