mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brenden Matthews" <bren...@diddyinc.com>
Subject Review Request: Don't prematurely kill TaskTrackers.
Date Fri, 03 May 2013 18:30:35 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10920/
-----------------------------------------------------------

Review request for mesos.


Description
-------

>From 9a67cc50605cce529f469c2899729c0799d70970 Mon Sep 17 00:00:00 2001
From: Brenden Matthews <brenden.matthews@airbnb.com>
Date: Fri, 26 Apr 2013 11:42:18 -0700
Subject: [PATCH 2/9] Don't prematurely kill TaskTrackers.

We assign the JobID to the internal Mesos tracker (for the TaskTracker)
rather than the TaskID.

In the case where a TaskTracker has only map tasks assigned to it and
they have all completed, we mustn't terminate the tracker until the
entire job has finished, including the map tasks.
---


Diffs
-----

  hadoop/mesos/src/java/org/apache/hadoop/mapred/MesosScheduler.java afe401f 

Diff: https://reviews.apache.org/r/10920/diff/


Testing
-------

Used in production at airbnb.


Thanks,

Brenden Matthews


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message