incubator-mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kone" <>
Subject Re: Review Request: Improved Hadoop port for mesos
Date Fri, 25 Jan 2013 01:42:14 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Jan. 25, 2013, 1:42 a.m.)

Review request for mesos, Benjamin Hindman and Ben Mahler.


benh's offline comments:

--> deleted hadoop-0.20.2-cdh3u3.patch and hadoop-
--> gridmix specific patch is called hadoop-gridmix.patch
--> jsvc patch is called hadoop-7698-1.patch (the same name it was given on apache's jira
--> explained why we fake resources in the tutorial.

i will send another diff with formatting-only changes.



--> Mesos scheduler is a thin shim that delegates the actual scheduling of task trackers
to the underlying scheduler.
--> Mesos executor is a thin shim that starts/stops task tracker properly.
--> Doesn't depend on mesos specific patches (status updates, task tracker instrumentation)
for hadoop.
--> Builds mesos executor bundle that can be used when running on a real mesos cluster.

Diffs (updated)

  hadoop/ 46d16f7c03cda217d1851d78515cad96f60cba2b 
  hadoop/ fca22c5b7bd485a5d18c99cb6666fab6bb0a06bb 
  hadoop/hadoop-0.20.2-cdh3u3.patch 84a948f23122a25fb41dfe497a73bff0c8e0867d 
  hadoop/ b1731e27b1f59d8dc913d259d8f32a69f46ac0b0

  hadoop/hadoop-0.20.2-cdh3u3_mesos.patch f93e53e286525829bdc2a3da71eefab8f093e5b8 
  hadoop/hadoop- cab488e402343bdbd5d0c4101785b9a48331f85e 
  hadoop/ 1b8f4d06323a3ca3f624d9374066e29be5a18acd 
  hadoop/hadoop-7698-1.patch PRE-CREATION 
  hadoop/mapred-site.xml.patch c2d6397d8fc1d662afd606e1069ff469c3556e19 
  hadoop/mesos-executor ce8dcccf7eaecd35dfa041a78aa9760dc2ce451c 
  hadoop/mesos/src/java/org/apache/hadoop/mapred/ 9238fe53a718c47ff4bbe2d555d1c072fa8bd6e2

  hadoop/mesos/src/java/org/apache/hadoop/mapred/ 754b198a5c7baacc92ce2adc96da15aa97c47ad1

  hadoop/mesos/src/java/org/apache/hadoop/mapred/ 1e9510873bab962250afbaf81a5c63a6b191e299

  hadoop/mesos/src/java/org/apache/hadoop/mapred/ PRE-CREATION 
  hadoop/mesos/src/java/org/apache/hadoop/mapred/ 1408f300a43eab043b40e4d313e6632cb21fd7b2

  hadoop/mesos/src/java/org/apache/hadoop/mapred/ 8c517d80e54555e12f906a219b12eb572ed7e3a3



make hadoop-0.20.2-cdh3u3
make hadoop-

Also, verified that the generator executor bundle is self-contained and works as expected
for non-local runs.


Vinod Kone

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message