Return-Path: X-Original-To: apmail-incubator-mesos-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-mesos-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0281AE340 for ; Wed, 23 Jan 2013 20:24:44 +0000 (UTC) Received: (qmail 61605 invoked by uid 500); 23 Jan 2013 20:24:43 -0000 Delivered-To: apmail-incubator-mesos-dev-archive@incubator.apache.org Received: (qmail 61562 invoked by uid 500); 23 Jan 2013 20:24:43 -0000 Mailing-List: contact mesos-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mesos-dev@incubator.apache.org Delivered-To: mailing list mesos-dev@incubator.apache.org Received: (qmail 61550 invoked by uid 99); 23 Jan 2013 20:24:43 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jan 2013 20:24:43 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id 706591C696C; Wed, 23 Jan 2013 20:24:37 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============3150196191140141427==" MIME-Version: 1.0 Subject: Re: Review Request: Improved Hadoop port for mesos From: "Vinod Kone" To: "Benjamin Hindman" , "Ben Mahler" Cc: "mesos" , "Vinod Kone" Date: Wed, 23 Jan 2013 20:24:37 -0000 Message-ID: <20130123202437.9780.14031@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org Auto-Submitted: auto-generated Sender: "Vinod Kone" X-ReviewGroup: mesos X-ReviewRequest-URL: https://reviews.apache.org/r/8965/ X-Sender: "Vinod Kone" References: <20130115222922.27590.98599@reviews.apache.org> In-Reply-To: <20130115222922.27590.98599@reviews.apache.org> Reply-To: "Vinod Kone" --===============3150196191140141427== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/8965/ ----------------------------------------------------------- (Updated Jan. 23, 2013, 8:24 p.m.) Review request for mesos, Benjamin Hindman and Ben Mahler. Changes ------- Bens' comments. Rebased off trunk. Description ------- Features: --> Mesos scheduler is a thin shim that delegates the actual scheduling of = task trackers to the underlying scheduler. --> Mesos executor is a thin shim that starts/stops task tracker properly. --> Doesn't depend on mesos specific patches (status updates, task tracker = instrumentation) for hadoop. --> Builds mesos executor bundle that can be used when running on a real me= sos cluster. Diffs (updated) ----- hadoop/Makefile.am 46d16f7c03cda217d1851d78515cad96f60cba2b = hadoop/NOTES PRE-CREATION = hadoop/TUTORIAL.sh fca22c5b7bd485a5d18c99cb6666fab6bb0a06bb = hadoop/hadoop-0.20.2-cdh3u3.patch 84a948f23122a25fb41dfe497a73bff0c8e0867= d = hadoop/hadoop-0.20.2-cdh3u3_hadoop-env.sh.patch b1731e27b1f59d8dc913d259d= 8f32a69f46ac0b0 = hadoop/hadoop-0.20.2-cdh3u3_mesos.patch f93e53e286525829bdc2a3da71eefab8f= 093e5b8 = hadoop/hadoop-0.20.205.0.patch cab488e402343bdbd5d0c4101785b9a48331f85e = hadoop/hadoop-0.20.205.0_hadoop-env.sh.patch 1b8f4d06323a3ca3f624d9374066= e29be5a18acd = hadoop/mapred-site.xml.patch c2d6397d8fc1d662afd606e1069ff469c3556e19 = hadoop/mesos-executor ce8dcccf7eaecd35dfa041a78aa9760dc2ce451c = hadoop/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java 923= 8fe53a718c47ff4bbe2d555d1c072fa8bd6e2 = hadoop/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 75= 4b198a5c7baacc92ce2adc96da15aa97c47ad1 = hadoop/mesos/src/java/org/apache/hadoop/mapred/HadoopFrameworkMessage.jav= a 1e9510873bab962250afbaf81a5c63a6b191e299 = hadoop/mesos/src/java/org/apache/hadoop/mapred/MesosExecutor.java PRE-CRE= ATION = hadoop/mesos/src/java/org/apache/hadoop/mapred/MesosScheduler.java 1408f3= 00a43eab043b40e4d313e6632cb21fd7b2 = hadoop/mesos/src/java/org/apache/hadoop/mapred/MesosTaskTrackerInstrument= ation.java 8c517d80e54555e12f906a219b12eb572ed7e3a3 = Diff: https://reviews.apache.org/r/8965/diff/ Testing ------- make hadoop-0.20.2-cdh3u3 make hadoop-0.20.205.0 Also, verified that the generator executor bundle is self-contained and wor= ks as expected for non-local runs. Thanks, Vinod Kone --===============3150196191140141427==--