hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Evans <ev...@yahoo-inc.com>
Subject Re: Platform MapReduce - Enterprise Features
Date Mon, 12 Sep 2011 20:22:32 GMT
Chi,

Most of these features are things that Hadoop is working on.  There is an HA branch in progress
that should go into trunk relatively soon.

As far as the batch system integration is concerned if what you care about is scheduling of
jobs, which jobs run when and on which machines, you can write your own scheduler which is
a standard API.

--Bobby Evans

On 9/12/11 1:04 PM, "Chi Chan" <chichan2008@gmail.com> wrote:

Are any Hadoop implementations planning to add "enterprise features"
in Platform MapReduce?

http://www.youtube.com/watch?v=QV4wJifsqbQ
http://www.youtube.com/watch?v=cDfZTx-BOyY
http://www.youtube.com/watch?v=MEKXo-1hnkQ

Platform said that its MapReduce implementation totally replaces the
JobTracker, while the rest of the Hadoop stack is unchanged. Is there
a Hadoop API that would allow external batch systems (like Grid Engine
or Open Grid Scheduler, PBS, Condor, SLURM, etc) to plug into Hadoop?

--Chi


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message