hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vaclav Petricek <v.petri...@gmail.com>
Subject Re: idle master - how to make it do some work
Date Tue, 14 Sep 2010 16:07:25 GMT
Thanks Steve,

$ hadoop-daemon.sh start tasktracker

Did the trick.


On Tue, Sep 14, 2010 at 1:06 PM, Steve Loughran <stevel@apache.org> wrote:
> On 14/09/10 12:41, Vaclav Petricek wrote:
>> Hi,
>> I have launched a small cluster of two nodes and noticed that the
>> master stays completely idle while the slave does all the work. I was
>> wondering what is the way to let master run some of the tasks. I
>> understand that for a larger cluster having a dedicated master may be
>> necessary but on a 2-node cluster it seems an overkill.
> You can put both a Task Tracker and a DataNode on it; give the TT less slots
> than the others so it doesn't take on twice as much work.
> When I bring up virtual clusters I always put a DataNode on the master,
> purely because on Hadoop 0.21+ the JobTracker doesn't come up until the
> filesystem is live, and the filesystem isn't live until there is >0
> DataNodes. Having a DataNode on the master means everything can come up
> without relying on any worker nodes.
> -steve

View raw message