hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Bockelman <bbock...@cse.unl.edu>
Subject Re: Running Hadoop on cluster with NFS booted systems
Date Mon, 28 Sep 2009 16:51:35 GMT
Hey Nick,

You sent the same message out 5 days ago and got 2 responses, but  
never followed up on them.

Did you try any of the techniques suggested?

Brian

On Sep 28, 2009, at 11:45 AM, Nick Rathke wrote:

> Hi,
>
> I am hopping that someone can help with this issue. I have a 64 node  
> cluster that we would like to run Hadoop on, most of the nodes are  
> netbooted via NFS.
>
> Hadoop runs fine on nodes IF the node uses a local OS install, but  
> doesn't work when nodes are netbooted. Under netboot I can see that  
> the slaves have the correct Java processes running, but the Hadoop  
> web pages never shows the nodes as available. The Hadoop logs on the  
> nodes also show that everything is running and started up correctly.
>
> On the few node that have a local OS installed everything works just  
> fine and I can run the test jobs without issue (so far).
>
> I  am using the identical hadoop install and configuration between  
> netbooted nodes and none netbooted nodes.
>
> Has anyone encountered this type of issue ?
>
> TIA
>
> -- 
> Nick Rathke
> Scientific Computing and Imaging Institute
> Sr. Systems Administrator
> nick@sci.utah.edu
> www.sci.utah.edu
> 801-587-9933
> 801-557-3832
>
> "I came I saw I made it possible" Royal Bliss - Here They Come


Mime
View raw message