Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of
 Ramya.Nimmagadda@microsoft.com designates 207.46.163.204 as permitted sender)
Received-SPF: softfail (mail57-co9: transitioning domain of microsoft.com does
 not designate 157.56.240.21 as permitted sender) client-ip=157.56.240.21;
 envelope-from=Ramya.Nimmagadda@microsoft.com;
 helo=BL2PRD0310HT004.namprd03.prod.outlook.com ;.outlook
From: Ramya Nimmagadda <Ramya.Nimmagadda@microsoft.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Subject: RE: Building branch-1-win, Starting Datanode on Windows
Thread-Topic: Building branch-1-win, Starting Datanode on Windows
Thread-Index: AQHOGOh56PzibqWJKUqS/iLkt2/58ZiV3sEAgAAehMCAAFFCgIAAfHaAgAC7wfA=
Date: Tue, 5 Mar 2013 20:03:52 +0000
Message-ID: 
 <70f39fb256244427822ff95720144d32@SN2PR03MB096.namprd03.prod.outlook.com>
References: 
 <CAE8WX8dNfUu5Ka9AzWgSbTe2CZum0FcbXPvygu+avCPSa4_D3Q@mail.gmail.com>
	<9872e44e80bcd894131be5ac43adf233@mail.gmail.com>
	<b3aef0f6e7aa48cd90df1d4963c02920@SN2PR03MB096.namprd03.prod.outlook.com>
	<CANJr2=F7PeZHVXwcUdpU41t+5x+kYbrZHoXKuSnasLcamwnceQ@mail.gmail.com>
 <CAE8WX8fwmgKqPBbqLhS2D7GRzbkq21auSLUxrk8FDZFx48Lfrw@mail.gmail.com>
In-Reply-To: 
 <CAE8WX8fwmgKqPBbqLhS2D7GRzbkq21auSLUxrk8FDZFx48Lfrw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

>> Will the datanode create the directory if it doesn't exist?
Yes, it does.

Thanks,
Ramya

-----Original Message-----
From: Daniel Jones [mailto:daniel.jones@opencredo.com]=20
Sent: Tuesday, March 05, 2013 12:50 AM
To: common-dev
Subject: Re: Building branch-1-win, Starting Datanode on Windows

Hi all,

Thanks very much for your help.

@Ramya: I created the directory before starting the datanode (I expect it w=
ould fail otherwise). Will the datanode create the directory if it doesn't =
exist?

@Giridharan: I do indeed have the "Microsoft Visual C++ x64 Runtime - 10.0.=
40219".

I worked around the problem by changing the dfs.datanode.data.dir.perm prop=
erty to set a value of "775".


On 5 March 2013 01:24, Giridharan Kesavan <gkesavan@hortonworks.com> wrote:

> Daniel,
>
> Could you pls check if you have 64 bit vc runtime and dotnet framework=20
> installed?
>
> 64 bit vc runtime is critical.
>
> -Giri
>
>
> On Mon, Mar 4, 2013 at 12:40 PM, Ramya Nimmagadda <=20
> Ramya.Nimmagadda@microsoft.com> wrote:
>
> > Hi Daniel,
> >
> > This can happen when "data" directory permissions are different from=20
> > default (755). Possible reasons could be:
> >
> > 1. This directory already exists but created with different permissions=
 .
> > One scenario I can think of : The directory got created as part of=20
> > build workflow, and the permissions are inherited from parent=20
> > (C:\Hadoop) 2. The datanode service tried to create this (if it does=20
> > not exist) and failed while setting permissions using "winutils".=20
> > This case can be verified by looking at the DN log for FSShell=20
> > exceptions
> >
> > To further investigate the root cause, it would help to find out who=20
> > exactly  created this directory. As Bikas mentioned, can you go=20
> > through
> the
> > logs for any exceptions related to permissions?
> >
> >
> > Thanks,
> > Ramya
> >
> > -----Original Message-----
> > From: Bikas Saha [mailto:bikas@hortonworks.com]
> > Sent: Monday, March 04, 2013 10:44 AM
> > To: common-dev@hadoop.apache.org
> > Subject: RE: Building branch-1-win, Starting Datanode on Windows
> >
> > I don't think you need to manually set permissions on Hadoop directorie=
s.
> > Did you build the native windows executable in your build? Do you=20
> > see any exceptions mentioning winutils?
> >
> > Bikas
> >
> > -----Original Message-----
> > From: Daniel Jones [mailto:daniel.jones@opencredo.com]
> > Sent: Monday, March 04, 2013 6:56 AM
> > To: common-dev@hadoop.apache.org
> > Subject: Building branch-1-win, Starting Datanode on Windows
> >
> > Hi all,
> >
> > I've cloned the branch-1-win branch of Hadoop, and successfully=20
> > managed
> to
> > build it on my Windows 8 machine.
> > When trying to start a datanode instance, I get the following error:
> >
> > 13/03/04 14:42:47 WARN datanode.DataNode: Invalid directory in
> > dfs.data.dir: Incorrect permission for C:/hadoop/data, expected:
> > rwxr-xr-x, while actual: ------rwx
> > 13/03/04 14:42:47 ERROR datanode.DataNode: All directories in
> dfs.data.dir
> > are invalid.
> >
> > The directory exists, and I've set "Allow all" to Everyone.
> >
> > Is this an issue that should exist in the Windows branch? Is there a=20
> > way to massage Windows' file permissions into something the datanode=20
> > will accept without further modifications to the code?
> >
> > Many thanks in advance.
> > --
> > Daniel Jones - Consultant
> > Open Credo Ltd - Excellence in Enterprise Application Development
> >
> > Mobile: +44 (0)79 8000 9153
> > Main: +44 (0)20 3393 8242
> >
> > daniel.jones@opencredo.com
> > http://twitter.com/BinaryTweedNet
> > www.opencredo.com
> >
> > Registered Office: 5-11 Lavington Street, London, SE1 0NZ Registered=20
> > in UK. No 3943999
> >
> > If you have received this e-mail in error please accept our=20
> > apologies, destroy it immediately and it would be greatly=20
> > appreciated if you
> notified
> > the sender.  It is your responsibility to protect your system from
> viruses
> > and any other harmful code or device.  We try to eliminate them from=20
> > e-mails and attachments; but we accept no liability for any that remain=
.
> > We may monitor or access any or all e-mails sent to us.
> >
> >
> >
> >
>


--
Daniel Jones - Consultant
Open Credo Ltd - Excellence in Enterprise Application Development

Mobile: +44 (0)79 8000 9153
Main: +44 (0)20 3393 8242

daniel.jones@opencredo.com
http://twitter.com/BinaryTweedNet
www.opencredo.com

Registered Office: 5-11 Lavington Street, London, SE1 0NZ Registered in UK.=
 No 3943999

If you have received this e-mail in error please accept our apologies, dest=
roy it immediately and it would be greatly appreciated if you notified the =
sender.  It is your responsibility to protect your system from viruses and =
any other harmful code or device.  We try to eliminate them from e-mails an=
d attachments; but we accept no liability for any that remain. We may monit=
or or access any or all e-mails sent to us.