Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 49603D4CA for ; Wed, 12 Dec 2012 18:08:40 +0000 (UTC) Received: (qmail 48912 invoked by uid 500); 12 Dec 2012 18:08:35 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 48816 invoked by uid 500); 12 Dec 2012 18:08:35 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 48806 invoked by uid 99); 12 Dec 2012 18:08:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Dec 2012 18:08:34 +0000 X-ASF-Spam-Status: No, hits=3.6 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL,UNRESOLVED_TEMPLATE X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [65.55.169.29] (HELO NA01-BL2-obe.outbound.protection.outlook.com) (65.55.169.29) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Dec 2012 18:08:25 +0000 Received: from BL2FFO11FD005.protection.gbl (10.173.161.201) by BL2FFO11HUB020.protection.gbl (10.173.160.112) with Microsoft SMTP Server (TLS) id 15.0.578.12; Wed, 12 Dec 2012 18:07:43 +0000 Received: from TK5EX14MLTC101.redmond.corp.microsoft.com (131.107.125.37) by BL2FFO11FD005.mail.protection.outlook.com (10.173.161.1) with Microsoft SMTP Server (TLS) id 15.0.578.12 via Frontend Transport; Wed, 12 Dec 2012 18:07:43 +0000 Received: from ch1outboundpool.messaging.microsoft.com (157.54.51.114) by mail.microsoft.com (157.54.79.178) with Microsoft SMTP Server (TLS) id 14.2.318.3; Wed, 12 Dec 2012 18:07:03 +0000 Received: from mail231-ch1-R.bigfish.com (10.43.68.229) by CH1EHSOBE002.bigfish.com (10.43.70.52) with Microsoft SMTP Server id 14.1.225.23; Wed, 12 Dec 2012 18:05:56 +0000 Received: from mail231-ch1 (localhost [127.0.0.1]) by mail231-ch1-R.bigfish.com (Postfix) with ESMTP id 6AEA9E40067 for ; Wed, 12 Dec 2012 18:05:56 +0000 (UTC) X-Forefront-Antispam-Report-Untrusted: CIP:157.56.240.21;KIP:(null);UIP:(null);(null);H:BL2PRD0310HT004.namprd03.prod.outlook.com;R:internal;EFV:INT X-SpamScore: 0 X-BigFish: PS0(zzbb2dI9371I936eIc85fhd772hzz1de0h1202h1e76h1d1ah1d2ahzz17326ah8275bh8275dh18c673hz32i2a8h668h839hd24hf0ah1288h12a5h12bdh137ah1441h1504h1537h153bh162dh1631h1758h9a9j1155h) X-Forefront-Antispam-Report-Untrusted: SFV:SKI;SFS:;DIR:OUT;SFP:;SCL:-1;SRVR:BLUPR03MB590;LANG:en; Received: from mail231-ch1 (localhost.localdomain [127.0.0.1]) by mail231-ch1 (MessageSwitch) id 1355335534413317_13368; Wed, 12 Dec 2012 18:05:34 +0000 (UTC) Received: from CH1EHSMHS027.bigfish.com (snatpool1.int.messaging.microsoft.com [10.43.68.250]) by mail231-ch1.bigfish.com (Postfix) with ESMTP id 62ED7B8004C for ; Wed, 12 Dec 2012 18:05:34 +0000 (UTC) Received: from BL2PRD0310HT004.namprd03.prod.outlook.com (157.56.240.21) by CH1EHSMHS027.bigfish.com (10.43.70.27) with Microsoft SMTP Server (TLS) id 14.1.225.23; Wed, 12 Dec 2012 18:05:34 +0000 Received: from BLUPR03MB590.namprd03.prod.outlook.com (10.255.124.36) by BL2PRD0310HT004.namprd03.prod.outlook.com (10.255.97.39) with Microsoft SMTP Server (TLS) id 14.16.245.2; Wed, 12 Dec 2012 18:05:34 +0000 Received: from BLUPR03MB590.namprd03.prod.outlook.com (10.255.124.36) by BLUPR03MB590.namprd03.prod.outlook.com (10.255.124.36) with Microsoft SMTP Server (TLS) id 15.0.578.12; Wed, 12 Dec 2012 18:05:33 +0000 Received: from BLUPR03MB590.namprd03.prod.outlook.com ([169.254.2.128]) by BLUPR03MB590.namprd03.prod.outlook.com ([169.254.2.128]) with mapi id 15.00.0578.008; Wed, 12 Dec 2012 18:05:33 +0000 From: Brad Sarsfield To: "user@hadoop.apache.org" Subject: RE: Permissions while running bin/hadoop Thread-Topic: Permissions while running bin/hadoop Thread-Index: AQHN2DTn7xbn/6OtWEWWVv6l5Mc6hpgVacOA Date: Wed, 12 Dec 2012 18:05:32 +0000 Message-ID: <967bb3578a6c4119a1f434f938f27032@BLUPR03MB590.namprd03.prod.outlook.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [131.107.174.244] Content-Type: multipart/alternative; boundary="_000_967bb3578a6c4119a1f434f938f27032BLUPR03MB590namprd03pro_" MIME-Version: 1.0 X-OrganizationHeadersPreserved: BL2PRD0310HT004.namprd03.prod.outlook.com X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn% X-FOPE-CONNECTOR: Id%59$Dn%HADOOP.APACHE.ORG$RO%2$TLS%6$FQDN%131.107.125.5$TlsDn% X-CrossPremisesHeadersPromoted: TK5EX14MLTC101.redmond.corp.microsoft.com X-CrossPremisesHeadersFiltered: TK5EX14MLTC101.redmond.corp.microsoft.com X-Forefront-Antispam-Report: CIP:131.107.125.37;CTRY:US;IPV:CAL;IPV:NLI;EFV:NLI;SFV:NSPM;SFS:(377454001)(377424002)(479174001)(33646001)(5343655001)(5343635001)(54356001)(59766001)(47736001)(47976001)(50986001)(77982001)(76482001)(512954001)(51856001)(53806001)(31966008)(551544001)(4396001)(49866001)(16236675001)(46102001)(47446002)(54316002)(16676001)(74662001)(6806001)(44976002)(74502001)(56816002)(56776001)(15202345001)(24736002);DIR:OUT;SFP:;SCL:1;SRVR:BL2FFO11HUB020;LANG:en; X-OriginatorOrg: microsoft.onmicrosoft.com X-Forefront-PRVS: 069373DFB6 X-Virus-Checked: Checked by ClamAV on apache.org --_000_967bb3578a6c4119a1f434f938f27032BLUPR03MB590namprd03pro_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi Jenny, You should consider looking at the branch-1-win which has removed the cygwi= n dependency for running Hadoop on Windows. There are vendors (Hortonworks= , Microsoft) that provide free windows install packages that are simple to = install as well. ~Brad From: Jennifer Lopez [mailto:lopez.mirinda@gmail.com] Sent: Tuesday, December 11, 2012 10:08 PM To: user@hadoop.apache.org Subject: Reg: Permissions while running bin/hadoop I am using Hadoop 1.1.1 to prepare a POC for a simple project. I am using W= indows 7 and cygwin for the same and it is a single node setup. I have only= my windows machine to use for this purpose and I login with my account tha= t is created by my company. I run all the commands from cygwin. I am trying to setup the Standalone Operation and Pseudo-Distributed Operat= ion as mentioned in the following link. http://hadoop.apache.org/docs/r0.20.0/quickstart.html#Prepare+to+Start+the+= Hadoop+Cluster Scenario 1: Standalone Operation, no entries in the conf/*-site.xml ran bin/hadoop jar hadoop*-exam*.jar grep input output 'dfs[a-z.]+' Error: 12/12/12 11:05:45 ERROR security.UserGroupInformation: PriviledgedActionExc= eption as: cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-<= user-id>\mapred\staging\1619674617\.staging to 0700 I tried chmod 0700 to the above folder. But the error persists. Scenario 2: Pseudo-Distributed Operation Made necessary changes @ conf/*-site.xml as mentioned in the above link ran the following commands bin/hadoop namenode bin/hadoop datanode bin/start-mapred.sh my jps states that 4524 JobTracker 7120 Jps 5200 DataNode 4736 NameNode I look at my logs and find that the tasktracker had problem starting up. Error: 2012-12-12 11:24:47,726 ERROR org.apache.hadoop.mapred.TaskTracker: Can not= start task tracker because java.io.IOException: Failed to set permissions = of path: \tmp\hadoop-\mapred\local\taskTracker to 0755 I tried chmod 0755 to the above folder. But the error persists. When tasktracker prompts for password @localhost's password, I ent= er my login password what am I missing here? Any help would be highly appreciated. I would not be getting any access to *nix machines nor can I install a dual= OS. Company restrictions. --Jenny --_000_967bb3578a6c4119a1f434f938f27032BLUPR03MB590namprd03pro_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi Jenny,

 <= /p>

You should consider looki= ng at the branch-1-win which has removed the cygwin dependency for running = Hadoop on Windows.  There are vendors (Hortonworks, Microsoft) that provide free windows install packages that are simple to install as w= ell.

 <= /p>

~Brad

 <= /p>

From: Jennif= er Lopez [mailto:lopez.mirinda@gmail.com]
Sent: Tuesday, December 11, 2012 10:08 PM
To: user@hadoop.apache.org
Subject: Reg: Permissions while running bin/hadoop
=

 

I am using Hadoop 1.1.1 to prepare a POC for a simple project. I am usin= g Windows 7 and cygwin for the same and it is a single node setup. I have o= nly my windows machine to use for this purpose and I login with my account = that is created by my company.
 
I run all the commands from cygwin.
 

I am trying to setup the Standalone Operation and Pseudo-Distributed Ope= ration as mentioned in the following link.
http://hadoop.apache.org/doc= s/r0.20.0/quickstart.html#Prepare+to+Start+the+Hadoop+C= luster
 
Scenario 1: Standalone Operation, no entries in the conf/*-site.xml
ran bin/hadoop jar hadoop*-exam*.jar grep input output 'dfs[a-z.]+'

Error:

12/12/12 11:05:45 ERROR security.UserGroupInformation: PriviledgedAction= Exception as:<user-id>
cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-&= lt;user-id>\mapred\staging\<user-id>1619674617\.staging to 0700  
I tried chmod 0700 to the above folder. But the error persists.<= /p>

Scenario 2: Pseudo-Distributed Operation

Made necessary changes @ conf/*-site.xml as mentioned in the above link =
ran the following commands
bin/hadoop namenode
bin/hadoop datanode
bin/start-mapred.sh

my jps states that

4524 JobTracker
7120 Jps
5200 DataNode
4736 NameNode

I look at my logs and find that the tasktracker had problem starting up.=

Error:
2012-12-12 11:24:47,726 ERROR org.apache.hadoop.mapred.TaskTracker: Can not= start task tracker because java.io.IOException: Failed to set permissions = of path: \tmp\hadoop-<user-id>\mapred\local\taskTracker to 0755
I tried chmod 0755 to the above folder. But the error persists.<= /p>

When tasktracker prompts for password <user-id>@localhost's passwo= rd, I enter my login password

what am I missing here? Any help would be highly appreciated.=

I would not be getting any access to *nix machines nor can I install a d= ual OS. Company restrictions.


--Jenny

 
 

--_000_967bb3578a6c4119a1f434f938f27032BLUPR03MB590namprd03pro_--