Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 41814 invoked from network); 12 Feb 2009 04:45:08 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 12 Feb 2009 04:45:08 -0000 Received: (qmail 35894 invoked by uid 500); 12 Feb 2009 04:45:05 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 34839 invoked by uid 500); 12 Feb 2009 04:45:02 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 34828 invoked by uid 99); 12 Feb 2009 04:45:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Feb 2009 20:45:01 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [203.99.254.143] (HELO rsmtp1.corp.hki.yahoo.com) (203.99.254.143) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Feb 2009 04:44:51 +0000 Received: from [10.66.74.35] (sevenshade-lr.eglbp.corp.yahoo.com [10.66.74.35]) by rsmtp1.corp.hki.yahoo.com (8.13.8/8.13.8/y.rout) with ESMTP id n1C4iQJn079229 for ; Wed, 11 Feb 2009 20:44:27 -0800 (PST) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:subject: references:in-reply-to:content-type:content-transfer-encoding; b=pSaxX9Xd7uUzBleWKwTYK4aXEB+0GqbnkawgGYmreb/TsqTmGClZvYszbtBjWNIB Message-ID: <4993A92A.6090707@yahoo-inc.com> Date: Thu, 12 Feb 2009 10:14:26 +0530 From: Amar Kamat User-Agent: Thunderbird 2.0.0.19 (X11/20081209) MIME-Version: 1.0 To: core-user@hadoop.apache.org Subject: Re: Hadoop setup questions References: <4992E314.4000308@cse.usf.edu> In-Reply-To: <4992E314.4000308@cse.usf.edu> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org bjday wrote: > Good morning everyone, > > I have a question about correct setup for hadoop. I have 14 Dell > computers in a lab. Each connected to the internet and each > independent of each other. All run CentOS. Logins are handled by > NIS. If userA logs into the master and starts the daemons and UserB > logs into the master and wants to run a job while the daemons from > UserA are still running the following error occurs: > > copyFromLocal: org.apache.hadoop.security.AccessControlException: > Permission denied: user=UserB, access=WRITE, > inode="user":UserA:supergroup:rwxr-xr-x Looks like one of your files (input or output) is of different user. Seems like your DFS has permissions enabled. If you dont require permissions then disable it else make sure that the input/output paths are under your permission (/user/userB is the hone directory for userB). Amar > > what needs to be changed to allow UserB-UserZ to run their jobs? Does > there need to be a local user the everyone logs into as and run from > there? Should Hadoop be ran in an actual cluster instead of > independent computers? Any ideas what is the correct configuration > settings that allow it? > > I followed Ravi Phulari suggestions and followed: > > http://hadoop.apache.org/core/docs/current/quickstart.html > http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster) > > > http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster) > > > > These allowed me to get Hadoop running on the 14 computers when I > login and everything works fine, thank you Ravi. The problem occurs > when additional people attempt to run jobs simultaneously. > > Thank you, > > Brian >