Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 39604 invoked from network); 11 Feb 2009 14:39:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Feb 2009 14:39:55 -0000 Received: (qmail 90980 invoked by uid 500); 11 Feb 2009 14:39:49 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 90939 invoked by uid 500); 11 Feb 2009 14:39:49 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 90928 invoked by uid 99); 11 Feb 2009 14:39:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Feb 2009 06:39:49 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [131.247.3.2] (HELO babbage.csee.usf.edu) (131.247.3.2) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Feb 2009 14:39:40 +0000 Received: from [131.247.2.161] (enb226b [131.247.2.161]) by babbage.csee.usf.edu (8.14.2/8.14.2) with ESMTP id n1BEUKE5020753 for ; Wed, 11 Feb 2009 09:30:20 -0500 (EST) (envelope-from bjday@cse.usf.edu) Message-ID: <4992E314.4000308@cse.usf.edu> Date: Wed, 11 Feb 2009 09:39:16 -0500 From: bjday User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: core-user@hadoop.apache.org Subject: Hadoop setup questions Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-PMX-Version: 5.5.1.360522, Antispam-Engine: 2.6.1.350677, Antispam-Data: 2009.2.11.142218 X-PerlMx-Spam: Gauge=IIIIIII, Probability=8%, Report='FROM_NAME_ONE_WORD 0.05, BODY_SIZE_1500_1599 0, BODY_SIZE_2000_LESS 0, BODY_SIZE_5000_LESS 0, SPF_NONE 0, __CP_URI_IN_BODY 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0, __HAS_MSGID 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __SANE_MSGID 0, __STOCK_PHRASE_7 0, __USER_AGENT 0' X-Virus-Checked: Checked by ClamAV on apache.org Good morning everyone, I have a question about correct setup for hadoop. I have 14 Dell computers in a lab. Each connected to the internet and each independent of each other. All run CentOS. Logins are handled by NIS. If userA logs into the master and starts the daemons and UserB logs into the master and wants to run a job while the daemons from UserA are still running the following error occurs: copyFromLocal: org.apache.hadoop.security.AccessControlException: Permission denied: user=UserB, access=WRITE, inode="user":UserA:supergroup:rwxr-xr-x what needs to be changed to allow UserB-UserZ to run their jobs? Does there need to be a local user the everyone logs into as and run from there? Should Hadoop be ran in an actual cluster instead of independent computers? Any ideas what is the correct configuration settings that allow it? I followed Ravi Phulari suggestions and followed: http://hadoop.apache.org/core/docs/current/quickstart.html http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster) http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster) These allowed me to get Hadoop running on the 14 computers when I login and everything works fine, thank you Ravi. The problem occurs when additional people attempt to run jobs simultaneously. Thank you, Brian