Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 56669 invoked from network); 3 Dec 2009 12:13:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Dec 2009 12:13:21 -0000 Received: (qmail 35960 invoked by uid 500); 3 Dec 2009 12:13:18 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 35897 invoked by uid 500); 3 Dec 2009 12:13:18 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 35887 invoked by uid 99); 3 Dec 2009 12:13:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Dec 2009 12:13:17 +0000 X-ASF-Spam-Status: No, hits=-1.8 required=5.0 tests=AWL,BAYES_00,DATE_IN_FUTURE_03_06 X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of pavelkolodinhadoop@gmail.com designates 209.85.219.215 as permitted sender) Received: from [209.85.219.215] (HELO mail-ew0-f215.google.com) (209.85.219.215) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Dec 2009 12:13:14 +0000 Received: by ewy7 with SMTP id 7so329330ewy.12 for ; Thu, 03 Dec 2009 04:12:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:to:subject:from :organization:content-type:mime-version:references :content-transfer-encoding:message-id:in-reply-to:user-agent; bh=IAVzQ3c+YlimNZb+wIB8E6pgtInxCd168X4sbKsVryw=; b=x+o24RgKkYX22X7lY5oIiO7Er8asfxtTQsciHr2IgV5BGEYwL1zmecInk3iXxMXxgc ndFCTAXlGEMH9BGHL/3IZavsllhxI4bbo5md/sjGhXGhBrGia5UJnOJNceNDVWlh3h34 3fKw4YEdB/KeMV4yFinvB22DRLXzFbh120uAw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:to:subject:from:organization:content-type:mime-version :references:content-transfer-encoding:message-id:in-reply-to :user-agent; b=tmDL4UaJbKEY6pLul+ZYfgoEaKZDIr4Ll5+sS1JfF8jKJWdW55Fu3Iu3iIXUNhBRZj Mqx5LD17RL7D+9InrXlrZT+MJB0oG2pvxyayFguQ7Lfn/jlWUpdoZKoge9UbxGiT9Au7 kgY1v23he3/T4OoSQ4Gg0N3W08CKP1aOyz/yg= Received: by 10.213.110.4 with SMTP id l4mr9049098ebp.81.1259842372571; Thu, 03 Dec 2009 04:12:52 -0800 (PST) Received: from master1 (ppp91-122-27-116.pppoe.avangarddsl.ru [91.122.27.116]) by mx.google.com with ESMTPS id 7sm3449627eyb.26.2009.12.03.04.12.50 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 03 Dec 2009 04:12:52 -0800 (PST) Date: Thu, 03 Dec 2009 16:09:20 -0000 To: common-user@hadoop.apache.org Subject: hardware servers != VPSs From: "pavel kolodin" Organization: 1 Content-Type: text/plain; format=flowed; delsp=yes; charset=us-ascii MIME-Version: 1.0 References: Content-Transfer-Encoding: 7bit Message-ID: In-Reply-To: User-Agent: Opera Mail/9.63 (Linux) 0) I am running hadoop-0.20.1. 1) Running only dfs (formatting, then "hadoop-0.20.1/bin/start-dfs.sh") 2) When i try to use 1 laptop with os linux + running VirtualBox on it with the same linux gentoo in VirtualBox, all fine. 3) When i try to use 2 VPS on 16 cpu intel xenon 64bit hardware with the same gentoo (or close to mine) OS, i am getting a mess with permissions. For example: hadoop@hadoopmaster ~ $ hadoop-0.20.1/bin/hadoop fs -put /tmp/idata/logogenPY_1259491560 / put: org.apache.hadoop.security.AccessControlException: Permission denied: user=DrWho, access=WRITE, inode="":hadoop:hadoop:rwxr-xr-x hadoop@hadoopmaster ~ $ This put command gives this message in namenode's logfile: http://pastebin.com/m7b9e10df Namenode's logfile contains this messages at startup: http://pastebin.com/m72398acb 4) I am sure, that hadoop's java processes running as 'hadoop', user exists, group exists etc. I am running as 'hadoop' all the processes (commands). hadoop@hadoopmaster ~ $ id uid=1000(hadoop) gid=1003(hadoop) groups=1003(hadoop) hadoop@hadoopmaster ~ $ 5) After starting i can see this: hadoopmaster ~ # netstat -natp | grep LIST | grep java tcp6 0 0 :::33657 :::* LISTEN 22038/java tcp6 0 0 :::50010 :::* LISTEN 22038/java tcp6 0 0 :::50075 :::* LISTEN 22038/java tcp6 0 0 :::37186 :::* LISTEN 21916/java tcp6 0 0 :::50020 :::* LISTEN 22038/java tcp6 0 0 10.10.10.1:9000 :::* LISTEN 21916/java tcp6 0 0 :::40681 :::* LISTEN 22152/java tcp6 0 0 :::50090 :::* LISTEN 22152/java tcp6 0 0 :::50070 :::* LISTEN 21916/java hadoopmaster ~ # ---------- Thank you. ----------