Return-Path: 
 <core-dev-return-38645-apmail-hadoop-core-dev-archive=hadoop.apache.org@hadoop.apache.org>
Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org
Received: (qmail 74552 invoked from network); 12 May 2008 08:04:20 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 12 May 2008 08:04:20 -0000
Received: (qmail 79290 invoked by uid 500); 12 May 2008 08:04:19 -0000
Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org
Received: (qmail 79257 invoked by uid 500); 12 May 2008 08:04:19 -0000
Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:core-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:core-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:core-dev@hadoop.apache.org>
List-Id: <core-dev.hadoop.apache.org>
Reply-To: core-dev@hadoop.apache.org
Delivered-To: mailing list core-dev@hadoop.apache.org
Received: (qmail 79240 invoked by uid 99); 12 May 2008 08:04:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 May 2008 01:04:19 -0700
X-ASF-Spam-Status: No, hits=-2000.0 required=10.0
	tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 May 2008 08:03:41 +0000
Received: from brutus (localhost [127.0.0.1])
	by brutus.apache.org (Postfix) with ESMTP id 95B9D234C10C
	for <core-dev@hadoop.apache.org>; Mon, 12 May 2008 01:03:55 -0700 (PDT)
Message-ID: <1288716276.1210579435608.JavaMail.jira@brutus>
Date: Mon, 12 May 2008 01:03:55 -0700 (PDT)
From: "Karam Singh (JIRA)" <jira@apache.org>
To: core-dev@hadoop.apache.org
Subject: [jira] Updated: (HADOOP-3367) hod dealliocate does not xecute
 properly and throws Operation not permitted error, when hod allcoated
 cluster is shared with multiple users.
In-Reply-To: <295056291.1210248895534.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Virus-Checked: Checked by ClamAV on apache.org


     [ https://issues.apache.org/jira/browse/HADOOP-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karam Singh updated HADOOP-3367:
--------------------------------

    Summary: hod dealliocate does not xecute properly and throws Operation not permitted error, when hod allcoated cluster is shared with multiple users.  (was: hod dealliocate does execute properly and throws Operation not permitted error, when hod allcoated cluster is shared with multiple users.)

> hod dealliocate does not xecute properly and throws Operation not permitted error, when hod allcoated cluster is shared with multiple users.
> --------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3367
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3367
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>    Affects Versions: 0.17.0
>            Reporter: Karam Singh
>            Priority: Minor
>
> 1. Allocate cluster using hadoop with dfs permissions on and this cluster is used by two users. 
> 2. Ran randomtextwriter and distcp jobs.
> 3. When tried to deallocate hod deallocate threw "Operation not permitted" but exitted with exit code 0.
>    Following the output of deallocate operation -:
>    [
> 	[2008-05-07 15:01:47,503] DEBUG/10 hadoop:595 - hadoop-ui-log-dir not specified. Skipping Hadoop UI log collection.
> 	[2008-05-07 15:01:47,512] DEBUG/10 hadoop:616 - calling rm.stop
> 	[2008-05-07 15:01:47,559] DEBUG/10 hadoop:618 - completed rm.stop
> 	[2008-05-07 15:01:47,564] CRITICAL/50 hod:517 - op: deallocate cluster_dir failed: <type 'exceptions.OSError'> [Errno 1] Operation not permitted: '<path of hod.temp-dir>/<userid>.<cluster_id>'
> 	[2008-05-07 15:01:47,569] DEBUG/10 hod:518 - Traceback (most recent call last):
> 		  File "/grid/0/hodqa/hod/hod-dev-20080414/hodlib/Hod/hod.py", line 510, in operation
> 			    getattr(self, "_op_%s" % opList[0])(opList)
> 		  File "/grid/0/hodqa/hod/hod-dev-20080414/hodlib/Hod/hod.py", line 365, in _op_deallocate
> 			    self.__cluster.deallocate(clusterDir, clusterInfo)
> 		  File "/grid/0/hodqa/hod/hod-dev-20080414/hodlib/Hod/hadoop.py", line 624, in deallocate
> 			    shutil.rmtree(tempDir)
> 		  File "/export/crawlspace/kryptonite/comps//python-2.5.1/lib/python2.5/shutil.py", line 178, in rmtree
> 			    onerror(os.rmdir, path, sys.exc_info())
> 		  File "/export/crawlspace/kryptonite/comps//python-2.5.1/lib/python2.5/shutil.py", line 176, in rmtree
> 			    os.rmdir(path)
> 		OSError: [Errno 1] Operation not permitted: '<path of hod.temp-dir>/<userid>.<clusrter_id>'
> 	[2008-05-07 15:01:47,511] DEBUG/10 hod:522 - return code: 0
>    ]
>    Torque got comleted, hod list shows clsuter as dead cluster.
>    It seems when mapred job is run by other user then the user who allocated the cluster. hdo.temp-dir is getting created with ownership of mapred who ran maped jobs. 
>    So when deallocate operation is fired, by trhe user who allcoated the cluser, hod tries to removes <hod.temp-dir>/<useruid>.<cluster_id> durectory which fails causing dellocate operation to behave oddly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.