Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 25818 invoked from network); 8 Jan 2008 00:53:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 8 Jan 2008 00:53:58 -0000 Received: (qmail 92060 invoked by uid 500); 8 Jan 2008 00:53:46 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 92024 invoked by uid 500); 8 Jan 2008 00:53:46 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 92015 invoked by uid 99); 8 Jan 2008 00:53:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Jan 2008 16:53:46 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jan 2008 00:53:42 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6B7AC714236 for ; Mon, 7 Jan 2008 16:53:34 -0800 (PST) Message-ID: <13858048.1199753614436.JavaMail.jira@brutus> Date: Mon, 7 Jan 2008 16:53:34 -0800 (PST) From: "Hairong Kuang (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-1873) User permissions for Map/Reduce In-Reply-To: <425656.1189470449827.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1873: ---------------------------------- Attachment: mapred6.patch Mmm...Copying configuration still does not work. Any change to the copied configuration is not visible to the file system handler. In order for the change to take effect, we have to close the file system handle (so it is removed from FileSystem cache and then refetch it. So the mkdirs code looks like: {noformat} public static boolean mkdirs(FileSystem fs, Path dir, FsPermission permission) throws IOException { Configuration conf = new Configuration(fs.getConf()); conf.setInt(FsPermission.UMASK_LABEL, 0); fs.close(); fs = FileSystem.get(conf); return fs.mkdirs(dir, permission); } {noformat} But closing the file handler is not acceptable and refeching a new file system handler is too expensive. The attached patch reverts to option 1. > User permissions for Map/Reduce > ------------------------------- > > Key: HADOOP-1873 > URL: https://issues.apache.org/jira/browse/HADOOP-1873 > Project: Hadoop > Issue Type: Improvement > Reporter: Raghu Angadi > Assignee: Hairong Kuang > Attachments: mapred.patch, mapred2.patch, mapred3.patch, mapred4.patch, mapred5.patch, mapred6.patch > > > HADOOP-1298 and HADOOP-1701 add permissions and pluggable security for DFS files and DFS accesses. Same users permission should work for Map/Reduce jobs as well. > User persmission should propegate from client to map/reduce tasks and all the file operations should be subject to user permissions. This is transparent to the user (i.e. no changes to user code should be required). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.