Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A3F1B172D2 for ; Mon, 6 Apr 2015 09:32:26 +0000 (UTC) Received: (qmail 52379 invoked by uid 500); 6 Apr 2015 09:32:21 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 52234 invoked by uid 500); 6 Apr 2015 09:32:21 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 52218 invoked by uid 99); 6 Apr 2015 09:32:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Apr 2015 09:32:20 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mathursharp@gmail.com designates 209.85.217.176 as permitted sender) Received: from [209.85.217.176] (HELO mail-lb0-f176.google.com) (209.85.217.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Apr 2015 09:31:55 +0000 Received: by lboc7 with SMTP id c7so16183004lbo.1 for ; Mon, 06 Apr 2015 02:29:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=c7C2gRUHkEJk7iGcTFTE6cef7kL5ze0F6DJWMUXMWQQ=; b=eR00f/Mh/JjP5LPf7EEiHiMOpt545j1O4ZpQwh1mMRbvKtw9U9pQXGuz3rW4Gw9Irm Ocu1Lxb3FqbpE3l32eA3pwmIyYSLXhCqdvotGPgGb18krVRB5WkS7HDruzqVlV6bafVx dOQIspUbfhaGluUTFWgbDqh8eJmES6NgBpFoxa5Vb9+aEfZPnbzh2D57CBEMN5lNBb1l zsMfCSSXfV54UiMvB2pPzZc3Mz3IADglESxvwOLsefzXDn9sCVyCjAl2NdHQso/2iHsF 1mN20z/SgLYecGcEmvpbvY5R/vfujnQe+b9NWm0KVrmxS948NmXF8pEbJlFIeknVwFVn ojXw== MIME-Version: 1.0 X-Received: by 10.152.204.40 with SMTP id kv8mr12569545lac.113.1428312578778; Mon, 06 Apr 2015 02:29:38 -0700 (PDT) Received: by 10.112.158.229 with HTTP; Mon, 6 Apr 2015 02:29:38 -0700 (PDT) In-Reply-To: References: Date: Mon, 6 Apr 2015 14:59:38 +0530 Message-ID: Subject: Re: File permission of Hadoop staging directory getting changed time to time From: Harshit Mathur To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11347da6e2eb0705130aefc5 X-Virus-Checked: Checked by ClamAV on apache.org --001a11347da6e2eb0705130aefc5 Content-Type: text/plain; charset=UTF-8 try running with sudo hive. On Mon, Apr 6, 2015 at 1:40 PM, Inosh Goonewardena wrote: > Hi All, > > Really appreciate any input on this issue. > > Thanks and Regards, > Inosh > > On Tue, Jan 20, 2015 at 10:29 PM, Inosh Goonewardena > wrote: > >> Hi All, >> >> We have setup a Hadoop cluster using hadoop 1.0.4 and we use Hive to >> submit map/reduce jobs. But we have noticed that these map/reduce job >> submission failing time to time due to a permission issue occurring in >> Hadoop. When this happens, we have to use the hadoop hdfs command and >> change the file permission of mapreduce staging directory. Following is the >> error that is getting logged. >> >> [2015-01-16 05:30:13,314] ERROR {org.apache.hadoop.hive.ql.exec.Task} - >> Job Submission failed with exception 'java.io.IOException(The >> ownership/permissions on the staging directory hdfs:// >> hadoop0.test.com:9000/mnt/hadoop_tmp/mapred/staging/inosh/.staging is >> not as expected. It is owned by inosh and permissions are rwxr-xr-x. The >> directory must be owned by the submitter inosh or by inosh and permissions >> must be rwx------)' >> java.io.IOException: The ownership/permissions on the staging directory >> hdfs://hadoop0.test.com:9000/mnt/hadoop_tmp/mapred/staging/inosh/.staging >> is not as expected. It is owned by inosh and permissions are rwxr-xr-x. The >> directory must be owned by the submitter inosh or by inosh and permissions >> must be rwx------ >> at >> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:108) >> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:798) >> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:792) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:415) >> at >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1123) >> at >> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792) >> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766) >> at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:460) >> at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136) >> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:129) >> at >> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:62) >> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1351) >> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1126) >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:934) >> at >> org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:201) >> at >> org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:187) >> ... >> >> >> When we get this error we go to hadoop name node and execute following >> command to set proper permission to the folder mentioned in the exception. >> ./hadoop dfs -chmod 700 /mnt/hadoop_tmp/mapred/staging/inosh/.staging >> >> >> We would like know why this happens and how to fix this permanently. >> >> >> Thanks and Regards, >> Inosh >> > > -- Harshit Mathur --001a11347da6e2eb0705130aefc5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
try running with sudo hive.

On Mon, Apr 6, 2015 at 1:40 PM, Inosh = Goonewardena <inoshmrt@gmail.com> wrote:
Hi All,

Really= appreciate any input on this issue.

Thanks and Regards,
Inosh

On Tue, Jan 20, 2015 at 10:29 PM,= Inosh Goonewardena <inoshmrt@gmail.com> wrote:
Hi All,

We have se= tup a Hadoop cluster using hadoop 1.0.4 and we use Hive to submit map/reduc= e jobs. But we have noticed that these map/reduce job submission failing ti= me to time due to a permission issue occurring in Hadoop. When this happens= , we have to use the hadoop hdfs command and change the file permission of = mapreduce staging directory. Following is the error that is getting logged.=

[2015-01-16 05:30:13,314] ERROR {org.apache.hadoop.hive.ql.exec.Ta= sk} - Job Submission failed with exception 'java.io.IOException(The own= ership/permissions on the staging directory hdfs://hadoop0.test.com:9000/mnt/hadoop_tmp/mapred/staging/inosh/.staging= is not as expected. It is owned by inosh and permissions are rwxr-xr-x. Th= e directory must be owned by the submitter inosh or by inosh and permission= s must be rwx------)'
java.io.IOException: The ownership/permissions= on the staging directory hdfs://hadoop0.test.= com:9000/mnt/hadoop_tmp/mapred/staging/inosh/.staging is not as expecte= d. It is owned by inosh and permissions are rwxr-xr-x. The directory must b= e owned by the submitter inosh or by inosh and permissions must be rwx-----= -
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSub= missionFiles.java:108)
at org.apache.hadoop.mapred.JobClient$2.run(JobCl= ient.java:798)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.jav= a:792)
at java.security.AccessController.doPrivileged(Native Method)
= at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hado= op.security.UserGroupInformation.doAs(UserGroupInformation.java:1123)
at= org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766)
at= org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:460)
= at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:129)
at o= rg.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:62)<= br>at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1351)
at o= rg.apache.hadoop.hive.ql.Driver.execute(Driver.java:1126)
at org.apache.= hadoop.hive.ql.Driver.run(Driver.java:934)
at org.apache.hadoop.hive.ser= vice.HiveServer$HiveServerHandler.execute(HiveServer.java:201)
at org.ap= ache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:187)...


When we get this error we go to hadoop name node and execut= e following command to set proper permission to the folder mentioned in the= exception.
./hadoop dfs -chmod 700 /mnt/hadoop_tmp/mapred/staging/inosh= /.staging


We would like know why this happens and how to fix th= is permanently.


Thanks and Regards,
Inosh




--
Harshit Mathur
--001a11347da6e2eb0705130aefc5--