hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pratik Gadiya <pratik_gad...@persistent.com>
Subject RE: Access on HDFS
Date Fri, 08 May 2015 16:37:26 GMT
@Alexander:
You mean to say that I need to restart the service again once I create the root-folders ?

Thanks,
Pratik Gadiya

From: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
Sent: Friday, May 08, 2015 10:01 PM
To: user@hadoop.apache.org
Subject: Re: Access on HDFS

Per default only hdfs (superuser) has permissions to write into hdfs root (/). Just sudo into
hdfs, create the root-folders, change the permissions to your user and start again.

BR,

--
Alexander Alten-Lorenz
m: wget.null@gmail.com<mailto:wget.null@gmail.com>
b: mapredit.blogspot.com<http://mapredit.blogspot.com>

On May 8, 2015, at 6:26 PM, Pratik Gadiya <pratik_gadiya@persistent.com<mailto:pratik_gadiya@persistent.com>>
wrote:

@Matt:
[root@vmkdev0022 ~]# hadoop fs -ls -d /
drwxr-xr-x   - hdfs hdfs          0 2015-05-08 10:44 /

@Olivier:
[admin@vmkdev0022 root]$ hadoop fs -mkdir /tptp
mkdir: Permission denied: user=admin, access=WRITE, inode="/":hdfs:hdfs:drwxr-xr-x

[admin@vmkdev0022 root]$ groups admin
admin : admin hdfs

[admin@vmkdev0022 root]$ id admin
uid=500(admin) gid=500(admin) groups=500(admin),498(hdfs)


Please suggest what should be the change for the permissions on / or if there is any other
way to resolve this.

Thanks,
Pratik
From: Matt Narrell [mailto:matt.narrell@gmail.com]
Sent: Friday, May 08, 2015 9:37 PM
To: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: Re: Access on HDFS

It looks like the group permissions on / is set to prohibit writes.

mn

On May 8, 2015, at 9:59 AM, Olivier Renault <orenault@hortonworks.com<mailto:orenault@hortonworks.com>>
wrote:

I meant did you check that user admin is part of the hdfs group on the namenode.

Olivier


From: Pratik Gadiya
Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>"
Date: Friday, 8 May 2015 16:57
To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>"
Subject: RE: Access on HDFS

Confirmed, that I have checked it on Namenode.
In addition to that, I have checked on all of the nodes in observed that superusergroup is
set as “hdfs” in hdfs-site.xml for all nodes.

Thanks,
Pratik Gadiya

From: Olivier Renault [mailto:orenault@hortonworks.com]
Sent: Friday, May 08, 2015 8:59 PM
To: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: Re: Access on HDFS

Could you confirm that you are doing it on the namenode ? ( I tend to do it on all nodes )

Thanks,
Olivier


From: Pratik Gadiya
Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>"
Date: Friday, 8 May 2015 16:14
To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>"
Subject: RE: Access on HDFS

Checked it’s hdfs

    <property>
      <name>dfs.permissions.superusergroup</name>
      <value>hdfs</value>
    </property>

Thanks,
Pratik

From: Olivier Renault [mailto:orenault@hortonworks.com]
Sent: Friday, May 08, 2015 8:39 PM
To: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: Re: Access on HDFS

You need to double check which group is setup in hdfs-site.xml. The parameter is: dfs.permissions.superusergroup

Thanks
Olivier

From: Pratik Gadiya
Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>"
Date: Friday, 8 May 2015 15:46
To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>"
Subject: Access on HDFS

Hi All,

I want to add a user who can create/remove and perform all the operations on hdfs.

Here is what I tried:

1.       Create user: adduser admin
2.       /usr/sbin/usermod -a -G hdfs admin

And when I try to create a directory on hdfs under “/” it raises error as follows,
[root@vmkdev0021 ~]# id admin
uid=500(admin) gid=500(admin) groups=500(admin),498(hdfs)

[root@vmkdev0021 ~]# su admin
[admin@vmkdev0021 root]$ hadoop  fs -mkdir /input
mkdir: Permission denied: user=admin, access=WRITE, inode="/":hdfs:hdfs:drwxr-xr-x

Please let me know how can I overcome this, this is reallly bugging me.

With Regards,
Pratik Gadiya

DISCLAIMER ========== This e-mail may contain privileged and confidential information which
is the property of Persistent Systems Ltd. It is intended only for the use of the individual
or entity to which it is addressed. If you are not the intended recipient, you are not authorized
to read, retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.
DISCLAIMER ========== This e-mail may contain privileged and confidential information which
is the property of Persistent Systems Ltd. It is intended only for the use of the individual
or entity to which it is addressed. If you are not the intended recipient, you are not authorized
to read, retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.
DISCLAIMER ========== This e-mail may contain privileged and confidential information which
is the property of Persistent Systems Ltd. It is intended only for the use of the individual
or entity to which it is addressed. If you are not the intended recipient, you are not authorized
to read, retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.

DISCLAIMER ========== This e-mail may contain privileged and confidential information which
is the property of Persistent Systems Ltd. It is intended only for the use of the individual
or entity to which it is addressed. If you are not the intended recipient, you are not authorized
to read, retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.


DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Persistent
Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed.
If you are not the intended recipient, you are not authorized to read, retain, copy, print,
distribute or use this message. If you have received this communication in error, please notify
the sender and delete all copies of this message. Persistent Systems Ltd. does not accept
any liability for virus infected mails.

Mime
View raw message