hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Senthil Kumar <senthilec...@gmail.com>
Subject Re: HDFS NFS Gateway - Exporting multiple Directories
Date Fri, 05 Aug 2016 01:01:39 GMT
Hi Team, Pls check this and let me your comment(s) ..

--Senthil

On Aug 4, 2016 7:22 PM, "Senthil Kumar" <senthilec566@gmail.com> wrote:

> Hi Team ,
>
>
> Current HDFS NFS gateway Supports exporting only one Directory..
>
> Example :
> <property>
> <name>nfs.export.point</name>
> <value>/user</value>
> </property>
>
> This property helps us to export particular directory ..
>
> Code Block :
>
> public RpcProgramMountd(NfsConfiguration config,
> DatagramSocket registrationSocket, boolean allowInsecurePorts)
> throws IOException
> { // Note that RPC cache is not enabled super("mountd", "localhost",
> config.getInt( NfsConfigKeys.DFS_NFS_MOUNTD_PORT_KEY,
> NfsConfigKeys.DFS_NFS_MOUNTD_PORT_DEFAULT), PROGRAM, VERSION_1,
> VERSION_3, registrationSocket, allowInsecurePorts); exports = new
> ArrayList<String>(); exports.add(config.get(NfsConfigKeys.DFS_NFS_EXPORT_POINT_KEY,
> NfsConfigKeys.DFS_NFS_EXPORT_POINT_DEFAULT)); this.hostsMatcher =
> NfsExports.getInstance(config); this.mounts =
> Collections.synchronizedList(new ArrayList<MountEntry>());
> UserGroupInformation.setConfiguration(config); SecurityUtil.login(config,
> NfsConfigKeys.DFS_NFS_KEYTAB_FILE_KEY, NfsConfigKeys.DFS_NFS_KERBEROS_PRINCIPAL_KEY);
> this.dfsClient = new DFSClient(NameNode.getAddress(config), config); }
>
> Export List:
> exports.add(config.get(NfsConfigKeys.DFS_NFS_EXPORT_POINT_KEY,
> NfsConfigKeys.DFS_NFS_EXPORT_POINT_DEFAULT));
>
> Current Code is supporting only one directory to be exposed ... Based on
> our example /user can be exported ..
>
> Most of the production environment expects more number of directories
> should be exported and the same can be mounted for different clients..
>
> Example:
>
> <property>
> <name>nfs.export.point</name>
> <value>/user,/data/web_crawler,/app-logs</value>
> </property>
>
> Here i have three directories to be exposed ..
>
> 1) /user
> 2) /data/web_crawler
> 3) /app-logs
>
> This would help us to mount directories for particular client ( Say client
> A wants to write data in /app-logs - Hadoop Admin can mount and handover to
> clients ).
>
> Please advise here..
>
>
> Have created JIRA for this issue : https://issues.apache.org/
> jira/browse/HDFS-10721.
>
>
> --Senthil
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message