Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 410C5200B68 for ; Fri, 5 Aug 2016 03:01:52 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3F9A2160AAE; Fri, 5 Aug 2016 01:01:52 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 87481160AAB for ; Fri, 5 Aug 2016 03:01:51 +0200 (CEST) Received: (qmail 97427 invoked by uid 500); 5 Aug 2016 01:01:49 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 97403 invoked by uid 99); 5 Aug 2016 01:01:48 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Aug 2016 01:01:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 77BE31A7AED; Fri, 5 Aug 2016 01:01:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.448 X-Spam-Level: * X-Spam-Status: No, score=1.448 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id V2iNz9HmU4_Q; Fri, 5 Aug 2016 01:01:47 +0000 (UTC) Received: from mail-ua0-f172.google.com (mail-ua0-f172.google.com [209.85.217.172]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id B3AD36121B; Fri, 5 Aug 2016 01:01:46 +0000 (UTC) Received: by mail-ua0-f172.google.com with SMTP id 35so187033207uap.1; Thu, 04 Aug 2016 18:01:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=ZulD/4Fl338vyCd4p/b9UXIoJJ73/Wre/ZA7isYKOq4=; b=O9xZMDFE/S1bYJiqj9O9u08iaoYuHLi3SG2H/bGZoP86+Y0ixY7LCJ1Zvzvvmtcos9 Qjlwa4xvnFHjqz62JT+QgOZyrCo/sHIi43c/yLx4hmYNW02xmJ1WcpL/ozk754oYNEHD HNaXEEFy8SWK2bn57ZfmUO5CZOJbDXAILeW9RRMEIqSOE87traayisU3fQZDUWohxL7y V0+lKPr3XmjzhExVP9BXPDEnHWUhQwntypgv7VQJ+ggWB+IjNi85vyIMlIyV2Ze+KjBk CEzgTpOX/IOGzKNoA5VvvvaGXJj0YQayUBjOXQ1T6wOvJNjDyL02I+GBgIFn4aS+10mp tE2w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=ZulD/4Fl338vyCd4p/b9UXIoJJ73/Wre/ZA7isYKOq4=; b=J9OZKq8rGgO8DrTV0JFUvJYFtKr58+mWfF8xLhqn8M5DfV0lytmoJbfS0MX7rUMi59 HaswUuOuzcMHXY+enYkcOEjE0kJ3bKGwZQKMOqa5dNm5JGZq2rLLZCAgus8hCjCFqyle 4Bz2ZzNC+qNyrKG6Z8/pKymyqUbfQPYfjdM3Qk0pX4xJwHuEiSUytTYzprM2yBrONJd9 LB5RfE1g6XLGdDgtML9ExV9ukhXn13/ABFgiZUa1g/VECRn2oHXa0YIrPXVq9bDd/T1P QRzk00jAuZQKlPf4l7wpWapM4S+optnMkhsmNDe7DEWnHvZfKAWgQkwn8uZPOEMgnuJ1 XrEw== X-Gm-Message-State: AEkoouvEAdtSBf9p1q3/cZ4V9Siq8o1FUH7f3E3Q8JTWhnlJ4GBpev92FN8CDByatpxKO6tq/boLSf1qYbOpGg== X-Received: by 10.176.3.1 with SMTP id 1mr1154231uat.131.1470358900349; Thu, 04 Aug 2016 18:01:40 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.148.66 with HTTP; Thu, 4 Aug 2016 18:01:39 -0700 (PDT) Received: by 10.103.148.66 with HTTP; Thu, 4 Aug 2016 18:01:39 -0700 (PDT) In-Reply-To: References: From: Senthil Kumar Date: Fri, 5 Aug 2016 06:31:39 +0530 Message-ID: Subject: Re: HDFS NFS Gateway - Exporting multiple Directories To: senthilec566@apache.org, hdfs-dev@hadoop.apache.org, common-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11469372f2a1070539489bdd archived-at: Fri, 05 Aug 2016 01:01:52 -0000 --001a11469372f2a1070539489bdd Content-Type: text/plain; charset=UTF-8 Hi Team, Pls check this and let me your comment(s) .. --Senthil On Aug 4, 2016 7:22 PM, "Senthil Kumar" wrote: > Hi Team , > > > Current HDFS NFS gateway Supports exporting only one Directory.. > > Example : > > nfs.export.point > /user > > > This property helps us to export particular directory .. > > Code Block : > > public RpcProgramMountd(NfsConfiguration config, > DatagramSocket registrationSocket, boolean allowInsecurePorts) > throws IOException > { // Note that RPC cache is not enabled super("mountd", "localhost", > config.getInt( NfsConfigKeys.DFS_NFS_MOUNTD_PORT_KEY, > NfsConfigKeys.DFS_NFS_MOUNTD_PORT_DEFAULT), PROGRAM, VERSION_1, > VERSION_3, registrationSocket, allowInsecurePorts); exports = new > ArrayList(); exports.add(config.get(NfsConfigKeys.DFS_NFS_EXPORT_POINT_KEY, > NfsConfigKeys.DFS_NFS_EXPORT_POINT_DEFAULT)); this.hostsMatcher = > NfsExports.getInstance(config); this.mounts = > Collections.synchronizedList(new ArrayList()); > UserGroupInformation.setConfiguration(config); SecurityUtil.login(config, > NfsConfigKeys.DFS_NFS_KEYTAB_FILE_KEY, NfsConfigKeys.DFS_NFS_KERBEROS_PRINCIPAL_KEY); > this.dfsClient = new DFSClient(NameNode.getAddress(config), config); } > > Export List: > exports.add(config.get(NfsConfigKeys.DFS_NFS_EXPORT_POINT_KEY, > NfsConfigKeys.DFS_NFS_EXPORT_POINT_DEFAULT)); > > Current Code is supporting only one directory to be exposed ... Based on > our example /user can be exported .. > > Most of the production environment expects more number of directories > should be exported and the same can be mounted for different clients.. > > Example: > > > nfs.export.point > /user,/data/web_crawler,/app-logs > > > Here i have three directories to be exposed .. > > 1) /user > 2) /data/web_crawler > 3) /app-logs > > This would help us to mount directories for particular client ( Say client > A wants to write data in /app-logs - Hadoop Admin can mount and handover to > clients ). > > Please advise here.. > > > Have created JIRA for this issue : https://issues.apache.org/ > jira/browse/HDFS-10721. > > > --Senthil > --001a11469372f2a1070539489bdd--