Return-Path: X-Original-To: apmail-commons-dev-archive@www.apache.org Delivered-To: apmail-commons-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5701818755 for ; Mon, 16 Nov 2015 22:12:13 +0000 (UTC) Received: (qmail 6763 invoked by uid 500); 16 Nov 2015 22:12:13 -0000 Delivered-To: apmail-commons-dev-archive@commons.apache.org Received: (qmail 6598 invoked by uid 500); 16 Nov 2015 22:12:12 -0000 Mailing-List: contact dev-help@commons.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Commons Developers List" Delivered-To: mailing list dev@commons.apache.org Received: (qmail 6581 invoked by uid 99); 16 Nov 2015 22:12:12 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Nov 2015 22:12:12 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 0372BC6B0C for ; Mon, 16 Nov 2015 22:12:12 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3 X-Spam-Level: *** X-Spam-Status: No, score=3 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id fXJlsWkl_yqv for ; Mon, 16 Nov 2015 22:12:05 +0000 (UTC) Received: from eu-smtp-delivery-106.mimecast.com (eu-smtp-delivery-106.mimecast.com [207.82.80.106]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id B3AE542B60 for ; Mon, 16 Nov 2015 22:12:04 +0000 (UTC) Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2lp0237.outbound.protection.outlook.com [207.46.163.237]) (Using TLS) by eu-smtp-1.mimecast.com with ESMTP id uk-mta-12-qTMhNEJ3Qsu85gtwFsNG4w-1; Mon, 16 Nov 2015 22:11:53 +0000 Received: from CY1PR0601MB1563.namprd06.prod.outlook.com (10.163.232.141) by CY1PR0601MB1563.namprd06.prod.outlook.com (10.163.232.141) with Microsoft SMTP Server (TLS) id 15.1.325.17; Mon, 16 Nov 2015 22:11:51 +0000 Received: from CY1PR0601MB1563.namprd06.prod.outlook.com ([10.163.232.141]) by CY1PR0601MB1563.namprd06.prod.outlook.com ([10.163.232.141]) with mapi id 15.01.0325.003; Mon, 16 Nov 2015 22:11:50 +0000 From: Roger Whitcomb To: Commons Developers List Subject: [VFS] Further changes to HDFS Provider for alternate configuration support Thread-Topic: [VFS] Further changes to HDFS Provider for alternate configuration support Thread-Index: AdEgtnK1dzsIHkIGQvWcMki7cKKqhQ== Date: Mon, 16 Nov 2015 22:11:50 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [12.32.116.227] x-microsoft-exchange-diagnostics: 1;CY1PR0601MB1563;5:koDsQ+x19sSGmOukRzAt8I5TJ7hdLtoAly0Z0Bht0aXNIH+bhhkErecqvjjaP/OiYf8nZQRaIbf7nUPyRQFNPhTUVJ0jtJ3rCmWM1YIixUzjrFxaMhVjhY01thy/cqFRMOknJqO/S/I1giJikSWeFg==;24:84flyuImEc/K/MzTvSg7VmxXFkKTHMj+qHL6zgA35+EdAhzzHcwwVcEnUkv4HqlukdjX98VvAEjLkE+bDXe3AoRQs6kYMUBa6hZdeiZlOL0=;20:pPoQ4l3tWCBM5X3PNsVXQwWcCm8qCl6O36QKXz5LSw0R+zMBidV2y7DIQZAs31JORxKCqTEwhqfKtJlszaKAHEBIfDUb8jc4jMQZdJK6ZKNuf67auXbGHrBjZamLzTF4bKbKaxQphw0spy8iyOR2prIyVsBeJ3JzdVY/oegZVeg= x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CY1PR0601MB1563; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(108003899814671); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(601004)(2401047)(520078)(5005006)(8121501046)(3002001)(10201501046);SRVR:CY1PR0601MB1563;BCL:0;PCL:0;RULEID:;SRVR:CY1PR0601MB1563; x-forefront-prvs: 0762FFD075 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(6009001)(199003)(53754006)(164054003)(189002)(19300405004)(5007970100001)(5004730100002)(81156007)(97736004)(229853001)(92566002)(110136002)(87936001)(2900100001)(19580395003)(5003600100002)(77096005)(450100001)(102836002)(5002640100001)(99936001)(66066001)(122556002)(74316001)(5890100001)(33656002)(86362001)(105586002)(40100003)(106356001)(10400500002)(99286002)(50986999)(101416001)(15975445007)(54356999)(189998001)(76576001)(16236675004)(19625215002)(5001960100002)(107886002)(586003)(5008740100001);DIR:OUT;SFP:1102;SCL:1;SRVR:CY1PR0601MB1563;H:CY1PR0601MB1563.namprd06.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: actian.com X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Nov 2015 22:11:50.8999 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 20057ce9-1386-4770-8b04-e7824ef632be X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR0601MB1563 X-MC-Unique: qTMhNEJ3Qsu85gtwFsNG4w-1 Content-Type: multipart/mixed; boundary="_004_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_" --_004_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_ Content-Type: multipart/alternative; boundary="_000_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_" --_000_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_ Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable Hi all, In trying to solve some customer issues we're having, mainl= y to do with trying to browse HDFS files when the Name Node is configured f= or High-Availability, I found I needed to make some more changes/additions = to the VFS HDFS Provider. I have attached a diff/patch file. But, a coupl= e of questions: * This is a follow-on (basically) to my earlier patch for VFS-555, = should I open a new JIRA, or just reopen the existing one? * Since this actually changes an API (but which is not released yet= ), is that an acceptable thing to do? * The new properties I have added to HdfsFileSystemConfigBuilder ar= e not actually symmetrical, so they don't fit the definition of a Java "pro= perty", that is the setters are "setXXX" while the getters are "getXXXs" (p= lural). The logic behind this is that the setters are called by user code, = and each can be called multiple times. The getters are only (meant to be) = called by the HdfsFileSystem object (that is internally to the HdfsProvider= ), and thus it is a lot easier to get all the settings at once than to have= to make multiple calls, with potentially iterators, etc. * Is this too big a change to fit in last-minute before the release= of VFS 2.1? Patch is attached. Thanks, ~Roger Whitcomb --_000_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_ Content-Type: text/html; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable

Hi all,

        &nbs= p;       In trying to solve some customer iss= ues we’re having, mainly to do with trying to browse HDFS files when = the Name Node is configured for High-Availability, I found I needed to make= some more changes/additions to the VFS HDFS Provider.  I have attached a diff/patch file.  But, a coupl= e of questions:

·         This is a follow-on (basically) to my earlie= r patch for VFS-555, should I open a new JIRA, or just reopen the existing = one?

·         Since this actually changes an API (but whic= h is not released yet), is that an acceptable thing to do?

·         The new properties I have added to HdfsFileS= ystemConfigBuilder are not actually symmetrical, so they don’t fit th= e definition of a Java “property”, that is the setters are R= 20;setXXX” while the getters are “getXXXs” (plural). The logic behind this is that the setters are called by user code, and each ca= n be called multiple times.  The getters are only (meant to be) called= by the HdfsFileSystem object (that is internally to the HdfsProvider), and= thus it is a lot easier to get all the settings at once than to have to make multiple calls, with potentially ite= rators, etc.

·         Is this too big a change to fit in last-minu= te before the release of VFS 2.1?

 

Patch is attached.

 

Thanks,

~Roger Whitcomb

--_000_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_-- --_004_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_ Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org For additional commands, e-mail: dev-help@commons.apache.org --_004_CY1PR0601MB156301F4CF0B050588FF3799E71E0CY1PR0601MB1563_--