Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B800D200C23 for ; Wed, 22 Feb 2017 16:38:19 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id B696B160B67; Wed, 22 Feb 2017 15:38:19 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D7421160B49 for ; Wed, 22 Feb 2017 16:38:18 +0100 (CET) Received: (qmail 90143 invoked by uid 500); 22 Feb 2017 15:38:18 -0000 Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.apache.org Delivered-To: mailing list dev@nifi.apache.org Received: (qmail 90132 invoked by uid 99); 22 Feb 2017 15:38:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2017 15:38:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 430191A075E for ; Wed, 22 Feb 2017 15:38:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.399 X-Spam-Level: X-Spam-Status: No, score=0.399 tagged_above=-999 required=6.31 tests=[FSL_HELO_BARE_IP_2=1.119, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id jK4CkJVDxduQ for ; Wed, 22 Feb 2017 15:38:16 +0000 (UTC) Received: from relayvx12b.securemail.intermedia.net (relayvx12b.securemail.intermedia.net [64.78.52.186]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 96C985FC3C for ; Wed, 22 Feb 2017 15:38:15 +0000 (UTC) Received: from emg-ca-1-2.securemail.intermedia.net (localhost [127.0.0.1]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id 9C61A53E57 for ; Wed, 22 Feb 2017 07:38:09 -0800 (PST) Subject: Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors MIME-Version: 1.0 x-echoworx-msg-id: b616548c-3729-41ee-b878-970e11467d93 x-echoworx-emg-received: Wed, 22 Feb 2017 07:38:09.579 -0800 x-echoworx-message-code-hashed: 003845344627e4222328cd9e855675374c9962febcf15b8994ed4eb597b3cafb x-echoworx-action: delivered Received: from 10.254.155.16 ([10.254.155.16]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 24 for ; Wed, 22 Feb 2017 07:38:09 -0800 (PST) Received: from MBX080-W4-CO-2.exch080.serverpod.net (unknown [10.224.117.102]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id 5F90153E57 for ; Wed, 22 Feb 2017 07:38:09 -0800 (PST) Received: from MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) by MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Wed, 22 Feb 2017 07:38:08 -0800 Received: from MBX080-W4-CO-2.exch080.serverpod.net ([10.224.117.102]) by mbx080-w4-co-2.exch080.serverpod.net ([10.224.117.102]) with mapi id 15.00.1178.000; Wed, 22 Feb 2017 07:38:08 -0800 From: Oleg Zhurakousky To: "dev@nifi.apache.org" Thread-Topic: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors Thread-Index: AQHSjJfJLWUQi1WByE20qyXoQsn6z6F0n0OA//+BSlyAAI+KgIAAW98AgABX/4CAAExLgA== Date: Wed, 22 Feb 2017 15:38:07 +0000 Message-ID: <2364F797-1E53-4581-AA35-10775E61422F@hortonworks.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [75.88.94.64] x-source-routing-agent: Processed Content-Type: text/plain; charset="utf-8" Content-ID: <4E0C1ED47EE0ED4EB2D6F13FC443BD7E@exch080.serverpod.net> Content-Transfer-Encoding: base64 archived-at: Wed, 22 Feb 2017 15:38:19 -0000 SeKAmWxsIHNlY29uZCBQaWVycmUNCg0KWWVzIHdpdGggdGhlIGN1cnJlbnQgZGVwbG95bWVudCBt b2RlbCB0aGUgYW1vdW50IG9mIHByb2Nlc3NvcnMgYW5kIHRoZSBzaXplIG9mIE5pRmkgZGlzdHJp YnV0aW9uIGlzIGEgY29uY2VybiBzaW1wbHkgYmVjYXVzZSBpdOKAmXMgZ3Jvd2luZyB3aXRoIGVh Y2ggcmVsZWFzZS4gQnV0IGl0IHNob3VsZCBub3QgYmUgdGhlIGRyaXZlciB0byBzdGFydCBqYW1t aW5nIG1vcmUgZnVuY3Rpb25hbGl0eSBpbnRvIGV4aXN0aW5nIHByb2Nlc3NvcnMgd2hpY2ggb24g dGhlIHN1cmZhY2UgbWF5IGxvb2sgbGlrZSByZWxhdGVkIChldmVuIGlmIHRoZXkgYXJlKS4NCkJh c2ljYWxseSBhIHByb2Nlc3NvciBzaG91bGQgbmV2ZXIgYmUgY29tcGxleCB3aXRoIHJlZ2FyZCB0 byBpdCBiZWluZyB1bmRlcnN0b29kIGJ5IHRoZSBlbmQgdXNlciB3aG8gaXMgbm9uLXRlY2huaWNh bCwgc28g4oCcc3BlY2lhbGl6YXRpb27igJ0gaXMgYWx3YXlzIHRha2VzIHByZWNlZGVuY2UgaGVy ZSBzaW5jZSBpdCBsaW1pdHMg4oCcY29uZmlndXJhdGlvbuKAnSBhbmQgdGh1cyBtYWtpbmcgc3Vj aCBwcm9jZXNzb3Igc2ltcGxlci4gSXQgYWxzbyBoZWxwcyB3aXRoIG1haW50ZW5hbmNlIGFuZCBt YW5hZ2VtZW50IG9mIHN1Y2ggcHJvY2Vzc29yIGJ5IHRoZSBkZXZlbG9wZXIuIEFsc28sIGhhdmlu ZyBtdWx0aXBsZSByZWxhdGVkIHByb2Nlc3NvcnMgd2lsbCBwcm9tb3RlIGhlYWx0aHkgY29tcGV0 aXRpb24gd2hlcmUgbXkgTXlwdXRIREZTIG1heSBmb3IgY2VydGFpbiBjYXNlcyBiZSBiZXR0ZXIv ZmFzdGVyIHRoZW4gWW91clB1dEhERlMgYW5kIHdoeSBub3QgaGF2ZSBib3RoPw0KDQpUaGUg4oCc YXJ0aWZhY3QgcmVnaXN0cnnigJ0gKGZsb3csIGV4dGVuc2lvbiwgdGVtcGxhdGUgZXRjKSBpcyB0 aGUgb25seSBhbnN3ZXIgaGVyZSBzaW5jZSBpdCB3aWxsIHJlbW92ZSB0aGUg4oCccHJvbGlmZXJh dGlvbuKAnSBhbmQgdGhlIG5lZWQgZm9yIOKAnHRhbWluZ+KAnSBhbnl0aGluZyBmcm9tIHRoZSBw aWN0dXJlLiBXaXRoIOKAnGFydGlmYWN0IHJlZ2lzdHJ54oCdIG9uZSBvciBvbmUgbWlsbGlvbiBw cm9jZXNzb3JzLCB0aGUgTmlGaSBzaXplL3N0YXRlIHdpbGwgYWx3YXlzIHJlbWFpbiBjb25zdGFu dCBhbmQgc21hbGwuDQoNCkNoZWVycw0KT2xlZw0KPiBPbiBGZWIgMjIsIDIwMTcsIGF0IDY6MDUg QU0sIFBpZXJyZSBWaWxsYXJkIDxwaWVycmUudmlsbGFyZC5mckBnbWFpbC5jb20+IHdyb3RlOg0K PiANCj4gSGV5IGd1eXMsDQo+IA0KPiBUaGFua3MgZm9yIHRoZSB0aHJlYWQgQW5kcmUuDQo+IA0K PiArMSB0byBKYW1lcycgYW5zd2VyLg0KPiANCj4gSSB1bmRlcnN0YW5kIHRoZSBpbnRlcmVzdCB0 aGF0IHdvdWxkIHByb3ZpZGUgYSBzaW5nbGUgcHJvY2Vzc29yIHRvIGNvbm5lY3QNCj4gdG8gYWxs IHRoZSBiYWNrIGVuZHMuLi4gYW5kIHdlIGNvdWxkIGRvY3VtZW50L2ltcHJvdmUgdGhlIFB1dEhE RlMgdG8gZWFzZQ0KPiBzdWNoIHVzZSBidXQgSSByZWFsbHkgZG9uJ3QgdGhpbmsgdGhhdCBpdCB3 aWxsIGJlbmVmaXQgdGhlIHVzZXIgZXhwZXJpZW5jZS4NCj4gVGhhdCBtYXkgYmUgaW50ZXJlc3Rp bmcgaW4gc29tZSBjYXNlcyBmb3Igc29tZSB1c2VycyBidXQgSSBkb24ndCB0aGluayB0aGF0DQo+ IHdvdWxkIGJlIGEgbWFqb3JpdHkuDQo+IA0KPiBJIGJlbGlldmUgTmlGaSBpcyBncmVhdCBmb3Ig b25lIHJlYXNvbjogeW91IGhhdmUgYSBsb3Qgb2Ygc3BlY2lhbGl6ZWQNCj4gcHJvY2Vzc29ycyB0 aGF0IGFyZSByZWFsbHkgZWFzeSB0byB1c2UgYW5kIGVmZmljaWVudCBmb3Igd2hhdCB0aGV5J3Zl IGJlZW4NCj4gZGVzaWduZWQgZm9yLg0KPiANCj4gTGV0J3MgYXNrIG91cnNlbHZlcyB0aGUgcXVl c3Rpb24gdGhlIG90aGVyIHdheTogd2l0aCB0aGUgTmlGaSByZWdpc3RyeSBvbg0KPiBpdHMgd2F5 LCB3aGF0IGlzIHRoZSBwcm9ibGVtIGhhdmluZyBtdWx0aXBsZSBwcm9jZXNzb3JzIGZvciBlYWNo IGJhY2sgZW5kPw0KPiBJIGRvbid0IHJlYWxseSBzZWUgdGhlIGlzc3VlIGhlcmUuIE9LIHdlIGhh dmUgYSBsb3Qgb2YgcHJvY2Vzc29ycyAoYnV0IEkNCj4gYmVsaWV2ZSB0aGlzIGlzIGEgZ29vZCBw b2ludCBmb3IgTmlGaSwgZm9yIHVzZXIgZXhwZXJpZW5jZSwgZm9yDQo+IGFkdmVydGlzaW5nLCBl dGMuIC0gbWF5YmUgd2Ugc2hvdWxkIGltcHJvdmUgdGhlIHByb2Nlc3NvciBsaXN0aW5nIHRob3Vn aCwNCj4gYnV0IGFnYWluLCB0aGlzIHdpbGwgYmUgcGFydCBvZiB0aGUgTmlGaSBSZWdpc3RyeSB3 b3JrKSwgaXQgZ2VuZXJhdGVzIGENCj4gaGVhdnkgTmlGaSBiaW5hcnkgKGJ1dCB0aGF0IHdpbGwg YmUgc29sdmVkIHdpdGggdGhlIHJlZ2lzdHJ5KSwgYnV0IHRoYXQncw0KPiBhbGwsIG5vPw0KPiAN Cj4gQWxzbyBhZ3JlZSBvbiB0aGUgcG9zaXRpb25pbmcgYXNwZWN0OiBJTU8gTmlGaSBzaG91bGQg bm90IGJlIGhpZ2hseSB0aWVkIHRvDQo+IHRoZSBIYWRvb3AgZWNvc3lzdGVtLiBUaGVyZSBpcyBh IGxvdCBvZiB1c2VycyB1c2luZyBOaUZpIHdpdGggYWJzb2x1dGVseSBubw0KPiByZWxhdGlvbiB0 byBIYWRvb3AuIE5vdCBzdXJlIHRoYXQgd291bGQgc2VuZCB0aGUgZ29vZCAic2lnbmFsIi4NCj4g DQo+IFBpZXJyZQ0KPiANCj4gDQo+IA0KPiANCj4gMjAxNy0wMi0yMiA2OjUwIEdNVCswMTowMCBB bmRyZSA8YW5kcmUtbGlzdHNAZnVjcy5vcmc+Og0KPiANCj4+IEFuZHJldywNCj4+IA0KPj4gDQo+ PiBPbiBXZWQsIEZlYiAyMiwgMjAxNyBhdCAxMToyMSBBTSwgQW5kcmV3IEdyYW5kZSA8YXBlcmVw ZWxAZ21haWwuY29tPg0KPj4gd3JvdGU6DQo+PiANCj4+PiBJIGFtIG9ic2VydmluZyBvbmUgYXNz dW1wdGlvbiBpbiB0aGlzIHRocmVhZC4gRm9yIHNvbWUgcmVhc29uIHdlIGFyZQ0KPj4+IGltcGx5 aW5nIGFsbCB0aGVzZSB3aWxsIGJlIGhhZG9vcCBjb21wYXRpYmxlIGZpbGUgc3lzdGVtcy4gVGhl eSBkb24ndA0KPj4+IGFsd2F5cyBoYXZlIGFuIEhERlMgcGx1Z2luLCBub3Igc2hvdWxkIHRoZXkg YXMgYSBtYW5kYXRvcnkgcmVxdWlyZW1lbnQuDQo+Pj4gDQo+PiANCj4+IFlvdSBhcmUgcGFydGlh bGx5IGNvcnJlY3QuDQo+PiANCj4+IFRoZXJlIGlzIGEgZGlyZWN0IGFzc3VtcHRpb24gaW4gdGhl IGF2YWlsYWJpbGl0eSBvZiBhIEhDRlMgKHRoYW5rcyBNYXR0ISkNCj4+IGltcGxlbWVudGF0aW9u Lg0KPj4gDQo+PiBUaGlzIGlzIHRoZSBjYXNlIHdpdGg6DQo+PiANCj4+ICogV2luZG93cyBBenVy ZSBCbG9iIFN0b3JhZ2UNCj4+ICogR29vZ2xlIENsb3VkIFN0b3JhZ2UgQ29ubmVjdG9yDQo+PiAq IE1hcFIgRmlsZVN5c3RlbSAoY3VycmVudGx5IGRvbmUgdmlhIE5BUiByZWNvbXBpbGF0aW9uIC8g bXZuIHByb2ZpbGUpDQo+PiAqIEFsbHV4aW8NCj4+ICogSXNpbG9uICh2aWEgSERGUykNCj4+ICog b3RoZXJzDQo+PiANCj4+IEJ1dCBJIHdvdWxkJ3Qgc2F5IHRoaXMgd2lsbCBhcHBseSB0byBldmVy eSBvdGhlciB1c2Ugc3RvcmFnZSBzeXN0ZW0gYW5kIGluDQo+PiBjZXJ0YWluIGNhc2VzIG1heSBu b3QgZXZlbiBiZSBuZWNlc3NhcnkgKGUuZy4gSXNpbG9uIHNjYWxlLW91dCBzdG9yYWdlIG1heQ0K Pj4gYmUgcmVhY2hlZCB1c2luZyBpdHMgbmF0aXZlIEhERlMgY29tcGF0aWJsZSBpbnRlcmZhY2Vz KS4NCj4+IA0KPj4gDQo+PiBVbnRpZSBjb21wbGV0ZWx5IGZyb20gdGhlIEhhZG9vcCBuYXIuIFRo aXMgYWxsb3dzIGZvciBlZmZlY3RpdmUgbWluaWZpDQo+Pj4gaW50ZXJhY3Rpb24gd2l0aG91dCB0 aGUgd2VpZ2h0IG9mIGhhZG9vcCBsaWJzIGZvciBleGFtcGxlLiBNYXNzaXZlIHNpemUNCj4+PiBz YXZpbmdzIHdoZXJlIGl0IG1hdHRlcnMuDQo+Pj4gDQo+Pj4gDQo+PiBBcmUgeW91IHN1Z2dlc3Rp bmcgYSB1c2UgY2FzZSB3ZXJlIE1pTmlGaSBhZ2VudHMgaW50ZXJhY3QgZGlyZWN0bHkgd2l0aA0K Pj4gY2xvdWQgc3RvcmFnZSwgd2l0aG91dCByZWx5aW5nIG9uIE5pRmkgaHVicyB0byBkbyB0aGF0 Pw0KPj4gDQo+PiANCj4+PiBGb3IgdGhlIGRlcGxveW1lbnQsIGl0J3MgZWFzeSBlbm91Z2ggZm9y IGFuIGFkbWluIHRvIGVpdGhlciByZWx5IG9uIGENCj4+PiBzdGFuZGFyZCB0YXIgb3IgcnBtIGlm IHRoZSBOQVIgbW9kdWxlcyBhcmUgYWxyZWFkeSBhdmFpbGFibGUgaW4gdGhlDQo+PiBkaXN0cm8N Cj4+PiAod2VsbCwgSSB3b24ndCB0YWxrIHJlZ2lzdHJ5IHRpbGwgaXQgYXJyaXZlcykuIE1vdW50 aW5nIGEgY29tbW9uDQo+PiBkaXJlY3RvcnkNCj4+PiBvbiBldmVyeSBub2RlIG9yIGRpc3RyaWJ1 dGluZyBhZGRpdGlvbmFsIGphcnMgZXZlcnl3aGVyZSwgcGx1cyBjb25maWdzLA0KPj4gYW5kDQo+ Pj4gdGhlbiBrZWVwaW5nIGl0IGNvbnNpc3RlbnQgYWNyb3NzIGlzIHNvbWV0aGluZyB3aGljaCBj YW4gYmUgYXZvaWRlZCBieQ0KPj4+IHNpbXBsZXIgcGFja2FnaW5nLg0KPj4+IA0KPj4gDQo+PiBB cyBsb25nIHRoZSBOQVIgb3IgUlBNIHN1cHBvcnRzIHlvdXIgdXNlLWNhc2UsIHdoaWNoIGlzIG5v dCB0aGUgY2FzZSBvZg0KPj4gcGVvcGxlIHJ1bm5pbmcgTmlGaSB3aXRoIE1hcFItRlMgZm9yIGV4 YW1wbGUuIEZvciB0aG9zZSwgYSByZWNvbXBpbGF0aW9uIGlzDQo+PiByZXF1aXJlZCBhbnl3YXku IEEgZmxleGlibGUgcHJvY2Vzc29yIG1heSByZW1vdmUgdGhlIG5lZWQgdG8gcmVjb21waWxlIChJ DQo+PiBhbSBjdXJyZW50bHkgcGxheWluZyB3aXRoIHRoZSBjbGFzc3BhdGggaW1wbGljYXRpb24g dG8gTWFwUiB1c2VycykuDQo+PiANCj4+IENoZWVycw0KPj4gDQoNCg==