Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C51BC179C1 for ; Wed, 18 Mar 2015 23:29:08 +0000 (UTC) Received: (qmail 76246 invoked by uid 500); 18 Mar 2015 23:29:03 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 76146 invoked by uid 500); 18 Mar 2015 23:29:02 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 76132 invoked by uid 99); 18 Mar 2015 23:29:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2015 23:29:02 +0000 X-ASF-Spam-Status: No, hits=3.5 required=5.0 tests=FSL_HELO_BARE_IP_2,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jzhang@hortonworks.com designates 64.78.52.187 as permitted sender) Received: from [64.78.52.187] (HELO relayvx12c.securemail.intermedia.net) (64.78.52.187) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2015 23:28:56 +0000 Received: from securemail.intermedia.net (localhost [127.0.0.1]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id C647653EF0 for ; Wed, 18 Mar 2015 16:27:32 -0700 (PDT) Subject: Re: trying to understand HashPartitioner MIME-Version: 1.0 x-echoworx-emg-received: Wed, 18 Mar 2015 16:27:32.793 -0700 x-echoworx-msg-id: 3e010c0c-bfb1-4946-80ae-f4dfd54df14a x-echoworx-action: delivered Received: from 10.254.155.17 ([10.254.155.17]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 1007 for ; Wed, 18 Mar 2015 16:27:32 -0700 (PDT) Received: from MBX080-W4-CO-2.exch080.serverpod.net (unknown [10.224.117.102]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id 895CC53EF0 for ; Wed, 18 Mar 2015 16:27:32 -0700 (PDT) Received: from MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) by MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Wed, 18 Mar 2015 16:27:31 -0700 Received: from MBX080-W4-CO-2.exch080.serverpod.net ([10.224.117.102]) by mbx080-w4-co-2.exch080.serverpod.net ([10.224.117.102]) with mapi id 15.00.1044.021; Wed, 18 Mar 2015 16:27:31 -0700 From: "Jianfeng (Jeff) Zhang" To: "user@hadoop.apache.org" Thread-Topic: trying to understand HashPartitioner Thread-Index: AQHQYV5cX/AN0ac85Uq6jPZlsJ/OYp0iilsAgAFUkIA= Date: Wed, 18 Mar 2015 23:27:31 +0000 Message-ID: References: <550945B7.1070001@gmail.com> <55095CB2.6070005@gmail.com> In-Reply-To: <55095CB2.6070005@gmail.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [61.171.19.12] x-source-routing-agent: Processed Content-Type: multipart/alternative; boundary="_000_D1302AA21AECEjzhanghortonworkscom_" X-Virus-Checked: Checked by ClamAV on apache.org --_000_D1302AA21AECEjzhanghortonworkscom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 DQpZb3UgY2FuIHRha2UgaXQgc2ltaWxhciBhcyB0aGUgSGFzaE1hcCBvZiBqYXZhLiBVc2UgdGhl IGhhc2hDb2RlIG9mIG9uZSBvYmplY3QgdG8gZGlzdHJpYnV0ZSBpdCBpbnRvIGRpZmZlcmVudCBi dWNrZXQuDQoNCg0KDQpCZXN0IFJlZ2FyZCwNCkplZmYgWmhhbmcNCg0KDQpGcm9tOiB4ZW9ubWFp bGluZ2xpc3QtZ21haWwgPHhlb25tYWlsaW5nbGlzdEBnbWFpbC5jb208bWFpbHRvOnhlb25tYWls aW5nbGlzdEBnbWFpbC5jb20+Pg0KUmVwbHktVG86ICJ1c2VyQGhhZG9vcC5hcGFjaGUub3JnPG1h aWx0bzp1c2VyQGhhZG9vcC5hcGFjaGUub3JnPiIgPHVzZXJAaGFkb29wLmFwYWNoZS5vcmc8bWFp bHRvOnVzZXJAaGFkb29wLmFwYWNoZS5vcmc+Pg0KRGF0ZTogV2VkbmVzZGF5LCBNYXJjaCAxOCwg MjAxNSBhdCA3OjA4IFBNDQpUbzogInVzZXJAaGFkb29wLmFwYWNoZS5vcmc8bWFpbHRvOnVzZXJA aGFkb29wLmFwYWNoZS5vcmc+IiA8dXNlckBoYWRvb3AuYXBhY2hlLm9yZzxtYWlsdG86dXNlckBo YWRvb3AuYXBhY2hlLm9yZz4+DQpTdWJqZWN0OiBSZTogdHJ5aW5nIHRvIHVuZGVyc3RhbmQgSGFz aFBhcnRpdGlvbmVyDQoNCldoYXQgdGVsbHMgd2l0aCBwYXJ0aXRpb24gd2lsbCBydW4gb24gd2hp Y2ggcmVkdWNlIHRhc2s/DQoNCk9uIDE4LTAzLTIwMTUgMDk6MzAsIHhlb25tYWlsaW5nbGlzdC1n bWFpbCB3cm90ZToNCg0KSGksDQoNCkkgYW0gdHJ5aW5nIHRvIHVuZGVyc3RhbmQgaG93IEhhc2hQ YXJ0aXRpb25lci5qYXZhIHdvcmtzLiBUaHVzLCBJIHJhbiBhIG1hcHJlZHVjZSBqb2Igd2l0aCA1 IHJlZHVjZXJzIGFuZCA1IGlucHV0IGZpbGVzLiBJIHRob3VnaHQgdGhhdCB0aGUgb3V0cHV0IG9m IGdldFBhcnRpdGlvbihLMiBrZXksIFYyIHZhbHVlLCBpbnQgbnVtUmVkdWNlVGFza3MpIHdhcyB0 aGUgbnVtYmVyIG9mIHJlZHVjZSB0YXNrIHRoYXQgSzIgYW5kIFYyIHdpbGwgZXhlY3V0ZS4gSXMg dGhpcyBjb3JyZWN0Pw0KDQrigIsNCg0KLS0NCi0tDQoNCg0KLS0NCi0tDQo= --_000_D1302AA21AECEjzhanghortonworkscom_ Content-Type: text/html; charset="utf-8" Content-ID: <675D1374E448194CB8482BC1AC245ACC@exch080.serverpod.net> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsgY29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zaXplOiAx NHB4OyBmb250LWZhbWlseTogQ2FsaWJyaSwgc2Fucy1zZXJpZjsiPg0KPGRpdj4NCjxkaXY+DQo8 ZGl2Pjxicj4NCjwvZGl2Pg0KPGRpdj5Zb3UgY2FuIHRha2UgaXQgc2ltaWxhciBhcyB0aGUgSGFz aE1hcCBvZiBqYXZhLiBVc2UgdGhlIGhhc2hDb2RlIG9mIG9uZSBvYmplY3QgdG8gZGlzdHJpYnV0 ZSBpdCBpbnRvIGRpZmZlcmVudCBidWNrZXQuPC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPGRp dj48YnI+DQo8L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2Pg0KPGRpdj5CZXN0IFJlZ2Fy ZCw8L2Rpdj4NCjxkaXY+SmVmZiBaaGFuZzwvZGl2Pg0KPGRpdj48YnI+DQo8L2Rpdj4NCjwvZGl2 Pg0KPC9kaXY+DQo8L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8c3BhbiBpZD0iT0xLX1NSQ19C T0RZX1NFQ1RJT04iPg0KPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6Q2FsaWJyaTsgZm9udC1zaXpl OjExcHQ7IHRleHQtYWxpZ246bGVmdDsgY29sb3I6YmxhY2s7IEJPUkRFUi1CT1RUT006IG1lZGl1 bSBub25lOyBCT1JERVItTEVGVDogbWVkaXVtIG5vbmU7IFBBRERJTkctQk9UVE9NOiAwaW47IFBB RERJTkctTEVGVDogMGluOyBQQURESU5HLVJJR0hUOiAwaW47IEJPUkRFUi1UT1A6ICNiNWM0ZGYg MXB0IHNvbGlkOyBCT1JERVItUklHSFQ6IG1lZGl1bSBub25lOyBQQURESU5HLVRPUDogM3B0Ij4N CjxzcGFuIHN0eWxlPSJmb250LXdlaWdodDpib2xkIj5Gcm9tOiA8L3NwYW4+eGVvbm1haWxpbmds aXN0LWdtYWlsICZsdDs8YSBocmVmPSJtYWlsdG86eGVvbm1haWxpbmdsaXN0QGdtYWlsLmNvbSI+ eGVvbm1haWxpbmdsaXN0QGdtYWlsLmNvbTwvYT4mZ3Q7PGJyPg0KPHNwYW4gc3R5bGU9ImZvbnQt d2VpZ2h0OmJvbGQiPlJlcGx5LVRvOiA8L3NwYW4+JnF1b3Q7PGEgaHJlZj0ibWFpbHRvOnVzZXJA aGFkb29wLmFwYWNoZS5vcmciPnVzZXJAaGFkb29wLmFwYWNoZS5vcmc8L2E+JnF1b3Q7ICZsdDs8 YSBocmVmPSJtYWlsdG86dXNlckBoYWRvb3AuYXBhY2hlLm9yZyI+dXNlckBoYWRvb3AuYXBhY2hl Lm9yZzwvYT4mZ3Q7PGJyPg0KPHNwYW4gc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQiPkRhdGU6IDwv c3Bhbj5XZWRuZXNkYXksIE1hcmNoIDE4LCAyMDE1IGF0IDc6MDggUE08YnI+DQo8c3BhbiBzdHls ZT0iZm9udC13ZWlnaHQ6Ym9sZCI+VG86IDwvc3Bhbj4mcXVvdDs8YSBocmVmPSJtYWlsdG86dXNl ckBoYWRvb3AuYXBhY2hlLm9yZyI+dXNlckBoYWRvb3AuYXBhY2hlLm9yZzwvYT4mcXVvdDsgJmx0 OzxhIGhyZWY9Im1haWx0bzp1c2VyQGhhZG9vcC5hcGFjaGUub3JnIj51c2VyQGhhZG9vcC5hcGFj aGUub3JnPC9hPiZndDs8YnI+DQo8c3BhbiBzdHlsZT0iZm9udC13ZWlnaHQ6Ym9sZCI+U3ViamVj dDogPC9zcGFuPlJlOiB0cnlpbmcgdG8gdW5kZXJzdGFuZCBIYXNoUGFydGl0aW9uZXI8YnI+DQo8 L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2Pg0KPGRpdiBiZ2NvbG9yPSIjRkZGRkZGIiB0 ZXh0PSIjMDAwMDAwIj5XaGF0IHRlbGxzIHdpdGggcGFydGl0aW9uIHdpbGwgcnVuIG9uIHdoaWNo IHJlZHVjZSB0YXNrPzxicj4NCjxicj4NCjxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24g MTgtMDMtMjAxNSAwOTozMCwgeGVvbm1haWxpbmdsaXN0LWdtYWlsIHdyb3RlOjxicj4NCjwvZGl2 Pg0KPGJsb2NrcXVvdGUgY2l0ZT0ibWlkOjU1MDk0NUI3LjEwNzAwMDFAZ21haWwuY29tIiB0eXBl PSJjaXRlIj4NCjxkaXYgc3R5bGU9IiIgY2xhc3M9Im1hcmtkb3duLWhlcmUtd3JhcHBlciIgZGF0 YS1tZC11cmw9IlRodW5kZXJiaXJkIj4NCjxwIHN0eWxlPSJtYXJnaW46IDEuMmVtIDBweCAhIGlt cG9ydGFudDsiPkhpLDwvcD4NCjxwIHN0eWxlPSJtYXJnaW46IDEuMmVtIDBweCAhIGltcG9ydGFu dDsiPkkgYW0gdHJ5aW5nIHRvIHVuZGVyc3RhbmQgaG93IDxjb2RlIHN0eWxlPSJmb250LXNpemU6 IDAuODVlbTsgZm9udC1mYW1pbHk6DQogICAgICAgICAgICBDb25zb2xhcyxJbmNvbnNvbGF0YSxD b3VyaWVyLG1vbm9zcGFjZTttYXJnaW46IDBweCAwLjE1ZW07DQogICAgICAgICAgICBwYWRkaW5n OiAwcHggMC4zZW07IHdoaXRlLXNwYWNlOiBwcmUtd3JhcDsgYm9yZGVyOiAxcHggc29saWQNCiAg ICAgICAgICAgIHJnYigyMzQsIDIzNCwgMjM0KTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI0OCwg MjQ4LCAyNDgpOw0KICAgICAgICAgICAgYm9yZGVyLXJhZGl1czogM3B4OyBkaXNwbGF5OiBpbmxp bmU7Ij4NCkhhc2hQYXJ0aXRpb25lci5qYXZhPC9jb2RlPiB3b3Jrcy4gVGh1cywgSSByYW4gYSBt YXByZWR1Y2Ugam9iIHdpdGggNSByZWR1Y2VycyBhbmQgNSBpbnB1dCBmaWxlcy4gSSB0aG91Z2h0 IHRoYXQgdGhlIG91dHB1dCBvZg0KPGNvZGUgc3R5bGU9ImZvbnQtc2l6ZToNCiAgICAgICAgICAg IDAuODVlbTsgZm9udC1mYW1pbHk6DQogICAgICAgICAgICBDb25zb2xhcyxJbmNvbnNvbGF0YSxD b3VyaWVyLG1vbm9zcGFjZTttYXJnaW46IDBweCAwLjE1ZW07DQogICAgICAgICAgICBwYWRkaW5n OiAwcHggMC4zZW07IHdoaXRlLXNwYWNlOiBwcmUtd3JhcDsgYm9yZGVyOiAxcHggc29saWQNCiAg ICAgICAgICAgIHJnYigyMzQsIDIzNCwgMjM0KTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI0OCwg MjQ4LCAyNDgpOw0KICAgICAgICAgICAgYm9yZGVyLXJhZGl1czogM3B4OyBkaXNwbGF5OiBpbmxp bmU7Ij4NCmdldFBhcnRpdGlvbihLMiBrZXksIFYyIHZhbHVlLCBpbnQgbnVtUmVkdWNlVGFza3Mp PC9jb2RlPiB3YXMgdGhlIG51bWJlciBvZiByZWR1Y2UgdGFzayB0aGF0DQo8Y29kZSBzdHlsZT0i Zm9udC1zaXplOiAwLjg1ZW07IGZvbnQtZmFtaWx5Og0KICAgICAgICAgICAgQ29uc29sYXMsSW5j b25zb2xhdGEsQ291cmllcixtb25vc3BhY2U7bWFyZ2luOiAwcHggMC4xNWVtOw0KICAgICAgICAg ICAgcGFkZGluZzogMHB4IDAuM2VtOyB3aGl0ZS1zcGFjZTogcHJlLXdyYXA7IGJvcmRlcjogMXB4 IHNvbGlkDQogICAgICAgICAgICByZ2IoMjM0LCAyMzQsIDIzNCk7IGJhY2tncm91bmQtY29sb3I6 IHJnYigyNDgsIDI0OCwgMjQ4KTsNCiAgICAgICAgICAgIGJvcmRlci1yYWRpdXM6IDNweDsgZGlz cGxheTogaW5saW5lOyI+DQpLMjwvY29kZT4gYW5kIDxjb2RlIHN0eWxlPSJmb250LXNpemU6IDAu ODVlbTsgZm9udC1mYW1pbHk6DQogICAgICAgICAgICBDb25zb2xhcyxJbmNvbnNvbGF0YSxDb3Vy aWVyLG1vbm9zcGFjZTttYXJnaW46IDBweCAwLjE1ZW07DQogICAgICAgICAgICBwYWRkaW5nOiAw cHggMC4zZW07IHdoaXRlLXNwYWNlOiBwcmUtd3JhcDsgYm9yZGVyOiAxcHggc29saWQNCiAgICAg ICAgICAgIHJnYigyMzQsIDIzNCwgMjM0KTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI0OCwgMjQ4 LCAyNDgpOw0KICAgICAgICAgICAgYm9yZGVyLXJhZGl1czogM3B4OyBkaXNwbGF5OiBpbmxpbmU7 Ij4NClYyPC9jb2RlPiB3aWxsIGV4ZWN1dGUuIElzIHRoaXMgY29ycmVjdD88L3A+DQo8ZGl2IHRp dGxlPSJNREg6U0drc1BHSnlQanhpY2o1SklHRnRJSFJ5ZVdsdVp5QjBieUIxYm1SbGNuTjBZVzVr SUdodmR5QmdTR0Z6YUZCaGNuUnBkR2x2Ym1WeUxtcGhkbUZnSUhkdmNtdHpMaUJVYUhWekxDQkpJ SEpoYmlCaElHMWhjSEpsWkhWalpTQnFiMklnZDJsMGFDQTFJSEpsWkhWalpYSnoNCklHRnVaQ0Ex SUdsdWNIVjBJR1pwYkdWekxpQkpJSFJvYjNWbmFIUWdkR2hoZENCMGFHVWdiM1YwY0hWMElHOW1J R0JuWlhSUVlYSjANCmFYUnBiMjRvU3pJZ2EyVjVMQ0JXTWlCMllXeDFaU3dnYVc1MElHNTFiVkps WkhWalpWUmhjMnR6S1dBZ2QyRnpJSFJvWlNCdWRXMWkNClpYSWdiMllnY21Wa2RXTmxJSFJoYzJz Z2RHaGhkQ0JnU3pKZ0lHRnVaQ0JnVmpKZ0lIZHBiR3dnWlhobFkzVjBaUzRnU1hNZ2RHaHANCg0K ICAgICAgICAgIGN5QmpiM0p5WldOMFB6eGljajQ4WW5JJiM0MztQR0p5UGc9PSIgc3R5bGU9Imhl aWdodDowO3dpZHRoOjA7bWF4LWhlaWdodDowO21heC13aWR0aDowO292ZXJmbG93OmhpZGRlbjtm b250LXNpemU6MGVtO3BhZGRpbmc6MDttYXJnaW46MDsiPg0K4oCLPC9kaXY+DQo8L2Rpdj4NCjxw cmUgY2xhc3M9Im1vei1zaWduYXR1cmUgbWFya2Rvd24taGVyZS1zaWduYXR1cmUiIGNvbHM9Ijcy Ij4tLSANCi0tPC9wcmU+DQo8L2Jsb2NrcXVvdGU+DQo8YnI+DQo8cHJlIGNsYXNzPSJtb3otc2ln bmF0dXJlIiBjb2xzPSI3MiI+LS0gDQotLTwvcHJlPg0KPC9kaXY+DQo8L2Rpdj4NCjwvc3Bhbj4N CjwvYm9keT4NCjwvaHRtbD4NCg== --_000_D1302AA21AECEjzhanghortonworkscom_--