Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 724679FEE for ; Fri, 23 Mar 2012 10:39:21 +0000 (UTC) Received: (qmail 88821 invoked by uid 500); 23 Mar 2012 10:39:20 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 88780 invoked by uid 500); 23 Mar 2012 10:39:20 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 88772 invoked by uid 99); 23 Mar 2012 10:39:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2012 10:39:20 +0000 X-ASF-Spam-Status: No, hits=3.1 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS,UNPARSEABLE_RELAY,URI_OBFU_WWW X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of mdefoinplatel.ext@orange.com designates 193.251.215.91 as permitted sender) Received: from [193.251.215.91] (HELO relais-inet.francetelecom.com) (193.251.215.91) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2012 10:39:14 +0000 Received: from omfedm05.si.francetelecom.fr (unknown [xx.xx.xx.1]) by omfedm10.si.francetelecom.fr (ESMTP service) with ESMTP id 2078426434F for ; Fri, 23 Mar 2012 11:38:53 +0100 (CET) Received: from PUEXCH41.nanterre.francetelecom.fr (unknown [10.101.44.30]) by omfedm05.si.francetelecom.fr (ESMTP service) with ESMTP id EB50D35C05A for ; Fri, 23 Mar 2012 11:38:52 +0100 (CET) Received: from PUEXCB2B.nanterre.francetelecom.fr ([10.64.14.47]) by PUEXCH41.nanterre.francetelecom.fr ([10.101.44.30]) with mapi; Fri, 23 Mar 2012 11:38:52 +0100 From: To: "user@hive.apache.org" Date: Fri, 23 Mar 2012 11:38:50 +0100 Subject: RE: Optimization on bucketized/sorted tables Thread-Topic: Optimization on bucketized/sorted tables Thread-Index: Ac0ITQ5kcKXTVHAfRUSOg7zPdTGJtgAj36HA Message-ID: <10603_1332499133_4F6C52BC_10603_13254_3_4BA1E491D48B884A82BF3952C3030A42018EBF4CA3@PUEXCB2B.nanterre.francetelecom.fr> References: <14294_1332253187_4F689202_14294_97_1_4BA1E491D48B884A82BF3952C3030A42018EB3C2B6@PUEXCB2B.nanterre.francetelecom.fr> <1410688115.2599.1332435498790.JavaMail.root@sms-zimbra-message-store-03.sms.scalar.ca> In-Reply-To: <1410688115.2599.1332435498790.JavaMail.root@sms-zimbra-message-store-03.sms.scalar.ca> Accept-Language: fr-FR Content-Language: fr-FR X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: fr-FR Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-PMX-Version: 5.6.1.2065439, Antispam-Engine: 2.7.2.376379, Antispam-Data: 2012.3.23.91517 X-Virus-Checked: Checked by ClamAV on apache.org SGkgTWFyazsNCk1hbnkgdGhhbmtzIGZvciB5b3VyIHN1cHBvcnQgIQ0KDQpBbW9uZ3N0IHRoZSBm b3VyIHF1ZXJ5IHR5cGVzIEkgbWVudGlvbmVkIEkgd2FzIGF0IGxlYXN0IGV4cGVjdGluZyB0aGF0 IHRoZSBmaXJzdCBvbmUgd2lsbCBiZSBvcHRpbWl6ZWQuIEkgbm90aWNlZCB0aGUgaGl2ZS5vcHRp bWl6ZS5ncm91cGJ5IHBhcmFtZXRlciBhbmQgSSB0aG91Z2h0IHRoaXMgY2FzZSB3YXMgc29ydGVk IG91dCBhbHJlYWR5Lg0KDQpTbyBpZiBJIHVuZGVyc3RhbmQgeW91IHdlbGwsIHRoZSBvbmx5IHBv aW50IGluIHN0b3JpbmcgYSB0YWJsZSBidWNrZXRpemVkIGFuZC9vciBzb3J0ZWQgYXQgdGhlIG1v bWVudCByZXNpZGVzIGluIHRoZSBvcHRpbWl6YXRpb24gb2YgdGhlIGpvaW4gb3BlcmF0aW9ucywg cmlnaHQgPyBDb3VsZCB5b3UgcGxlYXNlIGdpdmUgbWUgYW4gZXhhbXBsZSBvZiBzdWNoIGEgcXVl cnkgdGhhdCB3b3VsZCBiZW5lZml0IGZyb20gbWFpbnRhaW5pbmcgdGhlIHRhYmxlcyBzb3J0ZWQg Pw0KDQpDaGVlcnMsDQpNaWNoYWVsDQoNCi0tLS0tTWVzc2FnZSBkJ29yaWdpbmUtLS0tLQ0KRGXC oDogTWFyayBHcm92ZXIgW21haWx0bzptZ3JvdmVyQG9hbmRhLmNvbV0gDQpFbnZvecOpwqA6IGpl dWRpIDIyIG1hcnMgMjAxMiAxNzo1OA0Kw4DCoDogdXNlckBoaXZlLmFwYWNoZS5vcmcNCk9iamV0 wqA6IFJlOiBPcHRpbWl6YXRpb24gb24gYnVja2V0aXplZC9zb3J0ZWQgdGFibGVzDQoNCkhpIE1p Y2hhZWwsDQpUaGlzIEpJUkEgaXMgYWxvbmcgdGhlIGxpbmVzIG9mIHlvdXIgcXVlc3Rpb25zOg0K aHR0cHM6Ly9pc3N1ZXMuYXBhY2hlLm9yZy9qaXJhL2Jyb3dzZS9ISVZFLTI4NDYNCg0KVGhlIGZv bGxvd2luZyBpcyBiYXNlZCBvbiBteSB1bmRlcnN0YW5kaW5nIHNvIHRha2UgaXQgd2l0aCBhIGdy YWluIG9mIHNhbHQ6LSkNCllvdSdyZSByaWdodC4gVGhlIDQga2luZHMgb2YgcXVlcmllcyB5b3Ug cG9pbnRlZCBvdXQgY2FuIGJlIHBvdGVudGlhbGx5IGJlIG9wdGltaXplZCBpZiB0aGUgc291cmNl IHRhYmxlKHMpIGFyZSBidWNrZXRlZCBhbmQvb3Igc29ydGVkIGJ5IHRoZSBhcHByb3ByaWF0ZSBj b2x1bW5zLiBBbm90aGVyIHF1ZXJ5IHRoYXQgY291bGQgYmUgb3B0aW1pemVkIGJhc2VkIG9uIGJ1 Y2tldGluZy9zb3J0aW5nIGlzIGpvaW4uIFRoaXMgaXMgcHJlc2VudGx5IGJlaW5nIGRvbmUgaW4g YnVja2V0ZWQgbWFwIGpvaW5zIGFuZCBzb3J0IG1lcmdlIGpvaW5zLg0KDQpIb3dldmVyLCBsaWtl IHRoZSBKSVJBIHRpY2tldCBtZW50aW9ucywgdGhlIGJ1Y2tldGluZy9zb3J0aW5nIGluZm9ybWF0 aW9uIGlzbid0IHByZXNlbnRseSBzdG9yZWQgaW4gdGhlIG1ldGFzdG9yZSwgc28gdGhlIHF1ZXJp ZXMgY2FuJ3QgbWFrZSB1c2Ugb2YgdGhlbSB3aXRob3V0IHNwZWNpZnlpbmcgaGludHMgbGlrZSBq b2lucyBkby4NCg0KVG8gYW5zd2VyIHlvdXIgbGFzdCBxdWVzdGlvbiwgSSB0aGluayB5b3UgaGF2 ZSB0byBleHBsaWNpdGx5IChhdCBsZWFzdCBmb3Igbm93KSBtZW50aW9uIERJU1RSSUJVVEUgQlkg YW5kIFNPUlQgQlkgaW4geW91ciBxdWVyeSBhbmQgdGhhdCdzIHdoYXQgSSBkbyBpbiBteSBxdWVy aWVzIHRvby4NCg0KTWFyaw0KDQpNYXJrIEdyb3ZlciwgQnVzaW5lc3MgSW50ZWxsaWdlbmNlIEFu YWx5c3QNCk9BTkRBIENvcnBvcmF0aW9uIA0KDQp3d3c6IG9hbmRhLmNvbSB3d3c6IGZ4dHJhZGUu Y29tIA0KDQoiQmVzdCBUcmFkaW5nIFBsYXRmb3JtIiAtIFdvcmxkIEZpbmFuY2UncyBGb3JleCBB d2FyZHMgMjAwOS4gDQoiVGhlIE9uZSB0byBXYXRjaCIgLSBUcmVhc3VyeSBUb2RheSdzIEFkYW0g U21pdGggQXdhcmRzIDIwMDkuIA0KDQoNCi0tLS0tIE9yaWdpbmFsIE1lc3NhZ2UgLS0tLS0NCkZy b206ICJtZGVmb2lucGxhdGVsIGV4dCIgPG1kZWZvaW5wbGF0ZWwuZXh0QG9yYW5nZS5jb20+DQpU bzogdXNlckBoaXZlLmFwYWNoZS5vcmcNClNlbnQ6IFR1ZXNkYXksIE1hcmNoIDIwLCAyMDEyIDEw OjE5OjQxIEFNDQpTdWJqZWN0OiBPcHRpbWl6YXRpb24gb24gYnVja2V0aXplZC9zb3J0ZWQgdGFi bGVzDQoNCg0KDQoNCkhpIGZvbGtzLCANCg0KSSBoYXZlIHNldmVyYWwgcXVlc3Rpb25zIGFib3V0 IG9wdGltaXphdGlvbiBpbiBIaXZlLCB0aGV5IGFyZSBtYWlubHkgcmVsYXRlZCB0byBidWNrZXRp emVkL3NvcnRlZCB0YWJsZXMuIA0KDQoNCg0KTGV0IHNheSBJIGhhdmUgYSB0YWJsZSBUIGJ1Y2tl dGl6ZWQgb24gdXNlcl9pZCBhbmQgc29ydGVkIGJ5IHVzZXJfaWQsIHRpbWUuIA0KDQoNCg0KQ1JF QVRFIFRBQkxFIFQgDQoNCiggdXNlcl9pZCBCSUdJTlQsIA0KDQp0aW1lIElOVCANCg0KKSANCg0K Q0xVU1RFUkVEIEJZKHVzZXJfaWQpIFNPUlRFRCBCWSh1c2VyX2lkLCB0aW1lKSBJTlRPIDY0IEJV Q0tFVFM7IA0KDQoNCg0KDQoNCkluIGEgZ2VuZXJhbCB3YXksIEkgd29uZGVyIHdoaWNoIG9mIHRo ZSBmb2xsb3dpbmcgb3BlcmF0aW9ucyB3aWxsIGJlbmVmaXQgZnJvbSB0aGUgZmFjdCB0aGF0IFQg aXMgYnVja2V0aXplZCBhbmQgc29ydGVkLiANCg0KDQoNCjEpIEdyb3VwIGJ5IA0KDQpTRUxFQ1Qg dXNlcl9pZCwgY291bnQodGltZSkgRlJPTSBUIEdST1VQIEJZIHVzZXJfaWQ7IA0KDQoNCg0KMikg RGlzdHJpYnV0ZSBieSANCg0KU0VMRUNUIHVzZXJfaWQsIHRpbWUgRlJPTSBUIERJU1RSSUJVVEUg QlkgdXNlcl9pZDsgDQoNCg0KDQozKSBEaXN0cmlidXRlIGJ5LCBTb3J0IGJ5IA0KDQpTRUxFQ1Qg dXNlcl9pZCwgdGltZSBGUk9NIFQgRElTVFJJQlVURSBCWSB1c2VyX2lkIFNPUlQgQlkgdXNlcl9p ZCwgdGltZTsgDQoNCg0KDQo0KSBJbnNlcnQgaW50byBhIGJ1Y2tldGl6ZWQvc29ydGVkIHRhYmxl IA0KDQoNCg0KQ1JFQVRFIFRBQkxFIFQyIA0KDQooIHVzZXJfaWQgQklHSU5ULCANCg0KdGltZSBJ TlQgDQoNCikgDQoNCkNMVVNURVJFRCBCWSh1c2VyX2lkKSBTT1JURUQgQlkodXNlcl9pZCwgdGlt ZSkgSU5UTyA2NCBCVUNLRVRTOyANCg0KDQoNCnNldCBoaXZlLmVuZm9yY2UuYnVja2V0aW5nID0g dHJ1ZTsgDQoNCg0KDQpJTlNFUlQgT1ZFUldSSVRFIFRBQkxFIFQyIFNFTEVDVCBULnVzZXJfaWQs IFQudGltZSBGUk9NIFQ7IA0KDQoNCg0KDQoNCkZpbmFsbHksIG9uIGEgc2xpZ2h0bHkgbW9yZSBz cGVjaWZpYyB0b3BpY+KApiANCg0KDQoNCkxldCBzYXkgSSB3YW50IHRvIHBlcmZvcm0gdGhlIOKA mHNlc3Npb25pemF0aW9u4oCZIG9uIHRoZSB0YWJsZSBUIGFuZCBJIGFtIHBsYW5uaW5nIHRvIGNh bGwgYSBweXRob24gc2NyaXB0IHRvIGRvIHRoYXQgam9iLiANCg0KVG8gZ2V0IGEgdmFsaWQgYW5z d2VyIEkgbXVzdCBlbnN1cmUgdGhhdCB0aGUgZGF0YSBhcmUgc29ydGVkIGJ5IHVzZXJfaWQsdGlt ZSBhbmQgdGhhdCBhbGwgdGhlIGRhdGEgZm9yIGEgZ2l2ZW4gdXNlcl9pZCBhcmUgcHJvY2Vzc2Vk IGJ5IGEgc2luZ2xlIGNhbGwgdG8gbXkgc2NyaXB0LiANCg0KDQoNCkkgYW0gcGxhbm5pbmcgdG8g cnVuIHRoZSBmb2xsb3dpbmcgcXVlcnk6IA0KDQpGUk9NIChTRUxFQ1QgdXNlcl9JZCwgdGltZSBG Uk9NIFQgRElTVFJJQlVURSBCWSB1c2VyX2lkIFNPUlQgQlkgdXNlcl9pZCwgdGltZSkgcyBTRUxF Q1QgVFJBTlNGT1JNIChzLnVzZXJfaWQsIHMudGltZSkgVVNJTkcgJ3B5dGhvbiBzZXNzaW9uLnB5 JyBBUyB1c2VyX2lkLCBhdmdfc2Vzc2lvbiwgbmJfc2Vzc2lvbjsgDQoNCg0KDQpTbyBJIHdvbmRl ciBmaXJzdCBpZiB0aGlzIGlzIHRoZSBjb3JyZWN0IGFwcHJvYWNoIGFuZCBzZWNvbmQgaWYgdGhl IOKAmCBESVNUUklCVVRFIEJZIHVzZXJfaWQgU09SVCBCWSB1c2VyX2lkLCB0aW1lIOKAmSBjbGF1 c2VzIGFyZSByZXF1aXJlZCBrbm93aW5nIHRoYXQgVCBpcyBhbHJlYWR5IGJ1Y2tldGl6ZWQgYW5k IHNvcnRlZCBvbiB0aGUgcmlnaHQgY29sdW1ucy4gDQoNCg0KDQpNYW55IHRoYW5rcyBpbiBhZHZh bmNlIGZvciB5b3VyIGhlbHAsIA0KDQpNaWNoYWVsIA0KDQpfX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQoNCkNlIG1lc3NhZ2Ug ZXQgc2VzIHBpZWNlcyBqb2ludGVzIHBldXZlbnQgY29udGVuaXIgZGVzIGluZm9ybWF0aW9ucyBj b25maWRlbnRpZWxsZXMgb3UgcHJpdmlsZWdpZWVzIGV0IG5lIGRvaXZlbnQgZG9uYw0KcGFzIGV0 cmUgZGlmZnVzZXMsIGV4cGxvaXRlcyBvdSBjb3BpZXMgc2FucyBhdXRvcmlzYXRpb24uIFNpIHZv dXMgYXZleiByZWN1IGNlIG1lc3NhZ2UgcGFyIGVycmV1ciwgdmV1aWxsZXogbGUgc2lnbmFsZXIN CmEgbCdleHBlZGl0ZXVyIGV0IGxlIGRldHJ1aXJlIGFpbnNpIHF1ZSBsZXMgcGllY2VzIGpvaW50 ZXMuIExlcyBtZXNzYWdlcyBlbGVjdHJvbmlxdWVzIGV0YW50IHN1c2NlcHRpYmxlcyBkJ2FsdGVy YXRpb24sDQpGcmFuY2UgVGVsZWNvbSAtIE9yYW5nZSBkZWNsaW5lIHRvdXRlIHJlc3BvbnNhYmls aXRlIHNpIGNlIG1lc3NhZ2UgYSBldGUgYWx0ZXJlLCBkZWZvcm1lIG91IGZhbHNpZmllLiBNZXJj aS4NCg0KVGhpcyBtZXNzYWdlIGFuZCBpdHMgYXR0YWNobWVudHMgbWF5IGNvbnRhaW4gY29uZmlk ZW50aWFsIG9yIHByaXZpbGVnZWQgaW5mb3JtYXRpb24gdGhhdCBtYXkgYmUgcHJvdGVjdGVkIGJ5 IGxhdzsNCnRoZXkgc2hvdWxkIG5vdCBiZSBkaXN0cmlidXRlZCwgdXNlZCBvciBjb3BpZWQgd2l0 aG91dCBhdXRob3Jpc2F0aW9uLg0KSWYgeW91IGhhdmUgcmVjZWl2ZWQgdGhpcyBlbWFpbCBpbiBl cnJvciwgcGxlYXNlIG5vdGlmeSB0aGUgc2VuZGVyIGFuZCBkZWxldGUgdGhpcyBtZXNzYWdlIGFu ZCBpdHMgYXR0YWNobWVudHMuDQpBcyBlbWFpbHMgbWF5IGJlIGFsdGVyZWQsIEZyYW5jZSBUZWxl Y29tIC0gT3JhbmdlIGlzIG5vdCBsaWFibGUgZm9yIG1lc3NhZ2VzIHRoYXQgaGF2ZSBiZWVuIG1v ZGlmaWVkLCBjaGFuZ2VkIG9yIGZhbHNpZmllZC4NClRoYW5rIHlvdS4NCl9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KCkNlIG1l c3NhZ2UgZXQgc2VzIHBpZWNlcyBqb2ludGVzIHBldXZlbnQgY29udGVuaXIgZGVzIGluZm9ybWF0 aW9ucyBjb25maWRlbnRpZWxsZXMgb3UgcHJpdmlsZWdpZWVzIGV0IG5lIGRvaXZlbnQgZG9uYwpw YXMgZXRyZSBkaWZmdXNlcywgZXhwbG9pdGVzIG91IGNvcGllcyBzYW5zIGF1dG9yaXNhdGlvbi4g U2kgdm91cyBhdmV6IHJlY3UgY2UgbWVzc2FnZSBwYXIgZXJyZXVyLCB2ZXVpbGxleiBsZSBzaWdu YWxlcgphIGwnZXhwZWRpdGV1ciBldCBsZSBkZXRydWlyZSBhaW5zaSBxdWUgbGVzIHBpZWNlcyBq b2ludGVzLiBMZXMgbWVzc2FnZXMgZWxlY3Ryb25pcXVlcyBldGFudCBzdXNjZXB0aWJsZXMgZCdh bHRlcmF0aW9uLApGcmFuY2UgVGVsZWNvbSAtIE9yYW5nZSBkZWNsaW5lIHRvdXRlIHJlc3BvbnNh YmlsaXRlIHNpIGNlIG1lc3NhZ2UgYSBldGUgYWx0ZXJlLCBkZWZvcm1lIG91IGZhbHNpZmllLiBN ZXJjaS4KClRoaXMgbWVzc2FnZSBhbmQgaXRzIGF0dGFjaG1lbnRzIG1heSBjb250YWluIGNvbmZp ZGVudGlhbCBvciBwcml2aWxlZ2VkIGluZm9ybWF0aW9uIHRoYXQgbWF5IGJlIHByb3RlY3RlZCBi eSBsYXc7CnRoZXkgc2hvdWxkIG5vdCBiZSBkaXN0cmlidXRlZCwgdXNlZCBvciBjb3BpZWQgd2l0 aG91dCBhdXRob3Jpc2F0aW9uLgpJZiB5b3UgaGF2ZSByZWNlaXZlZCB0aGlzIGVtYWlsIGluIGVy cm9yLCBwbGVhc2Ugbm90aWZ5IHRoZSBzZW5kZXIgYW5kIGRlbGV0ZSB0aGlzIG1lc3NhZ2UgYW5k IGl0cyBhdHRhY2htZW50cy4KQXMgZW1haWxzIG1heSBiZSBhbHRlcmVkLCBGcmFuY2UgVGVsZWNv bSAtIE9yYW5nZSBpcyBub3QgbGlhYmxlIGZvciBtZXNzYWdlcyB0aGF0IGhhdmUgYmVlbiBtb2Rp ZmllZCwgY2hhbmdlZCBvciBmYWxzaWZpZWQuClRoYW5rIHlvdS4KCg==