Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B041DDBCA for ; Wed, 21 Nov 2012 09:02:23 +0000 (UTC) Received: (qmail 19754 invoked by uid 500); 21 Nov 2012 09:02:18 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 19670 invoked by uid 500); 21 Nov 2012 09:02:18 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 19646 invoked by uid 99); 21 Nov 2012 09:02:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Nov 2012 09:02:17 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ramon_wang@hotmail.com designates 65.54.190.94 as permitted sender) Received: from [65.54.190.94] (HELO bay0-omc2-s19.bay0.hotmail.com) (65.54.190.94) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Nov 2012 09:02:10 +0000 Received: from BAY002-W116 ([65.54.190.124]) by bay0-omc2-s19.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 21 Nov 2012 01:00:02 -0800 Message-ID: Content-Type: multipart/alternative; boundary="_38931890-2abe-4a5e-a804-db1f338fcb2e_" X-Originating-IP: [222.35.91.115] From: WangRamon To: "user@hadoop.apache.org" Subject: RE: Is there an additional overhead when storing data in HDFS? Date: Wed, 21 Nov 2012 17:00:01 +0800 Importance: Normal In-Reply-To: References: , , MIME-Version: 1.0 X-OriginalArrivalTime: 21 Nov 2012 09:00:02.0009 (UTC) FILETIME=[97567490:01CDC7C6] X-Virus-Checked: Checked by ClamAV on apache.org --_38931890-2abe-4a5e-a804-db1f338fcb2e_ Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: base64 VGhhbmsgZ3V5cywgZ3JlYXQgam9iLg0KIEZyb206IGRvbnRhcmlxQGdtYWlsLmNvbQ0KRGF0ZTog V2VkLCAyMSBOb3YgMjAxMiAxMzoyMzowOCArMDUzMA0KU3ViamVjdDogUmU6IElzIHRoZXJlIGFu IGFkZGl0aW9uYWwgb3ZlcmhlYWQgd2hlbiBzdG9yaW5nIGRhdGEgaW4gSERGUz8NClRvOiB1c2Vy QGhhZG9vcC5hcGFjaGUub3JnDQoNCkhlbGxvIFJhbW9uLA0KIFdoeSBkb24ndCB5b3UgZ28gdGhy b3VnaCB0aGlzIGxpbmsgb25jZSA6IGh0dHA6Ly93d3cuYW9zYWJvb2sub3JnL2VuL2hkZnMuaHRt bFN1cmVzaCBhbmQgZ3V5cyBoYXZlIGV4cGxhaW5lZCBldmVyeXRoaW5nIGJlYXV0aWZ1bGx5LgoK DQpIVEhSZWdhcmRzLCAgICBNb2hhbW1hZCBUYXJpcQ0KCg0KDQpPbiBXZWQsIE5vdiAyMSwgMjAx MiBhdCAxMjo1OCBQTSwgU3VyZXNoIFNyaW5pdmFzIDxzdXJlc2hAaG9ydG9ud29ya3MuY29tPiB3 cm90ZToNCgoKTmFtZW5vZGUgd2lsbCBoYXZlIHRyaXZpYWwgYW1vdW50IG9mIGRhdGEgc3RvcmVk IGluIGpvdXJuYWwvZnNpbWFnZS4gDQoNCk9uIFR1ZSwgTm92IDIwLCAyMDEyIGF0IDExOjIxIFBN LCBXYW5nUmFtb24gPHJhbW9uX3dhbmdAaG90bWFpbC5jb20+IHdyb3RlOg0KCgoKCgoKVGhhbmtz LCBiZXNpZGVzIHRoZSBjaGVja3N1bSBkYXRhIGlzIHRoZXJlIGFueXRoaW5nIGVsc2U/IERhdGEg aW4gbmFtZSBub2RlPw0KIA0KRGF0ZTogVHVlLCAyMCBOb3YgMjAxMiAyMzoxNDowNiAtMDgwMA0K U3ViamVjdDogUmU6IElzIHRoZXJlIGFuIGFkZGl0aW9uYWwgb3ZlcmhlYWQgd2hlbiBzdG9yaW5n IGRhdGEgaW4gSERGUz8NCgoKCkZyb206IHN1cmVzaEBob3J0b253b3Jrcy5jb20NClRvOiB1c2Vy QGhhZG9vcC5hcGFjaGUub3JnDQoNCkhERlMgdXNlcyA0R0IgZm9yIHRoZSBmaWxlICsgY2hlY2tz dW0gZGF0YS4KCgoNCkRlZmF1bHQgaXMgZm9yIGV2ZXJ5IDUxMiBieXRlcyBvZiBkYXRhLCA0IGJ5 dGVzIG9mIGNoZWNrc3VtIGFyZSBzdG9yZWQuIEluIHRoaXMgY2FzZSBhZGRpdGlvbmFsIDMyTUIg ZGF0YS4NCg0KT24gVHVlLCBOb3YgMjAsIDIwMTIgYXQgMTE6MDAgUE0sIFdhbmdSYW1vbiA8cmFt b25fd2FuZ0Bob3RtYWlsLmNvbT4gd3JvdGU6DQoKCgoKCgoKSGkgQWxsDQogDQpJJ20gd29uZGVy aW5nIGlmIHRoZXJlIGlzIGFuIGFkZGl0aW9uYWwgb3ZlcmhlYWQgd2hlbiBzdG9yaW5nIHNvbWUg ZGF0YSBpbnRvIEhERlM/IEZvciBleGFtcGxlLCBJIGhhdmUgYSAyR0IgZmlsZSwgdGhlIHJlcGxp Y2F0ZSBmYWN0b3Igb2YgSERTRiBpcyAyLCB3aGVuIHRoZSBmaWxlIGlzIHVwbG9hZGVkIHRvIEhE RlMsIHNob3VsZCBIREZTIHVzZSA0R0IgdG8gc3RvcmUgaXQgb3IgbW9yZSB0aGVuIDRHQiB0byBz dG9yZSBpdD8gSWYgaXQgdGFrZXMgbW9yZSB0aGFuIDRHQiBzcGFjZSwgd2h5Pw0KCgoKCiANClRo YW5rcw0KUmFtb24gDQogCQkgCSAgIAkJICAKDQoNCi0tIA0KIGh0dHA6Ly9ob3J0b253b3Jrcy5j b20vZG93bmxvYWQvDQoNCgogCQkgCSAgIAkJICAKDQoNCi0tIA0KIGh0dHA6Ly9ob3J0b253b3Jr cy5jb20vZG93bmxvYWQvDQoNCgoNCiAJCSAJICAgCQkgIA== --_38931890-2abe-4a5e-a804-db1f338fcb2e_ Content-Type: text/html; charset="gb2312" Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxzdHlsZT48IS0tDQouaG1tZXNzYWdlIFANCnsNCm1hcmdpbjowcHg7 DQpwYWRkaW5nOjBweA0KfQ0KYm9keS5obW1lc3NhZ2UNCnsNCmZvbnQtc2l6ZTogMTJwdDsNCmZv bnQtZmFtaWx5Os6iyO3RxbraDQp9DQotLT48L3N0eWxlPjwvaGVhZD4NCjxib2R5IGNsYXNzPSdo bW1lc3NhZ2UnPjxkaXYgZGlyPSdsdHInPlRoYW5rIGd1eXMsIGdyZWF0IGpvYi48YnI+Jm5ic3A7 PEJSPjxkaXY+PGRpdiBpZD0iU2t5RHJpdmVQbGFjZWhvbGRlciI+PC9kaXY+PGhyIGlkPSJzdG9w U3BlbGxpbmciPkZyb206IGRvbnRhcmlxQGdtYWlsLmNvbTxicj5EYXRlOiBXZWQsIDIxIE5vdiAy MDEyIDEzOjIzOjA4ICswNTMwPGJyPlN1YmplY3Q6IFJlOiBJcyB0aGVyZSBhbiBhZGRpdGlvbmFs IG92ZXJoZWFkIHdoZW4gc3RvcmluZyBkYXRhIGluIEhERlM/PGJyPlRvOiB1c2VyQGhhZG9vcC5h cGFjaGUub3JnPGJyPjxicj5IZWxsbyBSYW1vbiw8ZGl2Pjxicj48L2Rpdj48ZGl2PiZuYnNwO1do eSBkb24ndCB5b3UgZ28gdGhyb3VnaCB0aGlzIGxpbmsgb25jZSA6Jm5ic3A7PGEgaHJlZj0iaHR0 cDovL3d3dy5hb3NhYm9vay5vcmcvZW4vaGRmcy5odG1sIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDov L3d3dy5hb3NhYm9vay5vcmcvZW4vaGRmcy5odG1sPC9hPjwvZGl2PjxkaXY+U3VyZXNoIGFuZCBn dXlzIGhhdmUgZXhwbGFpbmVkIGV2ZXJ5dGhpbmcgYmVhdXRpZnVsbHkuPC9kaXY+Cgo8ZGl2Pjxi cj48L2Rpdj48ZGl2PkhUSDwvZGl2PjxkaXYgY2xhc3M9ImVjeGdtYWlsX2V4dHJhIj48YnIgY2xl YXI9ImFsbCI+UmVnYXJkcyw8ZGl2PiZuYnNwOyZuYnNwOyAmbmJzcDtNb2hhbW1hZCBUYXJpcTwv ZGl2Pjxicj4KPGJyPjxicj48ZGl2IGNsYXNzPSJlY3hnbWFpbF9xdW90ZSI+T24gV2VkLCBOb3Yg MjEsIDIwMTIgYXQgMTI6NTggUE0sIFN1cmVzaCBTcmluaXZhcyA8c3BhbiBkaXI9Imx0ciI+Jmx0 OzxhIGhyZWY9Im1haWx0bzpzdXJlc2hAaG9ydG9ud29ya3MuY29tIj5zdXJlc2hAaG9ydG9ud29y a3MuY29tPC9hPiZndDs8L3NwYW4+IHdyb3RlOjxicj48YmxvY2txdW90ZSBzdHlsZT0icGFkZGlu Zy1sZWZ0OiAxZXg7IGJvcmRlci1sZWZ0LWNvbG9yOiByZ2IoMjA0LCAyMDQsIDIwNCk7IGJvcmRl ci1sZWZ0LXdpZHRoOiAxcHg7IGJvcmRlci1sZWZ0LXN0eWxlOiBzb2xpZDsiIGNsYXNzPSJlY3hn bWFpbF9xdW90ZSI+CgpOYW1lbm9kZSB3aWxsIGhhdmUgdHJpdmlhbCBhbW91bnQgb2YgZGF0YSBz dG9yZWQgaW4gam91cm5hbC9mc2ltYWdlLiZuYnNwOzxkaXYgY2xhc3M9ImVjeEhPRW5aYiI+PGRp diBjbGFzcz0iaDUiPjxicj48YnI+PGRpdiBjbGFzcz0iZWN4Z21haWxfcXVvdGUiPk9uIFR1ZSwg Tm92IDIwLCAyMDEyIGF0IDExOjIxIFBNLCBXYW5nUmFtb24gPHNwYW4gZGlyPSJsdHIiPiZsdDs8 YSBocmVmPSJtYWlsdG86cmFtb25fd2FuZ0Bob3RtYWlsLmNvbSI+cmFtb25fd2FuZ0Bob3RtYWls LmNvbTwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+CgoKPGJsb2NrcXVvdGUgc3R5bGU9InBhZGRp bmctbGVmdDogMWV4OyBib3JkZXItbGVmdC1jb2xvcjogcmdiKDIwNCwgMjA0LCAyMDQpOyBib3Jk ZXItbGVmdC13aWR0aDogMXB4OyBib3JkZXItbGVmdC1zdHlsZTogc29saWQ7IiBjbGFzcz0iZWN4 Z21haWxfcXVvdGUiPgoKCjxkaXY+PGRpdiBkaXI9Imx0ciI+VGhhbmtzLCBiZXNpZGVzIHRoZSBj aGVja3N1bSBkYXRhIGlzIHRoZXJlIGFueXRoaW5nIGVsc2U/IERhdGEgaW4gbmFtZSBub2RlPzxi cj4mbmJzcDs8YnI+PGRpdj48ZGl2PjwvZGl2Pjxocj5EYXRlOiBUdWUsIDIwIE5vdiAyMDEyIDIz OjE0OjA2IC0wODAwPGJyPlN1YmplY3Q6IFJlOiBJcyB0aGVyZSBhbiBhZGRpdGlvbmFsIG92ZXJo ZWFkIHdoZW4gc3RvcmluZyBkYXRhIGluIEhERlM/PGJyPgoKCkZyb206IDxhIGhyZWY9Im1haWx0 bzpzdXJlc2hAaG9ydG9ud29ya3MuY29tIj5zdXJlc2hAaG9ydG9ud29ya3MuY29tPC9hPjxicj5U bzogPGEgaHJlZj0ibWFpbHRvOnVzZXJAaGFkb29wLmFwYWNoZS5vcmciPnVzZXJAaGFkb29wLmFw YWNoZS5vcmc8L2E+PGRpdj48ZGl2Pjxicj48YnI+SERGUyB1c2VzIDRHQiBmb3IgdGhlIGZpbGUg KyBjaGVja3N1bSBkYXRhLjxkaXY+CgoKPGJyPjwvZGl2PjxkaXY+RGVmYXVsdCBpcyBmb3IgZXZl cnkgNTEyIGJ5dGVzIG9mIGRhdGEsIDQgYnl0ZXMgb2YgY2hlY2tzdW0gYXJlIHN0b3JlZC4gSW4g dGhpcyBjYXNlIGFkZGl0aW9uYWwgMzJNQiBkYXRhLjxicj48YnI+PGRpdj5PbiBUdWUsIE5vdiAy MCwgMjAxMiBhdCAxMTowMCBQTSwgV2FuZ1JhbW9uIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJl Zj0ibWFpbHRvOnJhbW9uX3dhbmdAaG90bWFpbC5jb20iPnJhbW9uX3dhbmdAaG90bWFpbC5jb208 L2E+Jmd0Ozwvc3Bhbj4gd3JvdGU6PGJyPgoKCgo8YmxvY2txdW90ZSBzdHlsZT0icGFkZGluZy1s ZWZ0OiAxZXg7IGJvcmRlci1sZWZ0LWNvbG9yOiByZ2IoMjA0LCAyMDQsIDIwNCk7IGJvcmRlci1s ZWZ0LXdpZHRoOiAxcHg7IGJvcmRlci1sZWZ0LXN0eWxlOiBzb2xpZDsiPgoKCjxkaXY+PGRpdiBk aXI9Imx0ciI+SGkgQWxsPGJyPiZuYnNwOzxicj5JJ20gd29uZGVyaW5nIGlmIHRoZXJlIGlzJm5i c3A7YW4gYWRkaXRpb25hbCBvdmVyaGVhZCB3aGVuIHN0b3Jpbmcgc29tZSBkYXRhIGludG8gSERG Uz8gRm9yIGV4YW1wbGUsIEkgaGF2ZSBhIDJHQiBmaWxlLCB0aGUgcmVwbGljYXRlIGZhY3RvciBv ZiBIRFNGIGlzIDIsIHdoZW4gdGhlIGZpbGUgaXMgdXBsb2FkZWQgdG8gSERGUywgc2hvdWxkIEhE RlMgdXNlIDRHQiB0byBzdG9yZSBpdCBvciBtb3JlIHRoZW4gNEdCIHRvIHN0b3JlIGl0PyZuYnNw O0lmIGl0IHRha2VzIG1vcmUgdGhhbiA0R0ImbmJzcDtzcGFjZSwgd2h5Pzxicj4KCgoKJm5ic3A7 PGJyPlRoYW5rczxicj5SYW1vbiZuYnNwOzxicj4gCQkgCSAgIAkJICA8L2Rpdj48L2Rpdj4KPC9i bG9ja3F1b3RlPjwvZGl2Pjxicj48YnIgY2xlYXI9ImFsbCI+PGRpdj48YnI+PC9kaXY+LS0gPGJy PjxhIHRhcmdldD0iX2JsYW5rIj4gaHR0cDovL2hvcnRvbndvcmtzLmNvbS9kb3dubG9hZC88L2E+ PGJyPjxicj4KPC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+IAkJIAkgICAJCSAgPC9kaXY+PC9kaXY+ CjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PGJyIGNsZWFyPSJhbGwiPjxkaXY+PGJyPjwvZGl2Pjwv ZGl2PjwvZGl2PjxzcGFuIGNsYXNzPSJlY3hIT0VuWmIiPjxmb250IGNvbG9yPSIjODg4ODg4Ij4t LSA8YnI+PGEgdGFyZ2V0PSJfYmxhbmsiPiBodHRwOi8vaG9ydG9ud29ya3MuY29tL2Rvd25sb2Fk LzwvYT48YnI+PGJyPgo8L2ZvbnQ+PC9zcGFuPjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PC9kaXY+ PC9kaXY+IAkJIAkgICAJCSAgPC9kaXY+PC9ib2R5Pg0KPC9odG1sPg== --_38931890-2abe-4a5e-a804-db1f338fcb2e_--