Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CA0E9E8AC for ; Mon, 18 Feb 2013 08:03:30 +0000 (UTC) Received: (qmail 44924 invoked by uid 500); 18 Feb 2013 08:03:25 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 44839 invoked by uid 500); 18 Feb 2013 08:03:25 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 44815 invoked by uid 99); 18 Feb 2013 08:03:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Feb 2013 08:03:24 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of xieliang@xiaomi.com designates 58.68.235.87 as permitted sender) Received: from [58.68.235.87] (HELO mx1.mxmail.xiaomi.com) (58.68.235.87) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Feb 2013 08:03:19 +0000 Received: from mail.xiaomi.com (unknown [59.108.40.219]) by mx1.mxmail.xiaomi.com (Postfix) with ESMTP id 7533C8105C for ; Mon, 18 Feb 2013 16:02:57 +0800 (CST) Received: from EX-MBOX2.xiaomi.net ([fe80::3d39:a0dd:9859:26a6]) by EX-CAS2.xiaomi.net ([::1]) with mapi id 14.02.0247.003; Mon, 18 Feb 2013 16:02:22 +0800 From: =?gb2312?B?0LvBvA==?= To: "user@hadoop.apache.org" Subject: =?gb2312?B?tPC4tDogtPC4tDogc29tZSBpZGVhcyBmb3IgUUpNIGFuZCBORlM=?= Thread-Topic: =?gb2312?B?tPC4tDogc29tZSBpZGVhcyBmb3IgUUpNIGFuZCBORlM=?= Thread-Index: AQHODai3qYUEL8l4OEqpkJRfFuzOuJh/N8W4//+BlwCAAIaVCA== Date: Mon, 18 Feb 2013 08:02:21 +0000 Message-ID: References: <5121CE84.9090302@jp.fujitsu.com> , In-Reply-To: Accept-Language: zh-CN, en-US Content-Language: zh-CN X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.237.2.223] Content-Type: multipart/alternative; boundary="_000_DA8340397F7BAE41B8102757834CEB122306FCB7EXMBOX2xiaomine_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_DA8340397F7BAE41B8102757834CEB122306FCB7EXMBOX2xiaomine_ Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: base64 SU1ITywgaXQncyBub3QgYSByZWNvbW1lbnRlZCBkZXBsb3kgbWFubmVyIHRvIGRlcGxveSBKTiBh bmQgRE4gaW50byBzYW1lIG5vZGVzLg0KDQpSZWdhcmRzLA0KTGlhbmcNCl9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fDQq3orz+yMs6IEF6dXJ5eSBZdSBbYXp1cnl5eXVAZ21haWwuY29t XQ0Kt6LLzcqxvOQ6IDIwMTPE6jLUwjE4yNUgMTU6NTYNCsrVvP7IyzogdXNlckBoYWRvb3AuYXBh Y2hlLm9yZw0K1vfM4jogUmU6ILTwuLQ6IHNvbWUgaWRlYXMgZm9yIFFKTSBhbmQgTkZTDQoNCkFs bCBKTnMgYXJlIGRlcGxveWVkIG9uIHRoZSBzYW1lIG5vZGUgd2l0aCBETi4NCg0KDQpPbiBNb24s IEZlYiAxOCwgMjAxMyBhdCAzOjM1IFBNLCDQu8G8IDx4aWVsaWFuZ0B4aWFvbWkuY29tPG1haWx0 bzp4aWVsaWFuZ0B4aWFvbWkuY29tPj4gd3JvdGU6DQpIaSBBenVyeXksIGp1c3Qgd2FudCB0byBj b25maXJtIG9uZSB0aGluZywgeW91ciBKTiBkaWQgbm90IGRlcGxveSBvbiB0aGUgc2FtZSBtYWNo aW5lcyB3aXRoaW4gRE4sIHJpZ2h0ID8NCg0KUmVnYXJkcywNCkxpYW5nDQpfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXw0Kt6K8/sjLOiBBenVyeXkgWXUgW2F6dXJ5eXl1QGdtYWlsLmNv bTxtYWlsdG86YXp1cnl5eXVAZ21haWwuY29tPl0NCreiy83KsbzkOiAyMDEzxOoy1MIxOMjVIDE1 OjIyDQrK1bz+yMs6IHVzZXJAaGFkb29wLmFwYWNoZS5vcmc8bWFpbHRvOnVzZXJAaGFkb29wLmFw YWNoZS5vcmc+DQrW98ziOiBSZTogc29tZSBpZGVhcyBmb3IgUUpNIGFuZCBORlMNCg0KSGksDQoN CkkgZGlkIGl0IG9uIGhhZG9vcC0yLjAuMy1hbHBoYSB3aXRob3V0IEhBIGFzIGZvbGxvd2luZzoN Cg0KW3Jvb3RAd2ViZG0gdGVzdF0jIGRhdGUgKyVZLSVtLSVkXyVIOiVNOiVTOyBoZGZzIGRmcyAt cHV0IHRlc3RzcGVlZC50YXIuZ3ogLyA7IGRhdGUgKyVZLSVtLSVkXyVIOiVNOiVTDQoyMDEzLTAy LTE4XzE1OjIwOjAxDQoxMy8wMi8xOCAxNToyMDowMiBXQVJOIHV0aWwuTmF0aXZlQ29kZUxvYWRl cjogVW5hYmxlIHRvIGxvYWQgbmF0aXZlLWhhZG9vcCBsaWJyYXJ5IGZvciB5b3VyIHBsYXRmb3Jt Li4uIHVzaW5nIGJ1aWx0aW4tamF2YSBjbGFzc2VzIHdoZXJlIGFwcGxpY2FibGUNCjIwMTMtMDIt MThfMTU6MjA6MzANCg0Kc28gdGhlIHBlcmZvcm1hbmNlIGlzIGEgbGl0dGxlIGJpdCBiZXR0ZXIg dGhhbiBoYWRvb3AtMS4wLjQuDQoNCg0KDQpPbiBNb24sIEZlYiAxOCwgMjAxMyBhdCAyOjUzIFBN LCBBenVyeXkgWXUgPGF6dXJ5eXl1QGdtYWlsLmNvbTxtYWlsdG86YXp1cnl5eXVAZ21haWwuY29t Pj4gd3JvdGU6DQpPaCwgeWVzLCB5b3UgYXJlIHJpZ2h0LCBHZW9yZ2UuIEknbGwgcHJvYmFibHkg ZG8gaXQgaW4gdGhlIG5leHQgZGF5cy4NCg0KDQpPbiBNb24sIEZlYiAxOCwgMjAxMyBhdCAyOjQ3 IFBNLCBHZW9yZ2UgRGF0c2tvcyA8Z2VvcmdlLmRhdHNrb3NAanAuZnVqaXRzdS5jb208bWFpbHRv Omdlb3JnZS5kYXRza29zQGpwLmZ1aml0c3UuY29tPj4gd3JvdGU6DQpIaSBBenVyeXksDQoNClNv IHlvdSBoYXZlIG1lYXN1cmVtZW50cyBmb3IgaGFkb29wLTEuMC40IGFuZCBoYWRvb3AtMi4wLjMr UUpNLCBidXQgSSB0aGluayB5b3Ugc2hvdWxkIGFsc28gbWVhc3VyZSBoYWRvb3AtMi4wLjMgX3dp aG91dF8gUUpNIHNvIHlvdSBjYW4ga25vdyBmb3Igc3VyZSBpZiB0aGUgcGVyZm9ybWFuY2UgZGVn cmFkZSBpcyBhY3R1YWxseSByZWxhdGVkIHRvIFFKTSBvciBub3QuDQoNCg0KR2VvcmdlDQoNCg0K SGksDQoNCkhhcnNoSiBpcyBhIGdvb2QgZ3V5LCBJJ3ZlIHNlZW4gdGhpcyBKSVJBOiBodHRwczov L2lzc3Vlcy5hcGFjaGUub3JnL2ppcmEvYnJvd3NlL0hERlMtNDUwOA0KDQpJIGhhdmUgYSB0ZXN0 IGNsdXN0ZXIgaGFkb29wLTEuMC40LCBJJ3ZlIHVwZ3JhZGUgdG8gaGFkb29wLTIuMC4zLWFscGhh LiBtdSBjbHVzdGVyIGlzIHZlcnkgc21hbGwsIGZvdXIgbm9kZXMgdG90YWxseS4NCg0KdGhlbiBJ IGRpZCBzb21lIHRlc3Qgb24gdGhlIG9yaWdpbmFsIEhhZG9vcCBhbmQgbmV3IEhhZG9vcCwgdGhl IHRlc3RpbmcgaXMgdmVyeSBzaW1wbGU6IEkgaGF2ZSBhIGRhdGEgZmlsZSB3aXRoIDQ1ME1CLCBJ IGp1c3QgcHV0IGl0IG9uIHRoZSBIREZTLg0KDQpibG9jayBzaXplOiAxMjhNQiwgcmVwbGljYTog Mg0KDQp0aGUgZm9sbG93aW5nIGlzIHRoZSByZXN1bHQ6DQoNCltyb290QHdlYmRtIHRlc3RdIyBs bCB0ZXN0c3BlZWQudGFyLmd6DQotcnctci0tci0tIDEgcm9vdCByb290IDQ1Mk0gRmViIDE4IDEz OjU0IHRlc3RzcGVlZC50YXIuZ3oNCltyb290QHdlYmRtIHRlc3RdIw0KDQovL09uIHRoZSBoYWRv b3AtMS4wLjQNCltyb290QHdlYmRtIHRlc3RdIyBkYXRlICslWS0lbS0lZF8lSDolTTolUzsgaGFk b29wIGRmcyAtcHV0IHRlc3RzcGVlZC50YXIuZ3ogLyA7IGRhdGUgKyVZLSVtLSVkXyVIOiVNOiVT DQoyMDEzLTAyLTE4XzEzOjU0OjI0DQpXYXJuaW5nOiAkSEFET09QX0hPTUUgaXMgZGVwcmVjYXRl ZC4NCjIwMTMtMDItMThfMTM6NTQ6NTgNCg0KLy9PbiB0aGUgaGFkb29wLTIuMC4zLWFscGhhIHdp dGggUUpNDQpbcm9vdEB3ZWJkbSB0ZXN0XSMgZGF0ZSArJVktJW0tJWRfJUg6JU06JVM7IGhkZnMg ZGZzIC1wdXQgdGVzdHNwZWVkLnRhci5neiAvIDsgZGF0ZSArJVktJW0tJWRfJUg6JU06JVMNCjIw MTMtMDItMThfMTQ6MTM6MjkNCjEzLzAyLzE4IDE0OjEzOjMwIFdBUk4gdXRpbC5OYXRpdmVDb2Rl TG9hZGVyOiBVbmFibGUgdG8gbG9hZCBuYXRpdmUtaGFkb29wIGxpYnJhcnkgZm9yIHlvdXIgcGxh dGZvcm0uLi4gdXNpbmcgYnVpbHRpbi1qYXZhIGNsYXNzZXMgd2hlcmUgYXBwbGljYWJsZQ0KMjAx My0wMi0xOF8xNDoxNDozMw0KDQpJIGRvIHRoaW5rIFFKTSBIQSBmZWF0dXJlIGFmZmVjdCB0aGUg cGVyZm9ybWFuY2UsIGJlY2F1c2UgZWFjaCB3cml0ZXIgZnJvbSBRSk0sIGl0IHdpbGwgZG86IGZl bmNlIG9sZCB3cml0ZXI7IHN5bmMgaW4tcHJvZ3Jlc3MgbG9nOyBzdGFydCBuZXcgbG9nIHNlZ21l bnQ7IHRoZW4gd3JpdGUuIG9ubHkgaWYgd3JpdGVyIHJlY2VpdmVkIGEgc3VjY2Vzc2Z1bCByZXNw b25zZSBmcm9tIGEgcXVvcnVtIG9mIEpOcywgd3JpdGVyIGZpbmlzaGVkIGZvciB0aGlzIHRpbWUu DQoNCkJ1dCBORlMgSEEganVzdCB3cml0ZSBsb2cgc2VnbWVudCBpbiB0aGUgbG9jYWwgYW5kIE5G Uywgd2hlbiBpdCByZWNlaXZlIHN1Y2Nlc3NmdWwgcmVzcG9uc2UgZnJvbSBORlMsIGl0IGZpbmlz aGVkIHRoaXMgdGltZS4NCg0KU28sIEkganVzdCBzdWdnZXN0IHdlIGFsd2F5cyBrZWVwIHRoZXNl IHR3byBIQSBmZWF0dXJlcyBpbiBmdXR1cmUsIGV2ZW4gaW4gdGhlIHN0YWJsZSByZWxlYXNlLiB3 aGljaCBvbmUgc2hvdWxkIGJlIHVzZWQsIHdoaWNoIGRlcGVuZHMgb24geW91cnNlbGYgYmFzZWQg b24geW91ciBpbmZyYXN0cnVjdHVyZS4NCg0KVGhhbmtzLg0KDQoNCg0KDQo= --_000_DA8340397F7BAE41B8102757834CEB122306FCB7EXMBOX2xiaomine_ Content-Type: text/html; charset="gb2312" Content-Transfer-Encoding: quoted-printable
IMHO, it's not a recommented deploy manner to deploy JN and DN into = same nodes.

Regards,
Liang
=B7=A2=BC=FE=C8=CB: Azuryy Yu [azuryyyu@g= mail.com]
=B7=A2=CB=CD=CA=B1=BC=E4: 2013=C4=EA2=D4=C218=C8=D5 15:56
=CA=D5=BC=FE=C8=CB: user@hadoop.apache.org
=D6=F7=CC=E2: Re: =B4=F0=B8=B4: some ideas for QJM and NFS

All JNs are deployed on the same node with DN.


On Mon, Feb 18, 2013 at 3:35 PM, =D0=BB=C1=BC <xieliang@xiaomi.com> wrote:
Hi Azu= ryy, just want to confirm one thing, your JN did not deploy on the same mac= hines within DN, right ?

Regards,
Liang
= =B7=A2=BC=FE=C8=CB: Azuryy Yu [azuryyyu@gmail.com]
=B7=A2=CB=CD=CA=B1=BC=E4: 2013=C4=EA2=D4=C218=C8=D5 15:22
=CA=D5=BC=FE=C8=CB: user@hadoop.apache.org
=D6=F7=CC=E2: Re: some ideas for QJM and NFS

Hi,

I did it on hadoop-2.0.= 3-alpha without HA as following:

[root@webdm test]# date +%Y-%m-%d_%H:%M:%S; hdfs dfs -put testspeed.tar= .gz / ; date +%Y-%m-%d_%H:%M:%S
2013-02-18_15:20:01
13/02/18 15:20:02 WARN util.NativeCodeLoader: Unable to load native-hadoop = library for your platform... using builtin-java classes where applicable 2013-02-18_15:20:30

so the performance is a little bit better than hadoop-1.0.4.



On Mon, Feb 18, 2013 at 2:53 PM, Azuryy Yu <azuryyyu@gmail.= com> wrote:
Oh, yes, you are right, George. I'll probably do it in the= next days.


On Mon, Feb 18, 2013 at 2:47 PM, George Datskos = <geor= ge.datskos@jp.fujitsu.com> wrote:
Hi Azuryy,

So you have measurements for hadoop-1.0.4 and hadoop-2.0.3+QJM, but I t= hink you should also measure hadoop-2.0.3 _wihout_ QJM so you can know for = sure if the performance degrade is actually related to QJM or not.


George


Hi,

HarshJ is a good guy, I've seen this JIRA: https://issues.apache.org/jira/browse/HDFS-4508

I have a test cluster hadoop-1.0.4, I've upgrade to hadoop-2.0.3-alpha= . mu cluster is very small, four nodes totally.

then I did some test on the original Hadoop and new Hadoop, the testin= g is very simple: I have a data file with 450MB, I just put it on the HDFS.=

block size: 128MB, replica: 2

the following is the result:

[root@webdm test]# ll testspeed.tar.gz
-rw-r--r-- 1 root root 452M F= eb 18 13:54 testspeed.tar.gz
[root@webdm test]#

//On the hadoop-1.= 0.4
[root@webdm test]# date +%Y-%m-%d_%H:%M:%S; hadoop dfs -put testsp= eed.tar.gz / ; date +%Y-%m-%d_%H:%M:%S
2013-02-18_13:54:24
Warning: $HADOOP_HOME is deprecated.
2013-02-18_13:54:58

//On the hadoop-2.= 0.3-alpha with QJM
[root@webdm test]# date +%Y-%m-%d_%H:%M:%S; hdfs dfs -put testspee= d.tar.gz / ; date +%Y-%m-%d_%H:%M:%S
2013-02-18_14:13:29
13/02/18 14:13:30 WARN util.NativeCodeLoader: Unable to load native-hadoop = library for your platform... using builtin-java classes where applicable 2013-02-18_14:14:33

I do think QJM HA feature affect the performance, because each writer = from QJM, it will do: fence old writer; sync in-progress log; start new log= segment; then write. only if writer received a successful response from a = quorum of JNs, writer finished for this time.

But NFS HA just write log segment in the local and NFS, when it receiv= e successful response from NFS, it finished this time.

So, I just suggest we always ke= ep these two HA features in future, even in the stable release. which one s= hould be used, which depends on yourself based on your infrastructure.

Thanks.




--_000_DA8340397F7BAE41B8102757834CEB122306FCB7EXMBOX2xiaomine_--