Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5D7F817589 for ; Wed, 8 Apr 2015 02:41:34 +0000 (UTC) Received: (qmail 85942 invoked by uid 500); 8 Apr 2015 02:41:27 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 85826 invoked by uid 500); 8 Apr 2015 02:41:27 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 85816 invoked by uid 99); 8 Apr 2015 02:41:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Apr 2015 02:41:26 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of shurong.mai@qunar.com designates 59.151.11.101 as permitted sender) Received: from [59.151.11.101] (HELO Exchange02.qunarservers.com) (59.151.11.101) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Apr 2015 02:40:59 +0000 Received: from Exchange10.qunarservers.com (119.254.26.7) by EXCHANGE02.qunarservers.com (59.151.11.104) with Microsoft SMTP Server (TLS) id 14.1.438.0; Wed, 8 Apr 2015 10:40:04 +0800 Received: from EXCHANGE23.qunarservers.com ([fe80::2c7c:3c51:7b63:d774]) by Exchange10.qunarservers.com ([::1]) with mapi id 14.01.0218.012; Wed, 8 Apr 2015 10:40:04 +0800 From: =?utf-8?B?6bqm5qCR6I2j?= To: "user@hadoop.apache.org" Subject: =?utf-8?B?562U5aSNOiBXaHkgcmVwbGljYXRpb24gb2YgVW5kZXItUmVwbGljYXRlZCBi?= =?utf-8?Q?locks_in_decommissioned_datanodes__is_so_slow?= Thread-Topic: Why replication of Under-Replicated blocks in decommissioned datanodes is so slow Thread-Index: AdBw4MzcG7y96UMsSFezdYBPwn/ODAAw0RAQ Date: Wed, 8 Apr 2015 02:40:03 +0000 Message-ID: <7AEA68D8F5290344B43CE4F9B945C32C158B23@EXCHANGE23.qunarservers.com> References: <7AEA68D8F5290344B43CE4F9B945C32C154E03@EXCHANGE23.qunarservers.com> In-Reply-To: <7AEA68D8F5290344B43CE4F9B945C32C154E03@EXCHANGE23.qunarservers.com> Accept-Language: zh-CN, en-US Content-Language: zh-CN X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.126.223] Content-Type: multipart/alternative; boundary="_000_7AEA68D8F5290344B43CE4F9B945C32C158B23EXCHANGE23qunarse_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_7AEA68D8F5290344B43CE4F9B945C32C158B23EXCHANGE23qunarse_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Q291bGQgc29tZW9uZSBleHBsYWluIGl0ID8gVGhhbmtzLg0KDQrlj5Hku7bkuro6IOm6puagkeiN oyBbbWFpbHRvOnNodXJvbmcubWFpQHF1bmFyLmNvbV0NCuWPkemAgeaXtumXtDogMjAxNeW5tDTm nIg35pelIDExOjE5DQrmlLbku7bkuro6IHVzZXJAaGFkb29wLmFwYWNoZS5vcmcNCuaKhOmAgTog 5bGx55Ge5bOwDQrkuLvpopg6IFdoeSByZXBsaWNhdGlvbiBvZiBVbmRlci1SZXBsaWNhdGVkIGJs b2NrcyBpbiBkZWNvbW1pc3Npb25lZCBkYXRhbm9kZXMgaXMgc28gc2xvdw0KDQp2ZXJzaW9uOiBo YWRvb3AtMi4yLjANCg0KVGhlcmUgd2VyZSAxMyBub2RlcyBpbiBvdXIgaGRmcyBjbHVzdGVyLiBX ZSB3YW50ZWQgdG8gZGVjb21taXNzaW9uIDcgbm9kZXMuIFdlIHVzZWQgdHdvIG1ldGhvZHMgYXMg Zm9sbG93Og0KDQpNZXRob2QgMToNCkF0IHRoZSBiZWdpbm5pbmcsIHdlIHNldCB0aGUgZGZzLmhv c3RzLmV4Y2x1ZGUgcGFyYW1ldGVyIGFuZCBzdWNjZXNzZnVsbHkgZGVjb21taXNzaW9uZWQgNyBu b2Rlcywgc28gdGhlcmUgd2VyZSBtYW55IFVuZGVyLVJlcGxpY2F0ZWQgYmxvY2tzIG5lZWQgdG8g cmVwbGljYXRlLiBIb3dldmVyLCBpdCBzcGVudCBhYm91dCAyMCBob3VycyBhbmQgdGhlIHJlcGxp Y2F0aW9uIGRpZG7igJl0IGZpbmlzaCB5ZXQuIFdlIG9ic2VydmVkIHRoZSBzcGVlZCBvZiByZXBs aWNhdGlvbiBpcyB2ZXJ5IHNsb3cuDQoNCk1ldGhvZCAyOg0KTGF0ZXIsIHdlIGdhdmUgdXAgdGhl IG1ldGhvZCwgYW5kIHVzZWQgYW5vdGhlciBtZXRob2Qgb2Ygc3RvcHBpbmcgZGF0YW5vZGUgbm9k ZSBieSBub2RlLiBXZSBzdG9wcGVkIG9uZSBkYXRhbm9kZS4gV2hlbiByZXBsaWNhdGlvbiBvZiBV bmRlci1SZXBsaWNhdGVkIGJsb2NrcyBvZiB0aGUgbm9kZSBmaW5pc2hlZCwgd2UgY29udGludWVk IHRvIHN0b3AgYW5vdGhlciBkYXRhbm9kZSB0aWxsIDcgbm9kZXMgd2VyZSBzdG9wcGVkLiBJdCBz cGVudCBhYm91dCAxMiBob3VycyBhbmQgdGhlIHNwZWVkIG9mIHJlcGxpY2F0aW9uIGlzIG9idmlv dXNseSBtdWNoIGZhc3RlciB0aGUgbWV0aG9kIDEuDQoNCldlIHRob3VnaHQgbWV0aG9kIDEgc2hv dWxkIGJlIGZhc3RlciBtZXRob2QgMi4gQnV0IGZhY3R1YWxseSwgbWV0aG9kIDIgaXMgbXVjaCBm YXN0ZXIgdGhhbiBtZXRob2QgMS4gV2h5ID8NCg0KDQo= --_000_7AEA68D8F5290344B43CE4F9B945C32C158B23EXCHANGE23qunarse_ Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: base64 PGh0bWwgeG1sbnM6dj0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp2bWwiIHhtbG5zOm89InVy bjpzY2hlbWFzLW1pY3Jvc29mdC1jb206b2ZmaWNlOm9mZmljZSIgeG1sbnM6dz0idXJuOnNjaGVt YXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6d29yZCIgeG1sbnM6bT0iaHR0cDovL3NjaGVtYXMubWlj cm9zb2Z0LmNvbS9vZmZpY2UvMjAwNC8xMi9vbW1sIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv VFIvUkVDLWh0bWw0MCI+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIg Y29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjxtZXRhIG5hbWU9IkdlbmVyYXRv ciIgY29udGVudD0iTWljcm9zb2Z0IFdvcmQgMTQgKGZpbHRlcmVkIG1lZGl1bSkiPg0KPHN0eWxl PjwhLS0NCi8qIEZvbnQgRGVmaW5pdGlvbnMgKi8NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6 5a6L5L2TOw0KCXBhbm9zZS0xOjIgMSA2IDAgMyAxIDEgMSAxIDE7fQ0KQGZvbnQtZmFjZQ0KCXtm b250LWZhbWlseTrlrovkvZM7DQoJcGFub3NlLTE6MiAxIDYgMCAzIDEgMSAxIDEgMTt9DQpAZm9u dC1mYWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJcGFub3NlLTE6MiAxNSA1IDIgMiAyIDQg MyAyIDQ7fQ0KQGZvbnQtZmFjZQ0KCXtmb250LWZhbWlseToiXEDlrovkvZMiOw0KCXBhbm9zZS0x OjIgMSA2IDAgMyAxIDEgMSAxIDE7fQ0KLyogU3R5bGUgRGVmaW5pdGlvbnMgKi8NCnAuTXNvTm9y bWFsLCBsaS5Nc29Ob3JtYWwsIGRpdi5Nc29Ob3JtYWwNCgl7bWFyZ2luOjBjbTsNCgltYXJnaW4t Ym90dG9tOi4wMDAxcHQ7DQoJdGV4dC1hbGlnbjpqdXN0aWZ5Ow0KCXRleHQtanVzdGlmeTppbnRl ci1pZGVvZ3JhcGg7DQoJZm9udC1zaXplOjEwLjVwdDsNCglmb250LWZhbWlseToiQ2FsaWJyaSIs InNhbnMtc2VyaWYiO30NCmE6bGluaywgc3Bhbi5Nc29IeXBlcmxpbmsNCgl7bXNvLXN0eWxlLXBy aW9yaXR5Ojk5Ow0KCWNvbG9yOmJsdWU7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQph OnZpc2l0ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQNCgl7bXNvLXN0eWxlLXByaW9yaXR5 Ojk5Ow0KCWNvbG9yOnB1cnBsZTsNCgl0ZXh0LWRlY29yYXRpb246dW5kZXJsaW5lO30NCnAuTXNv UGxhaW5UZXh0LCBsaS5Nc29QbGFpblRleHQsIGRpdi5Nc29QbGFpblRleHQNCgl7bXNvLXN0eWxl LXByaW9yaXR5Ojk5Ow0KCW1zby1zdHlsZS1saW5rOiLnuq/mlofmnKwgQ2hhciI7DQoJbXNvLW1h cmdpbi10b3AtYWx0OmF1dG87DQoJbWFyZ2luLXJpZ2h0OjBjbTsNCgltc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0bzsNCgltYXJnaW4tbGVmdDowY207DQoJZm9udC1zaXplOjEyLjBwdDsNCglmb250 LWZhbWlseTrlrovkvZM7fQ0Kc3Bhbi5FbWFpbFN0eWxlMTcNCgl7bXNvLXN0eWxlLXR5cGU6cGVy c29uYWw7DQoJZm9udC1mYW1pbHk6IkNhbGlicmkiLCJzYW5zLXNlcmlmIjsNCgljb2xvcjp3aW5k b3d0ZXh0O30NCnNwYW4uQ2hhcg0KCXttc28tc3R5bGUtbmFtZToi57qv5paH5pysIENoYXIiOw0K CW1zby1zdHlsZS1wcmlvcml0eTo5OTsNCgltc28tc3R5bGUtbGluazrnuq/mlofmnKw7DQoJZm9u dC1mYW1pbHk65a6L5L2TO30NCnNwYW4uRW1haWxTdHlsZTIwDQoJe21zby1zdHlsZS10eXBlOnBl cnNvbmFsLXJlcGx5Ow0KCWZvbnQtZmFtaWx5OiJDYWxpYnJpIiwic2Fucy1zZXJpZiI7DQoJY29s b3I6IzFGNDk3RDt9DQouTXNvQ2hwRGVmYXVsdA0KCXttc28tc3R5bGUtdHlwZTpleHBvcnQtb25s eTsNCglmb250LXNpemU6MTAuMHB0O30NCkBwYWdlIFdvcmRTZWN0aW9uMQ0KCXtzaXplOjYxMi4w cHQgNzkyLjBwdDsNCgltYXJnaW46NzIuMHB0IDkwLjBwdCA3Mi4wcHQgOTAuMHB0O30NCmRpdi5X b3JkU2VjdGlvbjENCgl7cGFnZTpXb3JkU2VjdGlvbjE7fQ0KLS0+PC9zdHlsZT48IS0tW2lmIGd0 ZSBtc28gOV0+PHhtbD4NCjxvOnNoYXBlZGVmYXVsdHMgdjpleHQ9ImVkaXQiIHNwaWRtYXg9IjEw MjYiIC8+DQo8L3htbD48IVtlbmRpZl0tLT48IS0tW2lmIGd0ZSBtc28gOV0+PHhtbD4NCjxvOnNo YXBlbGF5b3V0IHY6ZXh0PSJlZGl0Ij4NCjxvOmlkbWFwIHY6ZXh0PSJlZGl0IiBkYXRhPSIxIiAv Pg0KPC9vOnNoYXBlbGF5b3V0PjwveG1sPjwhW2VuZGlmXS0tPg0KPC9oZWFkPg0KPGJvZHkgbGFu Zz0iWkgtQ04iIGxpbms9ImJsdWUiIHZsaW5rPSJwdXJwbGUiIHN0eWxlPSJ0ZXh0LWp1c3RpZnkt dHJpbTpwdW5jdHVhdGlvbiI+DQo8ZGl2IGNsYXNzPSJXb3JkU2VjdGlvbjEiPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5Db3Vs ZCBzb21lb25lIGV4cGxhaW4gaXQgPyBUaGFua3MuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiIHN0eWxlPSJjb2xvcjojMUY0OTdE Ij48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8ZGl2Pg0KPGRpdiBzdHlsZT0iYm9yZGVy Om5vbmU7Ym9yZGVyLXRvcDpzb2xpZCAjQjVDNERGIDEuMHB0O3BhZGRpbmc6My4wcHQgMGNtIDBj bSAwY20iPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgYWxpZ249ImxlZnQiIHN0eWxlPSJ0ZXh0LWFs aWduOmxlZnQiPjxiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQtZmFtaWx5OuWu i+S9kyI+5Y+R5Lu25Lq6PHNwYW4gbGFuZz0iRU4tVVMiPjo8L3NwYW4+PC9zcGFuPjwvYj48c3Bh biBsYW5nPSJFTi1VUyIgc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk65a6L5L2T Ij4NCjwvc3Bhbj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEwLjBwdDtmb250LWZhbWlseTrlrovk vZMiPum6puagkeiNozxzcGFuIGxhbmc9IkVOLVVTIj4gW21haWx0bzpzaHVyb25nLm1haUBxdW5h ci5jb21dDQo8YnI+DQo8L3NwYW4+PGI+5Y+R6YCB5pe26Ze0PHNwYW4gbGFuZz0iRU4tVVMiPjo8 L3NwYW4+PC9iPjxzcGFuIGxhbmc9IkVOLVVTIj4gMjAxNTwvc3Bhbj7lubQ8c3BhbiBsYW5nPSJF Ti1VUyI+NDwvc3Bhbj7mnIg8c3BhbiBsYW5nPSJFTi1VUyI+Nzwvc3Bhbj7ml6U8c3BhbiBsYW5n PSJFTi1VUyI+IDExOjE5PGJyPg0KPC9zcGFuPjxiPuaUtuS7tuS6ujxzcGFuIGxhbmc9IkVOLVVT Ij46PC9zcGFuPjwvYj48c3BhbiBsYW5nPSJFTi1VUyI+IHVzZXJAaGFkb29wLmFwYWNoZS5vcmc8 YnI+DQo8L3NwYW4+PGI+5oqE6YCBPHNwYW4gbGFuZz0iRU4tVVMiPjo8L3NwYW4+PC9iPjxzcGFu IGxhbmc9IkVOLVVTIj4gPC9zcGFuPuWxseeRnuWzsDxzcGFuIGxhbmc9IkVOLVVTIj48YnI+DQo8 L3NwYW4+PGI+5Li76aKYPHNwYW4gbGFuZz0iRU4tVVMiPjo8L3NwYW4+PC9iPjxzcGFuIGxhbmc9 IkVOLVVTIj4gV2h5IHJlcGxpY2F0aW9uIG9mIFVuZGVyLVJlcGxpY2F0ZWQgYmxvY2tzIGluIGRl Y29tbWlzc2lvbmVkIGRhdGFub2RlcyBpcyBzbyBzbG93PG86cD48L286cD48L3NwYW4+PC9zcGFu PjwvcD4NCjwvZGl2Pg0KPC9kaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBhbGlnbj0ibGVmdCIg c3R5bGU9InRleHQtYWxpZ246bGVmdCI+PHNwYW4gbGFuZz0iRU4tVVMiPjxvOnA+Jm5ic3A7PC9v OnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIGxhbmc9IkVOLVVTIj52 ZXJzaW9uOiBoYWRvb3AtMi4yLjA8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIj48c3BhbiBsYW5nPSJFTi1VUyI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiPlRoZXJlIHdlcmUgMTMgbm9k ZXMgaW4gb3VyIGhkZnMgY2x1c3Rlci4gV2Ugd2FudGVkIHRvIGRlY29tbWlzc2lvbiA3IG5vZGVz LiBXZSB1c2VkIHR3byBtZXRob2RzIGFzIGZvbGxvdzo8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBsYW5nPSJFTi1VUyI+PG86cD4mbmJzcDs8L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiPk1ldGhv ZCAxOjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIGxh bmc9IkVOLVVTIj5BdCB0aGUgYmVnaW5uaW5nLCB3ZSBzZXQgdGhlIGRmcy5ob3N0cy5leGNsdWRl IHBhcmFtZXRlciBhbmQgc3VjY2Vzc2Z1bGx5IGRlY29tbWlzc2lvbmVkIDcgbm9kZXMsIHNvIHRo ZXJlIHdlcmUgbWFueSBVbmRlci1SZXBsaWNhdGVkIGJsb2NrcyBuZWVkIHRvIHJlcGxpY2F0ZS4g SG93ZXZlciwgaXQgc3BlbnQgYWJvdXQgMjAgaG91cnMgYW5kIHRoZSByZXBsaWNhdGlvbiBkaWRu 4oCZdA0KIGZpbmlzaCB5ZXQuIFdlIG9ic2VydmVkIHRoZSBzcGVlZCBvZiByZXBsaWNhdGlvbiBp cyB2ZXJ5IHNsb3cuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+ PHNwYW4gbGFuZz0iRU4tVVMiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIGxhbmc9IkVOLVVTIj5NZXRob2QgMjo8bzpwPjwvbzpwPjwvc3Bh bj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBsYW5nPSJFTi1VUyI+TGF0ZXIsIHdl IGdhdmUgdXAgdGhlIG1ldGhvZCwgYW5kIHVzZWQgYW5vdGhlciBtZXRob2Qgb2Ygc3RvcHBpbmcg ZGF0YW5vZGUgbm9kZSBieSBub2RlLiBXZSBzdG9wcGVkIG9uZSBkYXRhbm9kZS4gV2hlbiByZXBs aWNhdGlvbiBvZiBVbmRlci1SZXBsaWNhdGVkIGJsb2NrcyBvZiB0aGUgbm9kZSBmaW5pc2hlZCwg d2UgY29udGludWVkIHRvIHN0b3AgYW5vdGhlciBkYXRhbm9kZQ0KIHRpbGwgNyBub2RlcyB3ZXJl IHN0b3BwZWQuIEl0IHNwZW50IGFib3V0IDEyIGhvdXJzIGFuZCB0aGUgc3BlZWQgb2YgcmVwbGlj YXRpb24gaXMgb2J2aW91c2x5IG11Y2ggZmFzdGVyIHRoZSBtZXRob2QgMS48bzpwPjwvbzpwPjwv c3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBsYW5nPSJFTi1VUyI+PG86cD4m bmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0i RU4tVVMiPldlIHRob3VnaHQgbWV0aG9kIDEgc2hvdWxkIGJlIGZhc3RlciBtZXRob2QgMi4gQnV0 IGZhY3R1YWxseSwgbWV0aG9kIDIgaXMgbXVjaCBmYXN0ZXIgdGhhbiBtZXRob2QgMS4gV2h5ID88 bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvUGxhaW5UZXh0IiBzdHlsZT0ibWFy Z2luOjBjbTttYXJnaW4tYm90dG9tOi4wMDAxcHQiPjxzcGFuIGxhbmc9IkVOLVVTIj48bzpwPiZu YnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8L2Rpdj4NCjwvYm9keT4NCjwvaHRtbD4NCg== --_000_7AEA68D8F5290344B43CE4F9B945C32C158B23EXCHANGE23qunarse_--