hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From air <cnwe...@gmail.com>
Subject Fwd: Decommission process without deletion
Date Wed, 11 Apr 2012 04:47:34 GMT
---------- 已转发邮件 ----------
发件人: air <cnweike@gmail.com>
日期: 2012年4月11日 上午11:21
主题: Re: Decommission process without deletion
收件人: CDH Users <cdh-user@cloudera.org>


this is the log of last week's decommission log, the decommission  process
successfully at the end !

2012-03-28 14:18:12,429 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020)
Starting thread to transfer block blk_-5988161868320786448_405451 to 192.16
8.85.98:50010
2012-03-28 14:18:12,430 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020)
Starting thread to transfer block blk_-4840159203919666938_336712 to 192.16
8.85.102:50010
2012-03-28 14:18:12,450 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block
blk_-5623726625798347617_167375 src: /192.168.85.
97:46739 dest: /192.168.85.106:50010
2012-03-28 14:18:12,464 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Received block
blk_-5623726625798347617_167375 src: /192.168.85.9
7:46739 dest: /192.168.85.106:50010 of size 1321
2012-03-28 14:18:13,837 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075,
ipcPort=50020):Transmitted block blk_-5988161868320786448_405451 to /
192.168.85.98:50010
2012-03-28 14:18:13,911 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075,
ipcPort=50020):Transmitted block blk_-4840159203919666938_336712 to /
192.168.85.102:50010
2012-03-28 14:18:15,431 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-7595219335459687840_180028 file /data1/dfs/
data/current/subdir10/subdir50/blk_-7595219335459687840 for deletion
2012-03-28 14:18:15,432 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-4477867212286377943_214106 file /data/dfs/d
ata/current/subdir48/blk_-4477867212286377943 for deletion
2012-03-28 14:18:15,432 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-1891414201539663539_454306 file /data1/dfs/
data/current/subdir52/subdir4/subdir13/blk_-1891414201539663539 for deletion
*2012-03-28 14:18:15,432 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-400857555653086208_125812 file /data3/dfs/d*
*ata/current/subdir41/blk_-400857555653086208 for deletion*
*2012-03-28 14:18:15,433 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_3639319147299843291_395265 file /data1/dfs/d*
*ata/current/subdir56/blk_3639319147299843291 for deletion*
2012-03-28 14:18:15,433 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Deleted block
blk_-400857555653086208_125812 at file /data3/dfs/d
ata/current/subdir41/blk_-400857555653086208

在 2012年4月11日 上午11:17,air <cnweike@gmail.com>写道:

I want to decommission a data node from our cluster , when look at the data
> node page (50070) , *the node is in " Decommission In Progress  " ,but
> the total blocks on the data node do not decrease* ...
>
> I then trace the datanode's log something as follows printing , there is
> no scheduler to delete blocks, but when I decommission  a datanode last
> week , *that datanode's total blocks keep decreasing*..., is there
> something wrong ? or bugs ?:
>
> 2012-04-11 11:14:54,435 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6573017297751334656_168550 to /
> 192.168.85.98:50010
> 2012-04-11 11:14:55,241 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6575243939298789628_114035 to /
> 192.168.85.99:50010
> 2012-04-11 11:14:57,410 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6589031782005118375_649615 to 192.168.85.103:50010
> 2012-04-11 11:14:57,410 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6589952891904532767_468695 to 192.168.85.94:50010
> 2012-04-11 11:14:58,688 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6589952891904532767_468695 to /
> 192.168.85.94:50010
> 2012-04-11 11:14:58,752 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6589031782005118375_649615 to /
> 192.168.85.103:50010
> 2012-04-11 11:15:00,411 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6607872487411185264_383722 to 192.168.85.98:50010 192.168.85.99:50010
> 2012-04-11 11:15:00,411 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6608621128742038818_290623 to 192.168.85.99:50010
> 2012-04-11 11:15:02,245 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6608621128742038818_290623 to /
> 192.168.85.99:50010
> 2012-04-11 11:15:02,486 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6607872487411185264_383722 to /
> 192.168.85.98:50010
> 2012-04-11 11:15:03,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6619660552568522275_159052 to 192.168.85.92:50010
> 2012-04-11 11:15:03,414 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6619893588660468927_376751 to 192.168.85.93:50010 192.168.85.95:50010
>
> --
> 不学习,不知道
>
>


-- 
不学习,不知道




-- 
不学习,不知道

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message