hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zbigniew Kostrzewa (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-13128) HDFS balancer in single node cluster fails with "Another Balancer is running.."
Date Fri, 09 Feb 2018 07:29:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-13128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zbigniew Kostrzewa updated HDFS-13128:
--------------------------------------
    Description: 
In a single node "cluster", HDFS balancer fails with:
{noformat}
Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved
java.io.IOException: Another Balancer is running.. Exiting ...
{noformat}
and in Name Node logs there is:
{noformat}
2018-02-09 07:23:21,671 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741865_1041{UCState=UNDER_CONSTRUCTION,
truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dae233d3-5c71-498e-9a8b-669bff3fccdf:NORMAL:10.9.4.184:30010|RBW]]}
for /system/balancer.id
2018-02-09 07:23:21,739 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* fsync: /system/balancer.id
for DFSClient_NONMAPREDUCE_-1126407107_1
2018-02-09 07:23:21,758 WARN org.apache.hadoop.hdfs.StateChange: DIR* NameSystem.append: Failed
to APPEND_FILE /system/balancer.id for DFSClient_NONMAPREDUCE_1275100437_1 on 10.9.4.184 because
this file lease is currently owned by DFSClient_NONMAPREDUCE_-1126407107_1 on 10.9.4.184
2018-02-09 07:23:21,758 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 8020, call
org.apache.hadoop.hdfs.protocol.ClientProtocol.append from 10.9.4.184:49781 Call#12 Retry#0:
org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: Failed to APPEND_FILE /system/balancer.id
for DFSClient_NONMAPREDUCE_1275100437_1 on 10.9.4.184 because this file lease is currently
owned by DFSClient_NONMAPREDUCE_-1126407107_1 on 10.9.4.184
2018-02-09 07:23:21,773 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.9.4.184:30010
is added to blk_1073741865_1041{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1,
replicas=[ReplicaUC[[DISK]DS-dae233d3-5c71-498e-9a8b669bff3fccdf:NORMAL:10.9.4.184:30010|RBW]]}
size 15
2018-02-09 07:23:21,776 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /system/balancer.id
is closed by DFSClient_NONMAPREDUCE_-1126407107_1{noformat}

  was:
In a single node "cluster", HDFS balancer fails with:
{noformat}
Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved
java.io.IOException: Another Balancer is running.. Exiting ...
{noformat}
and in Name Node logs there is:
{noformat}
2018-02-09 07:23:21,671 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741865_1041{UCState=UNDER_CONSTRUCTION,
truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[
DISK]DS-dae233d3-5c71-498e-9a8b-669bff3fccdf:NORMAL:10.9.4.184:30010|RBW]]} for /system/balancer.id
2018-02-09 07:23:21,739 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* fsync: /system/balancer.id
for DFSClient_NONMAPREDUCE_-1126407107_1
2018-02-09 07:23:21,758 WARN org.apache.hadoop.hdfs.StateChange: DIR* NameSystem.append: Failed
to APPEND_FILE /system/balancer.id for DFSClient_NONMAPREDUCE_1275100437_1 on 10.9.4.184 because
this file lease is currently owned by DFSClient_NONMAPREDUCE_-1126407107_1 on 10.9.4.184
2018-02-09 07:23:21,758 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 8020, call
org.apache.hadoop.hdfs.protocol.ClientProtocol.append from 10.9.4.184:49781 Call#12 Retry#0:
org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: Failed to APPEND_FILE /system/balancer.id
for DFSClient_NONMAPREDUCE_1275100437_1 on 10.9.4.184 because this file lease is currently
owned by DFSClient_NONMAPREDUCE_-1126407107_1 on 10.9.4.184
2018-02-09 07:23:21,773 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.9.4.184:30010
is added to blk_1073741865_1041{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1,
replicas=[ReplicaUC[[DISK]DS-dae233d3-5c71-498e-9a8b669bff3fccdf:NORMAL:10.9.4.184:30010|RBW]]}
size 15
2018-02-09 07:23:21,776 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /system/balancer.id
is closed by DFSClient_NONMAPREDUCE_-1126407107_1{noformat}


> HDFS balancer in single node cluster fails with "Another Balancer is running.."
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-13128
>                 URL: https://issues.apache.org/jira/browse/HDFS-13128
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: balancer &amp; mover, hdfs
>    Affects Versions: 2.7.3
>            Reporter: Zbigniew Kostrzewa
>            Priority: Minor
>
> In a single node "cluster", HDFS balancer fails with:
> {noformat}
> Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved
> java.io.IOException: Another Balancer is running.. Exiting ...
> {noformat}
> and in Name Node logs there is:
> {noformat}
> 2018-02-09 07:23:21,671 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741865_1041{UCState=UNDER_CONSTRUCTION,
truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dae233d3-5c71-498e-9a8b-669bff3fccdf:NORMAL:10.9.4.184:30010|RBW]]}
for /system/balancer.id
> 2018-02-09 07:23:21,739 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* fsync: /system/balancer.id
for DFSClient_NONMAPREDUCE_-1126407107_1
> 2018-02-09 07:23:21,758 WARN org.apache.hadoop.hdfs.StateChange: DIR* NameSystem.append:
Failed to APPEND_FILE /system/balancer.id for DFSClient_NONMAPREDUCE_1275100437_1 on 10.9.4.184
because this file lease is currently owned by DFSClient_NONMAPREDUCE_-1126407107_1 on 10.9.4.184
> 2018-02-09 07:23:21,758 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 8020,
call org.apache.hadoop.hdfs.protocol.ClientProtocol.append from 10.9.4.184:49781 Call#12 Retry#0:
org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: Failed to APPEND_FILE /system/balancer.id
for DFSClient_NONMAPREDUCE_1275100437_1 on 10.9.4.184 because this file lease is currently
owned by DFSClient_NONMAPREDUCE_-1126407107_1 on 10.9.4.184
> 2018-02-09 07:23:21,773 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated:
10.9.4.184:30010 is added to blk_1073741865_1041{UCState=UNDER_CONSTRUCTION, truncateBlock=null,
primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dae233d3-5c71-498e-9a8b669bff3fccdf:NORMAL:10.9.4.184:30010|RBW]]}
size 15
> 2018-02-09 07:23:21,776 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /system/balancer.id
is closed by DFSClient_NONMAPREDUCE_-1126407107_1{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message