hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ophir Etzion <op...@foursquare.com>
Subject wrong remaining space reported by Data Nodes
Date Fri, 22 Jul 2016 13:32:43 GMT
Hi,

I have a cluster with about 200 Data Nodes.
when doing `hdfs dfsadmin -report` all nodes report less remaining space
then exists on the disks (as seen by 'df -h' on the data node machine).
it is less by about 2TB in every machine.
when restarting a DataNode it calculates the remaining space well again and
we get the 2TB back as remaining space.

any idea why this difference in the remaining space happens and how I can
solve it? (something other than doing a rolling restart on the nodes every
time this happens)

Thank you,
Ophir

Mime
View raw message