hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lars hofhansl <la...@apache.org>
Subject Re: Sudden increase in disk utilization
Date Thu, 17 Oct 2013 17:48:51 GMT
Are you using any compression?

 From: Vimal Jain <vkjk89@gmail.com>
To: user@hbase.apache.org 
Sent: Thursday, October 17, 2013 6:15 AM
Subject: Sudden increase in disk utilization

I have configured Hbase in pseudo distributed mode.
I have only one table in hbase (event_data).
When i run following command it shows that this table has utilized  8.38 GB.

Command :-
*[hadoop@woody logs]$ $HBASE_HOME/bin/hbase org.jruby.Main ~/dus.rb

O/P :-
*Warning: $HADOOP_HOME is deprecated.

hdfs://    8.38 GB

where dus.rb is

*include Java
import org.apache.hadoop.util.StringUtils
path = ARGV[0]
dus = %x[$HADOOP_HOME/bin/hadoop fs -dus #{path}]
splited = dus.split
byteDesc = StringUtils.byteDesc(splited[1].to_i)
puts splited[0] + "\t" + byteDesc*

In short hbase command shows that disk utilized is around 9 GB but actual
file system usage is 30 GB.
However this difference vanishes if i restart my Hbase.
I am not able to understand this.
Does Hbase keeps lot of files ( in GBs ) open while working ?
Thanks and Regards,
Vimal Jain
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message