hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From varshar <varsha.raveend...@gmail.com>
Subject Calculate number of records in write buffer
Date Wed, 30 Jul 2014 10:34:55 GMT

We are writing a billion records into HBase using multiple clients. Each
client is multithreaded.
Autoflush is set to false and the write buffer size = 12MB. 

The WriteRequestCount metric is incremented by only 1 for one batch insert
and not by the number of records inserted.* Is there any API/method to
calculate the total number of puts in the write buffer before it is flushed?

We need to calculate how many writes are actually happening at every second. 

Another reason is to see whether all the records inserted from the client
side is actually inserted into the data store without any data loss (at
every second). 

Any suggestions are welcome. 


View this message in context: http://apache-hbase.679495.n3.nabble.com/Calculate-number-of-records-in-write-buffer-tp4062088.html
Sent from the HBase User mailing list archive at Nabble.com.

View raw message