hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Giorgi Jvaridze <giorgi.jvari...@gmail.com>
Subject Decreasing write speed over time
Date Mon, 18 Jun 2012 13:58:08 GMT
Hello list,

I have Hbase (CDH4) setup of a master and 4 region servers (8 core 2.0GHz,
6GB of RAM and 6 100GB disks per data node). All of them are virtual
machines.

I'm writing into a table using single thread w/ auto flush off.
Ids are increased by one and then reversed. Data is a string with average
length 150 chars.

I'm measuring time needed for writing one million rows. At first I got
quite good results, it could write about 40-50K rows in a second but after
time this speed decreased.
I have a chart showing how It has been decreased by the time and data got
bigger. At the end of chart it's about 2 billion rows inserted.

http://i.minus.com/iRFtEoVJVsFso.png

Is this expected behavior for this kind of setup or something could went
wrong and I should check it up?

Thanks!

Giorgi

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message