hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jarod Feng <jar...@gmail.com>
Subject low performance on hadoop
Date Fri, 07 Nov 2008 08:21:37 GMT

Hi ,
I'm using hbase0.2.1 + hadoop 0.17 with 11 client & 1master servers
I crawl some data and save them to hbase with map & reduce.
after that , I try to count the total number of some data.
it too slow , you can see the monitor , 1 of clients have a high request ,
but others is 0.

S1:60020 1226025034218 requests: 0 regions: 5
S2:60020 1226025034364 requests: 0 regions: 5
S3:60020 1226025033874 requests: 0 regions: 5
S4:60020 1226025035074 requests: 5085 regions: 4
S5:60020 1226025034712 requests: 0 regions: 5
S6:60020 1226025034716 requests: 0 regions: 5
S7:60020 1226025034280 requests: 0 regions: 4
S8:60020 1226025034130 requests: 0 regions: 5
S9:60020 1226025033726 requests: 0 regions: 5
S10:60020 1226025034539 requests: 0 regions: 5
S11:60020 1226025034528 requests: 0 regions: 4

I don't know the reason , and when I use shell for count or use single
process without map-reduce , it's faster

I have use hadoop for many month , but this is my first time to develop
based hbase


Thanks,
-- 
View this message in context: http://www.nabble.com/low-performance-on-hadoop-tp20376261p20376261.html
Sent from the HBase User mailing list archive at Nabble.com.


Mime
View raw message