hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From llpind <sonny_h...@hotmail.com>
Subject Re: Adding/Removing regionservers
Date Thu, 02 Jul 2009 17:28:06 GMT

Is there a relation between # of regionservers to performance of scanners?

Say I have 6 boxes and I up to 12, will I see much improvement?


Jonathan Gray-2 wrote:
> 
> Depends on the use case.
> 
> Generally most clusters colocate DataNodes and RegionServers, so an 
> equal number.
> 
> 
> llpind wrote:
>> Okay looks like it worked that way.  
>> 
>> Thanks.
>> 
>> What is recommended?  datanodes to regionservers?   Is it best to have
>> equal
>> # or diff?
>> 
>> 
>> 
>> Jonathan Gray-2 wrote:
>>> You do not need to restart the system to add or remove regionservers (or 
>>> hdfs datanodes).
>>>
>>> You should update your files, yes.  But to add a new regionserver, set 
>>> up all of the configuration files like the other nodes, and then start 
>>> it up:
>>>
>>> $HBASE_HOME/bin/hbase-daemon.sh start regionserver
>>>
>>>
>>> Without seeing what was happening prior to the Scanner expiration in the 
>>> regionserver logs, it's hard to tell what the problem is.  Can you post 
>>> the full logs somewhere?
>>>
>>> JG
>>>
>>> llpind wrote:
>>>> Hey Guys,
>>>>
>>>> What do I need to do to add regionservers?  I thought all I had to do
>>>> was
>>>> modify the regionservers file.  I've added another box, and updated the
>>>> regionservers file (and Hadoop slaves), restarted hadoop/hbase cluster,
>>>> and
>>>> receive the following when trying to access data via scanner:
>>>>
>>>> 09/07/02 09:10:02 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 0 time(s).
>>>> 09/07/02 09:10:03 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 1 time(s).
>>>> 09/07/02 09:10:04 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 2 time(s).
>>>> 09/07/02 09:10:05 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 3 time(s).
>>>> 09/07/02 09:10:06 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 4 time(s).
>>>> 09/07/02 09:10:07 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 5 time(s).
>>>> 09/07/02 09:10:08 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 6 time(s).
>>>> 09/07/02 09:10:09 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 7 time(s).
>>>> 09/07/02 09:10:10 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 8 time(s).
>>>> 09/07/02 09:10:11 INFO ipc.HBaseClient: Retrying connect to server:
>>>> /192.168.0.222:60020. Already tried 9 time(s).
>>>> 09/07/02 09:10:11 INFO ipc.HbaseRPC: Server at /192.168.0.222:60020 not
>>>> available yet, Zzzzz...
>>>>
>>>>
>>>> on the box: =======================================================
>>>>
>>>> 2009-07-02 08:59:59,265 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 2646315558964059972 lease expired
>>>> 2009-07-02 08:59:59,272 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 1810370986171440259 lease expired
>>>> 2009-07-02 08:59:59,273 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -4857942742243144770 lease expired
>>>> 2009-07-02 08:59:59,288 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 3123162276497438016 lease expired
>>>> 2009-07-02 08:59:59,289 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 608738648389654018 lease expired
>>>> 2009-07-02 08:59:59,296 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -2521940152150106398 lease expired
>>>> 2009-07-02 08:59:59,297 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 8091669741182809260 lease expired
>>>> 2009-07-02 08:59:59,304 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 7639149275918227842 lease expired
>>>> 2009-07-02 08:59:59,305 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -4243449001964507288 lease expired
>>>> 2009-07-02 08:59:59,336 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 1015989167671983355 lease expired
>>>> 2009-07-02 08:59:59,365 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 3137801875907893411 lease expired
>>>> 2009-07-02 08:59:59,365 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -8325694931774559300 lease expired
>>>> 2009-07-02 08:59:59,372 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -8936585826880409980 lease expired
>>>> 2009-07-02 08:59:59,373 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -908187178943291682 lease expired
>>>> 2009-07-02 08:59:59,380 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 2654166457442359069 lease expired
>>>> 2009-07-02 08:59:59,381 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -6211248022427672712 lease expired
>>>> 2009-07-02 08:59:59,381 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 3974694446665362397 lease expired
>>>> 2009-07-02 08:59:59,388 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 7443667809791934770 lease expired
>>>> 2009-07-02 08:59:59,389 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableA,954242,1245722360640
>>>> 2009-07-02 08:59:59,390 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableA,4603057,1245718674937
>>>> 2009-07-02 08:59:59,390 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableB,DATA\x7DATA\x20DATA\x7C1113950,1245707506310
>>>> 2009-07-02 08:59:59,391 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableB,NAME\x7DATA,\x20DATA\x7C440700,1245711086612
>>>> 2009-07-02 08:59:59,391 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableC,NAME\x7DATA,\x20DATA\x7C1304895,1246039336150
>>>> 2009-07-02 08:59:59,391 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableA,9320921,1245722360640
>>>> 2009-07-02 08:59:59,392 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableB,,1245707233007
>>>> 2009-07-02 08:59:59,392 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableA,706403,1245720721671
>>>> 2009-07-02 08:59:59,393 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableB,DATA\x7CTV\x20DATA\x7C1624424,1245711676808
>>>> 2009-07-02 08:59:59,393 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableA,3809913,1245718111373
>>>> 2009-07-02 09:00:02,049 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -2051187117514067432 lease expired
>>>> 2009-07-02 09:00:02,057 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -5436750646911643669 lease expired
>>>> 2009-07-02 09:00:02,057 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 3703189751852364720 lease expired
>>>> 2009-07-02 09:00:02,065 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -1804107906626216054 lease expired
>>>> 2009-07-02 09:00:02,065 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegion:
>>>> Closed tableA,1578094,1245716374054
>>>> 2009-07-02 09:00:03,693 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 9131595104858116429 lease expired
>>>> 2009-07-02 09:00:03,693 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 8992759827427237274 lease expired
>>>> 2009-07-02 09:00:03,693 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -2019578407247616091 lease expired
>>>> 2009-07-02 09:00:03,709 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> 3596045071882952182 lease expired
>>>> 2009-07-02 09:00:03,753 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -7795892844843445855 lease expired
>>>> 2009-07-02 09:00:03,789 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -3894684572515627828 lease expired
>>>> 2009-07-02 09:00:12,649 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
>>>> -2055258947739971980 lease expired
>>>> 2009-07-02 09:00:12,650 INFO org.apache.hadoop.hbase.Leases:
>>>> regionserver/0.0.0.0:60020.leaseChecker closing leases
>>>> 2009-07-02 09:00:12,650 INFO org.apache.hadoop.hbase.Leases:
>>>> regionserver/0.0.0.0:60020.leaseChecker closed leases
>>>> 2009-07-02 09:02:29,906 INFO
>>>> org.apache.hadoop.hbase.regionserver.HRegionServer: compactions no
>>>> longer
>>>> limited
>>>
>> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Adding-Removing-regionservers-tp24309642p24310867.html
Sent from the HBase User mailing list archive at Nabble.com.


Mime
View raw message