hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "HBase Review Board (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1511) Pseudo distributed mode in LocalHBaseCluster
Date Sat, 17 Jul 2010 00:11:49 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889427#action_12889427
] 

HBase Review Board commented on HBASE-1511:
-------------------------------------------

Message from: "Nicolas" <nspiegelberg@facebook.com>


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > This looks nice Nicolas.  Want to take care of the few below and I'll then commit?

I need to double-check to make sure that none of the ports will conflict at a low offset #.
 e.g.: shouldn't use 600+offset & 610+offset because it won't support more than 10 servers
then.  I think I saw that conflict last night, but just wanted to get some eyes/opinions on
this.


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > trunk/bin/local-master-backup.sh, line 1
bq.  > <http://review.hbase.org/r/328/diff/1/?file=2844#file2844line1>
bq.  >
bq.  >     Why is it called local-master-backup?  Should be a more descriptive name?  Its
the 'backup' that throws me off.  'local-masters'?
bq.  >

This JIRA also needs an associated wiki article change.  So, the workflow would be:

./bin/start-hbase.sh
./bin/local-master-backup start 1

I don't think you would want to use this file to start the original master, use start-hbase.sh
for that.  You primarily want to use this script to test master failover conditions.


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > trunk/bin/local-master-backup.sh, line 10
bq.  > <http://review.hbase.org/r/328/diff/1/?file=2844#file2844line10>
bq.  >
bq.  >     Explain 'offset' in this usage output?  (Seems to be port offset from default?)

offset is not only the port offset, but also an identifier for the logs.  The log for "./bin/local-master-backup.sh
start 1" would be located at logs/hbase-<user>-1-master-<server>.log

In an internal review, Kannan asked why you couldn't use "start 0", I thought offset would
help explain that issue.  opinions?


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > trunk/bin/local-master-backup.sh, line 23
bq.  > <http://review.hbase.org/r/328/diff/1/?file=2844#file2844line23>
bq.  >
bq.  >     Isn't the master default port 60000, not 60020?  60020 is RS default port?

oops. probably cut+paste error. can correct


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > trunk/conf/hbase-site.xml.psuedo-distributed, line 65
bq.  > <http://review.hbase.org/r/328/diff/1/?file=2846#file2846line65>
bq.  >
bq.  >     This is commented out because dfs.support.append doesn't work with local fs?

exactly


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > trunk/src/main/java/org/apache/hadoop/hbase/master/HMaster.java, line 637
bq.  > <http://review.hbase.org/r/328/diff/1/?file=2847#file2847line637>
bq.  >
bq.  >     You are adding a tab here?  Or white-space?

nasty editor! will fix


bq.  On 2010-07-16 13:39:10, stack wrote:
bq.  > trunk/src/main/java/org/apache/hadoop/hbase/master/HMaster.java, line 641
bq.  > <http://review.hbase.org/r/328/diff/1/?file=2847#file2847line641>
bq.  >
bq.  >     Add more comment in here... in particular on the '-splitting' suffix.  Where's
that come from?

ooops.  I had some stuff from HBASE-2312 sneak in.  I'll correct that


- Nicolas


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.hbase.org/r/328/#review414
-----------------------------------------------------------





> Pseudo distributed mode in LocalHBaseCluster
> --------------------------------------------
>
>                 Key: HBASE-1511
>                 URL: https://issues.apache.org/jira/browse/HBASE-1511
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.19.3
>            Reporter: Evgeny Ryabitskiy
>            Assignee: Nicolas Spiegelberg
>            Priority: Minor
>             Fix For: 0.92.0
>
>
> After changes to config and adding of parameter:
> {code}
>   <property>
>     <name>hbase.cluster.distributed</name>
>     <value>false</value>
>     <description>The mode the cluster will be in. Possible values are
>       false: standalone and pseudo-distributed setups with managed Zookeeper
>       true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh)
>     </description>
>   </property>
> {code}
> running HBase in pseudo destr mode become not so easy, I think description for false
variant is wrong and you can't get pseudo-distributed mode setting this option to false now.
> I wish to have some option in LocalHBaseCluster for pseudo destr mode where I wish to
have:
>  * separate processes for Master and HRSs
>  * ability to dynamically change HRS number in cluster
>  * managed ZK cluster (like it is in local mode now)
>  * managed small local HDFS cluster
> I think it is very useful for testing, debugging and for user experience with HBase,
who want to try something close to real HBase not some emulation in standalone mode.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message