hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From N Dm <nid...@gmail.com>
Subject Replication is on columnfamily level or table level?
Date Tue, 04 Jun 2013 22:01:09 GMT
hi, folks,

<hbase 0.94.3>

By reading several documents, I always have the impression that *
"Replication* works at the table-*column*-*family level*". However, when I
am setting up a table with two columnfamilies and replicate them to two
different slavers, the whole table replicated. Is this a bug? Thanks

Here is the simple steps to receate.

*Environment: *
Replication Master: hdtest014
Replication Slave 1: hdtest017
Replication Slave 2: hdtest009

*Create Table*: on Master, and the two slaves:  create 't2_dn','cf1','cf2'

*setup replication on Master*(hdtest014), so that
Master> list_peers
 PEER_ID CLUSTER_KEY STATE
 1 hdtest017.svl.ibm.com:2181:/hbase ENABLED
 2 hdtest009.svl.ibm.com:2181:/hbase ENABLED
Master> > describe 't2_dn'
DESCRIPTION
ENABLED
 {NAME => 't2_dn', FAMILIES => [{*NAME => 'cf1', REPLICATION_SCOPE => '1'*,
KEEP_DELETED_CELLS => 'fals
true
 e', COMPRESSION => 'NONE', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true',
MIN_VERSIONS => '0',
DATA
 _BLOCK_ENCODING => 'NONE', IN_MEMORY => 'false', BLOOMFILTER => 'NONE',
TTL => '2147483647',
VERSION
 S => '3', BLOCKSIZE => '65536'}, {*NAME => 'cf2', REPLICATION_SCOPE => '2'*,
KEEP_DELETED_CELLS =>
'fa
 lse', COMPRESSION => 'NONE', ENCODE_ON_DISK => 'true', BLOCKCACHE =>
'true', MIN_VERSIONS => '0',
DA
 TA_BLOCK_ENCODING => 'NONE', IN_MEMORY => 'false', BLOOMFILTER => 'NONE',
TTL => '2147483647',
VERSI
 ONS => '3', BLOCKSIZE =>
'65536'}]}

1 row(s) in 0.0250 seconds

*Put rows into t2_dn on Master*
put 't2_dn','row1','cf1:q1','val1cf1fromMaster'
put 't2_dn','row1','cf2:q1','val1cf2fromMaster'
put 't2_dn','row2','cf1:q1','val2cf1fromMaster'
put 't2_dn','row3','cf2:q1','val3cf2fromMaster'

*Expecting cf1 replicated to slave1, and cf2 replicatedto slave2. Where all
the three clusters got: *
scan 't2_dn'
ROW
COLUMN+CELL

 row1                          column=cf1:q1, timestamp=1370382328358,
value=val1cf1fromMaster
 row1                          column=cf2:q1, timestamp=1370382334303,
value=val1cf2fromMaster
 row2                          column=cf1:q1, timestamp=1370382351716,
value=val2cf1fromMaster
 row3                          column=cf2:q1, timestamp=1370382367724,
value=val3cf2fromMaster
3 row(s) in 0.0160 seconds

Many thanks

Demai

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message