hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dejan Menges <dejan.men...@gmail.com>
Subject Re: Cluster replication is not replicating any data
Date Tue, 28 Apr 2015 11:41:57 GMT
Maybe you missed some steps - I did it bunch of times following these steps
here:

http://hbase.apache.org/book.html#_cluster_replication

On Tue, Apr 28, 2015 at 1:39 PM Chandrashekhar Kotekar <
shekhar.kotekar@gmail.com> wrote:

> Yes. When replication did not worked then I copied 4 rows which were
> already present in primary cluster using copyTables program. Those 4 rows
> properly got copied into target cluster.
>
>
> Regards,
> Chandrash3khar Kotekar
> Mobile - +91 8600011455
>
> On Tue, Apr 28, 2015 at 4:48 PM, Dejan Menges <dejan.menges@gmail.com>
> wrote:
>
> > Hi,
> >
> > Did you copy the table that you want to replicate first to destination
> > cluster?
> >
> > Thanks,
> > Dejan
> >
> > On Tue, Apr 28, 2015 at 1:06 PM Chandrashekhar Kotekar <
> > shekhar.kotekar@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > I have setup cluster replication between 2 clusters but data is not
> > getting
> > > copied. Can anyone please help me in cluster replication?
> > >
> > > I would like to know if I add only 1 row in one of the tables then will
> > > that row get replicated in other cluster or HBase waits for some time
> or
> > > HBase waits before certain amount of data is added/deleted/edited (like
> > > 64MB)?
> > >
> > > Clusters are based on CDH 5.3.1 which have 0.98.6 version of HBase. I
> > have
> > > named slave nodes of both the clusters as slave1 and slave2 and master
> > > server is named as hbase-master (This setting is in /etc/hosts file).
> > >
> > > I took following steps to setup replication:
> > > 1) Set value of 'hbase.replication' property in 'hbase-site.xml' file
> to
> > > true in both the clusters
> > >
> > > 2) Restarted HBase master and all region servers of both the clusters.
> > > (Restarting needs to be done in any specifi order?? like master first
> > then
> > > region server or vice versa??)
> > >
> > > 3) Disabled, Altered all the tables in both the clusters by adding
> "{NAME
> > > => 'CF', REPLICATION_SCOPE => 1}" in alter statement, and then enabled
> > > tables one by one. (CF is actual column family name)
> > >
> > > 4) Added peer using "add_peer '1', '10.0.21.249:2181:/hbase' " in
> > primary
> > > cluster.
> > >
> > > 5) added peer using "add_peer 'nc' '10.0.21.111:/hbase '" in target
> > > cluster.
> > >
> > > 6) Primary cluster already has 4 rows. Added one more row having one
> > column
> > > for COMPANY_TABLE into primary cluster. So expecting either total 5
> rows
> > in
> > > target cluster or at least newly added row in target cluster. Waited
> few
> > > minutes for row to get replicated into other cluster. Executed scan
> > > 'table_name' command in target cluster but didnt get that row from
> > primary
> > > cluster.
> > >
> > > 7) Executed following verify replication command in primary cluster.
> This
> > > command runs m-r job and shows 4 good rows but in target cluster no row
> > > present for COMPANY_TABLE table.
> > >
> > > hbase org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication
> > > --families=CF nc COMPANY_TABLE
> > >
> > >
> > > There's no error in region server logs. Sample logs from primary
> > cluster's
> > > region server is as as below:
> > >
> > > 15/04/28 10:48:16 INFO regionserver.HRegionServer: Adding moved region
> > > record: 1a685b27708dfea86bb2d8a9ca1bceb5 to
> > > ip-10-0-21-90.ec2.internal,60020,1430217861644:60020 as of 4873480
> > > 15/04/28 10:51:06 INFO regionserver.Replication: Normal source for
> > cluster
> > > nc: Total replicated edits: 0, currently replicating from:
> > >
> > >
> >
> hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727
> > > at position: 83
> > >
> > > 15/04/28 10:56:06 INFO regionserver.Replication: Normal source for
> > cluster
> > > nc: Total replicated edits: 0, currently replicating from:
> > >
> > >
> >
> hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727
> > > at position: 83
> > >
> > > 15/04/28 11:01:06 INFO regionserver.Replication: Normal source for
> > cluster
> > > nc: Total replicated edits: 0, currently replicating from:
> > >
> > >
> >
> hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727
> > > at position: 83
> > >
> > > Regards,
> > > Chandrash3khar Kotekar
> > > Mobile - +91 8600011455
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message