hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matteo Bertozzi <theo.berto...@gmail.com>
Subject Re: WALPlayer?
Date Tue, 11 Feb 2014 19:42:52 GMT
I think that the problem here is that you're trying to replay the WAL for
TestTable-clone entries..
which are not present... you probably want to replay the entries from the
original TestTable.

I think that you can specify a mapping.. something like WalPlayer TestTable
TestTable-cloned

Matteo



On Tue, Feb 11, 2014 at 7:37 PM, Tianying Chang <tychang@gmail.com> wrote:

> I am trying to use snapshot+WALPlayer for HBase DR for our cluster in AWS.
>  I am trying to do below to verify it, seems the new data is not being
> played into the new table. Anything wrong with my steps?
> 1. Populate TestTable using PeformanceEvaluation Tool
> 2. count the rows being written, 63277 row(s)
> 3. take a snapshot, then clone a table TestTable-cloned based on this
> snapshot. Count the row # and verified that is has same number of rows as
> TestTable
> 4. write more data to TestTable using PerformanceEvaluation
> 5. count the row of TestTable, which has more rows.
> 6. call WALPlayer: su tychang hbase
> org.apache.hadoop.hbase.mapreduce.WALPlayer /hbase/.logs TestTable-cloned
> 7. count the row of TestTable-cloned. Find the row count is not changed,
> still 63277 row(s) :(
>
> I suspect that the WAL is not rolled yet, so  WALPlayer cannot replay those
> data. So I populated more data to make sure the WAL log rolled.(I can see
> the count of hlogs increased by 10) But still, after running WALPlayer, the
> rowCount is not changed. Any idea? Can WALPlayer work with Snapshot?
>
> Thanks
> Tian-Ying
>
>
> On Fri, Feb 7, 2014 at 10:31 AM, Tianying Chang <tychang@gmail.com> wrote:
>
> > Hi, Lars
> >
> > Sure. I will come back and update the thread.
> >
> > Thanks
> > Tian-Ying
> >
> >
> > On Fri, Feb 7, 2014 at 10:17 AM, lars hofhansl <larsh@apache.org> wrote:
> >
> >> Let me know how this works for you.
> >> I wrote that tool a while ago, but I ended up never actually using
> myself.
> >>
> >> -- Lars
> >>
> >>
> >>
> >> ________________________________
> >>  From: Tianying Chang <tychang@gmail.com>
> >> To: user@hbase.apache.org
> >> Sent: Thursday, February 6, 2014 10:06 PM
> >> Subject: Re: WALPlayer?
> >>
> >>
> >> Never mind. Should use hbase command. :)
> >>
> >> Thanks
> >> Tian-Ying
> >>
> >>
> >>
> >> On Thu, Feb 6, 2014 at 9:53 PM, Tianying Chang <tychang@gmail.com>
> wrote:
> >>
> >> > Hi, folks
> >> >
> >> > I want to try the WALPlayer. But it complains not found. Am I running
> it
> >> > the wrong way?
> >> >
> >> > Thanks
> >> > Tian-Ying
> >> >
> >> > hadoop jar /tmp/hbase-0.94.17-SNAPSHOT.jar WALPlayer
> >> >
> >> > Unknown program 'WALPlayer' chosen.
> >> >
> >> > Valid program names are:
> >> >
> >> >   CellCounter: Count cells in HBase table
> >> >
> >> >   completebulkload: Complete a bulk data load.
> >> >
> >> >   copytable: Export a table from local cluster to peer cluster
> >> >
> >> >   export: Write table data to HDFS.
> >> >
> >> >   import: Import data written by Export.
> >> >
> >> >   importtsv: Import data in TSV format.
> >> >
> >> >   rowcounter: Count rows in HBase table
> >> >
> >> >   verifyrep: Compare the data from tables in two different clusters.
> >> > WARNING: It doesn't work for incrementColumnValues'd cells since the
> >> > timestamp is changed after being appended to the log.
> >> >
> >>
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message