hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rahul malviya <malviyarahul2...@gmail.com>
Subject Re: Snapshot Timing Out on a Large HBase Table
Date Fri, 08 May 2015 18:48:42 GMT
Sure. It took 16 seconds.

hbase(main):003:0> flush 'table'
0 row(s) in 16.5600 seconds

On Fri, May 8, 2015 at 11:44 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Can you try to flush you table from the shell and see how long it takes?
> Don't test in prod of course ;)
> Le 2015-05-08 11:40, "rahul malviya" <malviyarahul2001@gmail.com> a écrit
> :
>
> > We have 16000 regions with approx 70 regions per regionserver.
> >
> > Thanks,
> > Rahul
> >
> > On Fri, May 8, 2015 at 11:25 AM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > How many regions do you have on this table, how many RS and how many
> > > regions per RS?
> > >
> > > JM
> > >
> > > 2015-05-08 14:21 GMT-04:00 Rahul Malviya <malviyarahul2001@gmail.com>:
> > >
> > > > Hi,
> > > >
> > > > I want to run MR job on snapshot of large HBase table but I am
> getting
> > > > timeout errors while doing so. Can you tell me what I am doing wrong
> ?
> > > >
> > > > I am using hbase-0.98.6-cdh5.2.0.
> > > >
> > > > hbase-site.xml
> > > > <property>
> > > >         <name>hbase.snapshot.master.timeoutMillis</name>
> > > >         <value>1800000</value>
> > > > </property>
> > > > <property>
> > > >         <name>hbase.snapshot.region.timeout</name>
> > > >         <value>1800000</value>
> > > > </property>
> > > > <property>
> > > >    <name>hbase.snapshot.enabled</name>
> > > >    <value>true</value>
> > > > </property>
> > > >
> > > > Error :
> > > > $ hbase shell
> > > > HBase Shell; enter 'help<RETURN>' for list of supported commands.
> > > > Type "exit<RETURN>" to leave the HBase Shell
> > > > Version 0.98.6-cdh5.2.0, rUnknown, Sat Oct 11 15:14:25 PDT 2014
> > > >
> > > > hbase(main):001:0> snapshot ’table','snapshot_test'
> > > > SLF4J: Class path contains multiple SLF4J bindings.
> > > > SLF4J: Found binding in
> > > >
> > >
> >
> [jar:file:/ngs/app/awdp/RELEASE-5.2/hbase-0.98.6-cdh5.2.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > SLF4J: Found binding in
> > > >
> > >
> >
> [jar:file:/ngs/app/awdp/RELEASE-5.2/hadoop-2.5.0-cdh5.2.0/share/hadoop/mapreduce1/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > SLF4J: Found binding in
> > > >
> > >
> >
> [jar:file:/ngs/app/awdp/RELEASE-5.2/hadoop-2.5.0-cdh5.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
> > > > http://www.slf4j.org/codes.html#multiple_bindings> for an
> explanation.
> > > > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> > > >
> > > > ERROR: Snapshot 'snapshot_test' wasn't completed in
> expectedTime:60000
> > ms
> > > >
> > > > Here is some help for this command:
> > > > Take a snapshot of specified table. Examples:
> > > >
> > > >  hbase> snapshot 'sourceTable', 'snapshotName'
> > > >  hbase> snapshot 'namespace:sourceTable', 'snapshotName', {SKIP_FLUSH
> > =>
> > > > true}
> > > >
> > > >
> > > > hbase(main):002:0>
> > > >
> > > > Thanks,
> > > > Rahul
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message