hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rahul malviya <malviyarahul2...@gmail.com>
Subject Re: Snapshot Timing Out on a Large HBase Table
Date Fri, 08 May 2015 18:40:07 GMT
We have 16000 regions with approx 70 regions per regionserver.

Thanks,
Rahul

On Fri, May 8, 2015 at 11:25 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> How many regions do you have on this table, how many RS and how many
> regions per RS?
>
> JM
>
> 2015-05-08 14:21 GMT-04:00 Rahul Malviya <malviyarahul2001@gmail.com>:
>
> > Hi,
> >
> > I want to run MR job on snapshot of large HBase table but I am getting
> > timeout errors while doing so. Can you tell me what I am doing wrong ?
> >
> > I am using hbase-0.98.6-cdh5.2.0.
> >
> > hbase-site.xml
> > <property>
> >         <name>hbase.snapshot.master.timeoutMillis</name>
> >         <value>1800000</value>
> > </property>
> > <property>
> >         <name>hbase.snapshot.region.timeout</name>
> >         <value>1800000</value>
> > </property>
> > <property>
> >    <name>hbase.snapshot.enabled</name>
> >    <value>true</value>
> > </property>
> >
> > Error :
> > $ hbase shell
> > HBase Shell; enter 'help<RETURN>' for list of supported commands.
> > Type "exit<RETURN>" to leave the HBase Shell
> > Version 0.98.6-cdh5.2.0, rUnknown, Sat Oct 11 15:14:25 PDT 2014
> >
> > hbase(main):001:0> snapshot ’table','snapshot_test'
> > SLF4J: Class path contains multiple SLF4J bindings.
> > SLF4J: Found binding in
> >
> [jar:file:/ngs/app/awdp/RELEASE-5.2/hbase-0.98.6-cdh5.2.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: Found binding in
> >
> [jar:file:/ngs/app/awdp/RELEASE-5.2/hadoop-2.5.0-cdh5.2.0/share/hadoop/mapreduce1/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: Found binding in
> >
> [jar:file:/ngs/app/awdp/RELEASE-5.2/hadoop-2.5.0-cdh5.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
> > http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
> > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> >
> > ERROR: Snapshot 'snapshot_test' wasn't completed in expectedTime:60000 ms
> >
> > Here is some help for this command:
> > Take a snapshot of specified table. Examples:
> >
> >  hbase> snapshot 'sourceTable', 'snapshotName'
> >  hbase> snapshot 'namespace:sourceTable', 'snapshotName', {SKIP_FLUSH =>
> > true}
> >
> >
> > hbase(main):002:0>
> >
> > Thanks,
> > Rahul
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message