hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: How to increase scan speed in Hbase
Date Thu, 26 Nov 2015 15:02:02 GMT
Excerpt from hbase-shell//src/main/ruby/shell/commands/major_compact.rb :

          Examples:
          Compact all regions in a table:
          hbase> major_compact 't1'

Cheers

On Wed, Nov 25, 2015 at 10:00 PM, Rajeshkumar J <rajeshkumarit8292@gmail.com
> wrote:

> Hi Ted Yu,
>
>     No I have not major compacted the table. Can you tell me how to do this
> or suggest me a link.
>
> Thanks,
> RajeshKumar J
>
> On Wed, Nov 25, 2015 at 9:26 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > After loading the data, have you major compacted the table ?
> >
> > You can include STARTROW, STOPROW and TIMERANGE for your scan to narrow
> the
> > scope.
> >
> > FYI
> >
> > On Wed, Nov 25, 2015 at 2:36 AM, Rajeshkumar J <
> > rajeshkumarit8292@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > >
> > > I am new to Apache Hbase and I am using hbase-0.98.13 and I have
> created
> > a
> > > table sample with column family sample_family. And I have loaded the
> > output
> > > from pig script to hbase table. when I try to scan the table based on
> one
> > > of the column in column family it takes more than 2 minutes.
> > >
> > > Here is the query
> > >
> > > scan 'sample',
> > >
> {FILTER=>"SingleColumnValueFilter('sample_family','id',=,'binary:1000')"}
> > > Can any one tell me how to bring this process in one or two seconds?
> > >
> > > I have searched and most of the sites suggest me to change the default
> > > value of hbase.client.scanner.caching property and I have changed it
> too
> > > but there is no change in performance.
> > > Is there any configuration changes to be made for this? Can any one
> help
> > me
> > > in this?
> > >
> > > Regards,
> > > Rajeshkumar J
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message