hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: Waiting forever on scanner iterator
Date Tue, 20 Oct 2009 20:44:09 GMT
If you have a very slow data source (S3), then it fetches 100 row
before coming back to your client with all of them and that can take a
lot of time. Also make sure that 100 of your rows can fit in a region
server's memory. How big is each row?

J-D

On Tue, Oct 20, 2009 at 1:32 PM, Ananth T. Sarathy
<ananth.t.sarathy@gmail.com> wrote:
> I am running this code where
>
> getScannerForAllRows(columns) just does return table.getScanner(columns);
>
> and the table   has setScannerCaching(100);
>
> But it spins forever after getting the iterator. Why would that be? How can
> I speed it up?
>
>        HBaseTableDataManagerImpl htdmni = new HBaseTableDataManagerImpl(
>                "GS_Applications");
>
>        String[] columns = { "Files:Name" };
>        log.info("Getting all Rows with Files");
>        Scanner s = htdmni.getScannerForAllRows(columns);
>        log.info("Got all Rows with Files");
>        log.info("Getting Iterator");
>
>        Iterator<RowResult> iter = s.iterator();
>        log.info("Got Iterator");
>
>        while (iter.hasNext())
>        {
>            log.info("Getting next Row");
>            RowResult rr = iter.next();
>
>
> Ananth T Sarathy
>

Mime
View raw message