hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Parallel scan on regions only
Date Tue, 12 Apr 2016 15:25:05 GMT
On Tue, Apr 12, 2016 at 3:15 AM, Davide Spataro <davide90.spataro@gmail.com>

> ...
> What I would like to do is to perform the same scan operation on all
> regions in parallel and fetch their result to the corresponding renderer.

> I'm trying to implement this mechanism using endpoint coprocessors .
> Basically each coprocessor receives the same scan query, performs it
> locally (at  region level) and send data  to a specific  rendering process
> over network (using sockets).
> Do you have guys  any better advice on how  to implement this in hbase?

Sounds like Admin#getTableRegions(TableName) which returns info on each
region in a table and then setting up a Scan per Region is not what you
want; you are trying to save a hop by having writing your rendering app
rather than return to the client and then to the rendering process?


> Thanks,
> Davide
> P.S. I'm running hbase 1.2 on top of hadoop 2.7

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message