hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Parallel scan on regions only
Date Tue, 12 Apr 2016 15:25:05 GMT
On Tue, Apr 12, 2016 at 3:15 AM, Davide Spataro <davide90.spataro@gmail.com>
wrote:

> ...
> What I would like to do is to perform the same scan operation on all
> regions in parallel and fetch their result to the corresponding renderer.
>


> I'm trying to implement this mechanism using endpoint coprocessors .
> Basically each coprocessor receives the same scan query, performs it
> locally (at  region level) and send data  to a specific  rendering process
> over network (using sockets).
>
> Do you have guys  any better advice on how  to implement this in hbase?
>
>

Sounds like Admin#getTableRegions(TableName) which returns info on each
region in a table and then setting up a Scan per Region is not what you
want; you are trying to save a hop by having writing your rendering app
rather than return to the client and then to the rendering process?

St.Ack



> Thanks,
>
> Davide
>
> P.S. I'm running hbase 1.2 on top of hadoop 2.7
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message