hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans" <jdcry...@gmail.com>
Subject Re: Map Reduce Jobs With Memory Cached Tables
Date Fri, 29 Aug 2008 20:32:25 GMT
Jeff,

Sorry for the late answer. Even though you can define families to be
IN_MEMORY in HBase, this feature is still not implemented. If it was and if
the map tasks were appointed the right region servers (holding the region
bundled to each map), I think this would solve your problem.

J-D

On Thu, Aug 28, 2008 at 3:21 PM, Jeff Payne <jeffp@eyealike.com> wrote:

> Greetings:
>
>
> I have a map reduce job based on TableMap that takes a single memory cached
> column on a single table as an input (all rows, of course).  What we need
> to
> have happen is to have the system create a separate map job for each region
> of the table and run in such a way that the input for the map job comes
> straight out of memory instead of being streamed over the network from a
> region server.
>
> Is this possible?  How might one do this?
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message