hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrzej Jan Taramina <andr...@chaeron.com>
Subject Re: Storing contents of a file in a java object
Date Thu, 01 Oct 2009 19:10:24 GMT

> I used Memcached with hadoop, so that i can store (read/write) data on
> memcached server. I can refer this data
>     from any task by just connecting the memcached server.

What kind of impact did that have on your network utilization when running big mapred jobs?
  Did you saturate your
network links, having all Hadoop tasktracker nodes accessing the same memcached box?


Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions

View raw message