hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chandraprakash Bhagtani <cpbhagt...@gmail.com>
Subject Re: static data sharing among map funtions
Date Thu, 10 Sep 2009 14:03:10 GMT
If you really want to share read/write data you can use memcached server or
file based database like Tokyocabinet or BDB


-- 
Thanks & Regards,
Chandra Prakash Bhagtani,

On Thu, Sep 10, 2009 at 2:22 PM, indoos <indoos@gmail.com> wrote:

>
> Hi,
> Here are 2 possible ways for static data sharing-
> 1. Using distributed cache- refer
>
> http://hadoop.apache.org/common/docs/current/mapred_tutorial.html#DistributedCache
> 2. Using JobConf object-
>
> http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/conf/Configuration.html#set%28java.lang.String,%20java.lang.String%29
> .
>
> Please note that only read only cache should be used in Hadoop.
>
> Regards,
> Sanjay
>
>
> wbari wrote:
> >
> >
> >
> >
> >
> >
> > Hi,
> >
> >    How static data is shared among mappers ? is it synchorinized or not
> > possible ? I will appreciate if someone can give possible way of sharing
> > data among Map funtions in one job.
> >
> >
> >
> > BR,
> >
> >
> >
> > Bari
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/static-data-sharing-among-map-funtions-tp25347960p25379620.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message