Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of cordioli.alberto@gmail.com
 designates 209.85.220.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAFnReZZM2wqzWdGp-JJat=0+Z=e2HBzeFsSz5NvU4k6=q5wsUA@mail.gmail.com>
References: 
 <CAFnReZZM2wqzWdGp-JJat=0+Z=e2HBzeFsSz5NvU4k6=q5wsUA@mail.gmail.com>
From: Alberto Cordioli <cordioli.alberto@gmail.com>
Date: Fri, 19 Oct 2012 14:49:16 +0200
Message-ID: 
 <CAFnReZYJY+HzgbY+NRfv78LnK67gY0nVn0Yh74XXv26mrBUpfg@mail.gmail.com>
Subject: Re: DistributedCache: getLocalCacheFiles() always null
To: user@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8

Ok, it was my fault.
Instead of using getConf() when I added a new cache file I should use
job.getConfiguration()
Not it works.


Cheers,
Alberto


On 19 October 2012 09:19, Alberto Cordioli <cordioli.alberto@gmail.com> wrote:
> Hi all,
>
> I am trying to use the DistributedCache with the new Hadoop API.
> According to the documentation it seems that nothing change, and the
> use is the same as with the old api.
> However I am facing some problems. This is the snippet in which I use it:
>
>
> // setting input/output format classes
> ....
>
> //DISTRIBUTED CACHE
> DistributedCache.addCacheFile(new
> Path("/cdr/input/cgi.csv#cgi.csv").toUri(), getConf());
> job.waitForCompletion(true);
>
>
> and in my reducer:
>
> @Override
> protected void setup(Context context) throws IOException{
>       Path[] localFiles =
> DistributedCache.getLocalCacheFiles(context.getConfiguration());
>       ....
> }
>
> localFiels is always null. I read that the getLocalCacheFiles() should
> be used in configure() method, but the mapper/reducer of the new api
> do not have that method.
> What's wrong?
> I read that the DistributedCache has some troubles if you try to run
> your program from a client (e.g., inside an IDE), but I tried also to
> run it directly on the cluster.
>
>
> Thanks.
>
> --
> Alberto Cordioli


-- 
Alberto Cordioli