Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.223.171 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <869970D71E26D7498BDAC4E1CA92226B86D8A0DB@MBX021-E3-NJ-2.exch021.domain.local>
References: 
 <869970D71E26D7498BDAC4E1CA92226B86D8A0DB@MBX021-E3-NJ-2.exch021.domain.local>
From: Harsh J <harsh@cloudera.com>
Date: Sun, 20 Oct 2013 22:18:44 +0530
Message-ID: 
 <CAOcnVr0e7i7kZK8s=Tz4ouksypHyiwb8tRcs7GaFsu-GP+m=_A@mail.gmail.com>
Subject: Re: temporary file locations for YARN applications
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1

Every container gets its own local work directory (You can use the
relative ./) thats auto-cleaned up at the end of the container's life.
This is the best place to store the temporary files. This is not
something you need custom configuration for.

Do the files need to be on a distributed FS or a local one?

On Sun, Oct 20, 2013 at 8:54 PM, John Lilley <john.lilley@redpoint.net> wrote:
> We have a pure YARN application (no MapReduce) that has need to store a
> significant amount of temporary data.  How can we know the best location for
> these files?  How can we ensure that our YARN tasks have write access to
> these locations?  Is this something that must be configured outside of YARN?
>
> Thanks,
>
> John
>
>
>
>


-- 
Harsh J