Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2C2DA10771 for ; Tue, 2 Jul 2013 19:26:22 +0000 (UTC) Received: (qmail 11187 invoked by uid 500); 2 Jul 2013 19:26:17 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 11090 invoked by uid 500); 2 Jul 2013 19:26:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 11083 invoked by uid 99); 2 Jul 2013 19:26:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Jul 2013 19:26:17 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of john.lilley@redpoint.net designates 206.225.164.217 as permitted sender) Received: from [206.225.164.217] (HELO hub021-nj-2.exch021.serverdata.net) (206.225.164.217) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Jul 2013 19:26:11 +0000 Received: from MBX021-E3-NJ-2.exch021.domain.local ([10.240.4.78]) by HUB021-NJ-2.exch021.domain.local ([10.240.4.33]) with mapi id 14.03.0123.003; Tue, 2 Jul 2013 12:25:50 -0700 From: John Lilley To: "user@hadoop.apache.org" Subject: HDFS temporary file locations Thread-Topic: HDFS temporary file locations Thread-Index: Ac53WbfD3ps3Mpi6QhKJcS46l8lMyQ== Date: Tue, 2 Jul 2013 19:25:50 +0000 Message-ID: <869970D71E26D7498BDAC4E1CA92226B658D6A9C@MBX021-E3-NJ-2.exch021.domain.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [173.160.43.61] Content-Type: multipart/alternative; boundary="_000_869970D71E26D7498BDAC4E1CA92226B658D6A9CMBX021E3NJ2exch_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_869970D71E26D7498BDAC4E1CA92226B658D6A9CMBX021E3NJ2exch_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Is there any convention for clients/applications wishing to use temporary f= ile space in HDFS? For example, my application wants to: 1) Load data into some temporary space in HDFS as an external client 2) Run an AM, which produces HDFS output (also in the temporary space) 3) Read the data out of the HDFS temporary space 4) Remove the temporary files Thanks John --_000_869970D71E26D7498BDAC4E1CA92226B658D6A9CMBX021E3NJ2exch_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Is there any convention for clients/applications wis= hing to use temporary file space in HDFS?  For example, my application= wants to:

1)      Load data into some temporary space in HDFS as an e= xternal client

2)      Run an AM, which produces HDFS output (also in the = temporary space)

3)      Read the data out of the HDFS temporary space<= /o:p>

4)      Remove the temporary files

Thanks

John

 

--_000_869970D71E26D7498BDAC4E1CA92226B658D6A9CMBX021E3NJ2exch_--