Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 606E9EF98 for ; Tue, 15 Jan 2013 17:44:02 +0000 (UTC) Received: (qmail 26681 invoked by uid 500); 15 Jan 2013 17:43:57 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 26454 invoked by uid 500); 15 Jan 2013 17:43:57 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 26440 invoked by uid 99); 15 Jan 2013 17:43:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2013 17:43:57 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of hemanty@thoughtworks.com designates 64.18.0.182 as permitted sender) Received: from [64.18.0.182] (HELO exprod5og106.obsmtp.com) (64.18.0.182) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2013 17:43:50 +0000 Received: from mail-oa0-f70.google.com ([209.85.219.70]) (using TLSv1) by exprod5ob106.postini.com ([64.18.4.12]) with SMTP ID DSNKUPWVQagG/bEDlE13MYKUu5Usc2sEUQb6@postini.com; Tue, 15 Jan 2013 09:43:30 PST Received: by mail-oa0-f70.google.com with SMTP id k14so1641099oag.5 for ; Tue, 15 Jan 2013 09:43:29 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:date:message-id :subject:from:to:content-type:x-gm-message-state; bh=JnXOjjURsOOJJb10e3R/zmt6RhN+8JHuph4u40lBBX0=; b=UkfR04bGeaPbOJ2wK1bYLEvByZYXk3JGYGXIEuqT3v0WfQ/ub9U738HfZnu1j3l4Kj AdrQniXG21xyWYFGZFAMOMm/RMQgKZhomvEDqZOROEkM6PYojOu/U9TPAclUwPE+io2O Wa6uRtQLuzp6hl4/T4U6r0gF86mwf6xvZO7vO4OE44UKuEc0tVVY+t0NRwdIxZdnVYRD Cat570GWIaVQIPdTZdGAQTbLp0czgVyMFIu+mYcLtAHpIaFDkg9LVPaNcW1CXtGH2TcE xbYSKa7T/RcCpT70DFrJlfwLpXaz5qNCfE/QUr2+4Rzy22ebbMPQA8Q4kgiAYanDMgqM QJtg== X-Received: by 10.60.7.167 with SMTP id k7mr57171277oea.20.1358271809234; Tue, 15 Jan 2013 09:43:29 -0800 (PST) MIME-Version: 1.0 Received: by 10.60.7.167 with SMTP id k7mr57171271oea.20.1358271809142; Tue, 15 Jan 2013 09:43:29 -0800 (PST) Received: by 10.76.1.18 with HTTP; Tue, 15 Jan 2013 09:43:28 -0800 (PST) In-Reply-To: References: Date: Tue, 15 Jan 2013 23:13:28 +0530 Message-ID: Subject: Re: FileSystem.workingDir vs mapred.local.dir From: Hemanth Yamijala To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=e89a8ff1c686b140c904d3574c46 X-Gm-Message-State: ALoCoQmgbY3XsFaR+P9LbjOftHMqwlPNwy8XNGeuYo+OqdfGDFUc1UTtIbskvbylF7wQ1Fmt+Lo9uDXEIPc2bZWh36mQNyd6Hi0ln4jgl57Nyw+OJwAWSh7UTC+wp7SKT4oSNcZmG/D2QNjWi2dlp/3z9meSPeXYtA== X-Virus-Checked: Checked by ClamAV on apache.org --e89a8ff1c686b140c904d3574c46 Content-Type: text/plain; charset=ISO-8859-1 Hi, AFAIK, the mapred.local.dir property refers to a set of directories under which different types of data related to mapreduce jobs are stored - for e.g. intermediate data, localized files for a job etc. The working directory for a mapreduce job is configured under a sub directory within one of the directories configured in this property. The workingDir property of the FileSystem class simply seems to indicate the working directory for a given filesystem as set by applications. They don't seem very related per se, unless I am missing something ? Thanks Hemanth On Tue, Jan 15, 2013 at 2:54 AM, Jay Vyas wrote: > Hi guys: What is the relationship between the "working directory" in the > FileSystem class (filesystem.workingDir), compared with the > mapred.local.dir properties ? > > It seems like these would essentially refer to the same thing? > -- > Jay Vyas > http://jayunit100.blogspot.com > --e89a8ff1c686b140c904d3574c46 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi,

AFAIK, the mapred.local.dir property refers to a set= of directories under which different types of data related to mapreduce jo= bs are stored - for e.g. intermediate data, localized files for a job etc. = The working directory for a mapreduce job is configured under a sub directo= ry within one of the directories configured in this property.

The workingDir property of the Fi= leSystem class simply seems to indicate the working directory for a given f= ilesystem as set by applications.

They don't seem very related per se, unless = I am missing something ?

Thanks
Hemanth

On Tue, Jan 15, 2013 at 2:54 AM, Jay Vyas <jayunit100@gmail.com>= wrote:
Hi guys:=A0 What is the rel= ationship between the "working directory" in the FileSystem class= (filesystem.workingDir), compared with the mapred.local.dir properties ?

It seems like these would essentially refer to the same thing?
--
Jay Vyas
http://jayunit100.blogspot.com

--e89a8ff1c686b140c904d3574c46--