Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of pku.gaoqin@gmail.com designates
 209.85.222.201 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type;
        b=hXy30ZvWDcp4bDJt6TYGfkw4sOw87dNJ+XWNi/Mpcy++PdCp/ZLmhBBz93R1xUfYCq
         5O6IXSntrEfGaCsg0wRaouiyyQxkmXG2uF+2dc8zxuPdPkT3yzcQ2oAX2+9C9+NAGj4h
         SrNhRdA0kxyjLDFIGh/b5kO5ezg1d4T1t078s=
MIME-Version: 1.0
Sender: pku.gaoqin@gmail.com
In-Reply-To: <445c748b0906221319x767f1c92wb63376eb115d848e@mail.gmail.com>
References: <826304a60906221215i6c72b0a5ue43722b1504ccc74@mail.gmail.com>
	 <445c748b0906221319x767f1c92wb63376eb115d848e@mail.gmail.com>
Date: Mon, 22 Jun 2009 16:24:57 -0400
Message-ID: <826304a60906221324l10865619v5d96d5322080c847@mail.gmail.com>
Subject: Re: Making sure the tmp directory is cleaned?
From: Qin Gao <qing@cs.cmu.edu>
To: core-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=000e0cd20ddced00d6046cf5aaf7

--000e0cd20ddced00d6046cf5aaf7
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

Thanks!

But what if the jobs get killed or failed? Does hadoop try to clean it? we
are considering bad situations - if job gets killed, will the tmp dirs sit
on local disks forever and eats up all the diskspace?

I guess this should be considered in distributed cache, but those files are
read-only, and our program will generate new temporary files.


--Q


On Mon, Jun 22, 2009 at 4:19 PM, Pankil Doshi <forpankil@gmail.com> wrote:

> Yes, If your job gets completed successfully .possibly it removes after
> completion of both map and reduce tasks.
>
> Pankil
>
> On Mon, Jun 22, 2009 at 3:15 PM, Qin Gao <qing@cs.cmu.edu> wrote:
>
> > Hi All,
> >
> > Do you know if the tmp directory on every map/reduce task will be deleted
> > automatically after the map task finishes or will do I have to delete
> them?
> >
> > I mean the tmp directory that automatically created by on current
> > directory.
> >
> > Thanks a lot
> > --Q
> >
>

--000e0cd20ddced00d6046cf5aaf7--