hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Andrews <mandr...@liveops.com>
Subject RE: Cleaning up files in HDFS?
Date Sat, 15 Nov 2008 19:01:32 GMT
It there anyway to ensure that a file is deleted if an MR job crashes?  It seems like deleteOnExit
should do this, but it's hard to tell from the docs/code.

From: lohit [lohit_bv@yahoo.com]
Sent: Friday, November 14, 2008 6:07 PM
To: core-user@hadoop.apache.org
Subject: Re: Cleaning up files in HDFS?

Have you tried fs.trash.interval

  <description>Number of minutes between trash checkpoints.
  If zero, the trash feature is disabled.

more info about trash feature here.


----- Original Message ----
From: Erik Holstad <erikholstad@gmail.com>
To: core-user@hadoop.apache.org
Sent: Friday, November 14, 2008 5:08:03 PM
Subject: Cleaning up files in HDFS?

We would like to run a delete script that deletes all files older than
x days that are stored in lib l in hdfs, what is the best way of doing that?

Regards Erik

View raw message