hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Andrews <mandr...@liveops.com>
Subject RE: Cleaning up files in HDFS?
Date Sat, 15 Nov 2008 19:01:32 GMT
It there anyway to ensure that a file is deleted if an MR job crashes?  It seems like deleteOnExit
should do this, but it's hard to tell from the docs/code.

Michael
________________________________________
From: lohit [lohit_bv@yahoo.com]
Sent: Friday, November 14, 2008 6:07 PM
To: core-user@hadoop.apache.org
Subject: Re: Cleaning up files in HDFS?

Have you tried fs.trash.interval

<property>
  <name>fs.trash.interval</name>
  <value>0</value>
  <description>Number of minutes between trash checkpoints.
  If zero, the trash feature is disabled.
  </description>
</property>

more info about trash feature here.
http://hadoop.apache.org/core/docs/current/hdfs_design.html


Thanks,
Lohit

----- Original Message ----
From: Erik Holstad <erikholstad@gmail.com>
To: core-user@hadoop.apache.org
Sent: Friday, November 14, 2008 5:08:03 PM
Subject: Cleaning up files in HDFS?

Hi!
We would like to run a delete script that deletes all files older than
x days that are stored in lib l in hdfs, what is the best way of doing that?

Regards Erik


Mime
View raw message