hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Auto clean DistCache?
Date Tue, 26 Mar 2013 00:16:17 GMT
Hi,

Each time my MR job is run, a directory is created on the TaskTracker
under mapred/local/taskTracker/hadoop/distcache (based on my
configuration).

I looked at the directory today, and it's hosting thousands of
directories and more than 8GB of data there.

Is there a way to automatically delete this directory when the job is done?

Thanks,

JM

Mime
View raw message