Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8C3DB7920 for ; Tue, 9 Aug 2011 15:45:42 +0000 (UTC) Received: (qmail 81715 invoked by uid 500); 9 Aug 2011 15:45:39 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 81473 invoked by uid 500); 9 Aug 2011 15:45:38 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 81465 invoked by uid 99); 9 Aug 2011 15:45:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2011 15:45:38 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.216.176] (HELO mail-qy0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2011 15:45:33 +0000 Received: by qyk7 with SMTP id 7so89992qyk.14 for ; Tue, 09 Aug 2011 08:45:12 -0700 (PDT) MIME-Version: 1.0 Received: by 10.229.247.15 with SMTP id ma15mr1543747qcb.1.1312904711694; Tue, 09 Aug 2011 08:45:11 -0700 (PDT) Received: by 10.229.246.12 with HTTP; Tue, 9 Aug 2011 08:45:11 -0700 (PDT) In-Reply-To: References: Date: Tue, 9 Aug 2011 15:45:11 +0000 Message-ID: Subject: Re: Is it ok to manually delta ~hadoop/mapred/local/taskTracker/archive/* From: "Owen O'Malley" To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016e6470d8ef6ebcf04aa1472f5 --0016e6470d8ef6ebcf04aa1472f5 Content-Type: text/plain; charset=ISO-8859-1 On Tue, Aug 9, 2011 at 8:34 AM, Robert J Berger wrote: > Looks like I have something not configured particularly well so that > mapred/local/taskTracker/archive is a local filesystem and its filling > things up. > Configure the size of the distributed cache on each node using local.cache.size, which defaults to 10gb. > Is it ok to delete mapred/local/taskTracker/archive/* at the Unix level? Or > is there some other way to force that to be deleted. If you restart the task tracker, I believe it will delete it. You shouldn't delete it behind the scenes, because you'll cause failures for any running tasks and confuse the task tracker with what it has stored. > I can't really restart my hadoop cluster just to fix this right n ow. I'm > running hadoop 0.20.1. I'd highly recommend you upgrade to 0.20.203.0. -- Owen --0016e6470d8ef6ebcf04aa1472f5--