Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1B30011AE8 for ; Sun, 11 May 2014 06:17:05 +0000 (UTC) Received: (qmail 93193 invoked by uid 500); 10 May 2014 23:26:15 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 71847 invoked by uid 500); 10 May 2014 23:16:59 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 33215 invoked by uid 99); 10 May 2014 22:58:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 May 2014 22:58:31 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of samliuhadoop@gmail.com designates 209.85.192.48 as permitted sender) Received: from [209.85.192.48] (HELO mail-qg0-f48.google.com) (209.85.192.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 May 2014 03:41:20 +0000 Received: by mail-qg0-f48.google.com with SMTP id i50so451318qgf.21 for ; Tue, 06 May 2014 20:40:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=cpoVsXEoMJ3nkVZPeHSdrBp8tgJhzIL3S3a4LoZ4GV8=; b=sChqssXzfkil+PkCNZwqMP5flC+fjYBR0JjNGhb6VI49dJ2enQ3T2NHpLv+AANkwtp xGrYPgQn5drDSLoSKD8I8DDvvc6BBLWdQHFwxFVOAj6rhow+uhugpVqfdz6bC+upt+gF eFxNwRpPGAk+ersqDiWwcoIpxy5t4Ftnh2bw+LKACOpag8mzFiPxbgv25fahlso9vvsr LmFFltQw7Vv05gFg1gNV+5aDRPEWnNI0uGuyrbl0pcc26DWExSH5i4KO37pMPdG9AZYK xOtCWm3vQllwCp98iAgBSGMNOpsGd1vZJ7a++eA7EQM0Y/kAzjBfxxRQ5+olqB7hKaGH tDUA== MIME-Version: 1.0 X-Received: by 10.224.151.82 with SMTP id b18mr37188580qaw.27.1399434059496; Tue, 06 May 2014 20:40:59 -0700 (PDT) Received: by 10.96.56.41 with HTTP; Tue, 6 May 2014 20:40:59 -0700 (PDT) Date: Wed, 7 May 2014 11:40:59 +0800 Message-ID: Subject: Questions about Hadoop logs and mapred.local.dir From: sam liu To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=089e0149ced600c97704f8c722f6 X-Virus-Checked: Checked by ClamAV on apache.org --089e0149ced600c97704f8c722f6 Content-Type: text/plain; charset=UTF-8 Hi Experts, 1. The size of mapred.local.dir is big(30 GB), how many methods could clean it correctly? 2. For logs of NameNode/DataNode/JobTracker/TaskTracker, are they all rolling type log? What's their max size? I can not find the specific settings for them in log4j.properties. 3. I find the size of dfs.name.dir and dfs.data.dir is very big now, are there any files under them could be removed actually? Or all files under the two folders could not be removed at all? Thanks! --089e0149ced600c97704f8c722f6 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable --089e0149ced600c97704f8c722f6--