Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6C976D37B for ; Wed, 13 Feb 2013 19:52:47 +0000 (UTC) Received: (qmail 35132 invoked by uid 500); 13 Feb 2013 19:52:46 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 35052 invoked by uid 500); 13 Feb 2013 19:52:46 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 35042 invoked by uid 99); 13 Feb 2013 19:52:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Feb 2013 19:52:46 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of arkoprovomukherjee@gmail.com designates 209.85.210.182 as permitted sender) Received: from [209.85.210.182] (HELO mail-ia0-f182.google.com) (209.85.210.182) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Feb 2013 19:52:41 +0000 Received: by mail-ia0-f182.google.com with SMTP id w33so1574845iag.27 for ; Wed, 13 Feb 2013 11:52:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:content-transfer-encoding; bh=llQet8mw9i2lqhjjYtWl9/eCg0M+m4oh4LotTD/nTWs=; b=a/tuxVw4N+C2YFHPTv1Jx5qkkf9+19aiEy49f9JXTFq+ZC3ChCSFtsbhJR91yUVlIq J/II03z0abMczzi0IPXWkhuEw1UL4y381vyHkvO44BX0LLrXoG6b1twg+kzw/UIuU7u2 CpQLLnXWUmfOrJ7QN6ZNsYoa7lhQB6VsIVu7IEoSS7/kyafQHZZ0Wmk3fcIL+d0tF+Cn b8bRLKOudmv2nvqK1+NT2692Ub1UanpIDhjL4UplneYtYZ4BmQvoRkDN7zqT6L4uxyKp LQrX2Ju2whTPqQKMoXd6/fMQEvZnbhypMm14qcMwypAWsYxQI85RUU8R3EFhItib4Iz3 XBRQ== X-Received: by 10.50.219.234 with SMTP id pr10mr13389960igc.26.1360785140368; Wed, 13 Feb 2013 11:52:20 -0800 (PST) MIME-Version: 1.0 Received: by 10.64.141.165 with HTTP; Wed, 13 Feb 2013 11:52:00 -0800 (PST) In-Reply-To: References: From: Arko Provo Mukherjee Date: Wed, 13 Feb 2013 13:52:00 -0600 Message-ID: Subject: Re: Managing space in Master Node To: hdfs-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi, Yeah, my NameNode is also seconding as a DataNode. I would like to "turn off" this feature. Request help regarding the same. Thanks & regards Arko On Wed, Feb 13, 2013 at 1:38 PM, Charles Baker wrote: > Hi Arko. Sounds like you may be running a DataNode on the NameNode which = is > not recommended practice. Normally, the only files the NN stores are the > image and edits files. It does not store any actual HDFS data. If you mus= t > run a DN on the NN, try turning down the logging in /conf/log4j.propertie= s: > > #hadoop.root.logger=3DINFO,console > #hadoop.root.logger=3DWARN,console > hadoop.root.logger=3DERROR,console > > Depending on the logging information you require, of course. > > -Chuck > > > -----Original Message----- > From: Arko Provo Mukherjee [mailto:arkoprovomukherjee@gmail.com] > Sent: Wednesday, February 13, 2013 11:32 AM > To: hdfs-user@hadoop.apache.org > Subject: Managing space in Master Node > > Hello Gurus, > > I am managing a Hadoop Cluster to run some experiments. > > The issue I am continuously facing is that the Master Node runs out of di= sk > space due to logs and data files. > > I can monitor and delete log files. However, I cannot delete the HDFS dat= a. > > Thus, is there a way to force Hadoop not to save any HDFS data in the Mas= ter > Node? > > Then I can use my master to handle the metadata only and store the logs. > > Thanks & regards > Arko > SDL Enterprise Technologies, Inc. - all rights reserved. The information= contained in this email may be confidential and/or legally privileged. It = has been sent for the sole use of the intended recipient(s). If you are not= the intended recipient of this mail, you are hereby notified that any unau= thorized review, use, disclosure, dissemination, distribution, or copying o= f this communication, or any of its contents, is strictly prohibited. If yo= u have received this communication in error, please reply to the sender and= destroy all copies of the message. > Registered address: 201 Edgewater Drive, Suite 225, Wakefield, MA 01880, = USA >