Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Subject: Reducing Hadoop Logs
Date: Tue, 9 Dec 2008 13:51:18 -0500
Message-ID: 
 <C001E847C1FD4248A7D6537643690E21028BC6B3@mse16be2.mse16.exchange.ms>
In-Reply-To: <493EAF19.5030608@apache.org>
Thread-Topic: Reducing Hadoop Logs
Thread-Index: AclaJj7F66pPKxMdQ1KWiqKWWNQNLwABvwHg
References: <2AC78631-8FC0-406D-BEAF-5042921A2D84@cse.unl.edu>
 <493D6132.3090908@apache.org> <493E6509.5040000@apache.org>
 <493EAF19.5030608@apache.org>
From: "Arv Mistry" <arv@kindsight.net>
To: <core-user@hadoop.apache.org>

=20
I'm using hadoop 0.17.0. Unfortunately I cant upgrade to 0.19.0 just
yet.

I'm trying to control the amount of extraneous files. I noticed there
are the following log files produced by hadoop;

	On Slave
		- userlogs (for each map/reduce job)
			- stderr
			- stdout
			- syslog
		- datanode .log file
		- datanode .out file
		- tasktracker .log file
		- tasktracker .out file

	On Master
		- jobtracker .log file
		- jobtracker .out file
		- namenode   .log file
		- namenode   .out file
		- secondarynamenode .log file
		- secondarynamenode .out file	=09
		- job .xml file
		- history
			- xml file for job

=09
Does any body know of how to configure hadoop so I don't have to delete
these files manually? Or just so that they don't get created at all.

For the history files, I set hadoop.job.history.user.location to none in
the hadoop-site.xml file but I still get the history files created.
Also I set in the log4j.properties the hadoop.root.logger=3DWARN but I
still see INFO messages in datanode,jobtracker etc logs

Thanks, in advance

Cheers Arv