hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joey Echeverria <j...@cloudera.com>
Subject Re: Log files expanding at an alarming rate
Date Mon, 23 May 2011 12:45:41 GMT
Hi Karthik,

FYI, I'm moving this thread to mapreduce-user@hadoop.apache.org (You
and common-user are BCCed).

My guess is that your task trackers are throwing a lot of exceptions
which are getting logged. Can you send a snippet of the logs to help
diagnose why it's logging so much? Can you also let us know what
logging level you currently have enabled?


On Mon, May 23, 2011 at 8:30 AM, Karthik Kumar <karthik84kumar@gmail.com> wrote:
> Hi,
> I am using a small cluster of 1 master node and 2 salves. The tasktracker
> log in slaves are increasing in size approximately 1mb per second. This
> results in disk space getting low over time. This happens even if no job is
> running. Please suggest ways to slow down the size of the log file. Also I
> would like to know why the log files are written even if there is no jobs
> running.
> --
> With Regards,
> Karthik

Joseph Echeverria
Cloudera, Inc.

View raw message