hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joey Echeverria <j...@cloudera.com>
Subject Re: Log files expanding at an alarming rate
Date Mon, 23 May 2011 12:45:41 GMT
Hi Karthik,

FYI, I'm moving this thread to mapreduce-user@hadoop.apache.org (You
and common-user are BCCed).

My guess is that your task trackers are throwing a lot of exceptions
which are getting logged. Can you send a snippet of the logs to help
diagnose why it's logging so much? Can you also let us know what
logging level you currently have enabled?

-Joey

On Mon, May 23, 2011 at 8:30 AM, Karthik Kumar <karthik84kumar@gmail.com> wrote:
> Hi,
>
> I am using a small cluster of 1 master node and 2 salves. The tasktracker
> log in slaves are increasing in size approximately 1mb per second. This
> results in disk space getting low over time. This happens even if no job is
> running. Please suggest ways to slow down the size of the log file. Also I
> would like to know why the log files are written even if there is no jobs
> running.
>
> --
> With Regards,
> Karthik
>



-- 
Joseph Echeverria
Cloudera, Inc.
443.305.9434

Mime
View raw message