hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4060) [HOD] Make HOD to roll log files on the client
Date Wed, 10 Sep 2008 05:11:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hemanth Yamijala updated HADOOP-4060:
-------------------------------------

    Release Note: HOD client was modified to roll over client logs being written to the cluster
directory. A new configuration parameter, hod.log-rollover-count, was introduced to specify
how many rollover log files to retain.
    Hadoop Flags: [Incompatible change, Reviewed]

> [HOD] Make HOD to roll log files on the client 
> -----------------------------------------------
>
>                 Key: HADOOP-4060
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4060
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>            Reporter: Hemanth Yamijala
>            Assignee: Vinod K V
>            Priority: Blocker
>             Fix For: 0.18.1, 0.19.0
>
>         Attachments: HOD-LOG-ROTATION.1.txt, HOD-LOG-ROTATION.txt
>
>
> Currently HOD writes a log file on the client in the cluster directory, named hod-<username>.log.
This file is appended to for each run of hod allocation that runs on the same cluster directory.
Thus, the file can become quite large - particularly if the job is queued for a long time.
If there are problems with the HOD client subsequently, this could result in stale file handles
pointing to this large file, and cause disk space to fill up. Another problem is that a large
log file is usually unusable for a user.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message