chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-421) new logfile rotation detection scheme
Date Thu, 17 Dec 2009 01:04:18 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791716#action_12791716
] 

Eric Yang commented on CHUKWA-421:
----------------------------------

-bash-3.1$ telnet localhost 9093
Trying 127.0.0.1...
Connected to localhost.localdomain (127.0.0.1).
Escape character is '^]'.
list
adaptor_1b0f8e15eedd2cb346aa8c1cfd4f35d9)  org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped
mapred 0 /usr/local/chukwa/current/var/log/metrics/chukwa-mapred-mapred-1260413773627.log
5332706

-bash-3.1$ ls -l chukwa-mapred-mapred-1260413773627.log
-rw-r--r-- 1 mapred users 168050 Dec 17 01:00 chukwa-mapred-mapred-1260413773627.log
-bash-3.1$ ls -l chukwa-mapred-mapred-1260413773627.log.2009-12-16
-rw-r--r-- 1 mapred users  5332706 Dec 16 23:59 chukwa-mapred-mapred-1260413773627.log.2009-12-16

It still doesn't rotate properly.

> new logfile rotation detection scheme
> -------------------------------------
>
>                 Key: CHUKWA-421
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-421
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: data collection
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
>         Attachments: CHUKWA-421.patch
>
>
> Currently, we keep files open in order to detect rotation. This is wasteful of file handles,
doesn't work correctly across reboots, and I think we can do better.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message