chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-238) race condition with archive manager
Date Fri, 15 May 2009 21:25:45 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709978#action_12709978
] 

Jerome Boulon commented on CHUKWA-238:
--------------------------------------

Ari,
We cannot do that since the code checks for daysInRawArchiveDir[0] and also we don't want
to sleep for 30  minutes 
We need to add a specific block right after FileStatus[] daysInRawArchiveDir = fs.listStatus(pDailyRawArchivesInput);

if (daysInRawArchiveDir.length == 0 )  {
 log.info( pDailyRawArchivesInput + " is empty, going to sleep for 1 minute");
 Thread.sleep(1 * 60 * 1000);
  continue;
}



> race condition with archive manager
> -----------------------------------
>
>                 Key: CHUKWA-238
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-238
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: Data Processors
>            Reporter: Ari Rabkin
>            Priority: Blocker
>         Attachments: chukwa-238.patch
>
>
> If the archive manager starts before any data has been loaded into the repository, it'll
buzz through its main loop, filling logs files with garbage at maximum speed:
> Symptom:
> a log file full of statements like:
> 2009-05-13 22:59:57,233 INFO main ChukwaArchiveManager - Raw Archive dir:/chukwa/dataSinkArchives

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message