chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Reopened: (CHUKWA-229) ExecPlugin leaks a file descriptor
Date Mon, 18 May 2009 03:51:45 GMT


Ari Rabkin reopened CHUKWA-229:

That fix didn't do the trick.  We're still leaking. What's more, it's sporadic; it doesn't
happen every execution. So I suspect it's a race condition somewhere.  Instead of tracking
it down immediately, I propose the following medium-term workaround:  If exec adaptor detects
that we're out of file handles, we stop the agent process and wait for watchdog to respawn

We went to a lot of trouble to implement robust checkpointing; I figure we might as well rely
on it here.

> ExecPlugin leaks a file descriptor
> ----------------------------------
>                 Key: CHUKWA-229
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: data collection
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
>         Attachments: fixExecFDLeak.patch
> ExecPlugin never properly disposes of the subprocess's input fd. This means we run out
of file descriptors eventually.  
> This only affects ExecAdaptor; if ExecPlugin is invoked by the inputtools framework,
the process doens't stay running.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message