aurora-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Erb (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AURORA-1724) Thermos runner fails if log rotation is enabled
Date Tue, 28 Jun 2016 16:45:57 GMT

    [ https://issues.apache.org/jira/browse/AURORA-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353350#comment-15353350
] 

Stephan Erb commented on AURORA-1724:
-------------------------------------

Good catch!

> Thermos runner fails if log rotation is enabled
> -----------------------------------------------
>
>                 Key: AURORA-1724
>                 URL: https://issues.apache.org/jira/browse/AURORA-1724
>             Project: Aurora
>          Issue Type: Bug
>            Reporter: Stephan Erb
>            Assignee: John Sirois
>            Priority: Critical
>
> Thermos is failing to start when log rotation is enabled as [described in our documentation|https://github.com/apache/aurora/blob/master/docs/operations/configuration.md#log-rotation]
> Steps to reproduce:
> * start the latest developer vagrant box (or even then released 0.14)
> * update to scheduler wide {{thermos_executor_flags}} to include {{--runner-logger-mode=rotate
--runner-rotate-log-size-mb=100 --runner-rotate-log-backups=10}} as documented (see above)
> * launch a task
> * observe that the task has failed with {{LOST : Runner died while task was active.}}
> The thermos stderr then contains this traceback:
> {code}
> ERROR] Caught exception in self.control(): Logger mode rotate is invalid.
> ERROR]   Traceback (most recent call last):
>   File "apache/thermos/core/runner.py", line 572, in control
>     yield
>   File "apache/thermos/core/runner.py", line 916, in run
>     self._run()
>   File "apache/thermos/core/runner.py", line 923, in _run
>     iteration_wait = runner.run()
>   File "apache/thermos/core/runner.py", line 291, in run
>     launched = self.runner._run_plan(self.runner._regular_plan)
>   File "apache/thermos/core/runner.py", line 843, in _run_plan
>     self._set_process_status(process_name, ProcessState.WAITING)
>   File "apache/thermos/core/runner.py", line 687, in _set_process_status
>     self._dispatcher.dispatch(self._state, runner_ckpt, self._recovery)
>   File "apache/thermos/common/ckpt.py", line 384, in dispatch
>     self._run_process_dispatch(process_update.state, process_update)
>   File "apache/thermos/common/ckpt.py", line 215, in _run_process_dispatch
>     getattr(handler, handler_function)(process_update)
>   File "apache/thermos/core/runner.py", line 106, in on_waiting
>     process_update.process, process_update.seq + 1))
>   File "apache/thermos/core/runner.py", line 723, in _task_process_from_process_name
>     preserve_env=self._preserve_env)
>   File "apache/thermos/core/process.py", line 348, in __init__
>     ProcessBase.__init__(self, *args, **kw)
>   File "apache/thermos/core/process.py", line 142, in __init__
>     raise ValueError("Logger mode %s is invalid." % self._logger_mode)
> ValueError: Logger mode rotate is invalid.
> {code}
> What's kind of obscure here: "rotate" is one of the [supported modes|https://github.com/apache/aurora/blob/master/src/main/python/apache/thermos/core/process.py#L73-L81].




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message