aurora-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Erb (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AURORA-1724) Thermos runner fails if log rotation is enabled
Date Tue, 28 Jun 2016 08:13:57 GMT
Stephan Erb created AURORA-1724:
-----------------------------------

             Summary: Thermos runner fails if log rotation is enabled
                 Key: AURORA-1724
                 URL: https://issues.apache.org/jira/browse/AURORA-1724
             Project: Aurora
          Issue Type: Bug
            Reporter: Stephan Erb
            Priority: Critical


Thermos is failing to start when log rotation is enabled as [described in our documentation|https://github.com/apache/aurora/blob/master/docs/operations/configuration.md#log-rotation]

Steps to reproduce:
* start the latest developer vagrant box (or even then released 0.14)
* update to scheduler wide {{thermos_executor_flags}} to include {{--runner-logger-mode=rotate
--runner-rotate-log-size-mb=100 --runner-rotate-log-backups=10}} as documented (see above)
* launch a task
* observe that the task has failed with {{LOST : Runner died while task was active.}}

The thermos stderr then contains this traceback:
{code}
ERROR] Caught exception in self.control(): Logger mode rotate is invalid.
ERROR]   Traceback (most recent call last):
  File "apache/thermos/core/runner.py", line 572, in control
    yield
  File "apache/thermos/core/runner.py", line 916, in run
    self._run()
  File "apache/thermos/core/runner.py", line 923, in _run
    iteration_wait = runner.run()
  File "apache/thermos/core/runner.py", line 291, in run
    launched = self.runner._run_plan(self.runner._regular_plan)
  File "apache/thermos/core/runner.py", line 843, in _run_plan
    self._set_process_status(process_name, ProcessState.WAITING)
  File "apache/thermos/core/runner.py", line 687, in _set_process_status
    self._dispatcher.dispatch(self._state, runner_ckpt, self._recovery)
  File "apache/thermos/common/ckpt.py", line 384, in dispatch
    self._run_process_dispatch(process_update.state, process_update)
  File "apache/thermos/common/ckpt.py", line 215, in _run_process_dispatch
    getattr(handler, handler_function)(process_update)
  File "apache/thermos/core/runner.py", line 106, in on_waiting
    process_update.process, process_update.seq + 1))
  File "apache/thermos/core/runner.py", line 723, in _task_process_from_process_name
    preserve_env=self._preserve_env)
  File "apache/thermos/core/process.py", line 348, in __init__
    ProcessBase.__init__(self, *args, **kw)
  File "apache/thermos/core/process.py", line 142, in __init__
    raise ValueError("Logger mode %s is invalid." % self._logger_mode)
ValueError: Logger mode rotate is invalid.
{code}

What's kind of obscure here: "rotate" is one of the [supported modes|https://github.com/apache/aurora/blob/master/src/main/python/apache/thermos/core/process.py#L73-L81].




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message