aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bill Farner <wfar...@apache.org>
Subject Re: Build failed in Jenkins: Aurora #711
Date Tue, 04 Nov 2014 23:08:06 GMT
Flaky test, filed https://issues.apache.org/jira/browse/AURORA-916

-=Bill

On Tue, Nov 4, 2014 at 2:30 PM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> See <https://builds.apache.org/job/Aurora/711/changes>
>
> Changes:
>
> [wfarner] Retry Driver.killTask periodically until the task changes states.
>
> ------------------------------------------
> [...truncated 7255 lines...]
>
> src/test/python/apache/thermos/core/test_finalization.py::TestRegularFinalizingTask::test_runner_state
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py::TestRegularFinalizingTask::test_runner_process_in_expected_states
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py <-
> ../../../tmp/tmp9OWmfQ/apache/thermos/testing/runner.py::TestRegularFinalizingTask::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
> src/test/python/apache/thermos/core/test_finalization.py::TestSequentialFinalizationSchedule::test_runner_state
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py::TestSequentialFinalizationSchedule::test_runner_process_in_expected_states
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py <-
> ../../../tmp/tmp9OWmfQ/apache/thermos/testing/runner.py::TestSequentialFinalizationSchedule::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
> src/test/python/apache/thermos/core/test_finalization.py::TestTaskSucceedsDespiteFinalizationFailure::test_runner_state
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py::TestTaskSucceedsDespiteFinalizationFailure::test_runner_process_in_expected_states
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py <-
> ../../../tmp/tmp9OWmfQ/apache/thermos/testing/runner.py::TestTaskSucceedsDespiteFinalizationFailure::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
> src/test/python/apache/thermos/core/test_finalization.py::TestParallelFinalizationFailure::test_runner_state
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py::TestParallelFinalizationFailure::test_runner_process_in_expected_states
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py <-
> ../../../tmp/tmp9OWmfQ/apache/thermos/testing/runner.py::TestParallelFinalizationFailure::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
> src/test/python/apache/thermos/core/test_finalization.py::TestFinalizationRunsDespiteFailure::test_runner_state
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py::TestFinalizationRunsDespiteFailure::test_runner_process_in_expected_states
> PASSED
> src/test/python/apache/thermos/core/test_finalization.py <-
> ../../../tmp/tmp9OWmfQ/apache/thermos/testing/runner.py::TestFinalizationRunsDespiteFailure::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
>
>  generated xml file: <
> https://builds.apache.org/job/Aurora/ws/dist/test-results/src.test.python.apache.thermos.core.test_finalization.xml
> >
> ========================== 15 passed in 19.96 seconds
> ==========================
> ============================= test session starts
> ==============================
> platform linux2 -- Python 2.7.6 -- py-1.4.26 -- pytest-2.6.4 -- <
> https://builds.apache.org/job/Aurora/ws/build-support/pants.venv/bin/python2.7
> >
> plugins: cov, timeout
> collecting ... collected 2 items
>
> src/test/python/apache/thermos/core/test_helper.py::test_this_is_really_our_pid
> PASSED
> src/test/python/apache/thermos/core/test_helper.py::test_scan_process
> WARNING:root:  Error gathering information on pid 12345:
> WARNING:root:  Error gathering information on pid 13337:
> PASSED
>
>  generated xml file: <
> https://builds.apache.org/job/Aurora/ws/dist/test-results/src.test.python.apache.thermos.core.test_helper.xml
> >
> =========================== 2 passed in 0.20 seconds
> ===========================
> ============================= test session starts
> ==============================
> platform linux2 -- Python 2.7.6 -- py-1.4.26 -- pytest-2.6.4 -- <
> https://builds.apache.org/job/Aurora/ws/build-support/pants.venv/bin/python2.7
> >
> plugins: cov, timeout
> collecting ... collected 13 items
>
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerBasic::test_runner_state_success
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerBasic::test_runner_header_populated
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerBasic::test_runner_has_allocated_name_ports
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerBasic::test_runner_has_expected_processes
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerBasic::test_runner_processes_have_expected_output
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerBasic::test_runner_processes_have_monotonically_increasing_timestamps
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py <-
> ../../../tmp/tmp9I3Rii/apache/thermos/testing/runner.py::TestRunnerBasic::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
> src/test/python/apache/thermos/core/test_runner_integration.py::TestConcurrencyBasic::test_runner_state_success
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestConcurrencyBasic::test_runner_processes_separated_temporally_due_to_concurrency_limit
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py <-
> ../../../tmp/tmp9I3Rii/apache/thermos/testing/runner.py::TestConcurrencyBasic::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerEnvironment::test_runner_state_success
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py::TestRunnerEnvironment::test_runner_processes_have_expected_output
> PASSED
> src/test/python/apache/thermos/core/test_runner_integration.py <-
> ../../../tmp/tmp9I3Rii/apache/thermos/testing/runner.py::TestRunnerEnvironment::test_runner_state_reconstruction
> PASSEDFailed to kill runner: [Errno 3] No such process
>
>
>  generated xml file: <
> https://builds.apache.org/job/Aurora/ws/dist/test-results/src.test.python.apache.thermos.core.test_runner_integration.xml
> >
> ========================== 13 passed in 13.02 seconds
> ==========================
> ============================= test session starts
> ==============================
> platform linux2 -- Python 2.7.6 -- py-1.4.26 -- pytest-2.6.4 -- <
> https://builds.apache.org/job/Aurora/ws/build-support/pants.venv/bin/python2.7
> >
> plugins: cov, timeout
> collecting ... collected 1 items
>
> src/test/python/apache/thermos/core/test_angry.py::test_flaky_runner Run #1
> Completed in 1 runs
> PASSED
>
>  generated xml file: <
> https://builds.apache.org/job/Aurora/ws/dist/test-results/src.test.python.apache.thermos.core.test_angry.xml
> >
> =========================== 1 passed in 5.83 seconds
> ===========================
> ============================= test session starts
> ==============================
> platform linux2 -- Python 2.7.6 -- py-1.4.26 -- pytest-2.6.4 -- <
> https://builds.apache.org/job/Aurora/ws/build-support/pants.venv/bin/python2.7
> >
> plugins: cov, timeout
> collecting ... collected 6 items
>
> src/test/python/apache/thermos/core/test_staged_kill.py::TestRunnerKill::test_process_kill
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140116346566-runner-base.
> PASSED
> src/test/python/apache/thermos/core/test_staged_kill.py::TestRunnerKill::test_coordinator_kill
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140122893363-runner-base.
> PASSED
> src/test/python/apache/thermos/core/test_staged_kill.py::TestRunnerKillProcessTrappingSIGTERM::test_coordinator_kill
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140143393984-runner-base.
> PASSED
> src/test/python/apache/thermos/core/test_staged_kill.py::TestRunnerKillProcessTrappingSIGTERM::test_coordinator_dead_kill
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140162079411-runner-base.
> PASSED
> src/test/python/apache/thermos/core/test_staged_kill.py::TestRunnerKillProcessTrappingSIGTERM::test_preemption_wait
> SKIPPED
> src/test/python/apache/thermos/core/test_staged_kill.py::TestRunnerKillProcessGroup::test_pg_is_killed
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> WARNING:root:Could not read from discovered task
> 1415140163636769-runner-base.
> PASSED
>
>  generated xml file: <
> https://builds.apache.org/job/Aurora/ws/dist/test-results/src.test.python.apache.thermos.core.test_staged_kill.xml
> >
> ===================== 5 passed, 1 skipped in 50.00 seconds
> =====================
> ============================= test session starts
> ==============================
> platform linux2 -- Python 2.7.6 -- py-1.4.26 -- pytest-2.6.4 -- <
> https://builds.apache.org/job/Aurora/ws/build-support/pants.venv/bin/python2.7
> >
> plugins: cov, timeout
> collecting ... collected 2 items
>
> src/test/python/apache/thermos/monitoring/test_disk.py::test_du_diskcollector
> PASSED
> src/test/python/apache/thermos/monitoring/test_disk.py::test_inotify_diskcollector
> FAILED
>
> =================================== FAILURES
> ===================================
> __________________________ test_inotify_diskcollector
> __________________________
>
>     @pytest.mark.skipif("sys.platform == 'darwin'")
>     def test_inotify_diskcollector():
>       target = safe_mkdtemp()
>       INTERVAL = Amount(50, Time.MILLISECONDS)
>       collector = InotifyDiskCollector(target)
>       collector._thread.COLLECTION_INTERVAL = INTERVAL
>
>       def wait():
>         time.sleep((2 * INTERVAL).as_(Time.SECONDS))
>
> >     _run_collector_tests(collector, target, wait)
>
> src/test/python/apache/thermos/monitoring/test_disk.py:79:
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _ _ _
>
> collector = <apache.thermos.monitoring.disk.InotifyDiskCollector object at
> 0x7fb3fbd31f90>
> target = '/tmp/tmpoUxGR5', wait = <function wait at 0x7fb3fbd2a488>
>
>     def _run_collector_tests(collector, target, wait):
>       assert collector.value == 0
>
>       collector.sample()
>       wait()
>       assert collector.value == 0
>
>       f1 = make_file(TEST_AMOUNT_1, dir=target)
>       wait()
> >     assert collector.value >= TEST_AMOUNT_1.as_(Data.BYTES)
> E     assert 9728000 >= 104857600.0
> E      +  where 9728000 =
> <apache.thermos.monitoring.disk.InotifyDiskCollector object at
> 0x7fb3fbd31f90>.value
> E      +  and   104857600.0 = <bound method Amount.as_ of Amount(100,
> MB)>(<twitter.common.quantity.Data object at 0x7fb3fb789a90>)
> E      +    where <bound method Amount.as_ of Amount(100, MB)> =
> Amount(100, MB).as_
> E      +    and   <twitter.common.quantity.Data object at 0x7fb3fb789a90>
> = Data.BYTES
>
> src/test/python/apache/thermos/monitoring/test_disk.py:46: AssertionError
>  generated xml file: <
> https://builds.apache.org/job/Aurora/ws/dist/test-results/src.test.python.apache.thermos.monitoring.test_disk.xml
> >
> !!!!!!!!!!!!!!!!!!!! Interrupted: stopping after 1 failures
> !!!!!!!!!!!!!!!!!!!!
> ====================== 1 failed, 1 passed in 1.29 seconds
> ======================
> Build operating on top level addresses: set([BuildFileAddress(<
> https://builds.apache.org/job/Aurora/ws/src/test/python/BUILD,> all)])
> src.test.python.apache.aurora.admin.admin_util
>       .....   SUCCESS
> src.test.python.apache.aurora.admin.host_maintenance
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.api
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.disambiguator
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.instance_watcher
>      .....   SUCCESS
> src.test.python.apache.aurora.client.api.job_monitor
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.mux
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.quota_check
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.restarter
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.scheduler_client
>      .....   SUCCESS
> src.test.python.apache.aurora.client.api.sla
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.updater
>       .....   SUCCESS
> src.test.python.apache.aurora.client.api.updater_util
>      .....   SUCCESS
> src.test.python.apache.aurora.client.binding_helper
>      .....   SUCCESS
> src.test.python.apache.aurora.client.cli.api
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.bridge
>      .....   SUCCESS
> src.test.python.apache.aurora.client.cli.command_hooks
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.config
>      .....   SUCCESS
> src.test.python.apache.aurora.client.cli.cron
>      .....   SUCCESS
> src.test.python.apache.aurora.client.cli.help
>      .....   SUCCESS
> src.test.python.apache.aurora.client.cli.inspect
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.job
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.logging
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.plugins
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.quota
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.sla
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.supdate
>       .....   SUCCESS
> src.test.python.apache.aurora.client.cli.task
>      .....   SUCCESS
> src.test.python.apache.aurora.client.cli.update
>      .....   SUCCESS
> src.test.python.apache.aurora.client.commands.admin
>      .....   SUCCESS
> src.test.python.apache.aurora.client.commands.core
>       .....   SUCCESS
> src.test.python.apache.aurora.client.commands.hooks
>      .....   SUCCESS
> src.test.python.apache.aurora.client.commands.maintenance
>      .....   SUCCESS
> src.test.python.apache.aurora.client.commands.run
>      .....   SUCCESS
> src.test.python.apache.aurora.client.commands.ssh
>      .....   SUCCESS
> src.test.python.apache.aurora.client.config
>      .....   SUCCESS
> src.test.python.apache.aurora.client.hooks.hooked_api
>      .....   SUCCESS
> src.test.python.apache.aurora.client.hooks.non_hooked_api
>      .....   SUCCESS
> src.test.python.apache.aurora.common.test_aurora_job_key
>       .....   SUCCESS
> src.test.python.apache.aurora.common.test_cluster
>      .....   SUCCESS
> src.test.python.apache.aurora.common.test_cluster_option
>       .....   SUCCESS
> src.test.python.apache.aurora.common.test_clusters
>       .....   SUCCESS
> src.test.python.apache.aurora.common.test_http_signaler
>      .....   SUCCESS
> src.test.python.apache.aurora.common.test_shellify
>       .....   SUCCESS
> src.test.python.apache.aurora.common.test_transport
>      .....   SUCCESS
> src.test.python.apache.aurora.config.test_base
>       .....   SUCCESS
> src.test.python.apache.aurora.config.test_constraint_parsing
>       .....   SUCCESS
> src.test.python.apache.aurora.config.test_loader
>       .....   SUCCESS
> src.test.python.apache.aurora.config.test_thrift
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.common.announcer
>      .....   SUCCESS
> src.test.python.apache.aurora.executor.common.directory_sandbox
>      .....   SUCCESS
> src.test.python.apache.aurora.executor.common.executor_timeout
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.common.health_checker
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.common.status_checker
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.common.task_info
>      .....   SUCCESS
> src.test.python.apache.aurora.executor.executor_base
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.executor_detector
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.executor_vars
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.gc_executor
>       .....   SUCCESS
> src.test.python.apache.aurora.executor.status_manager
>      .....   SUCCESS
> src.test.python.apache.aurora.executor.thermos_executor
>      .....   SUCCESS
> src.test.python.apache.aurora.executor.thermos_task_runner
>       .....   SUCCESS
> src.test.python.apache.thermos.bin.test_thermos
>      .....   SUCCESS
> src.test.python.apache.thermos.common.test_pathspec
>      .....   SUCCESS
> src.test.python.apache.thermos.common.test_planner
>       .....   SUCCESS
> src.test.python.apache.thermos.common.test_task_planner
>      .....   SUCCESS
> src.test.python.apache.thermos.config.test_schema
>      .....   SUCCESS
> src.test.python.apache.thermos.core.test_angry
>       .....   SUCCESS
> src.test.python.apache.thermos.core.test_ephemerals
>      .....   SUCCESS
> src.test.python.apache.thermos.core.test_failing_runner
>      .....   SUCCESS
> src.test.python.apache.thermos.core.test_failure_limit
>       .....   SUCCESS
> src.test.python.apache.thermos.core.test_finalization
>      .....   SUCCESS
> src.test.python.apache.thermos.core.test_helper
>      .....   SUCCESS
> src.test.python.apache.thermos.core.test_process
>       .....   SUCCESS
> src.test.python.apache.thermos.core.test_runner_integration
>      .....   SUCCESS
> src.test.python.apache.thermos.core.test_staged_kill
>       .....   SUCCESS
> src.test.python.apache.thermos.monitoring.test_disk
>      .....   FAILURE
> Build step 'Execute shell' marked build as failure
> Recording test results
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message