beam-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PostCommit_Py_ValCont #5313
Date Fri, 17 Jan 2020 03:57:24 GMT
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/5313/display/redirect?page=changes>

Changes:

[angoenka] [BEAM-8625] Implement servlet for exposing sdk harness statuses in Da…


------------------------------------------
[...truncated 630.66 KB...]
copying apache_beam/transforms/display.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.20.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.20.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.20.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.20.0.dev0/apache_beam/utils
Writing apache-beam-2.20.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.20.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz

# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
  --attr ValidatesContainer \
  --nologcapture \
  --processes=1 \
  --process-timeout=900 \
  --with-xunitmp \
  --xunitmp-file=$XUNIT_FILE \
  --ignore-files '.*py3\d?\.py$' \
  --test-pipeline-options=" \
    --runner=TestDataflowRunner \
    --project=$PROJECT \
    --worker_harness_container_image=$CONTAINER:$TAG \
    --staging_location=$GCS_LOCATION/staging-validatesrunner-test \
    --temp_location=$GCS_LOCATION/temp-validatesrunner-test \
    --output=$GCS_LOCATION/output \
    --sdk_location=$SDK_LOCATION \
    --num_workers=1"
setup.py:242: UserWarning: You are using Apache Beam with Python 2. New releases of Apache
Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/setuptools/dist.py>:476:
UserWarning: Normalizing '2.20.0.dev' to '2.20.0.dev0'
  normalized_version,
running nosetests
running egg_info
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:224:
UserWarning: Installing grpcio-tools is recommended for development.
  warnings.warn('Installing grpcio-tools is recommended for development.')
Skipping proto regeneration: all files up to date
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84:
UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon
support Python 3 only.
  'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires
Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for
Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]`
to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive
Beam features when you are not in an interactive environment such as a Jupyter notebook or
ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:513:
YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default
Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
  for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1.
Future releases of Beam will require the user to set --region explicitly, or else have a default
set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1.
Future releases of Beam will require the user to set --region explicitly, or else have a default
set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
... ERROR

======================================================================
ERROR: test suite for <class 'apache_beam.examples.wordcount_it_test.WordCountIT'>
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",>
line 812, in run
    test(orig)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/suite.py",>
line 177, in __call__
    return self.run(*arg, **kw)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",>
line 822, in run
    test.config.plugins.addError(test,err)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/manager.py",>
line 99, in __call__
    return self.call(*arg, **kw)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/manager.py",>
line 167, in simple
    result = meth(*arg, **kw)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/xunit.py",>
line 287, in addError
    tb = format_exception(err, self.encoding)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/pyversion.py",>
line 214, in format_exception
    ''.join(traceback.format_exception(*exc_info)),
  File "/usr/lib/python2.7/traceback.py", line 141, in format_exception
    list = list + format_tb(tb, limit)
  File "/usr/lib/python2.7/traceback.py", line 76, in format_tb
    return format_list(extract_tb(tb, limit))
  File "/usr/lib/python2.7/traceback.py", line 101, in extract_tb
    line = linecache.getline(filename, lineno, f.f_globals)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",>
line 14, in getline
    lines = getlines(filename, module_globals)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",>
line 41, in getlines
    return updatecache(filename, module_globals)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",>
line 132, in updatecache
    lines = fp.readlines()
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",>
line 276, in signalhandler
    raise TimedOutException()
TimedOutException: '<nose.plugins.multiprocess.NoSharedFixtureContextSuite context=WordCountIT>'

======================================================================
ERROR: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",>
line 812, in run
    test(orig)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/case.py",>
line 45, in __call__
    return self.run(*arg, **kwarg)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/case.py",>
line 133, in run
    self.runTest(result)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/case.py",>
line 151, in runTest
    test(result)
  File "/usr/lib/python2.7/unittest/case.py", line 393, in __call__
    return self.run(*args, **kwds)
  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
    testMethod()
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",>
line 58, in test_metrics_fnapi_it
    result = self.run_pipeline(experiment='beam_fn_api')
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",>
line 39, in run_pipeline
    test_pipeline = TestPipeline(is_integration_test=True)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",>
line 107, in __init__
    super(TestPipeline, self).__init__(runner, options)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",>
line 184, in __init__
    errors = PipelineOptionsValidator(self._options, runner).validate()
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/options/pipeline_options_validator.py",>
line 113, in validate
    errors.extend(self.options.view_as(cls).validate(self))
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/options/pipeline_options.py",>
line 591, in validate
    self.view_as(GoogleCloudOptions).region = self._get_default_gcp_region()
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/options/pipeline_options.py",>
line 559, in _get_default_gcp_region
    raw_output = processes.check_output(cmd, stderr=DEVNULL)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/processes.py",>
line 85, in check_output
    out = subprocess.check_output(*args, **kwargs)
  File "/usr/lib/python2.7/subprocess.py", line 568, in check_output
    output, unused_err = process.communicate()
  File "/usr/lib/python2.7/subprocess.py", line 792, in communicate
    stdout = _eintr_retry_call(self.stdout.read)
  File "/usr/lib/python2.7/subprocess.py", line 476, in _eintr_retry_call
    return func(*args)
  File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",>
line 276, in signalhandler
    raise TimedOutException()
TimedOutException: 'test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)'

----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 903.798s

FAILED (errors=2)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20200117-033442
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:8743b095f26bf8577fdb227e52581a5e47da7c74d317a71bb679cd9b8ee32594
Deleted: sha256:a663931f86008f0106601fe884af8f81f6ed8ef2f84a68acf485195536e7b792
Deleted: sha256:73ea5b658a572965618d6bc274f353bc22020272e5fc4c881020e3f6c264afc6
Deleted: sha256:86bac59a83ea78dfd2657d7aefcb745b9d67115291e558c7dfbc2c16367e6208
Deleted: sha256:f088460df511278caab05840023f7149bcd0895eb044b848e755a7cd8ecf2951
Deleted: sha256:3097b5957cd9e7700ce60ec95eb52fd93fc9991bf1bd0b17260e9dc635d46c01
Deleted: sha256:ab338da40af1d4d5b96db7b2a0a646797baf205dfe783e792e5720235a8a6c62
Deleted: sha256:7e4a4e30d5176e77e46029968d37c6912235064e4150ddd79733520e93afb6b6
Deleted: sha256:bdc6c3e0f30dcb32507c665fddff0341097bb04988ca5f9f644074dca3f7bcc3
Deleted: sha256:77a084627847e5195fb8c86748a4a002b0b1054f3a54bf54c87d48d8db196f7e
Deleted: sha256:8915a278a513b3babc4d6d36de2169b6b455e694969829b1f118d0090a792b10
Deleted: sha256:c5b4d23862d295eef0dbfe1bef346bed3ba93c603ae79a7c64cec2b853169ca3
Deleted: sha256:060264e0eadba3925709107e0ac7d8df012adc6ce8acbed6c1407f5f445f3bad
Deleted: sha256:b0531fecdd734970edb226f94adcb07ca3d16aac768c87bc0191bca410d7e1bb
Deleted: sha256:53a7c7760f25f8c28ba513d0329544d1e12692c14f06dc44dc1597f25f610baa
Deleted: sha256:e743c0458bd54c22afd7fe01dfeae92553759eddcdbd5b4a426dadf82229a099
Deleted: sha256:6590e655c6b69e86f136c239ced8596ac8b1cdbf9d000067e6bab67c2a06103b
Deleted: sha256:ed4c896d89dc0d463fc977a39b2478b567acdc5bacaf5d9010fd570d537ed90a
Deleted: sha256:3b57dc547d37bfaeb8ce73a2fc3416a0015b5f8b89c20ccae90fcc31dc33126e
Deleted: sha256:2c0dae0d75df18714ac43294ad4397540fa54f9c532b02a280dc8618e4f9fecd
Deleted: sha256:252aece661bd35833976d9fec1125a3e15cb711173e9f2a310d8eefaf1de3f07
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:8743b095f26bf8577fdb227e52581a5e47da7c74d317a71bb679cd9b8ee32594
  Associated tags:
 - 20200117-033442
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20200117-033442
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20200117-033442].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:8743b095f26bf8577fdb227e52581a5e47da7c74d317a71bb679cd9b8ee32594].
Removed the container
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Mime
View raw message