beam-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <>
Subject Build failed in Jenkins: beam_PubsubIO_Performance_Test_Python #2
Date Tue, 19 May 2020 15:08:03 GMT
See <>


[sniemitz] Allow users of AvroIO to specify a custom DatumReader implementation

[pawel.pasterz] [BEAM-2530] PreCommit Dataflow examples - test compiled with java 11

[rohde.samuel] Change TestStreamImpl to a producer/consumer pattern

[kawaigin] Use csv reader instead of split to read csv data.

[mxm] [BEAM-9966] Use dataproc staging bucket for checkpoints directory

[tysonjh] Disambiguate method filter for toArray.

[pabloem] Revert "Merge pull request #11673 from [BEAM-9967] Adding support for BQ

[thw] Bump Flink 1.10 version

[kcweaver] [BEAM-9975] Log invalid dictionary after unsuccessful struct conversion.

[github] [BEAM-9945] Ensure that the read index represents the number of fully

[github] [BEAM-9942] reduce groovy code duplication in python test-suites

[boyuanz] [BEAM-9935] Respect allowed split points in Java

[apilloud] [BEAM-9522] Reject FULL JOIN ON false

[pabloem] [BEAM-9967] Adding support for BQ labels on Query/Export jobs. (Roll

[github] Switch to %s

[github] [BEAM-9001, BEAM-6327] Ensure that all transforms (except for required

[github] [BEAM-9928] Add qualified import name to task descriptors (#11690)

[mxm] [BEAM-9966] Remove unnecessary Reshuffles

[robinyqiu] Support ZetaSQL DATE type as a Beam LogicalType

[omarismail] [BEAM-9964] Setting --workerCacheMB to make its way to the

[github] [BEAM-9634] Add natural language analysis transform (#11611)

[github] [BEAM-9430] Fixes the bounds of initial watermark set to estimators

[kcweaver] [BEAM-9993] Add option defaults for Flink Python tests.

[github] [BEAM-9941] Added a test of a GBK followed by a Flatten with an unknown

[github] Clarify pubsub IO comment about timestamps (#11672)

[omarismail] [BEAM-9964] Added testMaxWeight method in WIndmillStateCacheTest as per

[iemejia] [BEAM-9833] Add yamllint config

[iemejia] [BEAM-9833] Fix .asf.yaml issues, sort labels and disable rebase button

[github] Clarifies an error message in Katas to explain what is actually wrong.

[github] Merge pull request #11210 from [BEAM-8949] SpannerIO integration tests

[github] [BEAM-9876] Migrate the Beam website from Jekyll to Hugo to enable

[github] Update the range for pyarrow to qualify pyarrow 0.17.x (#11699)

[yifanzou] Run Inventory job twice a day at 6 and 18.

[github] Update release notes link for 2.20.0

[jiangxuehua1213] [BEAM-9136] Update doc about docker image license pulling

[kamil.wasilewski] Make Post-Commits status dashboard compatible with the latest Grafana

[] Modified the codeblock background

[mxm] [BEAM-9966] Propagate the keys to the load generator correctly

[github] [BEAM-2939] Ensure that we don't checkpoint the initial restriction as

[mxm] [BEAM-6733] Add pipeline option to flush bundle data before

[github] support isRelease tag for docker build command & update release guide

[github] [BEAM-1866] Enable validation of PAssert counts in Java validates runner

[daniel.o.programmer] [BEAM-9951] Creating a synthetic source for the Go SDK.

[daniel.o.programmer] [BEAM-9951] Creating a synthetic step for the Go SDK.

[github] Merge pull request #11725: [BEAM-10015] Fix output timestamp on dataflow

[hsuryawirawan] Remove all answer placeholder checks as they can be confusing at times

[hsuryawirawan] Update course in Stepik

[ihr] [BEAM-10018] Fix timestamps in windowing kata

[ihr] [BEAM-10018] Kata failing due to failed parsing

[github] [BEAM-2939] Ensure that we update the watermark even when no elements

[ihr] Remove unused import

[ihr] Add missing dependency

[ihr] Fix member variable name in Kata documentation

[ihr] Fix placeholder location

[github] [BEAM-2530] Implement Zeta SQL precommit compile tests and run on java

[pawel.pasterz] [BEAM-2530] Sql precommit compile and run on java 11

[github] Python3 fix - convert dict.keys() to list before indexing (#11733)

[github] Updates google-apitools and httplib2 (#11726)

[github] [BEAM-9964] Update  (#11743)

[github] [BEAM-9577] Artifact v2 support for uber jars. (#11708)

[nielm] Populate all SpannerIO batching parameters in display data.

[nielm] Fix capitalization, clarify descriptions

[nielm] fix capitalization, clarify description Grouped

[nielm] Refactor to extract single method for popuplating displayData

[github] [BEAM-9339] Ensure that Dataflow's pipeline proto also contains the

[github] [BEAM-9363] TUMBLE as TVF (#10946)

[sruthi.sreekumar] Updated Flink runner version in NEXMark documentation

[...truncated 13.78 KB...]
UserWarning: Normalizing '' to '2.22.0.dev0'
INFO:gen_protos:Regenerating Python proto definitions (no output files).
INFO:gen_protos:Found protoc_gen_mypy at <>
metrics.proto: warning: Import google/protobuf/timestamp.proto but not used.
beam_fn_api.proto: warning: Import google/protobuf/descriptor.proto but not used.
beam_fn_api.proto: warning: Import google/protobuf/wrappers.proto but not used.
beam_interactive_api.proto: warning: Import google/protobuf/timestamp.proto but not used.
Writing mypy to external_transforms_pb2.pyi
Writing mypy to beam_runner_api_pb2.pyi
Writing mypy to standard_window_fns_pb2.pyi
Writing mypy to metrics_pb2.pyi
Writing mypy to endpoints_pb2.pyi
Writing mypy to schema_pb2.pyi
Writing mypy to beam_artifact_api_pb2.pyi
Writing mypy to beam_expansion_api_pb2.pyi
Writing mypy to beam_job_api_pb2.pyi
Writing mypy to beam_provision_api_pb2.pyi
Writing mypy to beam_fn_api_pb2.pyi
Writing mypy to beam_interactive_api_pb2.pyi
RefactoringTool: Skipping optional fixer: idioms
RefactoringTool: Skipping optional fixer: ws_comma
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: No changes to <>
RefactoringTool: Refactored <>
RefactoringTool: Refactored <>
RefactoringTool: No changes to <>
RefactoringTool: Refactored <>
RefactoringTool: Files that were modified:
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
RefactoringTool: <>
INFO:gen_protos:Writing urn stubs: <>
INFO:gen_protos:Writing urn stubs: <>
INFO:gen_protos:Writing urn stubs: <>
INFO:gen_protos:Writing urn stubs: <>
warning: no files found matching ''
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt,

> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest
Processing <>
Processing /home/jenkins/.cache/pip/wheels/dc/9a/e9/49e627353476cec8484343c4ab656f1e0d783ee77b9dde2d1f/crcmod-1.7-cp37-cp37m-linux_x86_64.whl
Processing /home/jenkins/.cache/pip/wheels/a4/61/fd/c57e374e580aa78a45ed78d5859b3a44436af17e22ca53284f/dill-
Collecting fastavro<0.24,>=0.21.4
  Using cached fastavro-0.23.4-cp37-cp37m-manylinux2010_x86_64.whl (1.4 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in <>
(from apache-beam==2.22.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in <>
(from apache-beam==2.22.0.dev0) (1.29.0)
Processing /home/jenkins/.cache/pip/wheels/0a/7d/38/ea4eaf831518e6cd867b515b88919a9785eb66f11def5ab859/hdfs-2.5.8-py3-none-any.whl
Collecting httplib2<0.18.0,>=0.8
  Using cached httplib2-0.17.3-py3-none-any.whl (95 kB)
Collecting mock<3.0.0,>=1.0.1
  Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
  Using cached numpy-1.18.4-cp37-cp37m-manylinux1_x86_64.whl (20.2 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.10.1-cp37-cp37m-manylinux2014_x86_64.whl (462 kB)
Processing /home/jenkins/.cache/pip/wheels/86/73/7a/3b3f76a2142176605ff38fbca574327962c71e25a43197a4c1/oauth2client-3.0.0-py3-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <>
(from apache-beam==2.22.0.dev0) (3.12.0)
Collecting pydot<2,>=1.2.0
  Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
  Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
  Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
  Using cached typing_extensions- (22 kB)
Processing /home/jenkins/.cache/pip/wheels/bc/49/5f/fdb5b9d85055c478213e0158ac122b596816149a02d82e0ab1/avro_python3-
Collecting pyarrow<0.18.0,>=0.15.1
  Using cached pyarrow-0.17.1-cp37-cp37m-manylinux2014_x86_64.whl (63.8 MB)
Collecting boto3>=1.9
  Using cached boto3-1.13.12-py2.py3-none-any.whl (128 kB)
Collecting cachetools<4,>=3.1.0
  Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/19/b5/2f/1cc3cf2b31e7a9cd1508731212526d9550271274d351c96f16/google_apitools-0.5.31-py3-none-any.whl
Collecting google-cloud-datastore<1.8.0,>=1.7.1
  Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
  Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
  Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
  Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
  Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
  Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
  Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
  Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
  Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177 kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
  Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting freezegun>=0.3.12
  Using cached freezegun-0.3.15-py2.py3-none-any.whl (14 kB)
Collecting nose>=1.3.7
  Using cached nose-1.3.7-py3-none-any.whl (154 kB)
Processing /home/jenkins/.cache/pip/wheels/2e/29/a9/431158315f33abeaad2905460f5ffb18fc30f7ed7c66c47dee/nose_xunitmp-0.4.1-py3-none-any.whl
Collecting pandas<0.25,>=0.23.4
  Using cached pandas-0.24.2-cp37-cp37m-manylinux1_x86_64.whl (10.1 MB)
Collecting parameterized<0.8.0,>=0.7.1
  Using cached parameterized-0.7.4-py2.py3-none-any.whl (25 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
  Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Processing /home/jenkins/.cache/pip/wheels/5e/03/1e/e1e954795d6f35dfc7b637fe2277bff021303bd9570ecea653/PyYAML-5.3.1-cp37-cp37m-linux_x86_64.whl
Collecting requests_mock<2.0,>=1.7
  Using cached requests_mock-1.8.0-py2.py3-none-any.whl (23 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
  Using cached pytest-4.6.10-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
  Using cached pytest_xdist-1.32.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
  Using cached pytest_timeout-1.3.4-py2.py3-none-any.whl (10 kB)
Requirement already satisfied: six>=1.5.2 in <>
(from grpcio<2,>=1.12.1->apache-beam==2.22.0.dev0) (1.14.0)
Collecting requests>=2.7.0
  Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB)
Processing /home/jenkins/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e/docopt-0.6.2-py2.py3-none-any.whl
Collecting pbr>=0.11
  Using cached pbr-5.4.5-py2.py3-none-any.whl (110 kB)
Collecting pyasn1>=0.1.7
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting pyasn1-modules>=0.0.5
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa>=3.1.4
  Using cached rsa-4.0-py2.py3-none-any.whl (38 kB)
Requirement already satisfied: setuptools in <>
(from protobuf<4,>=3.5.0.post1->apache-beam==2.22.0.dev0) (46.4.0)
Collecting pyparsing>=2.1.4
  Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting jmespath<1.0.0,>=0.7.1
  Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB)
Collecting s3transfer<0.4.0,>=0.3.0
  Using cached s3transfer-0.3.3-py2.py3-none-any.whl (69 kB)
Collecting botocore<1.17.0,>=1.16.12
  Using cached botocore-1.16.12-py2.py3-none-any.whl (6.2 MB)
Collecting fasteners>=0.14
  Using cached fasteners-0.15-py2.py3-none-any.whl (23 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.6.0
  Using cached google_api_core-1.17.0-py2.py3-none-any.whl (70 kB)
Processing /home/jenkins/.cache/pip/wheels/b9/ee/67/2e444183030cb8d31ce8b34cee34a7afdbd3ba5959ea846380/grpc_google_iam_v1-0.12.3-py3-none-any.whl
Collecting google-resumable-media<0.6dev,>=0.5.0
  Using cached google_resumable_media-0.5.0-py2.py3-none-any.whl (38 kB)
Collecting google-auth<2.0dev,>=1.9.0
  Using cached google_auth-1.15.0-py2.py3-none-any.whl (89 kB)
Requirement already satisfied: py>=1.5.0 in <>
(from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (1.8.1)
Collecting wcwidth
  Using cached wcwidth-0.1.9-py2.py3-none-any.whl (19 kB)
Collecting more-itertools>=4.0.0; python_version > "2.7"
  Using cached more_itertools-8.3.0-py3-none-any.whl (44 kB)
Collecting packaging
  Downloading packaging-20.4-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <>
(from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (1.6.0)
Collecting attrs>=17.4.0
  Using cached attrs-19.3.0-py2.py3-none-any.whl (39 kB)
Collecting atomicwrites>=1.0
  Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: pluggy<1.0,>=0.12 in <>
(from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (0.13.1)
Collecting pytest-forked
  Using cached pytest_forked-1.1.3-py2.py3-none-any.whl (4.5 kB)
Collecting execnet>=1.1
  Using cached execnet-1.7.1-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2020.4.5.1-py2.py3-none-any.whl (157 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
  Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.9-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
  Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting docutils<0.16,>=0.10
  Using cached docutils-0.15.2-py3-none-any.whl (547 kB)
Collecting monotonic>=0.1
  Using cached monotonic-1.5-py2.py3-none-any.whl (5.3 kB)
Processing /home/jenkins/.cache/pip/wheels/4c/a1/71/5e427276ceeff277fd76878d1b19fbf4587a2845015d86864b/googleapis_common_protos-1.51.0-py3-none-any.whl
Requirement already satisfied: zipp>=0.5 in <>
(from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0)
Collecting apipkg>=1.4
  Using cached apipkg-1.5-py2.py3-none-any.whl (4.9 kB)
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam ( started
  Building wheel for apache-beam ( finished with status 'done'
  Created wheel for apache-beam: filename=apache_beam-2.22.0.dev0-py3-none-any.whl size=2061255
  Stored in directory: /home/jenkins/.cache/pip/wheels/27/f6/15/903d98a987e6b5927ad2e19bb9118a73aae69616e48a50831d
Successfully built apache-beam
Installing collected packages: crcmod, dill, pytz, fastavro, certifi, urllib3, idna, chardet,
requests, docopt, hdfs, httplib2, pbr, mock, numpy, pymongo, pyasn1, pyasn1-modules, rsa,
oauth2client, pyparsing, pydot, python-dateutil, typing-extensions, avro-python3, pyarrow,
jmespath, docutils, botocore, s3transfer, boto3, cachetools, monotonic, fasteners, google-apitools,
googleapis-common-protos, google-auth, google-api-core, google-cloud-core, google-cloud-datastore,
grpc-google-iam-v1, google-cloud-pubsub, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable,
google-cloud-spanner, grpcio-gcp, google-cloud-dlp, google-cloud-language, google-cloud-videointelligence,
google-cloud-vision, freezegun, nose, nose-xunitmp, pandas, parameterized, pyhamcrest, pyyaml,
requests-mock, tenacity, wcwidth, more-itertools, packaging, attrs, atomicwrites, pytest,
pytest-forked, apipkg, execnet, pytest-xdist, pytest-timeout, apache-beam
Successfully installed apache-beam-2.22.0.dev0 apipkg-1.5 atomicwrites-1.4.0 attrs-19.3.0
avro-python3- boto3-1.13.12 botocore-1.16.12 cachetools-3.1.1 certifi-2020.4.5.1 chardet-3.0.4
crcmod-1.7 dill- docopt-0.6.2 docutils-0.15.2 execnet-1.7.1 fastavro-0.23.4 fasteners-0.15
freezegun-0.3.15 google-api-core-1.17.0 google-apitools-0.5.31 google-auth-1.15.0 google-cloud-bigquery-1.24.0
google-cloud-bigtable-1.0.0 google-cloud-core-1.3.0 google-cloud-datastore-1.7.4 google-cloud-dlp-0.13.0
google-cloud-language-1.3.0 google-cloud-pubsub-1.0.2 google-cloud-spanner-1.13.0 google-cloud-videointelligence-1.13.0
google-cloud-vision-0.42.0 google-resumable-media-0.5.0 googleapis-common-protos-1.51.0 grpc-google-iam-v1-0.12.3
grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.17.3 idna-2.9 jmespath-0.10.0 mock-2.0.0 monotonic-1.5
more-itertools-8.3.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.18.4 oauth2client-3.0.0 packaging-20.4
pandas-0.24.2 parameterized-0.7.4 pbr-5.4.5 pyarrow-0.17.1 pyasn1-0.4.8 pyasn1-modules-0.2.8
pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.7 pytest-4.6.10 pytest-forked-1.1.3
pytest-timeout-1.3.4 pytest-xdist-1.32.0 python-dateutil-2.8.1 pytz-2020.1 pyyaml-5.3.1 requests-2.23.0
requests-mock-1.8.0 rsa-4.0 s3transfer-0.3.3 tenacity-5.1.5 typing-extensions- urllib3-1.25.9

> Task :sdks:python:apache_beam:testing:load_tests:run FAILED
No module named

FAILURE: Build failed with an exception.

* Where:
Build file '<'>
line: 51

* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to
get more log output. Run with --scan to get full insights.

* Get more help at

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.

BUILD FAILED in 1m 14s
5 actionable tasks: 5 executed

Publishing build scan...

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message