Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7C92D200C40 for ; Thu, 23 Mar 2017 19:19:41 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 7AA11160B83; Thu, 23 Mar 2017 18:19:41 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4EC82160B68 for ; Thu, 23 Mar 2017 19:19:40 +0100 (CET) Received: (qmail 51609 invoked by uid 500); 23 Mar 2017 18:19:39 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 51598 invoked by uid 99); 23 Mar 2017 18:19:39 -0000 Received: from crius.apache.org (HELO crius.apache.org) (140.211.11.14) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Mar 2017 18:19:39 +0000 Received: from crius.apache.org (localhost [127.0.0.1]) by crius.apache.org (ASF Mail Server at crius.apache.org) with ESMTP id 2B4CC9C00B8; Thu, 23 Mar 2017 18:19:39 +0000 (UTC) Date: Thu, 23 Mar 2017 18:19:37 +0000 (UTC) From: Apache Jenkins Server To: commits@beam.apache.org, klk@google.com, dhalperi@google.com Message-ID: <2031523288.1192.1490293178966.JavaMail.jenkins@crius> Subject: Build failed in Jenkins: beam_PostCommit_Python_Verify #1596 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Instance-Identity: MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAkqVKZPv7YyHBB3FvWfV7XQehwe/Ga3aadzSNknt8g382X3uN8A3SOQ+Ixq9HxS+ZlN6XR4TECySmSRy2JN5Rx8svxAD0TjtSF9LuU98dD+LniNDP7Lq6gvRFuJhbMHoS0nuTizDZLsK4X8TW5MyV9w+jFbdoZfRE5O/Mse0fkOeL5uoIS/3Vvu/W+x9QSjDkB7CaU56bPFlQjqqJBl3Cn9r34CkXQZYnLb/NjW4vcpw0+TgMUAPTIVEr5BTPZRshz19g7huwg3zANT5HBIZnzV4hsVY9w4JHkceFdKi/ibNnjPjsFs9pm0HSGJ/RDxjIvSTYT02eH4+m1RAYaj2E9QIDAQAB X-Jenkins-Job: beam_PostCommit_Python_Verify X-Jenkins-Result: FAILURE archived-at: Thu, 23 Mar 2017 18:19:41 -0000 See Changes: [klk] Enable WindowedWordCountIT on Flink runner in presubmit [dhalperi] [BEAM-1780] BigtableIO: better handling of bad split requests ------------------------------------------ [...truncated 693.32 KB...] DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.3.2.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz test_as_singleton_with_different_defaults_with_unique_labels (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.3.2.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_default_value_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_singleton_without_unique_labels (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_iterable_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_empty_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok ====================================================================== ERROR: test_par_do_with_multiple_outputs_and_using_return (apache_beam.transforms.ptransform_test.PTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File " line 207, in test_par_do_with_multiple_outputs_and_using_return pipeline.run() File " line 91, in run result = super(TestPipeline, self).run() File " line 163, in run return self.runner.run(self) File " line 32, in run self.result = super(TestDataflowRunner, self).run(pipeline) File " line 175, in run self.dataflow_client.create_job(self.job), self) File " line 174, in wrapper return fun(*args, **kwargs) File " line 411, in create_job self.create_job_description(job) File " line 432, in create_job_description job.options, file_copy=self._gcs_file_copy) File " line 290, in stage_job_resources setup_options.requirements_file, requirements_cache_path) File " line 226, in _populate_requirements_cache processes.check_call(cmd_args) File " line 40, in check_call return subprocess.check_call(*args, **kwargs) File "/usr/lib/python2.7/subprocess.py", line 540, in check_call raise CalledProcessError(retcode, cmd) CalledProcessError: Command '[' '-m', 'pip', 'install', '--download', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--no-binary', ':all:']' returned non-zero exit status 2 -------------------- >> begin captured logging << -------------------- root: DEBUG: PValue computed by Some Numbers (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/FlatMap(some_fn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Unkey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/FlatMap(some_fn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Unkey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/FlatMap(some_fn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Unkey (tag 1): refcount: 1 => 0 root: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0323180218-045580.1490292138.045885/requirements.txt... root: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0323180218-045580.1490292138.045885/requirements.txt root: INFO: Executing command: [' '-m', 'pip', 'install', '--download', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--no-binary', ':all:'] --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: test_par_do_with_multiple_outputs_and_using_yield (apache_beam.transforms.ptransform_test.PTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File " line 190, in test_par_do_with_multiple_outputs_and_using_yield pipeline.run() File " line 91, in run result = super(TestPipeline, self).run() File " line 163, in run return self.runner.run(self) File " line 32, in run self.result = super(TestDataflowRunner, self).run(pipeline) File " line 175, in run self.dataflow_client.create_job(self.job), self) File " line 174, in wrapper return fun(*args, **kwargs) File " line 411, in create_job self.create_job_description(job) File " line 432, in create_job_description job.options, file_copy=self._gcs_file_copy) File " line 290, in stage_job_resources setup_options.requirements_file, requirements_cache_path) File " line 226, in _populate_requirements_cache processes.check_call(cmd_args) File " line 40, in check_call return subprocess.check_call(*args, **kwargs) File "/usr/lib/python2.7/subprocess.py", line 540, in check_call raise CalledProcessError(retcode, cmd) CalledProcessError: Command '[' '-m', 'pip', 'install', '--download', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--no-binary', ':all:']' returned non-zero exit status 2 -------------------- >> begin captured logging << -------------------- root: DEBUG: PValue computed by Some Numbers (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/ParDo(SomeDoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Unkey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/ParDo(SomeDoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Unkey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/ParDo(SomeDoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Unkey (tag 1): refcount: 1 => 0 root: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0323180218-273568.1490292138.273842/requirements.txt... root: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0323180218-273568.1490292138.273842/requirements.txt root: INFO: Executing command: [' '-m', 'pip', 'install', '--download', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--no-binary', ':all:'] --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: test_undeclared_side_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File " line 220, in test_undeclared_side_outputs pipeline.run() File " line 91, in run result = super(TestPipeline, self).run() File " line 163, in run return self.runner.run(self) File " line 32, in run self.result = super(TestDataflowRunner, self).run(pipeline) File " line 175, in run self.dataflow_client.create_job(self.job), self) File " line 174, in wrapper return fun(*args, **kwargs) File " line 411, in create_job self.create_job_description(job) File " line 432, in create_job_description job.options, file_copy=self._gcs_file_copy) File " line 290, in stage_job_resources setup_options.requirements_file, requirements_cache_path) File " line 226, in _populate_requirements_cache processes.check_call(cmd_args) File " line 40, in check_call return subprocess.check_call(*args, **kwargs) File "/usr/lib/python2.7/subprocess.py", line 540, in check_call raise CalledProcessError(retcode, cmd) CalledProcessError: Command '[' '-m', 'pip', 'install', '--download', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--no-binary', ':all:']' returned non-zero exit status 2 -------------------- >> begin captured logging << -------------------- root: DEBUG: PValue computed by Some Numbers (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/FlatMap() (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert_that/Unkey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/FlatMap() (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:odd/Unkey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by ClassifyNumbers/FlatMap() (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/WindowInto(WindowIntoFn) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Create (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/ToVoidKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/pair_with_0 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/pair_with_1 (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/Flatten (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/GroupByKey (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Group/Map(_merge_tagged_vals_under_key) (tag 1): refcount: 1 => 0 root: DEBUG: PValue computed by assert:even/Unkey (tag 1): refcount: 1 => 0 root: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0323180218-484523.1490292138.484763/requirements.txt... root: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0323180218-484523.1490292138.484763/requirements.txt root: INFO: Executing command: [' '-m', 'pip', 'install', '--download', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--no-binary', ':all:'] --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- Ran 14 tests in 1009.245s FAILED (errors=3) Build step 'Execute shell' marked build as failure