From commits-return-56814-archive-asf-public=cust-asf.ponee.io@beam.apache.org Thu Jan 25 07:00:49 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 57D11180651 for ; Thu, 25 Jan 2018 07:00:49 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 47B91160C3C; Thu, 25 Jan 2018 06:00:49 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 41064160C4E for ; Thu, 25 Jan 2018 07:00:48 +0100 (CET) Received: (qmail 57338 invoked by uid 500); 25 Jan 2018 06:00:47 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 57329 invoked by uid 99); 25 Jan 2018 06:00:47 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Jan 2018 06:00:47 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id BDCCF180724 for ; Thu, 25 Jan 2018 06:00:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.79 X-Spam-Level: X-Spam-Status: No, score=0.79 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_LOW=-0.7, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id gzf75vDI4ejY for ; Thu, 25 Jan 2018 06:00:44 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id BB9345FAC9 for ; Thu, 25 Jan 2018 06:00:43 +0000 (UTC) Received: from jenkins-master.apache.org (unknown [62.210.60.235]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 27463E0CA3 for ; Thu, 25 Jan 2018 06:00:43 +0000 (UTC) Received: from jenkins-master.apache.org (localhost [127.0.0.1]) by jenkins-master.apache.org (ASF Mail Server at jenkins-master.apache.org) with ESMTP id F3C26A02C0 for ; Thu, 25 Jan 2018 06:00:40 +0000 (UTC) Date: Thu, 25 Jan 2018 06:00:40 +0000 (UTC) From: Apache Jenkins Server To: commits@beam.apache.org Message-ID: <1966049980.2766.1516860040986.JavaMail.jenkins@jenkins-master.apache.org> In-Reply-To: <2593206.2673.1516839517137.JavaMail.jenkins@jenkins-master.apache.org> References: <2593206.2673.1516839517137.JavaMail.jenkins@jenkins-master.apache.org> Subject: Build failed in Jenkins: beam_PerformanceTests_TextIOIT #64 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Instance-Identity: MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAkqVKZPv7YyHBB3FvWfV7XQehwe/Ga3aadzSNknt8g382X3uN8A3SOQ+Ixq9HxS+ZlN6XR4TECySmSRy2JN5Rx8svxAD0TjtSF9LuU98dD+LniNDP7Lq6gvRFuJhbMHoS0nuTizDZLsK4X8TW5MyV9w+jFbdoZfRE5O/Mse0fkOeL5uoIS/3Vvu/W+x9QSjDkB7CaU56bPFlQjqqJBl3Cn9r34CkXQZYnLb/NjW4vcpw0+TgMUAPTIVEr5BTPZRshz19g7huwg3zANT5HBIZnzV4hsVY9w4JHkceFdKi/ibNnjPjsFs9pm0HSGJ/RDxjIvSTYT02eH4+m1RAYaj2E9QIDAQAB X-Jenkins-Job: beam_PerformanceTests_TextIOIT X-Jenkins-Result: FAILURE See Changes: [chamikara] [BEAM-3060] Support for Perfkit execution of file-based-io-tests on HDFS ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam4 (beam) in workspace > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision ad82ac140161cd5d88c972c88a1c8168cf26ff1c (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f ad82ac140161cd5d88c972c88a1c8168cf26ff1c Commit message: "[BEAM-3060] Support for Perfkit execution of file-based-io-tests on HDFS cluster. (#4401)" > git rev-list 3c6899c001b28ff98db461df8b712c691403b67d # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins7668203321018513748.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins9222162188802103341.sh + rm -rf .env [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins7634089902440331277.sh + virtualenv .env --system-site-packages New python executable in .env/bin/python Installing setuptools, pip...done. [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins2919914929995303972.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git Cloning into 'PerfKitBenchmarker'... [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins8178705422684882247.sh + .env/bin/pip install -r PerfKitBenchmarker/requirements.txt Requirement already satisfied (use --upgrade to upgrade): absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14)) Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15)) Requirement already satisfied (use --upgrade to upgrade): setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16)) Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17)) Installing extra requirements: 'windows' Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18)) Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19)) Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20)) Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21)) Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22)) Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23)) Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24)) Requirement already satisfied (use --upgrade to upgrade): pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25)) Cleaning up... [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins8796694996377489637.sh + .env/bin/pip install -e 'src/sdks/python/[gcp,test]' Obtaining file:// Running setup.py (path: egg_info for package from file:// :66: UserWarning: You are using version 1.5.4 of pip. However, version 7.0.0 is recommended. _PIP_VERSION, REQUIRED_PIP_VERSION no previously-included directories found matching 'doc/.build' Installed /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'python_requires' warnings.warn(msg) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' Installing extra requirements: 'gcp,test' Requirement already satisfied (use --upgrade to upgrade): avro>=1.8.1,<2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): crcmod>=1.7,<2.0 in /usr/lib/python2.7/dist-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): grpcio>=1.0,<2 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): httplib2>=0.8,<0.10 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): mock>=1.0.1,<3.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): oauth2client>=2.0.1,<5 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): protobuf>=3.5.0.post1,<4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): pyyaml>=3.12,<4.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): pyvcf>=0.6.8,<0.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): six>=1.9,<1.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): typing>=3.6.0,<3.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): futures>=3.1.1,<4.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): hdfs3>=0.3.0,<0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): pyhamcrest>=1.9,<2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): google-apitools>=0.5.18,<=0.5.20 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): proto-google-cloud-datastore-v1>=0.90.0,<=0.90.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.0,<2->apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client>=2.0.1,<5->apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client>=2.0.1,<5->apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client>=2.0.1,<5->apache-beam==2.3.0.dev) Requirement already satisfied (use --upgrade to upgrade): googleapis-common-protos>=1.5.2,<2.0dev in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1>=0.90.0,<=0.90.4->apache-beam==2.3.0.dev) Installing collected packages: apache-beam Running setup.py develop for apache-beam :66: UserWarning: You are using version 1.5.4 of pip. However, version 7.0.0 is recommended. _PIP_VERSION, REQUIRED_PIP_VERSION /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'python_requires' warnings.warn(msg) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' Creating (link to .) Adding apache-beam 2.3.0.dev to easy-install.pth file Installed Successfully installed apache-beam Cleaning up... [beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins1678079888969454408.sh + .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.textioit_pkb_results --official=true --benchmarks=beam_integration_benchmark --beam_it_timeout=1200 --beam_it_profile=io-it --beam_prebuilt=true --beam_sdk=java --beam_it_module=sdks/java/io/file-based-io-tests --beam_it_class=org.apache.beam.sdk.io.text.TextIOIT '--beam_it_options=[--project=apache-beam-testing,--tempRoot=gs://temp-storage-for-perf-tests,--numberOfRecords=1000000,--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_TextIOIT/64/]' '--beam_extra_mvn_properties=[filesystem=gcs]' Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in sys.exit(Main()) File " line 869, in Main SetUpPKB() File " line 740, in SetUpPKB vm_util.GenTempDir() File " line 121, in GenTempDir temp_dir.CreateTemporaryDirectories() File " line 62, in CreateTemporaryDirectories os.makedirs(path) File " line 157, in makedirs mkdir(name, mode) OSError: [Errno 13] Permission denied: '/tmp/perfkitbenchmarker/runs/24d363cf' Build step 'Execute shell' marked build as failure