Mailing-List: contact commits-help@beam.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@beam.apache.org
Date: Wed, 15 Mar 2017 20:31:41 +0000 (UTC)
From: "Sourabh Bajaj (JIRA)" <jira@apache.org>
To: commits@beam.incubator.apache.org
Message-ID: <JIRA.13056406.1489605785000.30847.1489609901562@Atlassian.JIRA>
In-Reply-To: <JIRA.13056406.1489605785000@Atlassian.JIRA>
References: <JIRA.13056406.1489605785000@Atlassian.JIRA> <JIRA.13056406.1489605785148@jira-lw-us.apache.org>
Subject: [jira] [Commented] (BEAM-1730) Python post commits timing out
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Wed, 15 Mar 2017 20:31:49 -0000


    [ https://issues.apache.org/jira/browse/BEAM-1730?page=3Dcom.atlassian.=
jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D15926=
928#comment-15926928 ]=20

Sourabh Bajaj commented on BEAM-1730:
-------------------------------------

Reverting the changes in the commit as this needs broader discussion.

> Python post commits timing out
> ------------------------------
>
>                 Key: BEAM-1730
>                 URL: https://issues.apache.org/jira/browse/BEAM-1730
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py
>            Reporter: Ahmet Altay
>            Assignee: Sourabh Bajaj
>
> https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/151=
4/
> Dataflow worker logs:
> https://pantheon.corp.google.com/logs/viewer?logName=3Dprojects%2Fapache-=
beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup&project=3D=
apache-beam-testing&resource=3Ddataflow_step%2Fjob_id%2F2017-03-15_10_30_20=
-1232538583050549167&minLogLevel=3D0&expandAll=3Dfalse&timestamp=3D2017-03-=
15T19:15:33.000000000Z
> Stack trace:
> I  Executing: /usr/bin/python -m dataflow_worker.start -Djob_id=3D2017-03=
-15_10_30_20-1232538583050549167 -Dproject_id=3Dapache-beam-testing -Drepor=
ting_enabled=3DTrue -Droot_url=3Dhttps://dataflow.googleapis.com -Dservice_=
path=3Dhttps://dataflow.googleapis.com/ -Dtemp_gcs_directory=3Dgs://unused =
-Dworker_id=3Dpy-validatesrunner-148959-03151030-f51b-harness-t79h -Ddatafl=
ow.worker.logging.location=3D/var/log/dataflow/python-dataflow-0-json.log -=
Dlocal_staging_directory=3D/var/opt/google/dataflow -Dsdk_pipeline_options=
=3D{"display_data":[{"key":"requirements_file","namespace":"apache_beam.uti=
ls.pipeline_options.PipelineOptions","type":"STRING","value":"postcommit_re=
quirements.txt"},{"key":"sdk_location","namespace":"apache_beam.utils.pipel=
ine_options.PipelineOptions","type":"STRING","value":"dist/apache-beam-0.7.=
0.dev0.tar.gz"},{"key":"num_workers","namespace":"apache_beam.utils.pipelin=
e_options.PipelineOptions","type":"INTEGER","value":1},{"key":"runner","nam=
espace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING=
","value":"TestDataflowRunner"},{"key":"staging_location","namespace":"apac=
he_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs=
://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-valida=
tesrunner-1489599007.1489599009.190097"},{"key":"project","namespace":"apac=
he_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"ap=
ache-beam-testing"},{"key":"temp_location","namespace":"apache_beam.utils.p=
ipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage=
-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-14895990=
07.1489599009.190097"},{"key":"job_name","namespace":"apache_beam.utils.pip=
eline_options.PipelineOptions","type":"STRING","value":"py-validatesrunner-=
1489599007"}],"options":{"autoscalingAlgorithm":"NONE","dataflowJobId":"201=
7-03-15_10_30_20-1232538583050549167","dataflow_endpoint":"https://dataflow=
.googleapis.com","direct_runner_use_stacked_bundle":true,"gcpTempLocation":=
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-valida=
tesrunner-1489599007.1489599009.190097","job_name":"py-validatesrunner-1489=
599007","male":false,"maxNumWorkers":0,"mock_flag":false,"no_auth":false,"n=
umWorkers":1,"num_workers":1,"pipeline_type_check":true,"profile_cpu":false=
,"profile_memory":false,"project":"apache-beam-testing","requirements_file"=
:"postcommit_requirements.txt","runner":"TestDataflowRunner","runtime_type_=
check":false,"save_main_session":false,"sdk_location":"dist/apache-beam-0.7=
.0.dev0.tar.gz","staging_location":"gs://temp-storage-for-end-to-end-tests/=
staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.19009=
7","streaming":false,"style":"scrambled","temp_location":"gs://temp-storage=
-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-14895990=
07.1489599009.190097","type_check_strictness":"DEFAULT_TO_ANY"}}=20
> I  Traceback (most recent call last):=20
> I    File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main=
=20
> I      =20
> I  "__main__", fname, loader, pkg_name)=20
> I    File "/usr/lib/python2.7/runpy.py", line 72, in _run_code=20
> I      =20
> I  exec code in run_globals=20
> I    File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/start.p=
y", line 26, in <module>=20
> I      =20
> I  from dataflow_worker import batchworker=20
> I    File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchwo=
rker.py", line 51, in <module>=20
> I      =20
> I  from apache_beam.internal import pickler=20
> I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/__init__.py=
", line 85, in <module>=20
> I      =20
> I  __version__ =3D version.get_version()=20
> I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py"=
, line 30, in get_version=20
> I      =20
> I  __version__ =3D get_version_from_pom()=20
> I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py"=
, line 36, in get_version_from_pom=20
> I      =20
> I  with open('pom.xml', 'r') as f:=20
> I  IOError=20
> I   =20
> I  [Errno 2] No such file or directory: 'pom.xml'=20


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)