beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sourabh Bajaj (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1730) Python post commits timing out
Date Wed, 15 Mar 2017 20:31:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926928#comment-15926928
] 

Sourabh Bajaj commented on BEAM-1730:
-------------------------------------

Reverting the changes in the commit as this needs broader discussion.

> Python post commits timing out
> ------------------------------
>
>                 Key: BEAM-1730
>                 URL: https://issues.apache.org/jira/browse/BEAM-1730
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py
>            Reporter: Ahmet Altay
>            Assignee: Sourabh Bajaj
>
> https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/
> Dataflow worker logs:
> https://pantheon.corp.google.com/logs/viewer?logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup&project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2017-03-15_10_30_20-1232538583050549167&minLogLevel=0&expandAll=false&timestamp=2017-03-15T19:15:33.000000000Z
> Stack trace:
> I  Executing: /usr/bin/python -m dataflow_worker.start -Djob_id=2017-03-15_10_30_20-1232538583050549167
-Dproject_id=apache-beam-testing -Dreporting_enabled=True -Droot_url=https://dataflow.googleapis.com
-Dservice_path=https://dataflow.googleapis.com/ -Dtemp_gcs_directory=gs://unused -Dworker_id=py-validatesrunner-148959-03151030-f51b-harness-t79h
-Ddataflow.worker.logging.location=/var/log/dataflow/python-dataflow-0-json.log -Dlocal_staging_directory=/var/opt/google/dataflow
-Dsdk_pipeline_options={"display_data":[{"key":"requirements_file","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"postcommit_requirements.txt"},{"key":"sdk_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"dist/apache-beam-0.7.0.dev0.tar.gz"},{"key":"num_workers","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"INTEGER","value":1},{"key":"runner","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"TestDataflowRunner"},{"key":"staging_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"project","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"apache-beam-testing"},{"key":"temp_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"job_name","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"py-validatesrunner-1489599007"}],"options":{"autoscalingAlgorithm":"NONE","dataflowJobId":"2017-03-15_10_30_20-1232538583050549167","dataflow_endpoint":"https://dataflow.googleapis.com","direct_runner_use_stacked_bundle":true,"gcpTempLocation":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","job_name":"py-validatesrunner-1489599007","male":false,"maxNumWorkers":0,"mock_flag":false,"no_auth":false,"numWorkers":1,"num_workers":1,"pipeline_type_check":true,"profile_cpu":false,"profile_memory":false,"project":"apache-beam-testing","requirements_file":"postcommit_requirements.txt","runner":"TestDataflowRunner","runtime_type_check":false,"save_main_session":false,"sdk_location":"dist/apache-beam-0.7.0.dev0.tar.gz","staging_location":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","streaming":false,"style":"scrambled","temp_location":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","type_check_strictness":"DEFAULT_TO_ANY"}}

> I  Traceback (most recent call last): 
> I    File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main 
> I       
> I  "__main__", fname, loader, pkg_name) 
> I    File "/usr/lib/python2.7/runpy.py", line 72, in _run_code 
> I       
> I  exec code in run_globals 
> I    File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/start.py", line 26,
in <module> 
> I       
> I  from dataflow_worker import batchworker 
> I    File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line
51, in <module> 
> I       
> I  from apache_beam.internal import pickler 
> I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/__init__.py", line 85,
in <module> 
> I       
> I  __version__ = version.get_version() 
> I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 30, in
get_version 
> I       
> I  __version__ = get_version_from_pom() 
> I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 36, in
get_version_from_pom 
> I       
> I  with open('pom.xml', 'r') as f: 
> I  IOError 
> I    
> I  [Errno 2] No such file or directory: 'pom.xml' 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message