beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmet Altay (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-1730) Python post commits timing out
Date Wed, 15 Mar 2017 19:23:41 GMT
Ahmet Altay created BEAM-1730:
---------------------------------

             Summary: Python post commits timing out
                 Key: BEAM-1730
                 URL: https://issues.apache.org/jira/browse/BEAM-1730
             Project: Beam
          Issue Type: Bug
          Components: sdk-py
            Reporter: Ahmet Altay
            Assignee: Sourabh Bajaj


https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/

Dataflow worker logs:
https://pantheon.corp.google.com/logs/viewer?logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup&project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2017-03-15_10_30_20-1232538583050549167&minLogLevel=0&expandAll=false&timestamp=2017-03-15T19:15:33.000000000Z

Stack trace:
I  Executing: /usr/bin/python -m dataflow_worker.start -Djob_id=2017-03-15_10_30_20-1232538583050549167
-Dproject_id=apache-beam-testing -Dreporting_enabled=True -Droot_url=https://dataflow.googleapis.com
-Dservice_path=https://dataflow.googleapis.com/ -Dtemp_gcs_directory=gs://unused -Dworker_id=py-validatesrunner-148959-03151030-f51b-harness-t79h
-Ddataflow.worker.logging.location=/var/log/dataflow/python-dataflow-0-json.log -Dlocal_staging_directory=/var/opt/google/dataflow
-Dsdk_pipeline_options={"display_data":[{"key":"requirements_file","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"postcommit_requirements.txt"},{"key":"sdk_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"dist/apache-beam-0.7.0.dev0.tar.gz"},{"key":"num_workers","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"INTEGER","value":1},{"key":"runner","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"TestDataflowRunner"},{"key":"staging_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"project","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"apache-beam-testing"},{"key":"temp_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"job_name","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"py-validatesrunner-1489599007"}],"options":{"autoscalingAlgorithm":"NONE","dataflowJobId":"2017-03-15_10_30_20-1232538583050549167","dataflow_endpoint":"https://dataflow.googleapis.com","direct_runner_use_stacked_bundle":true,"gcpTempLocation":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","job_name":"py-validatesrunner-1489599007","male":false,"maxNumWorkers":0,"mock_flag":false,"no_auth":false,"numWorkers":1,"num_workers":1,"pipeline_type_check":true,"profile_cpu":false,"profile_memory":false,"project":"apache-beam-testing","requirements_file":"postcommit_requirements.txt","runner":"TestDataflowRunner","runtime_type_check":false,"save_main_session":false,"sdk_location":"dist/apache-beam-0.7.0.dev0.tar.gz","staging_location":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","streaming":false,"style":"scrambled","temp_location":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","type_check_strictness":"DEFAULT_TO_ANY"}}

I  Traceback (most recent call last): 
I    File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main 
I       
I  "__main__", fname, loader, pkg_name) 
I    File "/usr/lib/python2.7/runpy.py", line 72, in _run_code 
I       
I  exec code in run_globals 
I    File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/start.py", line 26, in <module>

I       
I  from dataflow_worker import batchworker 
I    File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 51,
in <module> 
I       
I  from apache_beam.internal import pickler 
I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/__init__.py", line 85, in <module>

I       
I  __version__ = version.get_version() 
I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 30, in get_version

I       
I  __version__ = get_version_from_pom() 
I    File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 36, in get_version_from_pom

I       
I  with open('pom.xml', 'r') as f: 
I  IOError 
I    
I  [Errno 2] No such file or directory: 'pom.xml' 




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message