airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] kaxil commented on issue #3744: [AIRFLOW-2893] fix stuck dataflow job due to name mismatch
Date Mon, 13 Aug 2018 15:26:07 GMT
kaxil commented on issue #3744: [AIRFLOW-2893] fix stuck dataflow job due to name mismatch
URL: https://github.com/apache/incubator-airflow/pull/3744#issuecomment-412558011
 
 
   @fenglu-g Looks like a Python 3 test failures:
   
   ```
   ======================================================================
   20) ERROR: test_data_flow_missing_job_id (tests.contrib.hooks.test_gcp_dataflow_hook.DataflowTest)
   ----------------------------------------------------------------------
      Traceback (most recent call last):
       tests/contrib/hooks/test_gcp_dataflow_hook.py line 297 in test_data_flow_missing_job_id
         self.assertEqual(_Dataflow(cmd).wait_for_done(), None)
       airflow/contrib/hooks/gcp_dataflow_hook.py line 153 in wait_for_done
         job_id = job_id or self._extract_job(line)
       airflow/contrib/hooks/gcp_dataflow_hook.py line 138 in _extract_job
         matched_job = job_id_pattern.match(line or '')
      TypeError: cannot use a string pattern on a bytes-like object
      -------------------- >> begin captured stdout << ---------------------
      [2018-08-13 08:48:14,177] {gcp_dataflow_hook.py:120} INFO - Running command: echo unit
testing
      [2018-08-13 08:48:14,202] {gcp_dataflow_hook.py:144} INFO - Start waiting for DataFlow
process to complete.
      [2018-08-13 08:48:14,203] {gcp_dataflow_hook.py:152} INFO - b'unit testing'
      
      --------------------- >> end captured stdout << ----------------------
      -------------------- >> begin captured logging << --------------------
      airflow.contrib.hooks.gcp_dataflow_hook._Dataflow: INFO: Running command: echo unit
testing
      airflow.contrib.hooks.gcp_dataflow_hook._Dataflow: INFO: Start waiting for DataFlow
process to complete.
      airflow.contrib.hooks.gcp_dataflow_hook._Dataflow: INFO: b'unit testing'
      --------------------- >> end captured logging << ---------------------
   ======================================================================
   21) ERROR: test_data_flow_valid_job_id (tests.contrib.hooks.test_gcp_dataflow_hook.DataflowTest)
   ----------------------------------------------------------------------
      Traceback (most recent call last):
       tests/contrib/hooks/test_gcp_dataflow_hook.py line 293 in test_data_flow_valid_job_id
         self.assertEqual(_Dataflow(cmd).wait_for_done(), TEST_JOB_ID)
       airflow/contrib/hooks/gcp_dataflow_hook.py line 153 in wait_for_done
         job_id = job_id or self._extract_job(line)
       airflow/contrib/hooks/gcp_dataflow_hook.py line 138 in _extract_job
         matched_job = job_id_pattern.match(line or '')
      TypeError: cannot use a string pattern on a bytes-like object
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message