airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "William Pursell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-873) Tests forcing availability of hive_metastore module
Date Fri, 27 Oct 2017 15:44:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222573#comment-16222573
] 

William Pursell commented on AIRFLOW-873:
-----------------------------------------

+1  To Andy's comment.  What is the resolution?  How does one run run_unit_tests.sh?

> Tests forcing availability of hive_metastore module
> ---------------------------------------------------
>
>                 Key: AIRFLOW-873
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-873
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: krishnabhupatiraju
>            Assignee: krishnabhupatiraju
>            Priority: Minor
>
> PR 2012 leads to an attempt to import hive_metastore any time unit tests are run, even
if these aren't the unit tests being run. hive_metastore is not a required module for Airflow,
but now any machine without it can't run any local unit tests! I put the traceback I'm seeing
below.
> The unit test file causing this import needs to be guarded so it only runs in if its
dependencies are available (see hive_operator.py in the same tests directory for one example,
or the explicit skip guards in the postgres/mysql tests that ensure they only run in the right
travis environment).
> ======================================================================
> ERROR: Failure: ImportError (No module named 'hive_metastore')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File "/Users/jlowin/anaconda3/lib/python3.5/site-packages/nose/failure.py", line 39,
in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File "/Users/jlowin/anaconda3/lib/python3.5/site-packages/nose/loader.py", line 418,
in loadTestsFromName
>     addr.filename, addr.module)
>   File "/Users/jlowin/anaconda3/lib/python3.5/site-packages/nose/importer.py", line 47,
in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File "/Users/jlowin/anaconda3/lib/python3.5/site-packages/nose/importer.py", line 94,
in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "/Users/jlowin/anaconda3/lib/python3.5/imp.py", line 244, in load_module
>     return load_package(name, filename)
>   File "/Users/jlowin/anaconda3/lib/python3.5/imp.py", line 216, in load_package
>     return _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 665, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
>   File "/Users/jlowin/git/airflow/tests/__init__.py", line 24, in <module>
>     from .operators import *
>   File "/Users/jlowin/git/airflow/tests/operators/__init__.py", line 20, in <module>
>     from .s3_to_hive_operator import *
>   File "/Users/jlowin/git/airflow/tests/operators/s3_to_hive_operator.py", line 25, in
<module>
>     from airflow.operators.s3_to_hive_operator import S3ToHiveTransfer
>   File "/Users/jlowin/git/airflow/airflow/operators/s3_to_hive_operator.py", line 27,
in <module>
>     from airflow.hooks.hive_hooks import HiveCliHook
>   File "/Users/jlowin/git/airflow/airflow/hooks/hive_hooks.py", line 28, in <module>
>     import hive_metastore
> ImportError: No module named 'hive_metastore'



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message