beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Baetens (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-842) dependency.py: package not found when running on Windows
Date Thu, 27 Oct 2016 10:12:59 GMT
Matthias Baetens created BEAM-842:
-------------------------------------

             Summary: dependency.py: package not found when running on Windows
                 Key: BEAM-842
                 URL: https://issues.apache.org/jira/browse/BEAM-842
             Project: Beam
          Issue Type: Bug
          Components: sdk-py
    Affects Versions: 0.4.0-incubating
         Environment: Windows 10, Python 2.7.11
            Reporter: Matthias Baetens
            Assignee: Frances Perry
            Priority: Minor


When having splitting your pipeline into multiple files and configuring your project according
to the Juliaset example (https://cloud.google.com/dataflow/pipelines/dependencies-python#multiple-file-dependencies),
the Pipeline still crashes when using Windows.

This is caused by setuptools defaulting to a .zip on Windows, and the current Beam code looks
for a .tar.gz (dependency.py, line 400). When changing this line to: output_files = glob.glob(os.path.join(temp_dir,
'*.zip')), it works. 

Suggestion: checking the OS would probably solve this issue. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message