beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Jiang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-842) dependency.py: package not found when running on Windows
Date Fri, 03 Feb 2017 13:14:51 GMT

    [ https://issues.apache.org/jira/browse/BEAM-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851475#comment-15851475
] 

Kai Jiang commented on BEAM-842:
--------------------------------

[~matthiasa4] Could you paste more crash error here?
Since I built Juliaset example on Windows and ran it on Dataflow, it seems all good to me.
setuptools version is 34.1.0

> dependency.py: package not found when running on Windows
> --------------------------------------------------------
>
>                 Key: BEAM-842
>                 URL: https://issues.apache.org/jira/browse/BEAM-842
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py
>         Environment: Windows 10, Python 2.7.11
>            Reporter: Matthias Baetens
>            Assignee: Ahmet Altay
>            Priority: Minor
>              Labels: newbie
>
> When having splitting your pipeline into multiple files and configuring your project
according to the Juliaset example (https://cloud.google.com/dataflow/pipelines/dependencies-python#multiple-file-dependencies),
the Pipeline still crashes when using Windows.
> This is caused by setuptools defaulting to a .zip on Windows, and the current Beam code
looks for a .tar.gz (dependency.py, line 400). When changing this line to: output_files =
glob.glob(os.path.join(temp_dir, '*.zip')), it works. 
> Suggestion: checking the OS would probably solve this issue. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message