beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Younghee Kwon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-588) All runners should support ProfilingOptions
Date Tue, 07 Feb 2017 18:18:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856468#comment-15856468
] 

Younghee Kwon commented on BEAM-588:
------------------------------------

The PR is about to be merged. 

Several things to do in a successive PR: 
 1. integrate the memory reporter into DirectRunner using PipelineOptions
 2. having an option to dump full profile into disk (as opposed to only logging the biggest
10 as now).
 3. (optional) experiment with other profilers for the platforms that guppy is not available.


> All runners should support ProfilingOptions
> -------------------------------------------
>
>                 Key: BEAM-588
>                 URL: https://issues.apache.org/jira/browse/BEAM-588
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py
>            Reporter: Ahmet Altay
>            Assignee: Ahmet Altay
>            Priority: Minor
>
> https://github.com/apache/incubator-beam/blob/python-sdk/sdks/python/apache_beam/utils/options.py#L366
> This is useful for profiling pipelines in different environments.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message