spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1742) Profiler for Spark
Date Tue, 27 Jan 2015 14:42:35 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293617#comment-14293617
] 

Sean Owen commented on SPARK-1742:
----------------------------------

Is it realistic to expect that this would be part of Spark? You can always attach a standard
Java profiler to an executor, and there are rich tools for that. Anything else developed is
probably a third party project right?

> Profiler for Spark
> ------------------
>
>                 Key: SPARK-1742
>                 URL: https://issues.apache.org/jira/browse/SPARK-1742
>             Project: Spark
>          Issue Type: Wish
>            Reporter: Kousuke Saruta
>
> Sometimes, I hope there were the profiler for Spark Job.
> I think it's useful to find critical path of DAG or  find the bottle-necked Stage / transformations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message