spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Mior (JIRA)" <>
Subject [jira] [Commented] (SPARK-991) Report call sites of operators in Python
Date Thu, 29 Mar 2018 14:40:00 GMT


Michael Mior commented on SPARK-991:

Maybe I'm missing something here, but I'm not seeing a Python stack trace captured when I
look at the RDD call site information.

> Report call sites of operators in Python
> ----------------------------------------
>                 Key: SPARK-991
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark
>            Reporter: Matei Zaharia
>            Priority: Major
>              Labels: Starter
>             Fix For: 0.9.0
> Similar to our call site reporting in Java, we can get a stack trace in Python with traceback.extract_stack.
It would be nice to set that stack trace as the name on the corresponding RDDs so it can appear
in the UI.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message