spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhang, Liye (JIRA)" <>
Subject [jira] [Updated] (SPARK-9107) Include memory usage for each job & stage
Date Thu, 16 Jul 2015 16:24:04 GMT


Zhang, Liye updated SPARK-9107:
    Component/s: Spark Core

> Include memory usage for each job & stage
> -----------------------------------------
>                 Key: SPARK-9107
>                 URL:
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core, Web UI
>            Reporter: Zhang, Liye
> In [spark-9104|], the memory usage is
showed as running time memory usage, which means, we can only see the current status of the
memory consumption, just in the same way how the "Storage" Tab works, it would not store the
previous status, and the same situation for history server WebUI. 
> The target for this issue is to show in different finished stages or in different finished
jobs, what is the memory usage status when/before the job/stage completes. Also we can give
out the maximum and minimum memory size used during each job/stage.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message