spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%
Date Wed, 25 Jan 2017 21:49:26 GMT

    [ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838649#comment-15838649
] 

Sean Owen commented on SPARK-4049:
----------------------------------

Data can be cached in multiple locations, so it makes some sense to indicate, for example,
that data that is meant to be 2x cached is 200% cached when all partitions are replicated
twice.

Imagine you have 2 partitions, each to be replicated twice. How do you report, in one number,
that one partition is 2x replicated and the other is not cached at all? right now it would
say 100%, as far as I can tell. That's ambiguous, but, one number necessarily is.

> Storage web UI "fraction cached" shows as > 100%
> ------------------------------------------------
>
>                 Key: SPARK-4049
>                 URL: https://issues.apache.org/jira/browse/SPARK-4049
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 1.2.0
>            Reporter: Josh Rosen
>            Priority: Minor
>
> In the Storage tab of the Spark Web UI, I saw a case where the "Fraction Cached" was
greater than 100%:
> !http://i.imgur.com/Gm2hEeL.png!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message