spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-10950) ApplicationHistoryInfo to include spark version; History Server to report incompatibility with later versions
Date Tue, 06 Oct 2015 15:13:28 GMT

    [ https://issues.apache.org/jira/browse/SPARK-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945161#comment-14945161
] 

Steve Loughran commented on SPARK-10950:
----------------------------------------

There's a less elegant solution which wouldn't address the home page display, but could  handle
the stack-trace-on-parse problem: have a specific {{incompatibleSparkVersionException}} exception
which {{ApplicationHistoryProvider.getAppUI()}} could raise if it wanted to report this; the
history server would catch this and present a specific error page

> ApplicationHistoryInfo to include spark version; History Server to report incompatibility
with later versions
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-10950
>                 URL: https://issues.apache.org/jira/browse/SPARK-10950
>             Project: Spark
>          Issue Type: Improvement
>          Components: Web UI
>    Affects Versions: 1.5.1
>            Reporter: Steve Loughran
>            Priority: Minor
>
> The history server cannot provide guarantees of forward compatibility -it's unrealistic.
What happens today is that the user gets to see a stack trace, perhaps when attempting to
unmarshall a JSON-formatted event which isn't known about.
> If {{ApplicationHistoryInfo}} included a version field, and history providers included
and later retrieved version information in their histories, then the UI could recognise incompatible
histories and present them differently. In the main UI, somehow indicating that they weren't
readable; perhaps with the URL being bonded to a page saying "incompatible version".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message