spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shahid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.
Date Thu, 20 Sep 2018 19:35:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622588#comment-16622588
] 

shahid commented on SPARK-25246:
--------------------------------

[~devaraj.k], Ideally when the application start, it should display in the incomplete page
of the History server UI. 

In this scenario, the application will list in the HistoryServer UI, once some events happened.

> When the spark.eventLog.compress is enabled, the Application is not showing in the History
server UI ('incomplete application' page), initially.
> ------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-25246
>                 URL: https://issues.apache.org/jira/browse/SPARK-25246
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.3.1
>            Reporter: shahid
>            Priority: Major
>
> 1) bin/spark-shell --master yarn --conf "spark.eventLog.compress=true" 
> 2) hdfs dfs -ls /spark-logs 
> {code:java}
> -rwxrwx---   1 root supergroup          *0* 2018-08-27 03:26 /spark-logs/application_1535313809919_0005.lz4.inprogress
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message