spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-7261) Change default log level to WARN in the REPL
Date Wed, 10 Jun 2015 01:32:01 GMT

    [ https://issues.apache.org/jira/browse/SPARK-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14579836#comment-14579836
] 

Apache Spark commented on SPARK-7261:
-------------------------------------

User 'zsxwing' has created a pull request for this issue:
https://github.com/apache/spark/pull/6734

> Change default log level to WARN in the REPL
> --------------------------------------------
>
>                 Key: SPARK-7261
>                 URL: https://issues.apache.org/jira/browse/SPARK-7261
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Shell
>            Reporter: Patrick Wendell
>            Assignee: Shixiong Zhu
>            Priority: Blocker
>              Labels: starter
>
> We should add a log4j properties file for the repl (log4j-defaults-repl.properties) that
has the level of warning. The main reason for doing this is that we now display nice progress
bars in the REPL so the need for task level INFO messages is much less.
> The best way to accomplish this is the following:
> 1. Add a second logging defaults file called log4j-defaults-repl.properties that has
log level WARN. https://github.com/apache/spark/blob/branch-1.4/core/src/main/resources/org/apache/spark/log4j-defaults.properties
> 2. When logging is initialized, check whether you are inside the REPL. If so, then use
that one:
> https://github.com/apache/spark/blob/branch-1.4/core/src/main/scala/org/apache/spark/Logging.scala#L124
> 3. The printed message should say something like:
> Using Spark's repl log4j profile: org/apache/spark/log4j-defaults-repl.properties
> To adjust logging level use sc.setLogLevel("INFO")



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message