hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chinna Rao Lalam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10058) Log the information of cached RDD [Spark Branch]
Date Mon, 23 Mar 2015 19:28:54 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376455#comment-14376455
] 

Chinna Rao Lalam commented on HIVE-10058:
-----------------------------------------

Hi [~xuefuz],

In spark plan explain we can log these details.

work -> RDD mapping (From work ->trans -> RDD)
FinallRDD (Computing tranToOutputRDDMap)
Cache enabled or disabled

In this JIRA my expectation is after plan generated, we are using cached RDD ID's for monitor()
or releaseCache(), so if we log this information at info level i thought it will be useful.


Here as you said in addCachedRDDId() log is not required but in getCachedRDDIds() log may
be helpful. Please check this and correct me if i understood wrong.

> Log the information of cached RDD [Spark Branch]
> ------------------------------------------------
>
>                 Key: HIVE-10058
>                 URL: https://issues.apache.org/jira/browse/HIVE-10058
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chinna Rao Lalam
>            Assignee: Chinna Rao Lalam
>             Fix For: spark-branch
>
>         Attachments: HIVE-10058.1-spark.patch
>
>
> Log the cached RDD Id's at info level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message