hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]
Date Tue, 21 Oct 2014 08:48:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178147#comment-14178147
] 

Chengxiang Li commented on HIVE-8537:
-------------------------------------

Hi, [~lirui]. Since you had put your hand on this, could you help to do more things here?
# AyncRDDAction API updated as well, we should updated it together with this, otherwise qtest
would be failed.
# remove SparkUtilities::setTaskInfoInJobConf as it's never used. 
# for setupMRLegacyConfigs, replace task id timestamp from System.currentTimeMillis() with
current date with date format "yyyy-MM-dd HH:mm:ss,SSS".

> Update to use the stable TaskContext API [Spark Branch]
> -------------------------------------------------------
>
>                 Key: HIVE-8537
>                 URL: https://issues.apache.org/jira/browse/HIVE-8537
>             Project: Hive
>          Issue Type: Task
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-8537-spark.patch
>
>
> TaskContext API is stabilized in SPARK-3874. We have to update hive side code, e.g. {{HivePairFlatMapFunction.setupMRLegacyConfigs}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message