hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <>
Subject [jira] [Commented] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]
Date Tue, 21 Oct 2014 08:48:33 GMT


Chengxiang Li commented on HIVE-8537:

Hi, [~lirui]. Since you had put your hand on this, could you help to do more things here?
# AyncRDDAction API updated as well, we should updated it together with this, otherwise qtest
would be failed.
# remove SparkUtilities::setTaskInfoInJobConf as it's never used. 
# for setupMRLegacyConfigs, replace task id timestamp from System.currentTimeMillis() with
current date with date format "yyyy-MM-dd HH:mm:ss,SSS".

> Update to use the stable TaskContext API [Spark Branch]
> -------------------------------------------------------
>                 Key: HIVE-8537
>                 URL:
>             Project: Hive
>          Issue Type: Task
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-8537-spark.patch
> TaskContext API is stabilized in SPARK-3874. We have to update hive side code, e.g. {{HivePairFlatMapFunction.setupMRLegacyConfigs}}.

This message was sent by Atlassian JIRA

View raw message