hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jimmy Xiang (JIRA)" <>
Subject [jira] [Commented] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]
Date Mon, 05 Jan 2015 23:08:34 GMT


Jimmy Xiang commented on HIVE-9135:

Looked into it and so far we can cache the works for the current thread only. The benefit
is limited.

> Cache Map and Reduce works in RSC [Spark Branch]
> ------------------------------------------------
>                 Key: HIVE-9135
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Brock Noland
>            Assignee: Jimmy Xiang
>         Attachments: HIVE-9135.1-spark.patch, HIVE-9135.1-spark.patch
> HIVE-9127 works around the fact that we don't cache Map/Reduce works in Spark. However,
other input formats such as HiveInputFormat will not benefit from that fix. We should investigate
how to allow caching on the RSC while not on tasks (see HIVE-7431).

This message was sent by Atlassian JIRA

View raw message