hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-7313) Allow session-level temp-tables to be marked as in-memory tables
Date Sat, 28 Jun 2014 02:39:24 GMT
Gopal V created HIVE-7313:
-----------------------------

             Summary: Allow session-level temp-tables to be marked as in-memory tables
                 Key: HIVE-7313
                 URL: https://issues.apache.org/jira/browse/HIVE-7313
             Project: Hive
          Issue Type: Improvement
          Components: Tez
            Reporter: Gopal V


When the hadoop-2.3C shims are in action, APIs which can pin small tables into memory are
available.

Any session with an in-memory table can create HDFS in-memory pools with default caching semantics
and add its files into the cache pool.

Example code to implement the behaviour was prototyped for the Tez Application Master, but
the AM does not have enough information to determine the cache policies.

https://github.com/rajeshbalamohan/hdfs-cache-tool/blob/master/src/main/java/org/apache/hadoop/hdfs/tools/HDFSCache.java#L74



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message