hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-2026) Parallelize UpdateInputAccessTimeHook
Date Thu, 03 Mar 2011 07:52:37 GMT
Parallelize UpdateInputAccessTimeHook
-------------------------------------

                 Key: HIVE-2026
                 URL: https://issues.apache.org/jira/browse/HIVE-2026
             Project: Hive
          Issue Type: Improvement
            Reporter: Ning Zhang
            Assignee: Ning Zhang


UpdateInputAccessTimeHook is usually used as a pre-execution hook to update the metastore's
lastAccessTime field of input partition/table. If a query touches a large number of partitions,
this hooks takes a long time to execute. One approach is to make the hook itself to run in
a separate thread. But it is hard to guarantee backward compatibility in semantics in case
of exceptions encountered in the hook execution. This task takes another approach to parallelize
the hook itself (update multiple partitions concurrently), but execute each pre-hook in sequential
order. 

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message