hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siying Dong (JIRA)" <>
Subject [jira] Created: (HIVE-2030) isEmptyPath() to use ContentSummary cache
Date Tue, 08 Mar 2011 01:17:59 GMT
isEmptyPath() to use ContentSummary cache

                 Key: HIVE-2030
             Project: Hive
          Issue Type: Improvement
            Reporter: Siying Dong
            Assignee: Siying Dong
            Priority: Minor

addInputPaths() calls isEmptyPath() for every input path. Now every call is a DFS namenode
call. Making isEmptyPath() to use cached ContentSummary, we should be able to avoid some namenode
calls and reduce latency in the case of multiple partitions.

This message is automatically generated by JIRA.
For more information on JIRA, see:

View raw message