hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siying Dong (JIRA)" <>
Subject [jira] Commented: (HIVE-2030) isEmptyPath() to use ContentSummary cache
Date Tue, 08 Mar 2011 22:28:00 GMT


Siying Dong commented on HIVE-2030:

Yongqiang, I don't quite understand your comment. If there is a cache miss, we call the original
method. We never make things worse.

> isEmptyPath() to use ContentSummary cache
> -----------------------------------------
>                 Key: HIVE-2030
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Siying Dong
>            Assignee: Siying Dong
>            Priority: Minor
>         Attachments: HIVE-2030.1.patch, HIVE-2030.2.patch
> addInputPaths() calls isEmptyPath() for every input path. Now every call is a DFS namenode
call. Making isEmptyPath() to use cached ContentSummary, we should be able to avoid some namenode
calls and reduce latency in the case of multiple partitions.

This message is automatically generated by JIRA.
For more information on JIRA, see:

View raw message