hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siying Dong (JIRA)" <>
Subject [jira] Updated: (HIVE-2030) isEmptyPath() to use ContentSummary cache
Date Tue, 08 Mar 2011 22:23:59 GMT


Siying Dong updated HIVE-2030:

    Attachment: HIVE-2030.2.patch

In the case of Exception, we don't populate cache. It's to make sure cache never gets wrong

> isEmptyPath() to use ContentSummary cache
> -----------------------------------------
>                 Key: HIVE-2030
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Siying Dong
>            Assignee: Siying Dong
>            Priority: Minor
>         Attachments: HIVE-2030.1.patch, HIVE-2030.2.patch
> addInputPaths() calls isEmptyPath() for every input path. Now every call is a DFS namenode
call. Making isEmptyPath() to use cached ContentSummary, we should be able to avoid some namenode
calls and reduce latency in the case of multiple partitions.

This message is automatically generated by JIRA.
For more information on JIRA, see:

View raw message