hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen Thomas <>
Subject StorageHandler and Hive Cost Based Optimization
Date Mon, 03 Oct 2016 23:45:08 GMT

I'd like to know if its possible for a StorageHandler backed table to
contribute more than table-wide statistics during CBO analysis.
Specifically, with native partitioned tables, CBO will filter partitions
not involved in the query. Is it possible to do something similar to the
StorageHandler's predicate push-down optimization for CBO?

Ideally, I'd like an interface that lets me generate a Statistics object
with respect to a Table and given predicate. This mirrors
the HiveStoragePredicateHandler, but for statistics generation.

Is there an approach for doing this or do I need to fall back to native
tables and partitions?

Apologies if this question has been asked before or this isn't the correct



View raw message