hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hari Sekhon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-10398) Variables to raise errors on select from non-existent or empty partitions rather than just return 0 rows
Date Mon, 20 Apr 2015 10:05:58 GMT
Hari Sekhon created HIVE-10398:
----------------------------------

             Summary: Variables to raise errors on select from non-existent or empty partitions
rather than just return 0 rows
                 Key: HIVE-10398
                 URL: https://issues.apache.org/jira/browse/HIVE-10398
             Project: Hive
          Issue Type: New Feature
          Components: Query Processor
    Affects Versions: 0.14.0
         Environment: HDP 2.2
            Reporter: Hari Sekhon
            Priority: Minor


Feature request to add 2 new variables to raise errors on queries that select from empty or
non-existent partitions, eg:
{code}set hive.error.select.non-existent.partition=true;
SELECT * FROM myTable WHERE date='2015-02-29';
<raise some error here>
{code}
Currently the behaviour is to return success with zero rows, which doesn't make practical
sense in many cases, and I only detected this because my bulk jobs started completing too
quickly. I work around this now by listing all partitions and then checking against that before
launching the bulk job but it would be more convenient to have the query just fail as is logical
in these sorts of scenarios.

There should also be a similar variable for selecting from empty partitions for people who
expect their partitions to be populated (a very common expectation), such as:
{code}hive.error.select.empty.partition{code}
This is somewhat similar to the existing variable
{code}hive.error.on.empty.partition{code}
except this existing one only covers dynamic partition inserts that generate empty partitions,
so the suggested query side variable would be a logical counterpart to that.

Having these variables as 'false' by default these would make these completely backwards compatible
improvements.

Hari Sekhon
http://www.linkedin.com/in/harisekhon



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message