drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deneche A. Hakim (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-4376) Wrong results when doing a count(*) on part of directories with metadata cache
Date Tue, 09 Feb 2016 00:16:18 GMT
Deneche A. Hakim created DRILL-4376:
---------------------------------------

             Summary: Wrong results when doing a count(*) on part of directories with metadata
cache
                 Key: DRILL-4376
                 URL: https://issues.apache.org/jira/browse/DRILL-4376
             Project: Apache Drill
          Issue Type: Bug
          Components: Metadata
    Affects Versions: 1.4.0
            Reporter: Deneche A. Hakim
            Assignee: Deneche A. Hakim
            Priority: Critical
             Fix For: 1.6.0


First create some parquet tables in multiple subfolders:
{noformat}
create table dfs.tmp.`test/201501` as select employee_id, full_name from cp.`employee.json`
limit 2;
create table dfs.tmp.`test/201502` as select employee_id, full_name from cp.`employee.json`
limit 2;
create table dfs.tmp.`test/201601` as select employee_id, full_name from cp.`employee.json`
limit 2;
create table dfs.tmp.`test/201602` as select employee_id, full_name from cp.`employee.json`
limit 2;
{noformat}

Running the following query gives the expected count:
{noformat}
select count(*) from dfs.tmp.`test/20160*`;
+---------+
| EXPR$0  |
+---------+
| 4       |
+---------+
{noformat}

But once you create the metadata cache files, the query no longer returns the correct results:
{noformat}
refresh table metadata dfs.tmp.`test`;
select count(*) from dfs.tmp.`test/20160*`;
+---------+
| EXPR$0  |
+---------+
| 2       |
+---------+
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message