drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4376) Wrong results when doing a count(*) on part of directories with metadata cache
Date Thu, 10 Mar 2016 10:15:41 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189011#comment-15189011
] 

ASF GitHub Bot commented on DRILL-4376:
---------------------------------------

GitHub user adeneche opened a pull request:

    https://github.com/apache/drill/pull/424

    Drill 4484: NPE when querying  empty directory

    this PR also includes the fix for DRILL-4376. I will rebase once that fix has been merged
into master

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/adeneche/incubator-drill DRILL-4484

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/424.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #424
    
----
commit b8fa596d421eca31ff28a40e681c544c10521078
Author: adeneche <adeneche@gmail.com>
Date:   2016-03-09T12:44:02Z

    DRILL-4376: Wrong results when doing a count(*) on part of directories with metadata cache

commit e8c5dcb64926d0931c48cb0eba3f17dc2b597822
Author: adeneche <adeneche@gmail.com>
Date:   2016-03-10T09:40:06Z

    DRILL-4484: NPE when querying  empty directory

----


> Wrong results when doing a count(*) on part of directories with metadata cache
> ------------------------------------------------------------------------------
>
>                 Key: DRILL-4376
>                 URL: https://issues.apache.org/jira/browse/DRILL-4376
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Metadata
>    Affects Versions: 1.4.0
>            Reporter: Deneche A. Hakim
>            Assignee: Aman Sinha
>            Priority: Critical
>             Fix For: 1.7.0
>
>
> First create some parquet tables in multiple subfolders:
> {noformat}
> create table dfs.tmp.`test/201501` as select employee_id, full_name from cp.`employee.json`
limit 2;
> create table dfs.tmp.`test/201502` as select employee_id, full_name from cp.`employee.json`
limit 2;
> create table dfs.tmp.`test/201601` as select employee_id, full_name from cp.`employee.json`
limit 2;
> create table dfs.tmp.`test/201602` as select employee_id, full_name from cp.`employee.json`
limit 2;
> {noformat}
> Running the following query gives the expected count:
> {noformat}
> select count(*) from dfs.tmp.`test/20160*`;
> +---------+
> | EXPR$0  |
> +---------+
> | 4       |
> +---------+
> {noformat}
> But once you create the metadata cache files, the query no longer returns the correct
results:
> {noformat}
> refresh table metadata dfs.tmp.`test`;
> select count(*) from dfs.tmp.`test/20160*`;
> +---------+
> | EXPR$0  |
> +---------+
> | 2       |
> +---------+
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message