drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sungwook Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-3692) Some subdirectories are not correctly picked up as dir0 for Hive partitioned by dirs
Date Sun, 23 Aug 2015 22:22:45 GMT
Sungwook Yoon created DRILL-3692:
------------------------------------

             Summary: Some subdirectories are not correctly picked up as dir0 for Hive partitioned
by dirs
                 Key: DRILL-3692
                 URL: https://issues.apache.org/jira/browse/DRILL-3692
             Project: Apache Drill
          Issue Type: Bug
          Components: Functions - Drill, Storage - Parquet
    Affects Versions: 1.1.0
         Environment: MapR 5.0, Drill 1.1.0 and Sqlline through Zookeeper
            Reporter: Sungwook Yoon
            Assignee: Mehant Baid


We are trying to use Hive parquet stored files partitioned by some column year.
So, the directory structure is partitioned with year=value

Let's say there are 5 years, so dir0 are like year=2010, year=2011,year=2012,year=2013,year=2014

We did like following
select * from dfs.root.`/user/hive/warehouse/table` d where d.dir0 = 'year=2012';

I get nothing.

Apparently, there are parquet files in the directory though.

Sometimes it picks up e.g., year=2010, 
That is,
select * from dfs.root.`/user/hive/warehouse/table` d where d.dir0 = 'year=2010';
retrieves values.

Not all subdirectories in dir0 are correctly picked up.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message