drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Khurram Faraaz (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-3865) Difference in results - query parquet table vs query HBase table
Date Wed, 30 Sep 2015 00:15:04 GMT
Khurram Faraaz created DRILL-3865:
-------------------------------------

             Summary: Difference in results - query parquet table vs query HBase table
                 Key: DRILL-3865
                 URL: https://issues.apache.org/jira/browse/DRILL-3865
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Flow
    Affects Versions: 1.2.0
         Environment: 4 node cluster CentOS
            Reporter: Khurram Faraaz
            Assignee: Mehant Baid


Querying HBase from Drill returns no results. Query from Drill over same data in parquet format
from Drill returns expected results.

{code}

0: jdbc:drill:schema=dfs.tmp> describe dt_Tbl;
+--------------+------------+--------------+
| COLUMN_NAME  | DATA_TYPE  | IS_NULLABLE  |
+--------------+------------+--------------+
| row_key      | ANY        | NO           |
| colfam1      | MAP        | NO           |
+--------------+------------+--------------+
2 rows selected (1.494 seconds)

0: jdbc:drill:schema=dfs.tmp> select RK from dfs.tmp.t20 WHERE RK >= TIME '00:00:00'
AND RK <= TIME '04:14:46.094';
+---------------+
|      RK       |
+---------------+
| 00:00:00      |
| 04:14:46.094  |
| 04:14:46.094  |
| 01:50:46.094  |
| 04:14:46.094  |
+---------------+
5 rows selected (0.242 seconds)
{code}

{code}

root@centos-01 ~]# parquet-tools/parquet-schema 0_0_0.parquet
message root {
  required int32 RK (TIME_MILLIS);  
}

0: jdbc:drill:schema=dfs.tmp> SELECT CONVERT_FROM(BYTE_SUBSTR(row_key,1,8),'time_epoch_be')
AS RK from dt_Tbl T WHERE CONVERT_FROM(BYTE_SUBSTR(row_key,1,8),'time_epoch_be') >= TIME
'00:00:00' AND CONVERT_FROM(BYTE_SUBSTR(row_key,1,8),'time_epoch_be') <= TIME '04:14:46.094';
+--+
|  |
+--+
+--+
No rows selected (0.902 seconds)

explain plan for above query

00-01      Project(RK=[CONVERT_FROMTIME_EPOCH_BE(BYTE_SUBSTR($0, 1, 8))])
00-02        Scan(groupscan=[HBaseGroupScan [HBaseScanSpec=HBaseScanSpec [tableName=dt_Tbl,
startRow=\x00\x00\x00\x00\x00\x00\x00\x00, stopRow=\x00\x00\x00\x00\x00\xE9?O, filter=null],
columns=[`row_key`]]])

{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message