Mailing-List: contact dev-help@drill.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@drill.apache.org
From: Khurram Faraaz <kfaraaz@mapr.com>
To: "dev@drill.apache.org" <dev@drill.apache.org>
Subject: Re: Column ordering is incorrect when ORDER BY is used with LIMIT
 clause in query over parquet data
Thread-Topic: Column ordering is incorrect when ORDER BY is used with LIMIT
 clause in query over parquet data
Thread-Index: AQHSgFp7QRjX8DkB7Eup8j+gJ+ZpyKFdv5pl
Date: Tue, 7 Feb 2017 16:36:02 +0000
Message-ID: <CY4PR16MB17330BD84F7CB4C353CB8E76DF430@CY4PR16MB1733.namprd16.prod.outlook.com>
References: <CY4PR16MB173305FD6AABDF659C55CE65DF400@CY4PR16MB1733.namprd16.prod.outlook.com>
In-Reply-To: <CY4PR16MB173305FD6AABDF659C55CE65DF400@CY4PR16MB1733.namprd16.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
received-spf: None (protection.outlook.com: mapr.com does not designate
 permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative;
	boundary="_000_CY4PR16MB17330BD84F7CB4C353CB8E76DF430CY4PR16MB1733namp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Feb 2017 16:36:02.6971
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 2573c0c8-6f2a-4418-a58a-a742cf6415fb
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR16MB1735
archived-at: Tue, 07 Feb 2017 18:21:21 -0000

--_000_CY4PR16MB17330BD84F7CB4C353CB8E76DF430CY4PR16MB1733namp_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Can someone please look at this. Is this a bug ?


Thanks,

Khurram

________________________________
From: Khurram Faraaz <kfaraaz@mapr.com>
Sent: Monday, February 6, 2017 2:52:25 PM
To: dev@drill.apache.org
Subject: Column ordering is incorrect when ORDER BY is used with LIMIT clau=
se in query over parquet data

All,


This looks incorrect.


Query with order by + limit clause, the ordering of the columns returned in=
 the query results is NOT the same as the column ordering in the parquet fi=
le.


{noformat}

0: jdbc:drill:schema=3Ddfs.tmp> SELECT * FROM typeall_l ORDER BY col_int li=
mit 1;
+----------+----------+-------------+------------+----------+--------------=
---+----------------+-----------+------------------------+----------------+=
-------------+
| col_bln  | col_chr  |   col_dt    |  col_flt   | col_int  | col_intrvl_da=
y  | col_intrvl_yr  |  col_tim  |       col_tmstmp       |   col_vrchr1   |=
 col_vrchr2  |
+----------+----------+-------------+------------+----------+--------------=
---+----------------+-----------+------------------------+----------------+=
-------------+
| false    | MI       | 1967-05-01  | 32.901897  | 0        | P12DT20775S  =
   | P196M          | 19:50:17  | 2004-10-15 17:49:36.0  | Felecia Gourd  |=
 NLBQMg9     |
+----------+----------+-------------+------------+----------+--------------=
---+----------------+-----------+------------------------+----------------+=
-------------+
1 row selected (0.279 seconds)

{noformat}

Without the ORDER BY clause the columns are returned in correct order, same=
 as the ordering in the parquet file.

{noformat}
0: jdbc:drill:schema=3Ddfs.tmp> SELECT * FROM typeall_l limit 1;
+----------+----------+----------------+-----------------------------------=
---------------------------------------------------------------------------=
-------+-------------+-----------+------------------------+------------+---=
-------------+-----------------+----------+
| col_int  | col_chr  |   col_vrchr1   |                                   =
                  col_vrchr2                                               =
       |   col_dt    |  col_tim  |       col_tmstmp       |  col_flt   | co=
l_intrvl_yr  | col_intrvl_day  | col_bln  |
+----------+----------+----------------+-----------------------------------=
---------------------------------------------------------------------------=
-------+-------------+-----------+------------------------+------------+---=
-------------+-----------------+----------+
| 45436    | WV       | John Mcginity  | Rhbf6VFLJguvH9ejrWNkY1CDO8QqumTZAG=
jwa9cHfjBnLmNIWvo9YfcGObxbeXwa1NkemW9ULxsq5293wEA2v5FFCduwt03D7ysI3RlH8b4B0=
XAPKY  | 2011-11-04  | 18:02:26  | 1988-09-23 16:58:42.0  | 10.193293  | P3=
14M          | P26DT27386S     | false    |
+----------+----------+----------------+-----------------------------------=
---------------------------------------------------------------------------=
-------+-------------+-----------+------------------------+------------+---=
-------------+-----------------+----------+
1 row selected (0.22 seconds)


{noformat}


Thanks,

Khurram

--_000_CY4PR16MB17330BD84F7CB4C353CB8E76DF430CY4PR16MB1733namp_--