drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andries Engelbrecht <aengelbre...@maprtech.com>
Subject Re: to_date(csv-columns[x],'yyyy-mm-dd') - IllegalArgumentException
Date Fri, 28 Oct 2016 14:09:13 GMT
You should use yyyy-MM-dd.

I have not noticed the issue before with CSV.

--Andries

> On Oct 28, 2016, at 6:24 AM, Khurram Faraaz <kfaraaz@maprtech.com> wrote:
> 
> All,
> 
> Question is - why does it work for a parquet column and fails when CSV
> column is used ?
> 
> Drill 1.9.0 commit : a29f1e29
> 
> This is a simple project of column from a csv file, works.
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select columns[4] FROM `typeall_l.csv` t1
> limit 5;
> +-------------+
> |   EXPR$0    |
> +-------------+
> | 2011-11-04  |
> | 1986-10-22  |
> | 1992-09-10  |
> | 2016-08-07  |
> | 1986-01-25  |
> +-------------+
> 5 rows selected (0.26 seconds)
> {noformat}
> 
> Using TO_DATE function with columns[x] as first input fails, with an
> IllegalArgumentException
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select to_date(columns[4],'yyyy-mm-dd') FROM
> `typeall_l.csv` t1 limit 5;
> Error: SYSTEM ERROR: IllegalArgumentException: Invalid format: ""
> 
> Fragment 0:0
> 
> [Error Id: 9cff3eb9-4045-4d9a-a6a1-1eadaa597f30 on centos-01.qa.lab:31010]
> (state=,code=0)
> {noformat}
> 
> However, interestingly same query over parquet column returns correct
> results, on same data.
> 
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select to_date(col_dt,'yyyy-mm-dd') FROM
> typeall_l limit 5;
> +-------------+
> |   EXPR$0    |
> +-------------+
> | 2011-01-04  |
> | 1986-01-22  |
> | 1992-01-10  |
> | 2016-01-07  |
> | 1986-01-25  |
> +-------------+
> 5 rows selected (0.286 seconds)
> {noformat}
> 
> When the date string is passed as first input, to_date function returns
> correct results.
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select to_date('2011-01-04','yyyy-mm-dd')
> from (values(1));
> +-------------+
> |   EXPR$0    |
> +-------------+
> | 2011-01-04  |
> +-------------+
> 1 row selected (0.235 seconds)
> {noformat}
> 
> Thanks,
> Khurram


Mime
View raw message