drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deneche A. Hakim (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-3259) cast_empty_string_to_null only works when set at SYSTEM level
Date Sat, 06 Jun 2015 18:41:00 GMT
Deneche A. Hakim created DRILL-3259:
---------------------------------------

             Summary: cast_empty_string_to_null only works when set at SYSTEM level
                 Key: DRILL-3259
                 URL: https://issues.apache.org/jira/browse/DRILL-3259
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.0.0
            Reporter: Deneche A. Hakim
            Assignee: Deneche A. Hakim
             Fix For: 1.2.0


When a CSV file contains "empty" values, the following query throws an exception:
{noformat}
select CAST(columns[1] as DOUBLE) FROM `twocols.csv`;
Error: SYSTEM ERROR: java.lang.NumberFormatException: empty String
(state=,code=0)
{noformat}

The problem, is that {{drill.exec.functions.cast_empty_string_to_null}} is only effective
when changing the {{SYSTEM}} option and not the {{SESSION}} option:
{noformat}
0: jdbc:drill:zk=local> select name, type, bool_val from sys.options where name like '%null%';
+-------------------------------------------------+----------+-----------+
|                      name                       |   type   | bool_val  |
+-------------------------------------------------+----------+-----------+
| drill.exec.functions.cast_empty_string_to_null  | SYSTEM   | false     |
| drill.exec.functions.cast_empty_string_to_null  | SESSION  | true      |
+-------------------------------------------------+----------+-----------+
2 rows selected (0.188 seconds)
0: jdbc:drill:zk=local> select CAST(columns[1] as DOUBLE) FROM `twocols.csv`;
Error: SYSTEM ERROR: java.lang.NumberFormatException: empty String
{noformat}

{noformat}
0: jdbc:drill:zk=local> select name, type, bool_val from sys.options where name like '%null%';
+-------------------------------------------------+----------+-----------+
|                      name                       |   type   | bool_val  |
+-------------------------------------------------+----------+-----------+
| drill.exec.functions.cast_empty_string_to_null  | SYSTEM   | true      |
| drill.exec.functions.cast_empty_string_to_null  | SESSION  | false     |
+-------------------------------------------------+----------+-----------+
2 rows selected (0.135 seconds)
0: jdbc:drill:zk=local> select CAST(columns[1] as DOUBLE) FROM `twocols.csv`;
+----------+
|  EXPR$0  |
+----------+
| 143.0    |
| 104.0    |
| 46.0     |
| 387.0    |
| 23.0     |
| 112.0    |
| null     |
| 76.0     |
| null     |
| 1225.0   |
| null     |
| null     |
| null     |
| 13.0     |
| 49.0     |
| 108.0    |
| 13.0     |
| 33.0     |
| null     |
| null     |
| 10.0     |
| null     |
| null     |
| null     |
| 145.0    |
| null     |
| 24.0     |
| 614.0    |
| null     |
| null     |
| null     |
| 59.0     |
| 262.0    |
| 3.0      |
| 14022.0  |
| 4812.0   |
| 14219.0  |
| 1365.0   |
| null     |
| 1531.0   |
| null     |
| 3736.0   |
| 11327.0  |
| 3115.0   |
| null     |
| 11713.0  |
| null     |
| 3410.0   |
| null     |
| null     |
| 1620.0   |
| 9675.0   |
| 6250.0   |
| null     |
| 1625.0   |
| null     |
| 5112.0   |
| 924.0    |
| 4150.0   |
| 2920.0   |
| null     |
| 1253.0   |
| 4108.0   |
| 2703.0   |
| 3524.0   |
| null     |
| null     |
| 3921.0   |
| 4529.0   |
| null     |
| null     |
| 4672.0   |
| 2125.0   |
| null     |
| null     |
| 706.0    |
| 80.0     |
| null     |
| null     |
| 457.0    |
| 8530.0   |
| null     |
| 262.0    |
| 760.0    |
| null     |
| 791.0    |
| 12816.0  |
| 883.0    |
| 1836.0   |
| 477.0    |
| 1240.0   |
| 107.0    |
| 1200.0   |
| 198.0    |
| 624.0    |
| null     |
| 40.0     |
| 11.0     |
| 338.0    |
+----------+
99 rows selected (0.096 seconds)
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message