Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 929931737A for ; Tue, 28 Apr 2015 18:35:07 +0000 (UTC) Received: (qmail 31631 invoked by uid 500); 28 Apr 2015 18:35:07 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 31599 invoked by uid 500); 28 Apr 2015 18:35:07 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 31589 invoked by uid 99); 28 Apr 2015 18:35:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Apr 2015 18:35:07 +0000 Date: Tue, 28 Apr 2015 18:35:07 +0000 (UTC) From: "Steven Phillips (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (DRILL-2873) CTAS reports error when timestamp values in CSV file are quoted MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Phillips updated DRILL-2873: ----------------------------------- Fix Version/s: 1.1.0 > CTAS reports error when timestamp values in CSV file are quoted > --------------------------------------------------------------- > > Key: DRILL-2873 > URL: https://issues.apache.org/jira/browse/DRILL-2873 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Parquet > Affects Versions: 0.9.0 > Environment: 64e3ec52b93e9331aa5179e040eca19afece8317 | DRILL-2611: value vectors should report valid value count | 16.04.2015 @ 13:53:34 EDT > Reporter: Khurram Faraaz > Assignee: Steven Phillips > Fix For: 1.1.0 > > > When timestamp values are quoted in quotes (") inside a CSV data file, CTAS statement reports error. > Failing CTAS > {code} > 0: jdbc:drill:> create table prqFrmCSV02 as select cast(columns[0] as int) col_int, cast(columns[1] as bigint) col_bgint, cast(columns[2] as char(10)) col_char, cast(columns[3] as varchar(18)) col_vchar, cast(columns[4] as timestamp) col_tmstmp, cast(columns[5] as date) col_date, cast(columns[6] as boolean) col_boln, cast(columns[7] as double) col_dbl from `csvToPrq.csv`; > Query failed: SYSTEM ERROR: Invalid format: ""2015-04-23 23:47:00.124"" > [a601a66a-b305-4a92-9836-f39edcdc8fe8 on centos-02.qa.lab:31010] > Error: exception while executing query: Failure while executing query. (state=,code=0) > {code} > Stack trace from drillbit.log > {code} > 2015-04-24 18:41:09,721 [2ac571ba-778f-f3d5-c60f-af2e536905a3:frag:0:0] ERROR o.a.drill.exec.ops.FragmentContext - Fragment Context received failure -- Fragment: 0:0 > org.apache.drill.common.exceptions.DrillUserException: SYSTEM ERROR: Invalid format: ""2015-04-23 23:47:00.124"" > [a601a66a-b305-4a92-9836-f39edcdc8fe8 on centos-02.qa.lab:31010] > at org.apache.drill.common.exceptions.DrillUserException$Builder.build(DrillUserException.java:115) ~[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.common.exceptions.ErrorHelper.wrap(ErrorHelper.java:39) ~[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.ops.FragmentContext.fail(FragmentContext.java:151) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:131) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:135) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:74) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:76) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:64) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:164) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] > Caused by: java.lang.IllegalArgumentException: Invalid format: ""2015-04-23 23:47:00.124"" > at org.joda.time.format.DateTimeFormatter.parseDateTime(DateTimeFormatter.java:873) ~[joda-time-2.3.jar:2.3] > at org.joda.time.DateTime.parse(DateTime.java:144) ~[joda-time-2.3.jar:2.3] > at org.apache.drill.exec.test.generated.ProjectorGen323.doEval(ProjectorTemplate.java:388) ~[na:na] > at org.apache.drill.exec.test.generated.ProjectorGen323.projectRecords(ProjectorTemplate.java:62) ~[na:na] > at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:175) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:93) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:135) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:102) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > ... 16 common frames omitted > {code} > Snippet of data from input CSV file > {code} > -225058309,44225657827296040,"QAhHUTNv","njEl0iAivVwLEbAg","2015-04-23 23:47:00.124","2001-05-27",true,905562343.765 > 1999912439,2211473083106365,"oBwtZmzK","WOLzjgzk5HgXO8l1","2015-04-23 23:47:00.124","1958-03-12",true,99152273.9327 > 1784506402,29351094148275324,"QlyTFtkw","SmP428hFKw5A085 ","2015-04-23 23:47:00.126","1990-07-21",false,752670995.24 > 2012511944,53048515756157424,"BybVyYWH","cnDqVgMANMtJGbuv","2015-04-23 23:47:00.127","1953-02-10",false,784335138.726 > 1546241934,77079445473902384,"ZDxIxxLs","JHp2B9q0rJKyZ12K","2015-04-23 23:47:00.127","1976-01-09",false,870192831.047 > 1553741594,69736976577857208,"smtgHcaV","aJoVXdN9363arx1Y","2015-04-23 23:47:00.127","1953-10-18",true,1109816755.0 > 395345402,18812010265162496,"pNetevKF","IrXNHyRm4EY02Mv7","2015-04-23 23:47:00.127","1989-09-17",false,166747196.389 > -478640426,71296213927402152,"jXsJbzuR","DJGy8xMZGEpHOEJh","2015-04-23 23:47:00.128","2013-02-21",false,541750692.166 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)