drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chi Lang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-3393) Quotes not being recognized in tab delimited (tsv) files
Date Fri, 26 Jun 2015 16:06:05 GMT

    [ https://issues.apache.org/jira/browse/DRILL-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603113#comment-14603113
] 

Chi Lang commented on DRILL-3393:
---------------------------------

I also came across this issue when a tsv file (with quotes) that ends with an empty line fail
to parse with 
{quote}
Error: SYSTEM ERROR: com.univocity.parsers.common.TextParsingException: Error processing input:
Cannot use newline character within quoted string, line=2, char=22. Content parsed: [ ]

Fragment 0:0
{quote}

Example file attached (fail.tsv)



> Quotes not being recognized in tab delimited (tsv) files
> --------------------------------------------------------
>
>                 Key: DRILL-3393
>                 URL: https://issues.apache.org/jira/browse/DRILL-3393
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Text & CSV
>    Affects Versions: 1.0.0
>            Reporter: Chi Lang
>            Assignee: Steven Phillips
>            Priority: Critical
>             Fix For: 1.2.0
>
>         Attachments: fail.tsv
>
>
> Drill doesn't seem to recognise quotes in tsv, while working fine for csv files.
> For example, given the following files
> test.tsv
> -------
> foobar	bar
> "aa"	"bc"
> -------
> test.csv
> ----------
> foobar,bar
> "aa","bc"
> ----------
> I get these results:
> 0: jdbc:drill:zk=local> select columns[0], columns[1] from dfs.`test.csv`;
> +---------+---------+
> | EXPR$0  | EXPR$1  |
> +---------+---------+
> | foobar  | bar     |
> | aa      | bc      |
> +---------+---------+
> 2 rows selected (0.259 seconds)
> 0: jdbc:drill:zk=local> select columns[0], columns[1] from dfs.`test.tsv`;
> +----------+---------+
> |  EXPR$0  | EXPR$1  |
> +----------+---------+
> | foobar   | bar     |
> | aa"	"bc  | null    |
> +----------+---------+
> 2 rows selected (0.122 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message