drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5674) Reading CSV file though table() function does not handle compression
Date Mon, 17 Jul 2017 21:34:00 GMT
Paul Rogers created DRILL-5674:
----------------------------------

             Summary: Reading CSV file though table() function does not handle compression
                 Key: DRILL-5674
                 URL: https://issues.apache.org/jira/browse/DRILL-5674
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.10.0
            Reporter: Paul Rogers


Create a compressed CSV file with column headers: data.csv.zip.

Define a storage plugin config for the file, call it "dfs.myws", set delimiter = ",", extract
header = true, skip header = false.

Run a simple query:

SELECT * FROM dfs.myws.`data.csv.zip`

This works fine.

Now, do the same thing, but using a table function:

{code}
SELECT * FROM table(dfs.myws.`data.csv.zip` (type => 'text', fieldDelimiter => ',' ,
extractHeader => true))
{code}

This does not work. Apparently, the reader tries to read the zip file as if it were an uncompressed
file:

{code}
DATA_READ ERROR: Drill failed to read your text file.  Drill supports up to 65536 columns
in a text file.  Your file appears to have more than that.
Failure while reading file file:/Users/fred/data/data.csv.zip. Happened at or shortly before
byte position 121177.
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message