hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sam Wilson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1603) support CSV text file format
Date Wed, 21 Dec 2011 16:37:30 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174190#comment-13174190
] 

Sam Wilson commented on HIVE-1603:
----------------------------------

Instead of hard-coding it to work only with Comma-separated-volumes, why not have a DelimitedTextFile
and a separate set of options to control the delimiter and quoting. Some people need pipe-delimited,
for example.
                
> support CSV text file format
> ----------------------------
>
>                 Key: HIVE-1603
>                 URL: https://issues.apache.org/jira/browse/HIVE-1603
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 0.7.0
>            Reporter: Ning Zhang
>
> Comma Separated Values (CSV) text format are commonly used in exchanging relational data
between heterogeneous systems. Currently Hive uses TextFile format when displaying query results.
This could cause confusions when column values contain new lines or tabs. A CSVTextFile format
could get around this problem. This will require a new CSVTextInputFormat, CSVTextOutputFormat,
and CSVSerDe. 
> A proposed use case is like:
> {code}
> -- exporting a table to CSV files in a directory
> hive> set hive.io.output.fileformat=CSVTextFile;
> hive> insert overwrite local directory '/tmp/CSVrepos/' select * from S where ...
;
> -- query result in CSV
> hive -e 'set hive.io.output.fileformat=CSVTextFile; select * from T;' | sql_loader_to_other_systems
> -- query CSV files directory from Hive
> hive> create table T (...) stored as CSVTextFile;
> hive> load data local inpath '/my/CSVfiles' into table T;
> hive> select * from T where ...;
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message