hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Madhan Sundararajan Devaki (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-9896) \N un-recognized in AVRO format Hive tables
Date Tue, 10 Mar 2015 08:45:38 GMT

     [ https://issues.apache.org/jira/browse/HIVE-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Madhan Sundararajan Devaki updated HIVE-9896:
---------------------------------------------
    Description: 
We Sqooped (1.4.5) data from many RDBMS into HDFS in text format with options --null-non-string
'\N' --null-string '\\N'.
When we load these into Hive tables in text format the \N is properly recognized as NULL and
we are able to use SQL clauses such as IS NULL and IS NOT NULL against columns.
However, when we convert the text files into AVRO (1.7.6) with SNAPPY compression and try
to query using the above SQL clauses, the query does not return results as expected.
Further, we have to use column_name = '\N' or column_name <> '\N' as a workaround.

  was:
We Sqooped (1.4.5) data from many RDBMS into HDFS in text format with options --null-non-string
'\\N' --null-string '\\N'.
When we load these into Hive tables in text format the \N is properly recognized as NULL and
we are able to use SQL clauses such as IS NULL and IS NOT NULL against columns.
However, when we convert the text files into AVRO (1.7.6) with SNAPPY compression and try
to query using the above SQL clauses, the query does not return results as expected.
Further, we have to use column_name = '\\N' or column_name <> '\\N' as a workaround.


> \N un-recognized in AVRO format Hive tables
> -------------------------------------------
>
>                 Key: HIVE-9896
>                 URL: https://issues.apache.org/jira/browse/HIVE-9896
>             Project: Hive
>          Issue Type: Bug
>          Components: Database/Schema, File Formats, Hive
>    Affects Versions: 0.13.0
>         Environment: CDH5.2.1, RHEL6.5, Java 7
>            Reporter: Madhan Sundararajan Devaki
>
> We Sqooped (1.4.5) data from many RDBMS into HDFS in text format with options --null-non-string
'\N' --null-string '\\N'.
> When we load these into Hive tables in text format the \N is properly recognized as NULL
and we are able to use SQL clauses such as IS NULL and IS NOT NULL against columns.
> However, when we convert the text files into AVRO (1.7.6) with SNAPPY compression and
try to query using the above SQL clauses, the query does not return results as expected.
> Further, we have to use column_name = '\N' or column_name <> '\N' as a workaround.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message