hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthew Knox (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-18295) Add ability to ignore invalid values in JSON SerDe
Date Mon, 18 Dec 2017 21:42:00 GMT
Matthew Knox created HIVE-18295:
-----------------------------------

             Summary: Add ability to ignore invalid values in JSON SerDe
                 Key: HIVE-18295
                 URL: https://issues.apache.org/jira/browse/HIVE-18295
             Project: Hive
          Issue Type: Improvement
          Components: HCatalog
            Reporter: Matthew Knox
            Assignee: Matthew Knox


It would be nice to be able to configure the JSON SerDe to ignore invalid values while parsing
JSON. 

In our case our raw JSON data is ingested from multiple sources, some of which unreliably
sanitize the data. Our current practice is to cleanse the data after ingestion, but that can
lead to other issues as well. Having the ability to simply default to NULL if a value can
not be parsed would be immensely helpful to us.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message