hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yibing Shi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16306) Encode binary fields of complex types with base64 and wrap them up with quotes
Date Mon, 27 Mar 2017 23:36:41 GMT
Yibing Shi created HIVE-16306:
---------------------------------

             Summary: Encode binary fields of complex types with base64 and wrap them up with
quotes
                 Key: HIVE-16306
                 URL: https://issues.apache.org/jira/browse/HIVE-16306
             Project: Hive
          Issue Type: Improvement
          Components: Serializers/Deserializers
    Affects Versions: 2.2.0
            Reporter: Yibing Shi


Consider a complex type that has a binary field/item. For example:
{noformat}
struct<field:binary>
{noformat}

In sink operators, the struct is encoded as a JSON string, but its binary field is directly
appended to the JSON string when encoded, which often breaks downstream JSON parsers.

Can we encode binary data within a complex type into base64 strings and quote them up like
normal strings? This helps JSON parsers to work properly with binary data.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message