hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rui Martins <ru...@ruibm.com>
Subject Re: Custom SerDe: Initialize() passes a null configuration to my Custom SerDe
Date Mon, 14 Oct 2013 12:20:12 GMT
+dev hive mailing list that I should've mailed in the first place.

(apologies for the spam)


On Mon, Oct 14, 2013 at 1:16 PM, Rui Martins <ruibm@ruibm.com> wrote:

> Hi hive users,
>
> I am writing a custom SerDe that loads any protocol buffer generated
> class.
> For flexibility this class can live in a jar external to the SerDe's jar
> and then I just use the Hive Configuration class passed in the initiliaze
> to dynamically load it and set the schema for the Hive table.
>
>
> http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop.hive/hive-serde/0.7.0-cdh3u0/org/apache/hadoop/hive/serde2/Serializer.java#Serializer
>
> When I use my custom SerDe as a Deserializer it all works well, I get a
> Configuration and I correctly load the ProtoBuffer class from the external
> Jar.
>
> However, when I use the SerDe as a Serializer, the Configuration is always
> set to null so I have no way of loading the external class from the Jar.
>
> My questions are:
>
> *  1) Is the initialize(..) method in Serializer supposed to always pass
> a null Configuration?*
> *
> *
> *  2) Is there a way of creating or retrieving the current Hadoop/Hive
> Configuration when this parameter is passed as null?*
> *
> *
>
> Thank you,
> rui
>

Mime
View raw message