Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of hsubramaniyan@hortonworks.com
 designates 74.125.82.169 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOSFW13aqXuM+zV1YjXPz6QQ8P5D03nBiY4=-wp4Zq_=ivJV7A@mail.gmail.com>
References: 
 <CAA-NicPtxd=phEcdQHp00Eh+81xEZq=R-+pYpNUEX2T3ntiJ2g@mail.gmail.com>
	<CAA-NicNTLk4ZNCkqyoXcPzniTMZSX-4Z4zsXC65VYh74Ppfvwg@mail.gmail.com>
	<CAOSFW13aqXuM+zV1YjXPz6QQ8P5D03nBiY4=-wp4Zq_=ivJV7A@mail.gmail.com>
Date: Mon, 14 Oct 2013 18:59:37 +0530
Message-ID: 
 <CAHCdSiuDT8zE=66vCgMDtB1r6w7O1q5KXK3FO=iukLRFZNurGg@mail.gmail.com>
Subject: Re: Custom SerDe: Initialize() passes a null configuration to my
 Custom SerDe
From: Hari Subramaniyan <hsubramaniyan@hortonworks.com>
To: dev@hive.apache.org, Rui Martins <ruibm@ruibm.com>
Cc: user@hive.apache.org
Content-Type: multipart/alternative; boundary=047d7bb04f68ad2fe704e8b375ee

--047d7bb04f68ad2fe704e8b375ee
Content-Type: text/plain; charset=US-ASCII

Please see
https://svn.apache.org/repos/asf/hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java
https://svn.apache.org/repos/asf/hive/trunk/ql/src/test/queries/clientpositive/
to see how a non-null conf is passed to initialize()

Thanks
Hari


On Mon, Oct 14, 2013 at 6:29 PM, Yin Huai <huaiyin.thu@gmail.com> wrote:

> Can you try to set serde properties?
>
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AddSerDeProperties
>
> I have not tried it, but seems it is the right way to pass configurations
> to serde class.
>
> Thanks,
>
> Yin
>
>
> On Mon, Oct 14, 2013 at 8:20 AM, Rui Martins <ruibm@ruibm.com> wrote:
>
> > +dev hive mailing list that I should've mailed in the first place.
> >
> > (apologies for the spam)
> >
> >
> > On Mon, Oct 14, 2013 at 1:16 PM, Rui Martins <ruibm@ruibm.com> wrote:
> >
> >> Hi hive users,
> >>
> >> I am writing a custom SerDe that loads any protocol buffer generated
> >> class.
> >> For flexibility this class can live in a jar external to the SerDe's jar
> >> and then I just use the Hive Configuration class passed in the
> initiliaze
> >> to dynamically load it and set the schema for the Hive table.
> >>
> >>
> >>
> http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop.hive/hive-serde/0.7.0-cdh3u0/org/apache/hadoop/hive/serde2/Serializer.java#Serializer
> >>
> >> When I use my custom SerDe as a Deserializer it all works well, I get a
> >> Configuration and I correctly load the ProtoBuffer class from the
> external
> >> Jar.
> >>
> >> However, when I use the SerDe as a Serializer, the Configuration is
> >> always set to null so I have no way of loading the external class from
> the
> >> Jar.
> >>
> >> My questions are:
> >>
> >> *  1) Is the initialize(..) method in Serializer supposed to always pass
> >> a null Configuration?*
> >> *
> >> *
> >> *  2) Is there a way of creating or retrieving the current Hadoop/Hive
> >> Configuration when this parameter is passed as null?*
> >> *
> >> *
> >>
> >> Thank you,
> >> rui
> >>
> >
> >
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

--047d7bb04f68ad2fe704e8b375ee--