Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 36D92D5CD for ; Fri, 12 Oct 2012 23:39:45 +0000 (UTC) Received: (qmail 51309 invoked by uid 500); 12 Oct 2012 23:39:44 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 51270 invoked by uid 500); 12 Oct 2012 23:39:43 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 51257 invoked by uid 99); 12 Oct 2012 23:39:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Oct 2012 23:39:43 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of roberto.congiu@openx.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vc0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Oct 2012 23:39:35 +0000 Received: by mail-vc0-f176.google.com with SMTP id gb22so4875499vcb.35 for ; Fri, 12 Oct 2012 16:39:14 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=TA5uJH9ATykBlN+8ExsSiY2M3Ljug2ySyV2W5Ybm1dM=; b=HKdtVXtBec5YBsbtEej+mkYykn/zBgccJaMFRyAmh5inrBONfmZlLJCEF5rF8cbwrt /S/0PH0R4CaZQRh8qpHYx1vIv6Xf8CBZ2Q4jFyoeTbBhzQlhM4vGjl7YVu9Yynm1KCuv HJ78rD0qbMH8tGF0UfT0BI3vED9EkMzzJf8tvJv7ASmocPMv6YMMRzrt2C5Eat3LUOoY YkV9JQrVNPZTzLBO9EPmIcfBWi1YpaLUK55YIPcFLZoVKEmYL4iS3XrqjTVUE8u0kaRL 59wrydI3UJOwAcLWnnfDuEt0/NlRuVYU783lbS//nbsQNdyFL9ETpUvhHwgt1N6G02oz zi+Q== MIME-Version: 1.0 Received: by 10.52.16.110 with SMTP id f14mr2734340vdd.8.1350085154548; Fri, 12 Oct 2012 16:39:14 -0700 (PDT) Received: by 10.58.69.47 with HTTP; Fri, 12 Oct 2012 16:39:14 -0700 (PDT) In-Reply-To: <44435898-2489-44D8-AA25-323B37532C57@gmail.com> References: <44435898-2489-44D8-AA25-323B37532C57@gmail.com> Date: Fri, 12 Oct 2012 16:39:14 -0700 Message-ID: Subject: Re: Interference between two customSerde.jar From: Roberto Congiu To: user@hive.apache.org Content-Type: multipart/alternative; boundary=bcaec5040ca60dac4f04cbe53257 X-Gm-Message-State: ALoCoQlJp6MhNJK4XpOsi3zWAoxeLx1OVywtnnGBaGvdYAK5+tntQB6nGjHNq+9zM/Dp0Kpct/Z9 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec5040ca60dac4f04cbe53257 Content-Type: text/plain; charset=UTF-8 Without more specific info about the two serdes I can't be sure, but most likely there may be a dependency conflict between the two serdes. Sometimes, for instance, they may use a different version of log4j, and if packaged with all dependencies they can indeed interfere with each other. Have a look at their POM, or jar -tf the serde to see if they have two different versions of the same class. R. On Fri, Oct 12, 2012 at 4:25 PM, Germain Tanguy wrote: > Hi everybody, > > I am using Hive-0.9.0 and Hadoop-0.20.2. I have two customizes SerDe : > custoSerde1.jar and custoSerde2.jar adding with ~/.hiverc . > In HDFS I have : /input/data_for_custoSerde1/ > /input/data_for_custoSerde2/ > > When I run a query on my tableSerde1 it's work but not on tableSerde2. If > I remove custoSerde1.jar of hiverc the query works on tableSerde2 and when > I put custoSerde1.jar back in hiverc the query don't work anymore on > tableSerde1 but it's continuing to work on tableSerde2. And inversely.. > > Does anyone have an idea why? > Is there any possibility to specify which SerDe.jar we want to use when we > run a query? > > All help will be welcome :) > > Thanks and regards, > > Germain. > > -- ---------------------------------------------------------- Good judgement comes with experience. Experience comes with bad judgement. ---------------------------------------------------------- Roberto Congiu - Data Engineer - OpenX tel: +1 626 466 1141 --bcaec5040ca60dac4f04cbe53257 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Without more specific info about the two serdes I can't be sure, but mo= st likely there may be a dependency conflict between the two serdes. Someti= mes, for instance, they may use a different version of log4j, and if packag= ed with all dependencies they can indeed interfere with each other.
Have a look at their POM, or jar -tf the serde to see if they have two diff= erent versions of the same class.

R.

On Fri, Oct 12, 2012 at 4:25 PM, Germain Tanguy <tanguy.germain@gmail.com> wrote:
Hi everybody,

I am using Hive-0.9.0 and Hadoop-0.20.2. I have two customizes SerDe : cust= oSerde1.jar and custoSerde2.jar adding with ~/.hiverc .
In HDFS I have : =C2=A0/input/data_for_custoSerde1/
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0/input/data_for_custoSerde2/

When I run a query on my tableSerde1 it's work but not on tableSerde2. = If I remove custoSerde1.jar of hiverc the query works on tableSerde2 and wh= en I put custoSerde1.jar back in hiverc the query don't work anymore on= tableSerde1 but it's continuing to work on tableSerde2. And inversely.= .

Does anyone have an idea why?
Is there any possibility to specify which SerDe.jar we want to use when we = run a query?

All help will be welcome :)

Thanks and regards,

Germain.




--
------------= ----------------------------------------------
Good judgement comes wit= h experience.
Experience comes with bad judgement.
------= ----------------------------------------------------
Roberto Congiu - Data Engineer - OpenX
tel: +1 626 466 1141<= /div>

--bcaec5040ca60dac4f04cbe53257--