Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AD43B11227 for ; Fri, 18 Jul 2014 05:25:09 +0000 (UTC) Received: (qmail 50804 invoked by uid 500); 18 Jul 2014 05:25:08 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 50739 invoked by uid 500); 18 Jul 2014 05:25:08 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 50729 invoked by uid 99); 18 Jul 2014 05:25:08 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Jul 2014 05:25:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of leftyleverenz@gmail.com designates 209.85.223.173 as permitted sender) Received: from [209.85.223.173] (HELO mail-ie0-f173.google.com) (209.85.223.173) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Jul 2014 05:25:06 +0000 Received: by mail-ie0-f173.google.com with SMTP id tr6so4142789ieb.18 for ; Thu, 17 Jul 2014 22:24:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=YvEQdthDmuvTJNl523CdjPca+SfUhyHCxWujzCXS0vQ=; b=pBeSAQT4vowVDbqyqleb2kxKI6e7dekEFD3hMPEn7VWYvZfPRQppnqfDgJkO8Rbyij kJw5YkkdTZ9ViS1tlSga3e95JDfHZoAzVZFrToDLqiPnunFJAdw8P1JRziOKQeYHHGl0 S7HVPaKSRHKeEWG7UhuZERzfgajgKX+Lx/BX8BQo2PL40s0qWEb3rTETKpWgEQsduh3c MqOgYReQJ52coGiGl611ck9NX8tB7oa4iY5uhmDq6jLYL7KoGCX75CapR5/JpOYuJDK8 MOEbm7Lq8hKT/UVVW8PII2Wyx+tbkYo9KvxbLvdvMlZUMuu/TdzkgbBg7F6PqopGn+Pu S9BA== MIME-Version: 1.0 X-Received: by 10.50.33.16 with SMTP id n16mr33903490igi.15.1405661081116; Thu, 17 Jul 2014 22:24:41 -0700 (PDT) Received: by 10.42.81.1 with HTTP; Thu, 17 Jul 2014 22:24:41 -0700 (PDT) In-Reply-To: References: Date: Fri, 18 Jul 2014 01:24:41 -0400 Message-ID: Subject: Re: External partition table question From: Lefty Leverenz To: user@hive.apache.org Content-Type: multipart/alternative; boundary=089e0153840c6a269b04fe70f99f X-Virus-Checked: Checked by ClamAV on apache.org --089e0153840c6a269b04fe70f99f Content-Type: text/plain; charset=UTF-8 Thanks for this clarification. I've revised the Add Partitions section in the wiki accordingly. -- Lefty On Fri, Jul 18, 2014 at 12:45 AM, Satish Mittal wrote: > 'ALTER TABLE .. ADD PARTITION..' would just a partition entry for the > table in hive metastore. It doesn't perform any data loading, instead it > expects the data to be loaded already in the file pointed to by LOCATION. > > > On Tue, Jul 15, 2014 at 5:39 AM, Raymond Lau wrote: > >> I've created an external table partitioned by a field and am attempting >> to load in the data via the command 'ALTER TABLE partitioned_table_test ADD >> PARTITION (pcode = '123') LOCATION '/path/to/parquet/files';' using a >> custom Parquet SerDe. >> >> Does loading in the data this way call the serializer() function in the >> SerDe at all? >> >> I've tried adding System.out.println statements in my deserializer and >> serializer to debug and no output seems to come from the Serializer >> function. >> >> -- >> *Raymond Lau* >> Software Engineer - Intern | >> rlau@ooyala.com | (925) 395-3806 >> > > > _____________________________________________________________ > The information contained in this communication is intended solely for the > use of the individual or entity to whom it is addressed and others > authorized to receive it. It may contain confidential or legally privileged > information. If you are not the intended recipient you are hereby notified > that any disclosure, copying, distribution or taking any action in reliance > on the contents of this information is strictly prohibited and may be > unlawful. If you have received this communication in error, please notify > us immediately by responding to this email and then delete it from your > system. The firm is neither liable for the proper and complete transmission > of the information contained in this communication nor for any delay in its > receipt. --089e0153840c6a269b04fe70f99f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks for this clarification. =C2=A0I've revised the = Add Partitions section in the wiki= accordingly.

-- Lefty=


On Fri, Jul 18, 2014 at 12:45 AM, Satish= Mittal <satish.mittal@inmobi.com> wrote:
'ALTER TABLE .. ADD PARTITION..' would just a part= ition entry for the table in hive metastore. It doesn't perform any dat= a loading, instead it expects the data to be loaded already in the file poi= nted to by LOCATION.


On Tue, Jul 1= 5, 2014 at 5:39 AM, Raymond Lau <rlau@ooyala.com> wrote:
I've created an external table partitioned by a field and am attempti= ng to load in the data via the command 'ALTER TABLE partitioned_table_t= est ADD PARTITION (pcode =3D '123') LOCATION '/path/to/parquet/= files';' using a custom Parquet SerDe. =C2=A0

Does l= oading in the data this way call the serializer() function in the SerDe at = all?=C2=A0
=
I've tried a= dding System.out.println statements in my deserializer and serializer to de= bug and no output seems to come from the Serializer function.=C2=A0

--
Raymond Lau
Software Engineer - Intern |=C2=A0
rlau@ooy= ala.com=C2=A0| (925) 395-3806


_= ____________________________________________________________<= /span>
The information contained in this communication is intend= ed solely for the use of the individual or entity to whom it is addressed a= nd others authorized to receive it. It may contain confidential or legally = privileged information. If you are not the intended recipient you are hereb= y notified that any disclosure, copying, distribution or taking any action = in reliance on the contents of this information is strictly prohibited and = may be unlawful. If you have received this communication in error, please n= otify us immediately by responding to this email and then delete it from yo= ur system. The firm is neither liable for the proper and complete transmiss= ion of the information contained in this communication nor for any delay in= its receipt.

--089e0153840c6a269b04fe70f99f--