Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
From: "Huang, Yunkai" <yhuang@syncsort.com>
To: "dev@hive.apache.org" <dev@hive.apache.org>
Subject: HCatalog dynamic partition on a single node
Thread-Topic: HCatalog dynamic partition on a single node
Thread-Index: AdDr1zNIhcgIW0FyQsyAhTMHZbsBiw==
Date: Thu, 10 Sep 2015 14:47:55 +0000
Message-ID: 
 <04C1A87C95B76542939DCC6D2F871B90010F94A7EF@PRODITMAILBOX1.us.syncsort.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_04C1A87C95B76542939DCC6D2F871B90010F94A7EFPRODITMAILBOX_"
MIME-Version: 1.0

--_000_04C1A87C95B76542939DCC6D2F871B90010F94A7EFPRODITMAILBOX_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi,

I am trying to use the HCatalog dynamic partition feature to write a Hive t=
able with partition columns. I was able to write successfully when running =
in Map-Reduce. However, I can't find a way to achieve the same result on a =
single node without running Map-Reduce.
When running in Map-Reduce, I set up the dynamic partition schema with HCat=
OutputFormat.setSchema(...), as shown in the example http://quabr.com/14286=
256/adding-partitions-to-hive-from-a-mapreduce-job.
When running on a single node,  I tried to use HCatWriter (the actual class=
 is HCatOutputFormatWriter) obtained through DataTransferFactory.getHCatWri=
ter as shown in https://cwiki.apache.org/confluence/display/Hive/HCatalog+R=
eaderWriter. However, with that class, I can't find a way to set up the dyn=
amic partition schema similar to running in Map-Reduce.
Will this missing feature be addressed in upcoming enhancements? Does anyon=
e have a work around currently?


________________________________


ATTENTION: -----

The information contained in this message (including any files transmitted =
with this message) may contain proprietary, trade secret or other confident=
ial and/or legally privileged information. Any pricing information containe=
d in this message or in any files transmitted with this message is always c=
onfidential and cannot be shared with any third parties without prior writt=
en approval from Syncsort. This message is intended to be read only by the =
individual or entity to whom it is addressed or by their designee. If the r=
eader of this message is not the intended recipient, you are on notice that=
 any use, disclosure, copying or distribution of this message, in any form,=
 is strictly prohibited. If you have received this message in error, please=
 immediately notify the sender and/or Syncsort and destroy all copies of th=
is message in your possession, custody or control.

--_000_04C1A87C95B76542939DCC6D2F871B90010F94A7EFPRODITMAILBOX_--