hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Huang, Yunkai" <>
Subject HCatalog dynamic partition on a single node
Date Thu, 10 Sep 2015 14:47:55 GMT

I am trying to use the HCatalog dynamic partition feature to write a Hive table with partition
columns. I was able to write successfully when running in Map-Reduce. However, I can't find
a way to achieve the same result on a single node without running Map-Reduce.
When running in Map-Reduce, I set up the dynamic partition schema with HCatOutputFormat.setSchema(...),
as shown in the example
When running on a single node,  I tried to use HCatWriter (the actual class is HCatOutputFormatWriter)
obtained through DataTransferFactory.getHCatWriter as shown in
However, with that class, I can't find a way to set up the dynamic partition schema similar
to running in Map-Reduce.
Will this missing feature be addressed in upcoming enhancements? Does anyone have a work around



The information contained in this message (including any files transmitted with this message)
may contain proprietary, trade secret or other confidential and/or legally privileged information.
Any pricing information contained in this message or in any files transmitted with this message
is always confidential and cannot be shared with any third parties without prior written approval
from Syncsort. This message is intended to be read only by the individual or entity to whom
it is addressed or by their designee. If the reader of this message is not the intended recipient,
you are on notice that any use, disclosure, copying or distribution of this message, in any
form, is strictly prohibited. If you have received this message in error, please immediately
notify the sender and/or Syncsort and destroy all copies of this message in your possession,
custody or control.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message