hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chagarlamudi, Prasanth" <prasanth.chagarlam...@epsilon.com>
Subject Merging small files in partitions
Date Tue, 16 Jun 2015 21:05:58 GMT
Hello,
I am looking for an optimized way to merge small files in hive partitions into one big file.
I came across Alter Table/Partition Concatenate https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AlterTable/PartitionConcatenate.
Doc says this only works for RCFiles. I wish there is something similar for TEXT FILE format.
Any suggestions?

Thanks in advance
Prasanth



________________________________

This e-mail and files transmitted with it are confidential, and are intended solely for the
use of the individual or entity to whom this e-mail is addressed. If you are not the intended
recipient, or the employee or agent responsible to deliver it to the intended recipient, you
are hereby notified that any dissemination, distribution or copying of this communication
is strictly prohibited. If you are not one of the named recipient(s) or otherwise have reason
to believe that you received this message in error, please immediately notify sender by e-mail,
and destroy the original message. Thank You.

Mime
View raw message