hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eugene Koifman <ekoif...@hortonworks.com>
Subject Re: hive transaction strange behaviour
Date Sat, 14 Nov 2015 17:31:54 GMT
When Compaction process runs, it will create base directory.
https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration

at a minimum you need hive.compactor.initiator.on<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.compactor.initiator.on>=true
and hive.compactor.worker.threads<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.compactor.worker.threads>>0

Also, see https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AlterTable/PartitionCompact
on how to trigger compaction manually.

Eugene

From: Sanjeev Verma <sanjeev.verma82@gmail.com<mailto:sanjeev.verma82@gmail.com>>
Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" <user@hive.apache.org<mailto:user@hive.apache.org>>
Date: Thursday, November 12, 2015 at 11:41 PM
To: "user@hive.apache.org<mailto:user@hive.apache.org>" <user@hive.apache.org<mailto:user@hive.apache.org>>,
"dev@hive.apache.org<mailto:dev@hive.apache.org>" <dev@hive.apache.org<mailto:dev@hive.apache.org>>
Subject: hive transaction strange behaviour

I have enable the hive transaction and able to see the delta files created for some of the
partition but i dont not see any base file created yet.it<http://yet.it> seems strange
to me seeing so many delta files without any base file.
Could somebody let me know when Base file created.

Thanks

Mime
View raw message