hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael G. Noll" <>
Subject Configuring Hive to automatically create _SUCCESS files
Date Thu, 15 Sep 2011 13:59:00 GMT

is there a way to configure Hive 0.7.1 so that it creates _SUCCESS files
similar to Hadoop MapReduce and Pig?

Hadoop has the property "mapreduce.fileoutputcommitter.marksuccessfuljobs"
(see, which is as of Hadoop enabled by
default.  In Pig 0.9.0, you can enable success files by e.g. setting the
property on the command line when running a Pig script (see PIG-1433 [1]):

    $ pig -Dmapreduce.fileoutputcommitter.marksuccessfuljobs=true ...

I have unsuccessfully tried to enable success files in Hive 0.7.1 in
combination with Hadoop

    # has no effect
    $ hive -hiveconf mapreduce.fileoutputcommitter.marksuccessfuljobs=true

The job configuration XML file lists the property as being set to true, but
Hive will not create a success file.



View raw message