hive-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mit...@apache.org
Subject hive git commit: HIVE-17233: Set mapred.input.dir.recursive in HCatInputFormat. (Mithun Radhakrishnan, reviewed by Thejas M Nair)
Date Thu, 17 Aug 2017 00:42:27 GMT
Repository: hive
Updated Branches:
  refs/heads/branch-2 6328f21db -> 8035254b6


HIVE-17233: Set mapred.input.dir.recursive in HCatInputFormat. (Mithun Radhakrishnan, reviewed
by Thejas M Nair)


Project: http://git-wip-us.apache.org/repos/asf/hive/repo
Commit: http://git-wip-us.apache.org/repos/asf/hive/commit/8035254b
Tree: http://git-wip-us.apache.org/repos/asf/hive/tree/8035254b
Diff: http://git-wip-us.apache.org/repos/asf/hive/diff/8035254b

Branch: refs/heads/branch-2
Commit: 8035254b612d3d3a723d558354174d987e17bf04
Parents: 6328f21
Author: Mithun RK <mithun@apache.org>
Authored: Thu Aug 3 10:35:31 2017 -0700
Committer: Mithun RK <mithun@apache.org>
Committed: Wed Aug 16 17:41:34 2017 -0700

----------------------------------------------------------------------
 .../org/apache/hive/hcatalog/mapreduce/HCatBaseInputFormat.java   | 3 +++
 1 file changed, 3 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hive/blob/8035254b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/HCatBaseInputFormat.java
----------------------------------------------------------------------
diff --git a/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/HCatBaseInputFormat.java
b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/HCatBaseInputFormat.java
index dbbdd61..9caff7a 100644
--- a/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/HCatBaseInputFormat.java
+++ b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/HCatBaseInputFormat.java
@@ -105,6 +105,9 @@ public abstract class HCatBaseInputFormat
   public List<InputSplit> getSplits(JobContext jobContext)
     throws IOException, InterruptedException {
     Configuration conf = jobContext.getConfiguration();
+    // Set up recursive reads for sub-directories.
+    // (Otherwise, sub-directories produced by Hive UNION operations won't be readable.)
+    conf.setBoolean("mapred.input.dir.recursive", true);
 
     //Get the job info from the configuration,
     //throws exception if not initialized


Mime
View raw message