hive-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mit...@apache.org
Subject hive git commit: HIVE-17803: With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs (Chris Drome, reviewed by Mithun Radhakrishnan)
Date Thu, 19 Oct 2017 17:57:03 GMT
Repository: hive
Updated Branches:
  refs/heads/branch-2 dd39330f6 -> a93e99ad4


HIVE-17803: With Pig multi-query, 2 HCatStorers writing to the same table will trample each
other's outputs (Chris Drome, reviewed by Mithun Radhakrishnan)


Project: http://git-wip-us.apache.org/repos/asf/hive/repo
Commit: http://git-wip-us.apache.org/repos/asf/hive/commit/a93e99ad
Tree: http://git-wip-us.apache.org/repos/asf/hive/tree/a93e99ad
Diff: http://git-wip-us.apache.org/repos/asf/hive/diff/a93e99ad

Branch: refs/heads/branch-2
Commit: a93e99ad4000f2922b36389021900f2ad17e976c
Parents: dd39330
Author: Mithun RK <mithun@apache.org>
Authored: Fri Oct 13 14:21:39 2017 -0700
Committer: Mithun Radhakrishnan <mithun@apache.org>
Committed: Thu Oct 19 10:54:44 2017 -0700

----------------------------------------------------------------------
 .../hive/hcatalog/mapreduce/FileOutputCommitterContainer.java    | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hive/blob/a93e99ad/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
----------------------------------------------------------------------
diff --git a/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
index b85ef0f..afecf5f 100644
--- a/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
+++ b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
@@ -598,9 +598,9 @@ class FileOutputCommitterContainer extends OutputCommitterContainer {
 
             final Path parentDir = finalOutputPath.getParent();
             // Create the directory
-            Path placeholder = new Path(parentDir, "_placeholder");
+            Path placeholder = new Path(parentDir, "_placeholder" + String.valueOf(Math.random()));
             if (fs.mkdirs(parentDir)) {
-              // It is weired but we need a placeholder, 
+              // It is weird but we need a placeholder,
               // otherwise rename cannot move file to the right place
               fs.create(placeholder).close();
             }


Mime
View raw message