hive-gitbox mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <>
Subject [GitHub] [hive] ayushtkn commented on a change in pull request #2043: HIVE-24852. Add support for Snapshots during external table replication.
Date Tue, 04 May 2021 19:08:13 GMT

ayushtkn commented on a change in pull request #2043:

File path: common/src/java/org/apache/hadoop/hive/conf/
@@ -668,6 +668,18 @@ private static void populateLlapDaemonVarsSet(Set<String> llapDaemonVarsSetLocal
         + " table or partition level. If hive.exec.parallel \n"
         + "is set to true then max worker threads created for copy can be hive.exec.parallel.thread.number(determines
         + "number of copy tasks in parallel) * hive.repl.parallel.copy.tasks "),
+    REPL_SNAPSHOT_DIFF_FOR_EXTERNAL_TABLE_COPY("hive.repl.externaltable.snapshotdiff.copy",
+        false,"Use snapshot diff for copying data from source to "
+        + "destination cluster for external table in distcp"),
+        true,"If this is enabled, in case the target is modified, when using snapshot for
external table"
+        + "data copy, the target data is overwritten and the modifications are removed and
the copy is again "
+        + "attempted using the snapshot based approach. If disabled, the replication will
fail in case the target is "
+        + "modified."),
+    REPL_SNAPSHOT_EXTERNAL_TABLE_PATHS("hive.repl.externatable.snapshot.paths",

Review comment:

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message