hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vin...@apache.org
Subject [incubator-hudi] branch master updated: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly (#1377)
Date Sun, 22 Mar 2020 17:31:57 GMT
This is an automated email from the ASF dual-hosted git repository.

vinoth pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/master by this push:
     new 38c3ccc  [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly (#1377)
38c3ccc is described below

commit 38c3ccc51a069dbccab718423055c0a708b44d63
Author: lamber-ken <lamberken@163.com>
AuthorDate: Sun Mar 22 12:31:48 2020 -0500

    [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly (#1377)
---
 .../java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java  | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java
b/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java
index 4ad8855..2989f20 100644
--- a/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java
+++ b/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java
@@ -180,7 +180,7 @@ public class KafkaOffsetGen {
               .map(x -> new TopicPartition(x.topic(), x.partition())).collect(Collectors.toSet());
 
       // Determine the offset ranges to read from
-      if (lastCheckpointStr.isPresent()) {
+      if (lastCheckpointStr.isPresent() && !lastCheckpointStr.get().isEmpty()) {
         fromOffsets = checkupValidOffsets(consumer, lastCheckpointStr, topicPartitions);
       } else {
         KafkaResetOffsetStrategies autoResetValue = KafkaResetOffsetStrategies


Mime
View raw message