hudi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinay Patil <vinay18.pa...@gmail.com>
Subject [Discuss] Provide a Flag to choose between Flink or Spark
Date Wed, 09 Jun 2021 07:42:14 GMT
Hi Team,

Currently, Hudi supports Flink as well Spark, there are two different
classes
1. HoodieDeltaStreamer
2. FlinkHoodieDeltaStreamer

Should we have a provision to pass the flag like --runner to choose between
Flink or Spark and have a single entry point class which will take all the
common configs.

Based on the runner flag, we can call HoodieDeltaStreamer or
FlinkHoodieDeltaStreamer

Thoughts?

Regards,
Vinay Patil

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message