spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <>
Subject [GitHub] [spark] skonto edited a comment on issue #26075: [WIP][K8S] Spark operator
Date Fri, 11 Oct 2019 01:33:34 GMT
skonto edited a comment on issue #26075: [WIP][K8S] Spark operator
   @dongjoon-hyun  @holdenk @jkremser @liyinan926  There are many operator projects out there
but it does not make sense to make them part of the core project. Same for the Flink project
( vs
Btw in other PRs people complained about the code base being to large so this is another argument
to avoid adding a lot of "external" stuff. Moreover the resource manager stuff logically belong
outside of this project but for historical reasons they were kept here since the effort for
the common  resource manager API never happened. I also find go libs superior for the purpose
of writing operators and there have been issues with the fabric8io client eg.
In addition, the java operator uses standalone mode and I think k8s native integration is
more efficient. Anyway I believe this should be another external project as many others. 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

With regards,
Apache Git Services

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message