spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [spark] skonto edited a comment on issue #26075: [WIP][K8S] Spark operator
Date Fri, 11 Oct 2019 01:22:58 GMT
skonto edited a comment on issue #26075: [WIP][K8S] Spark operator
URL: https://github.com/apache/spark/pull/26075#issuecomment-540858668
 
 
   @dongjoon-hyun  @holdenk @jkremser @liyinan926  There are many operator projects out there
but it does not make sense to make them part of the core project. Same for the Flink project
(https://github.com/lyft/flinkk8soperator vs https://github.com/GoogleCloudPlatform/flink-on-k8s-operator).
Btw in other PRs people complained about the code base being to large so this is another argument
to avoid adding a lot of "external" stuff. Moreover the resource manager stuff logically belong
outside of this project but for historical reasons they were kept here since the effort for
the common  resource manager API never happened. I also find go libs superior for the purpose
of writing operators and there have been issues with the fabric8io client eg. https://github.com/fabric8io/kubernetes-client/issues/1384.
Anyway I believe this should be another external project as many others. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message