spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Erik Erlandson (JIRA)" <>
Subject [jira] [Commented] (SPARK-23891) Debian based Dockerfile
Date Thu, 12 Apr 2018 19:36:00 GMT


Erik Erlandson commented on SPARK-23891:

The question of what OS base to use for "canonical" images or dockerfiles is an open one.
The use of alpine was influenced by the relatively small image size that resulted. We could
entertain arguments about why debian, centos, or some other OS, might be an advantage.

The current position of the Apache Spark project is that the dockerfiles shipped with the
project are for reference, and as an aid to users building their own images for use with the
kubernetes back-end.  IMO, the project should not get into the business of supporting _multiple_
dockerfiles at the present time. In the future, if/when the "container image api" stabilizes
further, we might reconsider maintaining multiple dockerfiles.

I'm interested if others have different point of view; my take currently is that if users
would like to construct similar dockerfiles using an alternative base OS, it would be great
to publish that as a github project where interested community members could use it.

> Debian based Dockerfile
> -----------------------
>                 Key: SPARK-23891
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>          Components: Kubernetes
>    Affects Versions: 2.3.0
>            Reporter: Sercan Karaoglu
>            Priority: Minor
> Current dockerfile inherits from alpine linux which causes netty tcnative ssl bindings
to fail while loading which is the case when we use Google Cloud Platforms Bigtable Client
on top of spark cluster. would be better to have another debian based dockerfile

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message