flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chesnay Schepler <ches...@apache.org>
Subject Re: [DISCUSS] Towards a leaner flink-dist
Date Tue, 29 Jan 2019 15:13:52 GMT
It is not viable for us, as of right now, to release both a lean and fat 
version of flink-dist.
We don't have the required tooling to assemble a correct NOTICE file for 
that scenario.

Besides that his would also go against recent efforts to reduce the 
total size of a Flink release,
as we'd be increasing the total size again by roughly 60% (and naturally 
also increase the compile
time of releases), which I'd like to avoid.

I like Stephans compromise of excluding reporters and file-systems; this 
removes more than 100mb
from the distribution yet still retains all the user-facing APIs.

Do note that hadoop will already not be included in convenience binaries 
for 1.8 . This was
the motivation behind the new section on the download page.

On 25.01.2019 06:42, Jark Wu wrote:
> +1 for the leaner distribution and improve the "Download" page.
> On Fri, 25 Jan 2019 at 01:54, Bowen Li <bowenli86@gmail.com> wrote:
>> +1 for leaner distribution and a better 'download' webpage.
>> +1 for a full distribution if we can automate it besides supporting the
>> leaner one. If we support both, I'd image release managers should be able
>> to package two distributions with a single change of parameter instead of
>> manually package the full distribution. How to achieve that needs to be
>> evaluated and discussed, probably can be something like 'mvn clean install
>> -Dfull/-Dlean', I'm not sure yet.
>> On Wed, Jan 23, 2019 at 10:11 AM Thomas Weise <thw@apache.org> wrote:
>>> +1 for trimming the size by default and offering the fat distribution as
>>> alternative download
>>> On Wed, Jan 23, 2019 at 8:35 AM Till Rohrmann <trohrmann@apache.org>
>>> wrote:
>>>> Ufuk's proposal (having a lean default release and a user convenience
>>>> tarball) sounds good to me. That way advanced users won't be bothered by
>>>> an
>>>> unnecessarily large release and new users can benefit from having many
>>>> useful extensions bundled in one tarball.
>>>> Cheers,
>>>> Till
>>>> On Wed, Jan 23, 2019 at 3:42 PM Ufuk Celebi <uce@apache.org> wrote:
>>>>> On Wed, Jan 23, 2019 at 11:01 AM Timo Walther <twalthr@apache.org>
>>>> wrote:
>>>>>> I think what is more important than a big dist bundle is a helpful
>>>>>> "Downloads" page where users can easily find available filesystems,
>>>>>> connectors, metric repoters. Not everyone checks Maven central for
>>>>>> available JAR files. I just saw that we added a "Optional components"
>>>>>> section recently [1], we just need to make it more prominent. This
>>>>>> also done for the SQL connectors and formats [2].
>>>>> +1 I fully agree with the importance of the Downloads page. We
>>>>> definitely need to make any optional dependencies that users need to
>>>>> download easy to find.

View raw message