Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
Subject: Re: Class loading and job versioning
To: user@flink.apache.org
References: <ba9453d0-8c3f-197c-9402-638938948241@zalando.de>
 <7269292b-bebe-f026-9406-06f79ee47215@zalando.de>
 <CAGco--ZbLhq6Onp5tkVKx+mUQf4+OjeST_uaVpUg8HJTEhzH2g@mail.gmail.com>
From: Michal Budzyn <michal.budzyn.extern@zalando.de>
Message-ID: <99f82585-5888-5529-2ac8-a3ea7dca7312@zalando.de>
Date: Wed, 20 Jul 2016 14:23:49 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.2.0
MIME-Version: 1.0
In-Reply-To: <CAGco--ZbLhq6Onp5tkVKx+mUQf4+OjeST_uaVpUg8HJTEhzH2g@mail.gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
archived-at: Wed, 20 Jul 2016 12:24:07 -0000

Thanks for the prompt replay.

You are right. The conflict was between "com.fasterxml.jackson.core" libs.

I am just wondering. If the the jobs were separted from the platform,

the jobs libs should have precedence and no versioning problem should 
have happened.

Regards,

Michal


On 20.07.2016 14:00, Maximilian Michels wrote:
> Hi Michal,
>
> I couldn't find Joda in flink-dist. Possibly there is some other clash?
>
> There are two potential issues here:
>
> 1) Flink shades some libraries (Guava) but not all. If you use a
> version of a library in your Flink job which doesn't match the one in
> flink-dist, you're bound for trouble.
>
> 2) Flink separates jobs from each other to avoid potential class
> version mismatches. Each job has its own classloader. In this sense,
> "job versioning" is supported.
>
> Cheers,
> Max
>
> On Wed, Jul 20, 2016 at 1:02 PM, Michal Budzyn
> <michal.budzyn.extern@zalando.de> wrote:
>> Hi all,
>> We had a class versioning problem within Flink Job.
>> The job uses Joda 2.6, but the flink-dist 1.0.3 packages 2.5.
>> The problem was solved by relocating job classes with shade plug-in.
>>
>> Does flink separate jobs from each other to avoid class conflicts between
>> them and the platform ?
>> Is job versioning supported or is shading always required ?
>>
>> Regards,
>> Michal
>>