flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chesnay Schepler <ches...@apache.org>
Subject Re: [DISCUSS] FLIP-19: Improved BLOB storage architecture
Date Wed, 14 Jun 2017 10:29:55 GMT
One thing i was wondering for a long time now is why the distributed 
cache is not implemented
via the blob store.

The DC is essentially just a copy routine with local caching and 
automatic cleanup, so basically what
the blob store is supposed to do (i guess).

On 13.06.2017 16:31, Nico Kruber wrote:
> Hi all,
> I'd like to initiate a discussion on some architectural changes for the BLOB
> server which finally add a proper cleanup story, remove some dead code, and
> extend the BLOB store's use for off-loaded (large) RPC messages.
> Please have a look at FLIP-19 that details the proposed changes:
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-19%3A+Improved+BLOB
> +storage+architecture
> Regards
> Nico
> PS: While doing the re-write, I'd also like to fix some concurrency issues in
> the current code.

View raw message