flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zili Chen <wander4...@gmail.com>
Subject Re: Local blobStore not freed
Date Wed, 12 Jun 2019 01:35:27 GMT
Hi Dan,

Said "The files are removed after a restart of the process", it sounds Flink
cleaned up blobs properly. From your description I don't understand clearly
in which case/situation you expected Flink deleted blobs but it doesn't.

Could you describe the difference between 1.4.2 and 1.7.2/1.8.0 in detail?
Especially what moment exactly you want blobs to be deleted and it was not.

Best,
tison.


Dede <rodede@gmail.com> 于2019年6月11日周二 下午11:06写道:

> Hi Team,
>
> I'm struggling for a while with a strange issue: the local blob store
> files are not actually deleted from the job manager/task manager in
> versions 1.7.2 and 1.8.0 : lsof commands shows them like this:
> java    6528          root   63r   REG 202,16 162458786 1802248
> /mnt/tmp1/blobStore-542fc202-b263-482f-87d7-11b5ad70cc32/job_b3446b24474ac3e107bbde27ff24df98/blob_p-96a29e8796d15ce6359edb4ab80ff8661f8b1fd0-73395221d4ffcfd603dbd1d25961aee3
> (deleted)
>
> The files are removed after a restart of the process, so I guess the flink
> itself is responsible for keeping a handle to the deleted file.
>
> The same process works fine on 1.4.2, deleting all the files properly.
>
> Is there something that I'm missing? I played around with the blob server
> configuration, but with no luck.
>
> I can provide more logs/debug if needed.
>
> Thanks,
> Dan
>
>
>

Mime
View raw message