flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Khachatryan Roman <khachatryan.ro...@gmail.com>
Subject Re: Some question about flink temp files
Date Fri, 20 Mar 2020 15:12:57 GMT
Hi Reo,

Please find the answers to your questions below.

> 1, what is the usage of this tmp files?
These files are used by Flink internally for things like caching state
locally, storing jars and so on. They are not intended for the end-user.
> 2, Is there have any mechanism of flink to manage this files?
Yes, they are created and deleted by Flink when not used.
> 3, Have any situation I need to delete the useless files manually´╝č
No.
> 4, I know I can specify the temp files path by "io.tmp.dirs" config for
flink cluster. But when I use LocalEnvironment, how can I config this path
instead of use the default path("/tmp")?
Please use "java.io.tmpdir" *system property* for standalone deployment [1].

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/ops/config.html

Regards,
Roman


On Fri, Mar 20, 2020 at 11:55 AM Reo Lei <leinuowen@gmail.com> wrote:

> Hi all,
>
> Recently, I found flink tmp files(localState,
> blobStore-*, flink-dist-cach-*, flink-io-*, flink-netty-shuffle-* etc.) has
> been grown to a total of about 6GB size. I have no idea what usage abot
> this files, and How big it will grow.
>
> So, I have some questions about the tmep files of flink as follow:
>
> 1, what is the usage of this tmp files?
> 2, Is there have any mechanism of flink to manage this files?
> 3, Have any situation I need to delete the useless files manually´╝č
> 4, I know I can specify the temp files path by "io.tmp.dirs" config for
> flink cluster. But when I use LocalEnvironment, how can I config this
> path instead of use the default path("/tmp")?
>
> Thanks.
>
> BR,
> Reo
>

Mime
View raw message