flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6295) use LoadingCache instead of WeakHashMap to lower latency
Date Tue, 18 Apr 2017 15:17:41 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972894#comment-15972894
] 

ASF GitHub Bot commented on FLINK-6295:
---------------------------------------

Github user WangTaoTheTonic commented on the issue:

    https://github.com/apache/flink/pull/3709
  
    I mean who's in charge of updating EGHolder? EGHolder itself or JobManager? EGHolder don't
sense status changing of jobs until it queries from JobManager periodically.
    
    If JobManager took the responsibility, so it will be a listenser design pattern, i guess?
Would it be too complicated as now EGHolder is just a light weighted cache?


> use LoadingCache instead of WeakHashMap to lower latency
> --------------------------------------------------------
>
>                 Key: FLINK-6295
>                 URL: https://issues.apache.org/jira/browse/FLINK-6295
>             Project: Flink
>          Issue Type: Bug
>          Components: Webfrontend
>            Reporter: Tao Wang
>            Assignee: Tao Wang
>
> Now in ExecutionGraphHolder, which is used in many handlers, we use a WeakHashMap to
cache ExecutionGraph(s), which is only sensitive to garbage collection.
> The latency is too high when JVM do GC rarely, which will make status of jobs or its
tasks unmatched with the real ones.
> LoadingCache is a common used cache implementation from guava lib, we can use its time
based eviction to lower latency of status update.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message