flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaogang Shi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-5917) Remove MapState.size()
Date Thu, 02 Mar 2017 09:58:45 GMT

    [ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891970#comment-15891970

Xiaogang Shi commented on FLINK-5917:

+1 to remove the {{size()}} method due to the cost implementation. 

> Remove MapState.size()
> ----------------------
>                 Key: FLINK-5917
>                 URL: https://issues.apache.org/jira/browse/FLINK-5917
>             Project: Flink
>          Issue Type: Improvement
>          Components: DataStream API
>    Affects Versions: 1.3.0
>            Reporter: Aljoscha Krettek
> I'm proposing to remove {{size()}} because it is a prohibitively expensive operation
and users might not be aware of it. Instead of {{size()}} users can use an iterator over all
mappings to determine the size, when doing this they will be aware of the fact that it is
a costly operation.
> Right now, {{size()}} is only costly on the RocksDB state backend but I think with future
developments on the in-memory state backend it might also become an expensive operation there.

This message was sent by Atlassian JIRA

View raw message