beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Weise (JIRA)" <>
Subject [jira] [Created] (BEAM-935) Pre-aggregation for group-by-key
Date Mon, 07 Nov 2016 17:59:59 GMT
Thomas Weise created BEAM-935:

             Summary: Pre-aggregation for group-by-key
                 Key: BEAM-935
             Project: Beam
          Issue Type: Improvement
          Components: runner-apex
            Reporter: Thomas Weise

Apex runner currently does not perform pre-aggregation of results in GBK. Depending on the
input data volume the result iterable for a given window can grow very large and lead to performance
degradation and out of memory errors. This can be mitigated by applying the combine function
during GBK.  

This message was sent by Atlassian JIRA

View raw message