beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Weise (JIRA)" <>
Subject [jira] [Created] (BEAM-1329) Improve default resource allocation in ApexRunner
Date Fri, 27 Jan 2017 04:45:24 GMT
Thomas Weise created BEAM-1329:

             Summary: Improve default resource allocation in ApexRunner
                 Key: BEAM-1329
             Project: Beam
          Issue Type: Improvement
          Components: runner-apex
            Reporter: Thomas Weise

The runner currently works off the Apex defaults, which especially for memory leads to excessive
resource requests when applied to the Beam situation with many small ParDo operators. The
runner should populate the attributes that drive resource allocation when generating the logical
DAG during pipeline translation in a way more appropriate for Beam pipelines.

This message was sent by Atlassian JIRA

View raw message