flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Greg Hogan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2882) Improve performance of string conversions
Date Tue, 20 Oct 2015 19:42:27 GMT
Greg Hogan created FLINK-2882:

             Summary: Improve performance of string conversions
                 Key: FLINK-2882
                 URL: https://issues.apache.org/jira/browse/FLINK-2882
             Project: Flink
          Issue Type: Improvement
          Components: Core
    Affects Versions: 0.10
            Reporter: Greg Hogan
            Assignee: Greg Hogan

{{AbstractID.toString()}} and {{AbstractID.toShortString()}} call {{StringUtils.byteToHexString(...)}}
which uses a StringBuilder to convert from binary to hex. This is a hotspot when scaling the
number of workers.

While testing on my single node with parallelism=512 jvisualvm reports 600,000 calls taking
13.4 seconds. Improving {{StringUtils.byteToHexString(...)}} reduces the time to 1.3 seconds.
Additionally memoizing the string values in {{AbstractID}} reduce the time to 350 ms and the
number of calls to {{StringUtils.byteToHexString(...)}} to ~1000.

This message was sent by Atlassian JIRA

View raw message