crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <>
Subject [jira] [Created] (CRUNCH-546) Avoid CellUtil.cloneXXX in HFileUtils and HFileInputFormat
Date Sun, 19 Jul 2015 14:42:04 GMT
Gabriel Reid created CRUNCH-546:

             Summary: Avoid CellUtil.cloneXXX in HFileUtils and HFileInputFormat
                 Key: CRUNCH-546
             Project: Crunch
          Issue Type: Improvement
            Reporter: Gabriel Reid
            Assignee: Gabriel Reid

HFileUtils and HFileInputFormat currently make use of the CellUtil.cloneXXX in a number of
places when comparing row, family, and qualifier values with a constant.

The clone methods are relatively costly, as they require allocating a new byte array and copying
all data over into the new array on every call. 

{{Bytes.equals}}, {{Bytes.compareTo}}, and {{ByteBuffer.wrap}} also accept a byte array and
offset and length parameters, which allows accessing portions of KeyValues without copying
them out into a separate byte array when using them for comparison. We should replace the
uses of CellUtil.cloneXXX with the alternate calls to the above methods where possible.

This message was sent by Atlassian JIRA

View raw message