drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-6080) Sort incorrectly limits batch size to 65535 records rather than 65536
Date Thu, 11 Jan 2018 00:00:14 GMT
Paul Rogers created DRILL-6080:
----------------------------------

             Summary: Sort incorrectly limits batch size to 65535 records rather than 65536
                 Key: DRILL-6080
                 URL: https://issues.apache.org/jira/browse/DRILL-6080
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.12.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
            Priority: Minor
             Fix For: 1.13.0


Drill places an upper limit on the number of rows in a batch of 64K. That is 65,536 decimal.
When we index records, the indexes run from 0 to 64K-1 or 0 to 65,535.

The sort code incorrectly uses {{Character.MAX_VALUE}} as the maximum row count. So, if an
incoming batch uses the full 64K size, sort ends up splitting batches unnecessarily.

The fix is to instead use the correct constant `ValueVector.MAX_ROW_COUNT`.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message