drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aman Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-2333) Parquet writer reports negative count for very large number of records
Date Fri, 27 Feb 2015 02:42:04 GMT
Aman Sinha created DRILL-2333:
---------------------------------

             Summary: Parquet writer reports negative count for very large number of records
                 Key: DRILL-2333
                 URL: https://issues.apache.org/jira/browse/DRILL-2333
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - Parquet
            Reporter: Aman Sinha
            Assignee: Steven Phillips


When doing large scale CTAS, the counter for keeping track of number of records written overflows.
 See below.  The actual number of records written by each minor fragment was about 45B rows.


 +------------+---------------------------+
|  Fragment  | Number of records written |
+------------+---------------------------+
| 1_1        | -1271142674               |
| 1_0        | -1276497044               |
+------------+---------------------------+



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message