drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Phillips (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-2333) Parquet writer reports negative count for very large number of records
Date Fri, 10 Apr 2015 20:50:12 GMT

     [ https://issues.apache.org/jira/browse/DRILL-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steven Phillips updated DRILL-2333:
-----------------------------------
    Assignee: Jason Altekruse  (was: Steven Phillips)

> Parquet writer reports negative count for very large number of records
> ----------------------------------------------------------------------
>
>                 Key: DRILL-2333
>                 URL: https://issues.apache.org/jira/browse/DRILL-2333
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Aman Sinha
>            Assignee: Jason Altekruse
>             Fix For: 0.9.0
>
>         Attachments: DRILL-2333.patch
>
>
> When doing large scale CTAS, the counter for keeping track of number of records written
overflows.  See below.  The actual number of records written by each minor fragment was about
45B rows. 
>  +------------+---------------------------+
> |  Fragment  | Number of records written |
> +------------+---------------------------+
> | 1_1        | -1271142674               |
> | 1_0        | -1276497044               |
> +------------+---------------------------+



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message