drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (DRILL-285) Some operators fail to process all records
Date Thu, 29 May 2014 15:46:13 GMT

     [ https://issues.apache.org/jira/browse/DRILL-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jacques Nadeau resolved DRILL-285.
----------------------------------

    Resolution: Fixed

> Some operators fail to process all records
> ------------------------------------------
>
>                 Key: DRILL-285
>                 URL: https://issues.apache.org/jira/browse/DRILL-285
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Ben Becker
>            Assignee: Jacques Nadeau
>         Attachments: big_filter.patch
>
>
> The test below shows that the Filter operator cannot process more than  more than 15625
records from the mock scanner.  The issue may affect multiple operators and scanners.
> h4. Steps to reproduce:
> # Edit {{filter/test1.json}} and increase the record count to some number above 15625
(e.g. 20k).
> # Update the assertion in TestSimpleFilter.testFilter().
> # Run TestSimpleFilter.testFilter().
> h4. Expected Results:
> The test would return 1/2 the record count.
> h4. Results:
> FilterRecordBatch.doWork() gets a value of 15625 from incoming.getRecordCount().  Only
one batch is processed, and never more than 15625 records.  The same holds true when the mock
reader generates multiple batches.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message