Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 779AD10F23 for ; Thu, 29 May 2014 15:46:34 +0000 (UTC) Received: (qmail 95710 invoked by uid 500); 29 May 2014 15:46:34 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 95686 invoked by uid 500); 29 May 2014 15:46:34 -0000 Mailing-List: contact issues-help@drill.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.incubator.apache.org Delivered-To: mailing list issues@drill.incubator.apache.org Received: (qmail 95677 invoked by uid 99); 29 May 2014 15:46:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 May 2014 15:46:34 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Thu, 29 May 2014 15:46:33 +0000 Received: (qmail 93063 invoked by uid 99); 29 May 2014 15:46:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 May 2014 15:46:13 +0000 Date: Thu, 29 May 2014 15:46:13 +0000 (UTC) From: "Jacques Nadeau (JIRA)" To: issues@drill.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (DRILL-285) Some operators fail to process all records MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/DRILL-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacques Nadeau resolved DRILL-285. ---------------------------------- Resolution: Fixed > Some operators fail to process all records > ------------------------------------------ > > Key: DRILL-285 > URL: https://issues.apache.org/jira/browse/DRILL-285 > Project: Apache Drill > Issue Type: Bug > Reporter: Ben Becker > Assignee: Jacques Nadeau > Attachments: big_filter.patch > > > The test below shows that the Filter operator cannot process more than more than 15625 records from the mock scanner. The issue may affect multiple operators and scanners. > h4. Steps to reproduce: > # Edit {{filter/test1.json}} and increase the record count to some number above 15625 (e.g. 20k). > # Update the assertion in TestSimpleFilter.testFilter(). > # Run TestSimpleFilter.testFilter(). > h4. Expected Results: > The test would return 1/2 the record count. > h4. Results: > FilterRecordBatch.doWork() gets a value of 15625 from incoming.getRecordCount(). Only one batch is processed, and never more than 15625 records. The same holds true when the mock reader generates multiple batches. -- This message was sent by Atlassian JIRA (v6.2#6252)