Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9B445172F3 for ; Sun, 9 Nov 2014 20:35:39 +0000 (UTC) Received: (qmail 90580 invoked by uid 500); 9 Nov 2014 20:35:39 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 90554 invoked by uid 500); 9 Nov 2014 20:35:39 -0000 Mailing-List: contact issues-help@drill.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.incubator.apache.org Delivered-To: mailing list issues@drill.incubator.apache.org Received: (qmail 90545 invoked by uid 99); 9 Nov 2014 20:35:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 09 Nov 2014 20:35:39 +0000 X-ASF-Spam-Status: No, hits=-2000.6 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Sun, 09 Nov 2014 20:35:38 +0000 Received: (qmail 89387 invoked by uid 99); 9 Nov 2014 20:31:33 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 09 Nov 2014 20:31:33 +0000 Date: Sun, 9 Nov 2014 20:31:33 +0000 (UTC) From: "Jason Altekruse (JIRA)" To: issues@drill.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (DRILL-1642) flatten function is dropping the last record when the json file contains even no of records MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/DRILL-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14204100#comment-14204100 ] Jason Altekruse commented on DRILL-1642: ---------------------------------------- This isn't related to Drill 1608, it also is not quite an accurate diagnosis of the real problem. The issue was the number of map that were being flattened was wrong due to a bug in the repeated map vector. Drill 1643 was created for the bug, and it was determined that this solves the issue here as well. > flatten function is dropping the last record when the json file contains even no of records > ------------------------------------------------------------------------------------------- > > Key: DRILL-1642 > URL: https://issues.apache.org/jira/browse/DRILL-1642 > Project: Apache Drill > Issue Type: Bug > Components: Storage - JSON > Reporter: Rahul Challapalli > Assignee: Jason Altekruse > Attachments: flatten.json > > > git.commit.id.abbrev=5adadfa > The below query does not produce the right output. It is missing the last record from the data file. The record count is even for the data set. However if it is odd, the flatten operator has not issues . > {code} > 0: jdbc:drill:schema=dfs> select rownum, flatten(complex) from `flatten.json`; > +------------+------------+ > | rownum | EXPR$1 | > +------------+------------+ > | 1 | {"col1":3} | > | 1 | {"col2":2,"col3":1} | > | 1 | {"col1":7} | > | 2 | {"col2":2,"col3":1} | > | 2 | {"col1":7} | > | 3 | {"col1":2,"col3":1} | > +------------+------------+ > {code} > Attached the data file. Let me know if you need anything more. -- This message was sent by Atlassian JIRA (v6.3.4#6332)