Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id ED766200C06 for ; Fri, 27 Jan 2017 10:57:31 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id EC32E160B5B; Fri, 27 Jan 2017 09:57:31 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1D800160B47 for ; Fri, 27 Jan 2017 10:57:30 +0100 (CET) Received: (qmail 75719 invoked by uid 500); 27 Jan 2017 09:57:30 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 75710 invoked by uid 99); 27 Jan 2017 09:57:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Jan 2017 09:57:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 84042C0D64 for ; Fri, 27 Jan 2017 09:57:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.199 X-Spam-Level: X-Spam-Status: No, score=-1.199 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id c3Yrb9cGxa2B for ; Fri, 27 Jan 2017 09:57:27 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 1AC6E5F592 for ; Fri, 27 Jan 2017 09:57:27 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id B4E90E036B for ; Fri, 27 Jan 2017 09:57:24 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 6BB5D2528B for ; Fri, 27 Jan 2017 09:57:24 +0000 (UTC) Date: Fri, 27 Jan 2017 09:57:24 +0000 (UTC) From: "Pallavi Singh (JIRA)" To: issues@carbondata.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (CARBONDATA-666) Select Query fails with NullPoint exception if using 2 or more logical operators MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 27 Jan 2017 09:57:32 -0000 [ https://issues.apache.org/jira/browse/CARBONDATA-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15842468#comment-15842468 ] Pallavi Singh edited comment on CARBONDATA-666 at 1/27/17 9:57 AM: ------------------------------------------------------------------- I tried to run the following query with two logical operators and it seems to be working fine: select * from uniqdata where integer_column1 IN(159,17,4) OR cust_id NOT IN(9158,9016,9003) AND cust_name IN ('CUST_NAME_00003 ','CUST_NAME_00016') ; and it gives me the following result set : +----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+ | cust_id | cust_name | active_emui_version | dob | doj | bigint_column1 | bigint_column2 | decimal_column1 | decimal_column2 | double_column1 | double_column2 | integer_column1 | +----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+ | 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04 01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 | 12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 4 | | 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04 01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 | 12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 4 | | 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04 01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 | 12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 4 | | 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17 01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 | 12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 17 | | 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17 01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 | 12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 17 | | 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17 01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 | 12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 17 | | 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08 01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 | 12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 159 | | 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08 01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 | 12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 159 | | 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08 01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 | 12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 159 | +----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+ If you still encounter the problem. Please describe the entire scenario with attached csv. was (Author: pallavisingh_09): I tried to run the following query with two logical operators and it seems to be working fine: select * from uniqdata where integer_column1 IN(159,17,4) OR cust_id NOT IN(9158,9016,9003) AND cust_name IN ('CUST_NAME_00003 ','CUST_NAME_00016') ; and it gives me the following result set : +----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+ | cust_id | cust_name | active_emui_version | dob | doj | bigint_column1 | bigint_column2 | decimal_column1 | decimal_column2 | double_column1 | double_column2 | integer_column1 | +----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+ | 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04 01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 | 12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 4 | | 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04 01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 | 12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 4 | | 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04 01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 | 12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 4 | | 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17 01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 | 12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 17 | | 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17 01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 | 12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 17 | | 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17 01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 | 12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 17 | | 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08 01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 | 12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 159 | | 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08 01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 | 12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 159 | | 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08 01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 | 12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 | -1.12345674897976E10 | 159 | +----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+ > Select Query fails with NullPoint exception if using 2 or more logical operators > -------------------------------------------------------------------------------- > > Key: CARBONDATA-666 > URL: https://issues.apache.org/jira/browse/CARBONDATA-666 > Project: CarbonData > Issue Type: Bug > Affects Versions: 1.0.0-incubating > Environment: Spark 1.6 > Reporter: Ramakrishna > Priority: Minor > > select * from communication.flow_carbon where cus_ac = '6222621350672465397' and txn_bk IN ('00000000000', '00000000001','00000000002') OR own_bk IN ('00000000124','00000000175','00000000034','00000000231','00000000167','00000000182','00000000206') limit 10; > Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, linux-79): java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException > at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:65) > at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:35) > at org.apache.carbondata.scan.result.iterator.ChunkRowIterator.(ChunkRowIterator.java:43) > at org.apache.carbondata.hadoop.CarbonRecordReader.initialize(CarbonRecordReader.java:81) > at org.apache.carbondata.spark.rdd.CarbonScanRDD.compute(CarbonScanRDD.scala:194) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:270) > at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:270) > at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:270) > at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:270) > at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:270) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) > at org.apache.spark.scheduler.Task.run(Task.scala:89) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:227) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.util.concurrent.ExecutionException: java.lang.NullPointerException > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:52) > ... 24 more > Caused by: java.lang.NullPointerException > at org.apache.carbondata.scan.result.AbstractScannedResult.getDictionaryKeyIntegerArray(AbstractScannedResult.java:186) > at org.apache.carbondata.scan.result.impl.FilterQueryScannedResult.getDictionaryKeyIntegerArray(FilterQueryScannedResult.java:53) > at org.apache.carbondata.scan.collector.impl.DictionaryBasedResultCollector.collectData(DictionaryBasedResultCollector.java:111) > at org.apache.carbondata.scan.processor.impl.DataBlockIteratorImpl.next(DataBlockIteratorImpl.java:52) > at org.apache.carbondata.scan.processor.impl.DataBlockIteratorImpl.next(DataBlockIteratorImpl.java:33) > at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator$1.call(DetailQueryResultIterator.java:78) > at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator$1.call(DetailQueryResultIterator.java:72) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > ... 3 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)