Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4ED2C18457 for ; Mon, 23 Nov 2015 22:38:11 +0000 (UTC) Received: (qmail 83782 invoked by uid 500); 23 Nov 2015 22:38:11 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 83747 invoked by uid 500); 23 Nov 2015 22:38:11 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 83728 invoked by uid 99); 23 Nov 2015 22:38:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Nov 2015 22:38:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 003712C1F58 for ; Mon, 23 Nov 2015 22:38:11 +0000 (UTC) Date: Mon, 23 Nov 2015 22:38:10 +0000 (UTC) From: "Victoria Markman (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (DRILL-4109) NPE in external sort MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victoria Markman updated DRILL-4109: ------------------------------------ Attachment: drillbit.log.debug > NPE in external sort > --------------------- > > Key: DRILL-4109 > URL: https://issues.apache.org/jira/browse/DRILL-4109 > Project: Apache Drill > Issue Type: Bug > Affects Versions: 1.4.0 > Reporter: Victoria Markman > Priority: Blocker > Attachments: 29b41f37-4803-d7ce-e05f-912d1f65da79.sys.drill, drillbit.log, drillbit.log.debug > > > 4 node cluster > 36GB of direct memory > 4GB heap memory > planner.memory.max_query_memory_per_node=2GB (default) > planner.enable_hashjoin = false > Spill directory has 6.4T of memory available: > {noformat} > [Tue Nov 17 18:23:18 /tmp/drill ] # df -H . > Filesystem Size Used Avail Use% Mounted on > localhost:/mapr 7.7T 1.4T 6.4T 18% /mapr > {noformat} > Run query below: framework/resources/Advanced/tpcds/tpcds_sf100/original/query15.sql > drillbit.log > {code} > 2015-11-18 02:22:12,639 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:9] INFO o.a.d.e.p.i.xsort.ExternalSortBatch - Merging and spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_9/operator_17/7 > 2015-11-18 02:22:12,770 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:5] INFO o.a.d.e.p.i.xsort.ExternalSortBatch - Merging and spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_5/operator_17/7 > 2015-11-18 02:22:13,345 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:17] INFO o.a.d.e.p.i.xsort.ExternalSortBatch - Completed spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_17/operator_17/7 > 2015-11-18 02:22:13,346 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] INFO o.a.d.e.p.i.xsort.ExternalSortBatch - Completed spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_13/operator_16/1 > 2015-11-18 02:22:13,346 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] WARN o.a.d.e.p.i.xsort.ExternalSortBatch - Starting to merge. 34 batch groups. Current allocated memory: 2252186 > 2015-11-18 02:22:13,363 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] INFO o.a.d.e.w.fragment.FragmentExecutor - 29b41f37-4803-d7ce-e05f-912d1f65da79:3:13: State change requested RUNNING --> FAILED > 2015-11-18 02:22:13,370 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] INFO o.a.d.e.w.fragment.FragmentExecutor - 29b41f37-4803-d7ce-e05f-912d1f65da79:3:13: State change requested FAILED --> FINISHED > 2015-11-18 02:22:13,371 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] ERROR o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: NullPointerException > Fragment 3:13 > [Error Id: c5d67dcb-16aa-4951-89f5-599b4b4eb54d on atsqa4-133.qa.lab:31010] > org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: NullPointerException > Fragment 3:13 > [Error Id: c5d67dcb-16aa-4951-89f5-599b4b4eb54d on atsqa4-133.qa.lab:31010] > at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:534) ~[drill-common-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT] > at org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:321) [drill-java-exec-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT] > at org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:184) [drill-java-exec-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT] > at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:290) [drill-java-exec-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT] > at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_71] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_71] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71] > java.lang.NullPointerException: null > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)