drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victoria Markman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-4109) NPE in external sort
Date Wed, 18 Nov 2015 02:39:10 GMT
Victoria Markman created DRILL-4109:
---------------------------------------

             Summary: NPE in external sort 
                 Key: DRILL-4109
                 URL: https://issues.apache.org/jira/browse/DRILL-4109
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.4.0
            Reporter: Victoria Markman
            Priority: Blocker
         Attachments: 29b41f37-4803-d7ce-e05f-912d1f65da79.sys.drill

4 node cluster
36GB of direct memory
4GB heap memory

planner.memory.max_query_memory_per_node=2GB (default)
planner.enable_hashjoin = false

Spill directory has 6.4T of memory available:
{noformat}
[Tue Nov 17 18:23:18 /tmp/drill ] # df -H .
Filesystem       Size  Used Avail Use% Mounted on
localhost:/mapr  7.7T  1.4T  6.4T  18% /mapr
{noformat}

Run query below: framework/resources/Advanced/tpcds/tpcds_sf100/original/query15.sql

drillbit.log
{code}
2015-11-18 02:22:12,639 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:9] INFO  o.a.d.e.p.i.xsort.ExternalSortBatch
- Merging and spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_9/operator_17/7
2015-11-18 02:22:12,770 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:5] INFO  o.a.d.e.p.i.xsort.ExternalSortBatch
- Merging and spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_5/operator_17/7
2015-11-18 02:22:13,345 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:17] INFO  o.a.d.e.p.i.xsort.ExternalSortBatch
- Completed spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_17/operator_17/7
2015-11-18 02:22:13,346 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] INFO  o.a.d.e.p.i.xsort.ExternalSortBatch
- Completed spilling to /tmp/drill/spill/29b41f37-4803-d7ce-e05f-912d1f65da79/major_fragment_3/minor_fragment_13/operator_16/1
2015-11-18 02:22:13,346 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] WARN  o.a.d.e.p.i.xsort.ExternalSortBatch
- Starting to merge. 34 batch groups. Current allocated memory: 2252186
2015-11-18 02:22:13,363 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] INFO  o.a.d.e.w.fragment.FragmentExecutor
- 29b41f37-4803-d7ce-e05f-912d1f65da79:3:13: State change requested RUNNING --> FAILED
2015-11-18 02:22:13,370 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] INFO  o.a.d.e.w.fragment.FragmentExecutor
- 29b41f37-4803-d7ce-e05f-912d1f65da79:3:13: State change requested FAILED --> FINISHED
2015-11-18 02:22:13,371 [29b41f37-4803-d7ce-e05f-912d1f65da79:frag:3:13] ERROR o.a.d.e.w.fragment.FragmentExecutor
- SYSTEM ERROR: NullPointerException

Fragment 3:13

[Error Id: c5d67dcb-16aa-4951-89f5-599b4b4eb54d on atsqa4-133.qa.lab:31010]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: NullPointerException

Fragment 3:13

[Error Id: c5d67dcb-16aa-4951-89f5-599b4b4eb54d on atsqa4-133.qa.lab:31010]
        at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:534)
~[drill-common-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT]
        at org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:321)
[drill-java-exec-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT]
        at org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:184)
[drill-java-exec-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT]
        at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:290)
[drill-java-exec-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT]
        at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-1.4.0-SNAPSHOT.jar:1.4.0-SNAPSHOT]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_71]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_71]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]
java.lang.NullPointerException: null
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message