drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-2417) Exception seen when system parameter is set to `store.parquet.compression` = 'snappy'
Date Fri, 13 Mar 2015 21:12:38 GMT

     [ https://issues.apache.org/jira/browse/DRILL-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jacques Nadeau updated DRILL-2417:
----------------------------------
    Fix Version/s: 0.9.0

> Exception seen when system parameter is set to `store.parquet.compression` = 'snappy'
> -------------------------------------------------------------------------------------
>
>                 Key: DRILL-2417
>                 URL: https://issues.apache.org/jira/browse/DRILL-2417
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>    Affects Versions: 0.8.0
>         Environment: Administrators-MacBook-Pro-11:log kfaraaz$ uname -a
> Darwin Administrators-MacBook-Pro-11.local 14.0.0 Darwin Kernel Version 14.0.0: Fri Sep
19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64 x86_64
>            Reporter: Khurram Faraaz
>            Assignee: Steven Phillips
>             Fix For: 0.9.0
>
>
> Attempt to, alter system set `store.parquet.compression` = 'snappy'
> results in an Exception
> Details of driblet version that I am working with are
> 0: jdbc:drill:zk=local> select * from sys.version;
> +------------+----------------+-------------+-------------+------------+
> | commit_id  | commit_message | commit_time | build_email | build_time |
> +------------+----------------+-------------+-------------+------------+
> | a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix Decimal38/Decimal28 vector's
get() to copy the scale and precision into the holder | 02.03.2015 @ 14:13:27 EST | Unknown
    | 02.03.2015 @ 15:43:47 EST |
> +------------+----------------+-------------+-------------+------------+
> 1 row selected (0.334 seconds)
> Failing alter system set statement
> 0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy';
> +------------+------------+
> |     ok     |  summary   |
> +------------+------------+
> | true       | store.parquet.compression updated. |
> Query failed: RemoteRpcException: Failure while running fragment., Failure while closing
accountor.  Expected private and shared pools to be set to initial values.  However, one or
more were not.  Stats are
> 	zone	init	allocated	delta 
> 	private	1000000	738112	261888 
> 	shared	9999000000	9999261888	-261888. [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010
]
> [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> java.lang.RuntimeException: java.sql.SQLException: Failure while executing query.
> 	at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
> 	at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> 	at sqlline.SqlLine.print(SqlLine.java:1809)
> 	at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> 	at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> 	at sqlline.SqlLine.dispatch(SqlLine.java:889)
> 	at sqlline.SqlLine.begin(SqlLine.java:763)
> 	at sqlline.SqlLine.start(SqlLine.java:498)
> 	at sqlline.SqlLine.main(SqlLine.java:460)
> 0: jdbc:drill:zk=local> 
> From the log file
> 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR o.a.d.e.w.f.AbstractStatusReporter
- Error 669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment.
> java.lang.IllegalStateException: Failure while closing accountor.  Expected private and
shared pools to be set to initial values.  However, one or more were not.  Stats are
>         zone    init    allocated       delta
>         private 1000000 738112  261888
>         shared  9999000000      9999261888      -261888.
>         at org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
>         at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO  o.a.drill.exec.work.foreman.Foreman
- State change requested.  RUNNING --> FAILED
> org.apache.drill.exec.rpc.RemoteRpcException: Failure while running fragment., Failure
while closing accountor.  Expected private and shared pools to be set to initial values. 
However, one or more were not.  Stats are
>         zone    init    allocated       delta
>         private 1000000 738112  261888
>         shared  9999000000      9999261888      -261888. [ 669998c2-d44f-446d-85b1-bc19b0a33003
on 10.250.0.35:31010 ]
> [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
>         at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
>         at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> ...
> 2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN  o.a.d.e.w.fragment.FragmentExecutor
- Failure while closing out resources.
> java.lang.IllegalStateException: Failure while trying to close child allocator: Child
level allocators not closed. Fragment 0:0. Stack trace:
>                 org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43)
>                 org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112)
>                 org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35)
>                 org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29)
>                 org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>                 org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                 org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
>                 org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39)
>                 org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>                 org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>                 org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                 org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
>                 org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>                 org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>                 org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
>                 org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                 org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130)
>                 org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188)
>                 org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97)
>                 org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
>                 org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109)
>                 org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
>                 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>                 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>                 java.lang.Thread.run(Thread.java:745)
>         at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
>         at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message