drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Khurram Faraaz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4254) LIMIT query over mapr fs generated audit logs throws IOB Exception
Date Fri, 08 Jan 2016 10:09:40 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089003#comment-15089003
] 

Khurram Faraaz commented on DRILL-4254:
---------------------------------------

Note that one the audit log file is big, ~14 GB

{noformat}
02:01 AM root atsqa8 :tmp ✗ hadoop fs -ls /tmp/auditlogs
Found 31 items
----------+  3 root root           0 2015-12-28 04:32 /tmp/auditlogs/DBAudit.log-2015-12-28-001.json
----------+  3 root root           0 2015-12-28 14:54 /tmp/auditlogs/DBAudit.log-2015-12-28-002.json
----------+  3 root root           0 2015-12-28 15:29 /tmp/auditlogs/DBAudit.log-2015-12-28-003.json
----------+  3 root root           0 2015-12-28 17:19 /tmp/auditlogs/DBAudit.log-2015-12-28-004.json
----------+  3 root root        1215 2015-12-29 10:35 /tmp/auditlogs/DBAudit.log-2015-12-29-001.json
----------+  3 root root           0 2015-12-30 07:05 /tmp/auditlogs/DBAudit.log-2015-12-30-001.json
----------+  3 root root           0 2015-12-31 14:21 /tmp/auditlogs/DBAudit.log-2015-12-31-001.json
----------+  3 root root           0 2015-12-31 14:14 /tmp/auditlogs/DBAudit.log-2015-12-31-002.json
----------+  3 root root           0 2016-01-01 06:49 /tmp/auditlogs/DBAudit.log-2016-01-01-001.json
----------+  3 root root           0 2016-01-06 06:30 /tmp/auditlogs/DBAudit.log-2016-01-06-001.json
----------+  3 root root   207343422 2016-01-06 12:35 /tmp/auditlogs/DBAudit.log-2016-01-06-002.json
----------+  3 root root           0 2016-01-06 13:56 /tmp/auditlogs/DBAudit.log-2016-01-06-003.json
----------+  3 root root           0 2016-01-06 13:56 /tmp/auditlogs/DBAudit.log-2016-01-06-004.json
----------+  3 root root           0 2015-12-28 04:32 /tmp/auditlogs/FSAudit.log-2015-12-28-001.json
----------+  3 root root           0 2015-12-28 14:54 /tmp/auditlogs/FSAudit.log-2015-12-28-002.json
----------+  3 root root    42030702 2015-12-28 17:17 /tmp/auditlogs/FSAudit.log-2015-12-28-003.json
----------+  3 root root         359 2015-12-28 17:24 /tmp/auditlogs/FSAudit.log-2015-12-28-004.json
----------+  3 root root        1055 2015-12-29 10:35 /tmp/auditlogs/FSAudit.log-2015-12-29-001.json
----------+  3 root root           0 2015-12-30 07:05 /tmp/auditlogs/FSAudit.log-2015-12-30-001.json
----------+  3 root root 14233781528 2015-12-31 14:19 /tmp/auditlogs/FSAudit.log-2015-12-31-001.json
----------+  3 root root           0 2015-12-31 14:21 /tmp/auditlogs/FSAudit.log-2015-12-31-002.json
----------+  3 root root         160 2015-12-31 14:20 /tmp/auditlogs/FSAudit.log-2015-12-31-003.json
----------+  3 root root         507 2016-01-01 17:34 /tmp/auditlogs/FSAudit.log-2016-01-01-001.json
----------+  3 root root         160 2016-01-03 17:37 /tmp/auditlogs/FSAudit.log-2016-01-03-001.json
----------+  3 root root         160 2016-01-04 07:23 /tmp/auditlogs/FSAudit.log-2016-01-04-001.json
----------+  3 root root           0 2016-01-06 06:30 /tmp/auditlogs/FSAudit.log-2016-01-06-001.json
----------+  3 root root         374 2016-01-06 13:21 /tmp/auditlogs/FSAudit.log-2016-01-06-002.json
----------+  3 root root         935 2016-01-06 22:06 /tmp/auditlogs/FSAudit.log-2016-01-06-003.json
----------+  3 root root         935 2016-01-06 23:07 /tmp/auditlogs/FSAudit.log-2016-01-06-004.json
----------+  3 root root        2992 2016-01-07 23:39 /tmp/auditlogs/FSAudit.log-2016-01-07-001.json
----------+  3 root root         748 2016-01-08 04:49 /tmp/auditlogs/FSAudit.log-2016-01-08-001.json
{noformat}

> LIMIT query over mapr fs generated audit logs throws IOB Exception
> ------------------------------------------------------------------
>
>                 Key: DRILL-4254
>                 URL: https://issues.apache.org/jira/browse/DRILL-4254
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>    Affects Versions: 1.4.0
>         Environment: CentOS
>            Reporter: Khurram Faraaz
>            Priority: Critical
>
> Querying mapr fs generated audit files through mapr Drill 1.4 results in IOB Exception
> MapR Drill 1.4.0, commit ID : 9627a80f
> MapRBuildVersion : 5.1.0.36488.GA
> OS : CentOS x86_64 GNU/Linux
> {noformat}
> 01:01 AM root atsqa8c27 :bin ✓ ./sqlline -u "jdbc:drill:schema=dfs.tmp -n mapr -p mapr"apache
drill 1.4.0
> "the only truly happy people are children, the creative minority and drill users"
> 0: jdbc:drill:schema=dfs.tmp> select * from `auditlogs` limit 5;
> Error: SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0,
0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010] (state=,code=0)
> {noformat}
> Stack trace from drillbit.log
> {noformat}
> 2016-01-08 09:43:22,932 [29707b45-6740-8462-cf83-9c2aaa2ed337:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor
- SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: IndexOutOfBoundsException:
index: 0, length: 1 (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
>         at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:534)
~[drill-common-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:321)
[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:184)
[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:290)
[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-1.4.0.jar:1.4.0]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_65]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_65]
>         at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
> Caused by: java.lang.IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0,
0))
>         at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:175) ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
>         at io.netty.buffer.DrillBuf.chk(DrillBuf.java:197) ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
>         at io.netty.buffer.DrillBuf.getByte(DrillBuf.java:732) ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
>         at org.apache.drill.exec.vector.UInt1Vector$Accessor.get(UInt1Vector.java:356)
~[vector-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.vector.NullableIntVector$Accessor.isSet(NullableIntVector.java:378)
~[vector-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.vector.NullableIntVector$Accessor.isNull(NullableIntVector.java:374)
~[vector-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.vector.NullableIntVector.copyFrom(NullableIntVector.java:339)
~[vector-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.test.generated.CopierGen1050.doEval(CopierTemplate2.java:168)
~[na:na]
>         at org.apache.drill.exec.test.generated.CopierGen1050.copyRecords(CopierTemplate2.java:59)
~[na:na]
>         at org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.doWork(RemovingRecordBatch.java:100)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:93)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:94)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:81)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:256)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:250)
~[drill-java-exec-1.4.0.jar:1.4.0]
>         at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_65]
>         at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_65]
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
~[hadoop-common-2.7.0-mapr-1506.jar:na]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:250)
[drill-java-exec-1.4.0.jar:1.4.0]
>         ... 4 common frames omitted
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message