drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-5569) NullPointerException in Async Parquet reader
Date Mon, 19 Jun 2017 04:57:00 GMT

     [ https://issues.apache.org/jira/browse/DRILL-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Paul Rogers updated DRILL-5569:
-------------------------------
    Summary: NullPointerException in Async Parquet reader  (was: NullPointerException)

> NullPointerException in Async Parquet reader
> --------------------------------------------
>
>                 Key: DRILL-5569
>                 URL: https://issues.apache.org/jira/browse/DRILL-5569
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>    Affects Versions: 1.11.0
>            Reporter: Khurram Faraaz
>
> The below Exception was seen when TPC-DS Query 4 was executed against Drill 1.11.0
> Drill 1.11.0 git commit ID: d11aba2
> [root@centos-01 mapr]# cat MapRBuildVersion
> 5.2.1.42646.GA
> Stack trace from drillbit.log
> {noformat}
> 2017-06-06 07:46:43,160 [Drillbit-ShutdownHook#0] WARN  o.apache.drill.exec.work.WorkManager
- Closing WorkManager but there are 80 running fragments.
> 2017-06-06 07:46:43,207 [Drillbit-ShutdownHook#0] INFO  o.a.drill.exec.compile.CodeCompiler
- Stats: code gen count: 959, cache miss count: 12, hit rate: 99%
> 2017-06-06 07:46:43,504 [scan-3] ERROR o.a.d.e.u.f.BufferedDirectBufInputStream - Error
reading from stream 1_1_0.parquet. Error was : Error reading out of an FSDataInputStream using
the Hadoop 2 ByteBuffer based read method.
> 2017-06-06 07:46:43,510 [scan-8] ERROR o.a.d.e.u.f.BufferedDirectBufInputStream - Error
reading from stream 1_1_0.parquet. Error was : Error reading out of an FSDataInputStream using
the Hadoop 2 ByteBuffer based read method.
> 2017-06-06 07:46:43,514 [scan-8] INFO  o.a.d.e.s.p.c.AsyncPageReader - User Error Occurred:
Exception occurred while reading from disk. (java.io.IOException: Error reading out of an
FSDataInputStream using the Hadoop 2 ByteBuffer based read method.)
> org.apache.drill.common.exceptions.UserException: DATA_READ ERROR: Exception occurred
while reading from disk.
> File:  /drill/testdata/tpcds_sf1/parquet/store_sales/1_1_0.parquet
> Column:  ss_ext_list_price
> Row Group Start:  75660513
> [Error Id: 3a758095-fcc4-4364-a50b-33a027c1beb6 ]
>         at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:544)
~[drill-common-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.handleAndThrowException(AsyncPageReader.java:199)
[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.access$600(AsyncPageReader.java:81)
[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:483)
[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:392)
[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_65]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_65]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_65]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_65]
> Caused by: java.io.IOException: java.io.IOException: Error reading out of an FSDataInputStream
using the Hadoop 2 ByteBuffer based read method.
>         at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.getNextBlock(BufferedDirectBufInputStream.java:185)
~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.readInternal(BufferedDirectBufInputStream.java:212)
~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.read(BufferedDirectBufInputStream.java:277)
~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.util.filereader.DirectBufInputStream.getNext(DirectBufInputStream.java:111)
~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:437)
[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         ... 5 common frames omitted
> Caused by: java.io.IOException: Error reading out of an FSDataInputStream using the Hadoop
2 ByteBuffer based read method.
>         at org.apache.parquet.hadoop.util.CompatibilityUtil.getBuf(CompatibilityUtil.java:99)
~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
>         at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.getNextBlock(BufferedDirectBufInputStream.java:182)
~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
>         ... 9 common frames omitted
> Caused by: java.lang.NullPointerException: null
>         at com.mapr.fs.MapRFsInStream.readIntoDirectByteBuffer(MapRFsInStream.java:219)
~[maprfs-5.2.1-mapr.jar:5.2.1-mapr]
>         at com.mapr.fs.MapRFsInStream.read(MapRFsInStream.java:333) ~[maprfs-5.2.1-mapr.jar:5.2.1-mapr]
>         at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:156) ~[hadoop-common-2.7.0-mapr-1607.jar:na]
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source) ~[na:na]
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_65]
>         at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_65]
>         at org.apache.parquet.hadoop.util.CompatibilityUtil.getBuf(CompatibilityUtil.java:83)
~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
>         ... 10 common frames omitted
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message