drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramana Inukonda Nagaraj (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2780) java.lang.IllegalStateException files open exceptions in drillbit.out
Date Tue, 14 Apr 2015 04:24:13 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493541#comment-14493541
] 

Ramana Inukonda Nagaraj commented on DRILL-2780:
------------------------------------------------

And followed by:

{code}
File '/drill/testdata/tpch100/parquet/lineitem/part-m-00005.parquet' opened at callstack:
        org.apache.drill.exec.store.parquet.columnreaders.PageReader.<init>(PageReader.java:105)
        org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.<init>(ColumnReader.java:87)
        org.apache.drill.exec.store.parquet.columnreaders.NullableColumnReader.<init>(NullableColumnReader.java:45)
        org.apache.drill.exec.store.parquet.columnreaders.NullableFixedByteAlignedReaders$NullableFixedByteAlignedReader.<init>(NullableFixedByteAlignedReaders.java:55)
        org.apache.drill.exec.store.parquet.columnreaders.ColumnReaderFactory.getNullableColumnReader(ColumnReaderFactory.java:203)
        org.apache.drill.exec.store.parquet.columnreaders.ColumnReaderFactory.createFixedColumnReader(ColumnReaderFactory.java:145)
        org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.setup(ParquetRecordReader.java:297)
        org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:100)
        org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:157)
        org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:56)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
        org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
        org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
        org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
        org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject(AbstractPhysicalVisitor.java:75)
        org.apache.drill.exec.physical.config.Project.accept(Project.java:51)
        org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
        org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
        org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject(AbstractPhysicalVisitor.java:75)
        org.apache.drill.exec.physical.config.Project.accept(Project.java:51)
        org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
        org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
        org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
        org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSender(AbstractPhysicalVisitor.java:105)
        org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSingleSender(AbstractPhysicalVisitor.java:193)
        org.apache.drill.exec.physical.config.SingleSender.accept(SingleSender.java:87)
        org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
        org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:124)
        org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
        java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        java.lang.Thread.run(Thread.java:744)
{code}

> java.lang.IllegalStateException files open exceptions in drillbit.out
> ---------------------------------------------------------------------
>
>                 Key: DRILL-2780
>                 URL: https://issues.apache.org/jira/browse/DRILL-2780
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>            Reporter: Ramana Inukonda Nagaraj
>            Assignee: Chris Westin
>
> There are many stacktraces like this in drillbit.out 
> {code}
> Exception in thread "Thread-2" java.lang.IllegalStateException: Not all files opened
using this FileSystem are closed. There are still [84] files open.
> File '/drill/testdata/tpch100/parquet/lineitem/part-m-00045.parquet' opened at callstack:
>         org.apache.drill.exec.store.parquet.columnreaders.PageReader.<init>(PageReader.java:105)
>         org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.<init>(ColumnReader.java:88)
>         org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumn.<init>(VarLengthColumn.java:39)
>         org.apache.drill.exec.store.parquet.columnreaders.VarLengthValuesColumn.<init>(VarLengthValuesColumn.java:43)
>         org.apache.drill.exec.store.parquet.columnreaders.NullableVarLengthValuesColumn.<init>(NullableVarLengthValuesColumn.java:39)
>         org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumnReaders$NullableVarBinaryColumn.<init>(VarLengthColumnReaders.java:303)
>         org.apache.drill.exec.store.parquet.columnreaders.ColumnReaderFactory.getReader(ColumnReaderFactory.java:176)
>         org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.setup(ParquetRecordReader.java:303)
>         org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:100)
>         org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:157)
>         org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:56)
>         org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>         org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>         org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:126)
>         org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
>         org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>         org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>         org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>         org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:214)
>         org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>         org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>         org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>         org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> {code}
> We should not be getting any exceptions in drillbit.out.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message