Mailing-List: contact issues-help@drill.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@drill.apache.org
Date: Fri, 23 Dec 2016 08:23:58 +0000 (UTC)
From: "Paul Rogers (JIRA)" <jira@apache.org>
To: issues@drill.apache.org
Message-ID: <JIRA.13030288.1482463957000.587714.1482481438490@Atlassian.JIRA>
In-Reply-To: <JIRA.13030288.1482463957000@Atlassian.JIRA>
References: <JIRA.13030288.1482463957000@Atlassian.JIRA> <JIRA.13030288.1482463957251@arcas>
Subject: [jira] [Updated] (DRILL-5157)
 TestDrillbitResilience.doMemoryLeaksWhenCancelled fails with Parquet async
 Snappy error
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Fri, 23 Dec 2016 08:24:00 -0000


     [ https://issues.apache.org/jira/browse/DRILL-5157?page=3Dcom.atlassia=
n.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paul Rogers updated DRILL-5157:
-------------------------------
    Assignee: Parth Chandra

> TestDrillbitResilience.doMemoryLeaksWhenCancelled fails with Parquet asyn=
c Snappy error
> -------------------------------------------------------------------------=
--------------
>
>                 Key: DRILL-5157
>                 URL: https://issues.apache.org/jira/browse/DRILL-5157
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.9.0
>            Reporter: Paul Rogers
>            Assignee: Parth Chandra
>
> Run the {{TestDrillbitResilience.doMemoryLeaksWhenCancelled}} unit test. =
It fails with the following stack trace and the memory leak trace shown sec=
ond.
> Strangely, this error appears only if the test is run as part of the over=
all suite. The error does not appear if the test is run individually in the=
 debugger.
> Stack trace that seems to show that the code was trying to find a Snappy =
native library:
> {code}
> java.lang.reflect.InvocationTargetException
> =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp=
l.java:62)
> =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc=
essorImpl.java:43)
> =09at java.lang.reflect.Method.invoke(Method.java:498)
> =09at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:=
317)
> =09at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:219)
> =09at org.xerial.snappy.Snappy.<clinit>(Snappy.java:44)
> =09at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$D=
ecompressionHelper.decompress(AsyncPageReader.java:402)
> =09at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.d=
ecompress(AsyncPageReader.java:169)
> =09at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.g=
etDecompressedPageData(AsyncPageReader.java:96)
> =09at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.n=
extInternal(AsyncPageReader.java:219)
> =09at org.apache.drill.exec.store.parquet.columnreaders.PageReader.next(P=
ageReader.java:280)
> =09at org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.read=
Page(ColumnReader.java:250)
> =09at org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.dete=
rmineSize(ColumnReader.java:178)
> =09at org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.proc=
essPages(ColumnReader.java:130)
> =09at org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordRead=
er.readAllFixedFieldsSerial(ParquetRecordReader.java:485)
> =09at org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordRead=
er.readAllFixedFields(ParquetRecordReader.java:479)
> =09at org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordRead=
er.next(ParquetRecordReader.java:562)
> =09at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:1=
78)
> =09at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatch=
Iterator.next(IteratorValidatorBatchIterator.java:215)
> =09at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecor=
dBatch.java:119)
> =E2=80=A6
> {code}
> Resulting memory leak if the test is allowed to complete:
> {code}
> java.lang.AssertionError: Query state is incorrect (expected: CANCELED, a=
ctual: FAILED) AND/OR=20
> Exception thrown: org.apache.drill.common.exceptions.UserRemoteException:=
 SYSTEM ERROR: IllegalStateException: Allocator[op:3:0:15:ParquetRowGroupSc=
an] closed with outstanding buffers allocated (2).
> Allocator(op:3:0:15:ParquetRowGroupScan) 1000000/393216/3162112/100000000=
00 (res/actual/peak/limit)
>   child allocators: 0
>   ledgers: 2
>     ledger[3407] allocator: op:3:0:15:ParquetRowGroupScan), isOwning: tru=
e, size: 131072, references: 1, life: 73148192887288..0, allocatorManager: =
[3027, life: 73148192235794..0] holds 1 buffers.=20
>         DrillBuf[4949], udle: [3028 0..131072]
>     ledger[3471] allocator: op:3:0:15:ParquetRowGroupScan), isOwning: tru=
e, size: 262144, references: 1, life: 73148451288840..0, allocatorManager: =
[3091, life: 73148451257480..0] holds 1 buffers.=20
>         DrillBuf[5017], udle: [3092 0..262144]
>   reservations: 0
> Fragment 3:0
> [Error Id: 8502074b-f488-4a14-bf7d-a2a4480392cd on 172.30.1.67:31016]
> =09at org.apache.drill.exec.server.TestDrillbitResilience.assertStateComp=
leted(TestDrillbitResilience.java:861)
> =09at org.apache.drill.exec.server.TestDrillbitResilience.assertCancelled=
WithoutException(TestDrillbitResilience.java:876)
> =09at org.apache.drill.exec.server.TestDrillbitResilience.doMemoryLeaksWh=
enCancelled(TestDrillbitResilience.java:680)
> =09at org.apache.drill.exec.server.TestDrillbitResilience.memoryLeaksWhen=
Cancelled(TestDrillbitResilience.java:647)
> =09...
> {code}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)