drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vlad Rozov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-6164) Heap memory leak during parquet scan and OOM
Date Sat, 17 Feb 2018 02:21:00 GMT

     [ https://issues.apache.org/jira/browse/DRILL-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Vlad Rozov updated DRILL-6164:
    Labels: ready-to-commit  (was: )

> Heap memory leak during parquet scan and OOM
> --------------------------------------------
>                 Key: DRILL-6164
>                 URL: https://issues.apache.org/jira/browse/DRILL-6164
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Vlad Rozov
>            Assignee: Vlad Rozov
>            Priority: Major
>              Labels: ready-to-commit
>             Fix For: 1.13.0
> During a scan of a large set of parquet files, Drill iterates over the set initializing
parquet readers. Such initialization may require a significant memory usage (both heap and
direct). When scan moves to the next parquet file in the set, it does not remove reference
to the reader from the set it iterates over and does not remove references created during

This message was sent by Atlassian JIRA

View raw message