drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vlad Rozov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-6164) Heap memory leak during parquet scan and OOM
Date Sat, 17 Feb 2018 02:21:00 GMT

     [ https://issues.apache.org/jira/browse/DRILL-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vlad Rozov updated DRILL-6164:
------------------------------
    Labels: ready-to-commit  (was: )

> Heap memory leak during parquet scan and OOM
> --------------------------------------------
>
>                 Key: DRILL-6164
>                 URL: https://issues.apache.org/jira/browse/DRILL-6164
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Vlad Rozov
>            Assignee: Vlad Rozov
>            Priority: Major
>              Labels: ready-to-commit
>             Fix For: 1.13.0
>
>
> During a scan of a large set of parquet files, Drill iterates over the set initializing
parquet readers. Such initialization may require a significant memory usage (both heap and
direct). When scan moves to the next parquet file in the set, it does not remove reference
to the reader from the set it iterates over and does not remove references created during
initialization.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message