drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vlad Rozov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-6164) Heap memory leak during parquet scan and OOM
Date Fri, 16 Feb 2018 02:30:00 GMT
Vlad Rozov created DRILL-6164:

             Summary: Heap memory leak during parquet scan and OOM
                 Key: DRILL-6164
                 URL: https://issues.apache.org/jira/browse/DRILL-6164
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Vlad Rozov
            Assignee: Vlad Rozov

During a scan of a large set of parquet files, Drill iterates over the set initializing parquet
readers. Such initialization may require a significant memory usage (both heap and direct).
When scan moves to the next parquet file in the set, it does not remove reference to the reader
from the set it iterates over and does not remove references created during initialization.

This message was sent by Atlassian JIRA

View raw message