drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-3874) flattening large JSON objects consumes too much direct memory
Date Fri, 02 Oct 2015 21:24:27 GMT

    [ https://issues.apache.org/jira/browse/DRILL-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941789#comment-14941789

ASF GitHub Bot commented on DRILL-3874:

Github user jaltekruse commented on the pull request:

    I'm running the unit tests on the changeset rebased on top of master, will be merging
shortly if it passes.

> flattening large JSON objects consumes too much direct memory
> -------------------------------------------------------------
>                 Key: DRILL-3874
>                 URL: https://issues.apache.org/jira/browse/DRILL-3874
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>    Affects Versions: 1.1.0
>            Reporter: Chris Westin
>            Assignee: Chris Westin
> A JSON record has a field whose value is an array with 20,000 elements; the record's
size is 4MB. A select is used to flatten this. The query profile reports that the peak memory
utilization was 8GB, most of it used by the flatten. 

This message was sent by Atlassian JIRA

View raw message