carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <>
Subject [jira] [Resolved] (CARBONDATA-545) Carbon Query GC Problem
Date Sun, 08 Jan 2017 14:31:58 GMT


Ravindra Pesala resolved CARBONDATA-545.
    Resolution: Fixed

> Carbon Query GC Problem
> -----------------------
>                 Key: CARBONDATA-545
>                 URL:
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: data-query
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>             Fix For: 1.0.0-incubating
>          Time Spent: 6h
>  Remaining Estimate: 0h
> Problem
> There are lots of gc when carbon is processing more number of records during query, which
is impacting carbon query performance.To solve this gc problem happening when query output
is too huge or when more number of records are processed.
> Solution
> Currently we are storing all the data which is read during query from carbon data file
in heap, when number of query output is huge it is causing more gc. Instead of storing in
heap we can store this data in offheap and will clear when scanning is finished for that query.

This message was sent by Atlassian JIRA

View raw message