carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (CARBONDATA-363) Block loading issue in case of blocklet distribution
Date Mon, 07 Nov 2016 02:16:58 GMT


ASF GitHub Bot commented on CARBONDATA-363:

Github user asfgit closed the pull request at:

> Block loading issue in case of blocklet distribution
> ----------------------------------------------------
>                 Key: CARBONDATA-363
>                 URL:
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: kumar vishal
>            Assignee: kumar vishal
> Problem: In case of blocklet distribution same block is getting loaded multiple times
this is because when blocklet distribution is enabled same block will divided inside a task
so there is not synchronisation as block loading is done in different thread because of this
same block is getting read from carbon data file footer multiple times and it is hitting the
first time query performance.
> Solution: Need to add locking for above issue, if one thread is loading particulate block
other thread need and once block loaded other thread need to use same reference of the block

This message was sent by Atlassian JIRA

View raw message