carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-363) Block loading issue in case of blocklet distribution
Date Wed, 02 Nov 2016 17:16:59 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629677#comment-15629677
] 

ASF GitHub Bot commented on CARBONDATA-363:
-------------------------------------------

GitHub user kumarvishal09 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/280

    [CARBONDATA-363]fixed block loading issue in case of blocklet distribution

    **Problem**: In case of blocklet distribution same block is getting loaded multiple times
this is because when blocklet distribution is enabled same block will divided inside a task
so there is not synchronisation as block loading is done in different thread because of this
same block is getting read from carbon data file footer multiple times and it is hitting the
first time query performance.
    **Solution**: Need to add locking for above issue, if one thread is loading particulate
block other thread need and once block loaded other thread need to use same reference of the
block 


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kumarvishal09/incubator-carbondata blockloadingissue

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/280.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #280
    
----
commit a6d8a18a73e3ed8e39de444b2ddfded45813493f
Author: kumarvishal <kumarvishal.1802@gmail.com>
Date:   2016-11-02T17:02:42Z

    fixed block loading issue in case of blocklet distribution

----


> Block loading issue in case of blocklet distribution
> ----------------------------------------------------
>
>                 Key: CARBONDATA-363
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-363
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>
> Problem: In case of blocklet distribution same block is getting loaded multiple times
this is because when blocklet distribution is enabled same block will divided inside a task
so there is not synchronisation as block loading is done in different thread because of this
same block is getting read from carbon data file footer multiple times and it is hitting the
first time query performance.
> Solution: Need to add locking for above issue, if one thread is loading particulate block
other thread need and once block loaded other thread need to use same reference of the block




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message