ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Mashenkov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-4106) SQL: parallelize sql queries over cache local partitions
Date Thu, 24 Nov 2016 13:02:58 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15693238#comment-15693238
] 

Andrew Mashenkov commented on IGNITE-4106:
------------------------------------------

I've done with splitting indices. There are some broken tests left, unresolved issue with
distributed joins and issue with prepared statement cache.

Prepared statement cache is now broken due to H2 knows nothing about splitted indices and
how they work. Reused statement can return same result on different segments, so I've just
disabled this feature.

Serj, would you please review PR #1278 for if I go the right way.



> SQL: parallelize sql queries over cache local partitions
> --------------------------------------------------------
>
>                 Key: IGNITE-4106
>                 URL: https://issues.apache.org/jira/browse/IGNITE-4106
>             Project: Ignite
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.6, 1.7
>            Reporter: Andrew Mashenkov
>            Assignee: Andrew Mashenkov
>              Labels: performance
>             Fix For: 2.0
>
>         Attachments: 1node-4thread.jfr, 4node-1thread.jfr
>
>
> If we run SQL query on cache partitioned over several cluster nodes, it will be split
into several queries running in parallel. But really we will have one thread per query on
each node.
> So, for now, to improve SQL query performance we need to run more Ignite instances or
split caches manually.
> It seems to be better to split local SQL queries over cache partitions, so we would be
able to parallelize SQL query on every single node and utilize CPU more efficiently.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message