cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mck (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-6091) Better Vnode support in hadoop/pig
Date Wed, 11 Feb 2015 22:28:12 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317105#comment-14317105
] 

mck commented on CASSANDRA-6091:
--------------------------------

With handling of multiple token rages, we loose a little accuracy in the resulting splitSize
because token ranges are so much smaller (eg from the corner splits), but apart from such
errors evening out, isn't the more important goal here is to have splits sized more consistently
from splitSize so that users can tune and achieve a reasonably steady throughput of tasks?

> Better Vnode support in hadoop/pig
> ----------------------------------
>
>                 Key: CASSANDRA-6091
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6091
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>            Reporter: Alex Liu
>            Assignee: Alex Liu
>
> CASSANDRA-6084 shows there are some issues during running hadoop/pig job if vnodes are
enable. Also the hadoop performance of vnode enabled nodes  are bad for there are so many
splits.
> The idea is to combine vnode splits into a big sudo splits so it work like vnode is disable
for hadoop/pig job



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message