helix-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kanak Biscuitwala (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HELIX-345) Speed up the controller pipelines
Date Tue, 17 Dec 2013 01:26:07 GMT

    [ https://issues.apache.org/jira/browse/HELIX-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13849972#comment-13849972

Kanak Biscuitwala commented on HELIX-345:

A good way to start is to vary parameters like nodes, resources, partitions, replicas, etc,
and see how that impacts the time needed to run the pipeline (and the number of times the
pipeline is run). We can hold variables fixed while changing two of them simultaneously, producing
a few 2D graphs.

Then, we can find the bottlenecks and fix them through caching, parallelization, or any other
strategy that makes sense.

> Speed up the controller pipelines
> ---------------------------------
>                 Key: HELIX-345
>                 URL: https://issues.apache.org/jira/browse/HELIX-345
>             Project: Apache Helix
>          Issue Type: Bug
>    Affects Versions: 0.6.2-incubating, 0.7.0-incubating
>            Reporter: Kanak Biscuitwala
>            Assignee: Kanak Biscuitwala
> ReadClusterDataStage can take some time. We should have techniques for speeding it up
like parallelizing or caching.

This message was sent by Atlassian JIRA

View raw message