Return-Path: X-Original-To: apmail-incubator-chukwa-user-archive@www.apache.org Delivered-To: apmail-incubator-chukwa-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8F7AB648A for ; Fri, 15 Jul 2011 03:46:12 +0000 (UTC) Received: (qmail 4947 invoked by uid 500); 15 Jul 2011 03:46:12 -0000 Delivered-To: apmail-incubator-chukwa-user-archive@incubator.apache.org Received: (qmail 4790 invoked by uid 500); 15 Jul 2011 03:45:54 -0000 Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-user@incubator.apache.org Delivered-To: mailing list chukwa-user@incubator.apache.org Received: (qmail 4780 invoked by uid 99); 15 Jul 2011 03:45:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jul 2011 03:45:49 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_FROM,FREEMAIL_REPLY,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of highpointe3i@gmail.com designates 209.85.213.47 as permitted sender) Received: from [209.85.213.47] (HELO mail-yw0-f47.google.com) (209.85.213.47) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jul 2011 03:45:41 +0000 Received: by ywa12 with SMTP id 12so413702ywa.6 for ; Thu, 14 Jul 2011 20:45:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to; bh=IePUwlpp/WeBbK6qMrulaJsa/Fb4y1hMTm7qPv/ki7E=; b=ohZ/m8zZnf8KIvxJUAtUjfwTsiNGwjOgGpTjrMXQ7CVgnBq8WZjCW3ihdMMiZ8WYdX G0htAj4ZWr5z0EJ9JXQW5gT+9uvVnxlaYQXBMMGASu4/pfwXPpJdvEZa1YVTC2ocBGr2 cYw4NakGXzOnYSjTHZfijG1UrBzTn03DmcCtI= Received: by 10.236.175.10 with SMTP id y10mr3565032yhl.255.1310701520364; Thu, 14 Jul 2011 20:45:20 -0700 (PDT) Received: from [10.134.104.130] ([166.205.9.142]) by mx.google.com with ESMTPS id p50sm833480yhj.0.2011.07.14.20.45.19 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 14 Jul 2011 20:45:19 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (iPhone Mail 8J2) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: Cc: "chukwa-user@incubator.apache.org" X-Mailer: iPhone Mail (8J2) From: highpointe Subject: Re: Multiple agents and multiple clusters Date: Thu, 14 Jul 2011 21:45:14 -0600 To: "chukwa-user@incubator.apache.org" Ahhhh. Good insight. I didn't think about that. Yes, I am aggregating the same data for two clusters. =20 So now my challenge is: If one cluster is unreachable... How do I that clu= ster's sender fail without affecting the other sender or the connector.=20 Excellent insight Ari! Thank you! Sent from my iPhone On Jul 14, 2011, at 11:54 AM, Ariel Rabkin wrote: > Just to be clear -- you want the same data to end up in each cluster? >=20 > You'll have to do some hacking. I think it won't be so very monstrous. > In the Agent, there's a notion of pluggable Connectors and Senders. I > think you want a new Connector with two senders. >=20 > One caveat -- you'll need to think through what happens if just one > cluster is down, and perhaps other partial failure scenarios too. >=20 > --Ari >=20 > On Thu, Jul 14, 2011 at 10:44 AM, high pointe wro= te: >> I have a situation where I need to take the one data stream, send it thro= ugh >> two agents and have the end point residing in separate clusters. >> Rough explanation.... >> Streaming Data Box ---> Chukwa Box >> Agent one on Chukwa Box sends feed to cluster one. >> Agent two on Chukwa box sends feed to cluster two. >> Does anyone know of a way to do this without hacking this baby to shreds?= >>=20 >> Thanks! >=20 >=20 >=20 > --=20 > Ari Rabkin asrabkin@gmail.com > UC Berkeley Computer Science Department