Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 83A32EA0D for ; Fri, 28 Dec 2012 07:53:45 +0000 (UTC) Received: (qmail 55041 invoked by uid 500); 28 Dec 2012 07:53:44 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 54862 invoked by uid 500); 28 Dec 2012 07:53:43 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 54833 invoked by uid 99); 28 Dec 2012 07:53:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Dec 2012 07:53:42 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.32.180.11] (HELO va3outboundpool.messaging.microsoft.com) (216.32.180.11) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Dec 2012 07:53:34 +0000 Received: from mail209-va3-R.bigfish.com (10.7.14.243) by VA3EHSOBE010.bigfish.com (10.7.40.12) with Microsoft SMTP Server id 14.1.225.23; Fri, 28 Dec 2012 07:53:12 +0000 Received: from mail209-va3 (localhost [127.0.0.1]) by mail209-va3-R.bigfish.com (Postfix) with ESMTP id 4902A64012C for ; Fri, 28 Dec 2012 07:53:12 +0000 (UTC) X-Forefront-Antispam-Report: CIP:59.163.77.45;KIP:(null);UIP:(null);IPV:NLI;H:KCHJEXHC01.kpit.com;RD:59.163.77.45.static.vsnl.net.in;EFVD:NLI X-SpamScore: -3 X-BigFish: VPS-3(zz98dI9371Ic85fh4015Izz1de0h1202h1e76h1d1ah1d2ahzz8275bh8275dh18c673h17326ahz2dh2a8h668h839hd25hf0ah1288h12a5h12bdh137ah1441h14ddh1504h1537h153bh15d0h162dh1631h1758h1155h) Received: from mail209-va3 (localhost.localdomain [127.0.0.1]) by mail209-va3 (MessageSwitch) id 1356681188923673_23557; Fri, 28 Dec 2012 07:53:08 +0000 (UTC) Received: from VA3EHSMHS042.bigfish.com (unknown [10.7.14.241]) by mail209-va3.bigfish.com (Postfix) with ESMTP id DF702C80073 for ; Fri, 28 Dec 2012 07:53:08 +0000 (UTC) Received: from KCHJEXHC01.kpit.com (59.163.77.45) by VA3EHSMHS042.bigfish.com (10.7.99.52) with Microsoft SMTP Server (TLS) id 14.1.225.23; Fri, 28 Dec 2012 07:53:08 +0000 Received: from KCHJEXMB03.kpit.com ([169.254.4.5]) by KCHJEXHC01.kpit.com ([172.10.15.73]) with mapi id 14.02.0247.003; Fri, 28 Dec 2012 13:23:00 +0530 From: Abhijeet Pathak To: "user@flume.apache.org" Subject: RE: Source and Sink on different machine Thread-Topic: Source and Sink on different machine Thread-Index: Ac3kxa0/QciZ7mO4QkylGlFXjALEUf//t58A//+i4XA= Date: Fri, 28 Dec 2012 07:53:00 +0000 Message-ID: <385EB45A4FF452429090E0D6CA782D375631916A@KCHJEXMB03.kpit.com> References: <385EB45A4FF452429090E0D6CA782D375631710E@KCHJEXMB03.kpit.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.10.62.30] Content-Type: multipart/alternative; boundary="_000_385EB45A4FF452429090E0D6CA782D375631916AKCHJEXMB03kpitc_" MIME-Version: 1.0 X-OriginatorOrg: kpitcummins.com X-Virus-Checked: Checked by ClamAV on apache.org --_000_385EB45A4FF452429090E0D6CA782D375631916AKCHJEXMB03kpitc_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I want to setup a failover configuration. On Machine1 I've a source. On Machine2 & Machine3, I have (hbase) sinks. I want to configure them in failover mode. That is, by default events shoul= d go to sink on Machine2's sink. But if Machine2 fails then they should aut= omatically go to Machine3's sink. Is that possible in Flume-NG? How? Thanks, Abhijeet From: Nitin Pawar [mailto:nitinpawar432@gmail.com] Sent: Friday, December 28, 2012 1:18 PM To: user@flume.apache.org Subject: Re: Source and Sink on different machine if I understood it correctly, you want to put your log data into hbase whic= h is hosted remotely? yes thats easily doable. Flume-NG does everything alone instead of older master-slave architecture. = It has currently source channel and sink. you can collect logs on a machine= via an agent and using same agent you can sink them into hbase on a remot= e host On Fri, Dec 28, 2012 at 12:06 PM, Abhijeet Pathak > wrote: Hi, It was possible to have source and sinks on different machines using Flume = 0.9x. Is it possible to have source and sinks on different machines in Flume-NG (= 1.3.0)? I want to use tail source on one machine and hbase sink on another machine.= How should I go about it? Thanks, Abhijeet This message contains information that may be privileged or confidential an= d is the property of the KPIT Cummins Infosystems Ltd. It is intended only = for the person to whom it is addressed. If you are not the intended recipie= nt, you are not authorized to read, print, retain copy, disseminate, distri= bute, or use this message or any part thereof. If you receive this message = in error, please notify the sender immediately and delete all copies of thi= s message. KPIT Cummins Infosystems Ltd. does not accept any liability for = virus infected mails. -- Nitin Pawar --_000_385EB45A4FF452429090E0D6CA782D375631916AKCHJEXMB03kpitc_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

I want to setup a failove= r configuration.

 <= /p>

On Machine1 I’ve a = source.

On Machine2 & Machine= 3, I have (hbase) sinks.

I want to configure them = in failover mode. That is, by default events should go to sink on Machine2&= #8217;s sink. But if Machine2 fails then they should automatically go to Machine3’s sink.

 <= /p>

Is that possible in Flume= -NG? How?

 <= /p>

Thanks,=

Abhijeet

 <= /p>

From: Nitin Pa= war [mailto:nitinpawar432@gmail.com]
Sent: Friday, December 28, 2012 1:18 PM
To: user@flume.apache.org
Subject: Re: Source and Sink on different machine<= /p>

 

if I understood it correctly, you want to put your l= og data into hbase which is hosted remotely? 

 

yes thats easily doable. 

 

Flume-NG does everything alone instead of older mast= er-slave architecture. It has currently source channel and sink. you can co= llect logs on a machine via an agent and using same agent you can sink them= into hbase  on a remote host 

 

=

On Fri, Dec 28, 2012 at 12:06 PM, Abhijeet Pathak &l= t;Abhi= jeet.Pathak@kpitcummins.com> wrote:

Hi,

 

It was possible to have source and sinks on different machines usi= ng Flume 0.9x.

 

Is it possible to have source and sinks on different machines in F= lume-NG (1.3.0)?

 

I want to use tail source on one machine and hbase sink on another= machine.

How should I go about it?

 

Thanks,

Abhijeet


This message contains information that may be privileged or confidential an= d is the property of the KPIT Cummins Infosystems Ltd. It is intended only = for the person to whom it is addressed. If you are not the intended recipie= nt, you are not authorized to read, print, retain copy, disseminate, distribute, or use this message or any pa= rt thereof. If you receive this message in error, please notify the sender = immediately and delete all copies of this message. KPIT Cummins Infosystems= Ltd. does not accept any liability for virus infected mails.



 

--
Nitin Pawar


This message contains information that may be privileged o= r confidential and is the property of the KPIT Cummins Infosystems Ltd. It = is intended only for the person to whom it is addressed. If you are not the= intended recipient, you are not authorized to read, print, retain copy, di= sseminate, distribute, or use this message or any part thereof. If you rece= ive this message in error, please notify the sender immediately and delete = all copies of this message. KPIT Cummins Infosystems Ltd. does not accept a= ny liability for virus infected mails. --_000_385EB45A4FF452429090E0D6CA782D375631916AKCHJEXMB03kpitc_--