Return-Path: X-Original-To: apmail-incubator-flume-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-flume-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2CE807DD0 for ; Fri, 11 Nov 2011 12:29:25 +0000 (UTC) Received: (qmail 22051 invoked by uid 500); 11 Nov 2011 12:29:25 -0000 Delivered-To: apmail-incubator-flume-user-archive@incubator.apache.org Received: (qmail 22030 invoked by uid 500); 11 Nov 2011 12:29:25 -0000 Mailing-List: contact flume-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: flume-user@incubator.apache.org Delivered-To: mailing list flume-user@incubator.apache.org Received: (qmail 22022 invoked by uid 99); 11 Nov 2011 12:29:25 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Nov 2011 12:29:25 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.160.175] (HELO mail-gy0-f175.google.com) (209.85.160.175) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Nov 2011 12:29:17 +0000 Received: by gyh4 with SMTP id 4so2799508gyh.6 for ; Fri, 11 Nov 2011 04:28:56 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.100.194 with SMTP id fa2mr7445992igb.49.1321014535842; Fri, 11 Nov 2011 04:28:55 -0800 (PST) Received: by 10.50.222.230 with HTTP; Fri, 11 Nov 2011 04:28:55 -0800 (PST) X-Originating-IP: [213.243.174.212] In-Reply-To: References: Date: Fri, 11 Nov 2011 14:28:55 +0200 Message-ID: Subject: Re: How to tail a flume stream? From: =?ISO-8859-1?Q?Juho_M=E4kinen?= To: flume-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Is that appending sink released somewhere? - Juho On Fri, Nov 11, 2011 at 2:24 PM, Torsten Curdt wrote: > Tailing in flume would have the benefit that you can tap into and can > ignore rotations. But if you have a flume cluster - not sure how that > should look like. > We ended up implementing our own sink that writes into hdfs using the > hdfs append feature. With that we can just tail on the hdfs side of > things. > > cheers, > Torsten >