Mailing-List: contact flume-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: flume-user@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of guidox@gmail.com designates
 209.85.161.175 as permitted sender)
MIME-Version: 1.0
Date: Thu, 5 Jul 2012 14:37:51 +0200
Message-ID: 
 <CAKz-6hR6U8bAzRG5Q3rnK_eMkyWAJc5fqBdJC-CS8U=GRCmTMw@mail.gmail.com>
Subject: Reliable flows in flume
From: Guido Urdaneta <guidox@gmail.com>
To: flume-user@incubator.apache.org
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I have been trying to configure a reliable flow in Flume NG.
I installed the Flume NG distribution that comes with Cloudera cdh4.
Cloudera's documentation says that JDBC channel is "ideal for flows
where recoverability is important" and that FileChannel "is not yet
ready for use".
However, in some messages in this mailing list  FileChannel has been
recommended as the best option for reliable flows. Is this actually
the case?
Is Cloudera packing an old version of Flume NG with its CDH4 distribution?
Any recommendations?

I have found the performance of JDBC channel to be extremely slow
(about 10,000 times slower than memory channel), with the bottleneck
being CPU usage.

Can anybody give a recommendation?


Thanks in advance,
GU