flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Will McQueen <w...@cloudera.com>
Subject Re: How to upload the SEQ data into hdfs
Date Tue, 24 Jul 2012 02:26:41 GMT
Hi Mardan,

You can try:


agent2.channels = c1
agent2.sources = r1
agent2.sinks = k1

agent2.channels.c1.type = MEMORY

agent2.sources.r1.channels = c1
agent2.sources.r1.type = SEQ

agent2.sinks.k1.channel = c1
agent2.sinks.k1.type = HDFS
agent2.sinks.k1.hdfs.path = hdfs://134.83.35.24/user/mardan/flume/

Be sure that hadoop libs are installed on the same box as the flume agent.

Cheers,
Will

On Mon, Jul 23, 2012 at 5:26 PM, mardan Khan <mardan8310@gmail.com> wrote:

> Hi,
>
> I am just doing testing. I am generating the sequence and want to upload
> into hdfs. My configuration file as:
>
> agent2.channels = c1
> agent2.sources = r1
> agent2.sinks = k1
>
> agent2.channels.c1.type = MEMORY
>
> agent2.sources.r1.channels = c1
> agent2.sources.r1.type = SEQ
>
> agent2.sinks.k1.channel = c1
> agent2.sinks.k1.type = LOGGER
>
>
> Is it possible to upload into hdfs, if possible then how I can make the
> changes in configuration file.
>
>
> Many thanks
>
>

Mime
View raw message