Return-Path: 
 <user-return-5556-apmail-flume-user-archive=flume.apache.org@flume.apache.org>
X-Original-To: apmail-flume-user-archive@www.apache.org
Delivered-To: apmail-flume-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1227F11892
	for <apmail-flume-user-archive@www.apache.org>;
 Mon, 23 Jun 2014 07:16:18 +0000 (UTC)
Received: (qmail 31944 invoked by uid 500); 23 Jun 2014 07:16:17 -0000
Delivered-To: apmail-flume-user-archive@flume.apache.org
Received: (qmail 31883 invoked by uid 500); 23 Jun 2014 07:16:17 -0000
Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@flume.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@flume.apache.org>
List-Post: <mailto:user@flume.apache.org>
List-Id: <user.flume.apache.org>
Reply-To: user@flume.apache.org
Delivered-To: mailing list user@flume.apache.org
Received: (qmail 31870 invoked by uid 99); 23 Jun 2014 07:16:17 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Jun 2014 07:16:17 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=AC_DIV_BONANZA,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of alajangikishore@gmail.com
 designates 209.85.213.43 as permitted sender)
Received: from [209.85.213.43] (HELO mail-yh0-f43.google.com) (209.85.213.43)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Jun 2014 07:16:12 +0000
Received: by mail-yh0-f43.google.com with SMTP id a41so4737788yho.2
        for <user@flume.apache.org>; Mon, 23 Jun 2014 00:15:51 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=PKi94FYm4IMpeDymWibJoP8L3SdLyZ5QqvBe/d2Jd+8=;
        b=mpAN/5urtL9l7j39HIjMdH2dChyK+CBG2UMmnEWOL6CUTsJdQffpdQ0zrFm/+A9SmG
         IuzvAAeRkaE85cMQhZ5Z4eLWfQ52ZKckHb6gEtI2OgcC15C/em8O0E2zuuMICHRWBMh3
         HjuBDYVC6+pyepzzF/R7v7wJidmHAFI1Hr9IMitSjYI+yj3qs+0psmK7Hq8NMS5bcL1S
         97hsDJq7aaFElWNEi2iHL+whblEWBzkv/HoO2sCf8Ka/Fw2310EIMfZa3+krE3MjEa18
         /uBKDG7aVP/qa76thLDVA+TFyQUjfEgB/d8lmv/OY033GcoMsGC2rewvEHRRND+0O5GS
         DRSQ==
MIME-Version: 1.0
X-Received: by 10.236.85.45 with SMTP id t33mr1902509yhe.74.1403507751541;
 Mon, 23 Jun 2014 00:15:51 -0700 (PDT)
Received: by 10.170.142.198 with HTTP; Mon, 23 Jun 2014 00:15:51 -0700 (PDT)
Date: Mon, 23 Jun 2014 11:15:51 +0400
Message-ID: 
 <CAHv0dghSOUif5MUSrxHQ_QskHv61ObkGsSuMXLwojHgF0bX8Bw@mail.gmail.com>
Subject: EventDeliveryException: Could not find schema for event
From: kishore alajangi <alajangikishore@gmail.com>
To: "user@flume.apache.org" <user@flume.apache.org>
Content-Type: multipart/alternative; boundary=20cf3005dd4ef87ec804fc7b9cfe
X-Virus-Checked: Checked by ClamAV on apache.org

--20cf3005dd4ef87ec804fc7b9cfe
Content-Type: text/plain; charset=ISO-8859-1

I want to store avro files into hdfs using flume, could anybody suggest me
the configuration? I am trying with the below configuration, but it throws
"flume.EventDeliveryException: Could not find schema for event" error,
please help me

first I copied the schema file to /etc/flume.conf/schemas(created this
directory explicitly)/avro.avsc

#defined source as spooldir, channel as memory, sink as hdfs,
agent.sources = s1
agent.channels = c1
agent.sinks = r1


agent.sources.s1.type = spooldir
agent.sources.s1.spoolDir = <dir path>
agent.sources.s1.deserializer = avro
agent.sources.s1.deletePolicy = immediate
agent.sources.s1.channels = c1
agent.sources.s1.interceptors = attach-schema
agent.sources.s1.interceptors.attach-schema = static
agent.sources.s1.interceptors.attach-schema.key = flume.avro.schema.url
agent.sources.s1.interceptors.attach-schema.value =
flle:/etc/flume-ng/schemas/avro.avsc

agent.channels.c1.type = memory
agent.channels.c1.capacity = 10000000
agent.channels.c1.transactionCapacity = 1000

agent.sinks.s1.type = hdfs
agent.sinks.s1.hdfs.path = /flume/
agent.sinks.s1.hdfs.fileType = DataStream
agent.sinks.s1.channel = c1
agent.sinks.s1.hdfs.batchSize = 100
agent.sinks.s1.hdfs.serializer =
org.apache.flume.sink.hdfs.AvroEventSerializer$Builder


-- 
Thanks,
Kishore.

--20cf3005dd4ef87ec804fc7b9cfe
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div><div><div><div><div><div><div><div><br=
 clear=3D"all"></div>I want to store avro files into hdfs using flume, coul=
d anybody suggest me the configuration? I am trying with the below configur=
ation, but it throws &quot;flume.EventDeliveryException: Could not find sch=
ema for event&quot; error, please help me<br>
<br></div>first I copied the schema file to /etc/flume.conf/schemas(created=
 this directory explicitly)/avro.avsc<br><br></div>#defined source as spool=
dir, channel as memory, sink as hdfs, <br></div>agent.sources =3D s1<br></d=
iv>
agent.channels =3D c1<br></div>agent.sinks =3D r1<br></div><div><br></div><=
div><br></div>agent.sources.s1.type =3D spooldir<br></div>agent.sources.s1.=
spoolDir =3D &lt;dir path&gt;<br></div>agent.sources.s1.deserializer =3D av=
ro<br>
</div>agent.sources.s1.deletePolicy =3D immediate<br></div><div>agent.sourc=
es.s1.channels =3D c1<br></div>agent.sources.s1.interceptors =3D attach-sch=
ema<br><div><div><div><div><div><div><div><div><div><div>agent.sources.s1.i=
nterceptors.attach-schema =3D static<br>
</div><div>agent.sources.s1.interceptors.attach-schema.key =3D flume.avro.s=
chema.url<br></div><div>agent.sources.s1.interceptors.attach-schema.value =
=3D flle:/etc/flume-ng/schemas/avro.avsc<br></div><div><br>agent.channels.c=
1.type =3D memory<br>
</div><div>agent.channels.c1.capacity =3D 10000000<br></div><div>agent.chan=
nels.c1.transactionCapacity =3D 1000<br><br></div><div>agent.sinks.s1.type =
=3D hdfs<br></div><div>agent.sinks.s1.hdfs.path =3D /flume/<br></div><div>a=
gent.sinks.s1.hdfs.fileType =3D DataStream<br>
</div><div>agent.sinks.s1.channel =3D c1<br></div><div>agent.sinks.s1.hdfs.=
batchSize =3D 100<br></div><div>agent.sinks.s1.hdfs.serializer =3D org.apac=
he.flume.sink.hdfs.AvroEventSerializer$Builder<br><br><br></div><div><div><=
div>
<div>-- <br>Thanks,<br>Kishore.
</div></div></div></div></div></div></div></div></div></div></div></div></d=
iv></div>

--20cf3005dd4ef87ec804fc7b9cfe--