flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Santiago Mola <sm...@stratio.com>
Subject Re: Disgesting a CSV file as a whole file using spooldir source
Date Thu, 04 Sep 2014 16:39:46 GMT
Hi Pradeep,

2014-09-04 5:47 GMT+02:00 Pradeep Srinivasa <pradeep.srinivasa@hcl.com>:

> Is there any way that we can read a CSV file and store them as is using
> Flume?

You should change the serializer used by spooldir  (see "deserializer" in
the spooldir doc). [1]
BlobSerializer will do what you want, reading the whole file into the event
body. There is a maximum length
per blob that you can tune with "deserializer.maxBlobLength". [2]

[1] https://flume.apache.org/FlumeUserGuide.html#spooling-directory-source
[2] https://flume.apache.org/FlumeUserGuide.html#blobdeserializer

Santiago M. Mola

View raw message