flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis.gospodne...@gmail.com>
Subject Re: Flume - compressed files
Date Thu, 05 Feb 2015 19:23:05 GMT
In short, no.  You can uncompress the ZIP + parse XML and the feed
individual pieces of data to Flume, but not the whole ZIP.

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/


On Wed, Feb 4, 2015 at 11:48 PM, Mahadevappa, Shobha <
Shobha.Mahadevappa@nttdata.com> wrote:

>  Hi,
>
> Can flume be used to ingest compressed files?
>
>
>
> Use case is:
>
> Ingest zip files from FTP server. Each zip file contains multiple XML’s
> and each XML have multiple events (in the form of XML) which have to be
> persisted to Hbase.
>
>
>
> Is flume the right candidate to address the same?
>
>
>
> Regards,
>
> *Shobha M *
>
>
>
> ______________________________________________________________________
> Disclaimer: This email and any attachments are sent in strictest confidence
> for the sole use of the addressee and may contain legally privileged,
> confidential, and proprietary data. If you are not the intended recipient,
> please advise the sender by replying promptly to this email and then delete
> and destroy this email and any attachments without any further use, copying
> or forwarding.
>

Mime
View raw message