flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From MIkkel Islay <my.inputstr...@gmail.com>
Subject Re: Azure Blob Storage Connector
Date Tue, 16 Aug 2016 12:50:05 GMT
Hello Ufuk,

Thanks for your swift reply.
Those are essentially the steps I took for Drill. I am happy to report back
with my success, or otherwise.

Mikkel

On Tue, Aug 16, 2016 at 12:40 PM, Ufuk Celebi <uce@apache.org> wrote:

> You should be able to follow this:
>
> http://mail-archives.apache.org/mod_mbox/drill-user/201512.mbox/%
> 3CCAAL5oQJQRgqO5LjhG_=YFLyHuZUNqEvm3VX3C=2d9UXnBTok4g@mail.gmail.com%3E
>
> It's similar to the AWS S3 config
> (https://ci.apache.org/projects/flink/flink-docs-master/setup/aws.html).
>
> Add the Azure JARs to Flink (add them to the lib folder), configure
> the fs.hdfs.hadoopconf key to point to your Hadoop config directory,
> and update the core-site.xml like in the mailing list Thread.
>
> Then you should be able to access your data via azure://...
>
> Would appreciate some feedback whether this works as expected.
>
>
> On Tue, Aug 16, 2016 at 2:37 PM, MIkkel Islay <my.inputstream@gmail.com>
> wrote:
> > Hello,
> >
> > I would like to access data in Azure blob storage from Flink, via the
> Azure
> > storage HDFS-compatibility interface.
> > That is feasible from Apache Drill, and I am thinking something similar
> > should be doable from Flink. A documentation page on eternal storage
> > connectors for Flink exist, but it was written pre 1.0.
> > Does anyone have experience with setting up a Azure blob connector?
> >
> > Mikkel
>

Mime
View raw message