nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mikhail Sosonkin <mikh...@synack.com>
Subject Re: Processors for Google Cloud Platform
Date Mon, 27 Feb 2017 04:30:27 GMT
Andre,

I would love to get the PubSub processors into nifi proper. I'm not too
familiar with your development processes, can you give me some directions
on how you want me to do that and what sort of things the code should have?

Thanks,
Mike.

On Sun, Feb 26, 2017 at 9:58 PM, Andre <andre-lists@fucs.org> wrote:

> Mikhail,
>
> Thanks for the email!
>
> Someone had recently contributed processors to handle Google Cloud Storage
> buckets and objects, however I am not aware of anyone providing processors
> to handle PubSub yet so I am sure it will be a welcome processor!
>
> Would you be willing to submit a PR to include your processors as part of
> the GCS bundle?
>
> Cheers
>
> On Mon, Feb 27, 2017 at 1:27 PM, Mikhail Sosonkin <mikhail@synack.com>
> wrote:
>
>> Hello Everyone,
>>
>> SYNACK has recently started working with Google Cloud and we use NiFi to
>> move some of our data sets. For that, we've built processors to work with
>> Cloud Storage and Pubsub systems.
>>
>> A processor that uploads messages to Google Cloud Platform PubSub topic:
>> https://github.com/synack/nifi-gcp-pubsub-publisher
>>
>> A processor that reads messages from a Google Cloud Platform PubSub
>> topic: https://github.com/synack/nifi-gcp-pubsub-consumer
>>
>> A processor that uploads files to Google Cloud Platform Cloud: Storage:
>> https://github.com/synack/nifi-gcp-putgcs
>>
>> They are certainly works in progress, but we're running them in our
>> production environments inside and outside of GCP without any issues. Since
>> these processors have been working so well for us, I wanted to share them
>> with the community - just in case some one else finds them useful.
>>
>> Our team is still growing and being able to do these functions as part of
>> NiFi, rather than building specialized widgets, has been a major boon for
>> us. So, thanks NIFI team!
>>
>> Mike.
>> http://synack.com
>>
>> This email may contain material that is confidential for the sole use of
>> the intended recipient(s).  Any review, reliance or distribution or
>> disclosure by others without express permission is strictly prohibited.  If
>> you are not the intended recipient, please contact the sender and delete
>> all copies of this message.
>>
>
>

-- 
This email may contain material that is confidential for the sole use of 
the intended recipient(s).  Any review, reliance or distribution or 
disclosure by others without express permission is strictly prohibited.  If 
you are not the intended recipient, please contact the sender and delete 
all copies of this message.

Mime
View raw message