airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andy Hadjigeorgiou <andyxha...@gmail.com>
Subject Re: Redshift operation examples
Date Sat, 14 Oct 2017 19:27:17 GMT
This blog post
<http://tech.marksblogg.com/airflow-postgres-redis-forex.html> has a good
example of using PostgresHook to query a database - all you'd need to
change is the connection info (to however you'd normally access your
Redshift cluster to query).

Andy

-------
Software Engineer | Fundera

On Sat, Oct 14, 2017 at 3:22 PM, Andy Hadjigeorgiou <andyxhadji@gmail.com>
wrote:

> Hello,
>
> If you are looking for querying Redshift clusters, PostgresOperators and
> PostgresHook is what you are looking for. Here's the docs
> <https://pythonhosted.org/airflow/code.html#airflow.hooks.PostgresHook> for
> both. If you are looking to manage Redshift clusters, right now you'd have
> to use boto3 by hand (there is not currently a hook for managing Redshift
> clusters). I'm working on a RedshiftHook based on this ticket
> <https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-1695>,
> but it's awaiting PR#2532
> <https://github.com/apache/incubator-airflow/pull/2532> (moving s3 hook
> to boto3).
>
> Hope that is helpful!
>
> Best,
>
> Andy
>
> -------
> Software Engineer | Fundera
>
> On Sat, Oct 14, 2017 at 3:11 PM, Veeranagouda Mukkanagoudar <
> mukkanagoudar@gmail.com> wrote:
>
>> I am new to Airflow,
>> Can anyone point me to Redshift/Postgress operator or task implementation
>> examples.
>>
>> -Thanks
>> Veera
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message