airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Somasundaram Sekar <somasundar.se...@tigeranalytics.com>
Subject Re: Airflow logs are stored in Remote s3 and also in the base log folder
Date Thu, 07 Dec 2017 08:00:28 GMT
When S3 remote log is configured, webui will access S3 for logs right(for
read and write) so will we still be required to have them in the local
filesystem?

On 7 Dec 2017 1:20 pm, "Bolke de Bruin" <bdbruin@gmail.com> wrote:

> Safe being a relative thing, but yes. I would keep a few and remove old
> ones.
>
> Sent from my iPhone
>
> > On 7 Dec 2017, at 07:34, Somasundaram Sekar <somasundar.sekar@
> tigeranalytics.com> wrote:
> >
> > Hi Bolke,
> >
> > So it is safe to periodically purge them from the local filesystem
> without
> > any impact?
> >
> > On 7 Dec 2017 12:56 pm, "Bolke de Bruin" <bdbruin@gmail.com> wrote:
> >
> > Yes. We dont delete them.
> >
> > Sent from my iPhone
> >
> >> On 7 Dec 2017, at 07:17, Neethu M V <mvneethu90@gmail.com> wrote:
> >>
> >> Hi,
> >>
> >> I wanted to use the remote base log (s3) folder and as per instructions
> by
> >> giving the s3 location and remote_log_conn_id, the logs are stored in
> s3.
> >> But my question is will the logs also present in base log folder? As I
> can
> >> see the logs are also saved in the base log folder. Please clarify if
> this
> >> behaviour is as expected.
> >>
> >> Thanks,
> >> Neethu M V
> >
> > --
> > *Disclaimer*: This e-mail is intended to be delivered only to the named
> > addressee(s). If this information is received by anyone other than the
> > named addressee(s), the recipient(s) should immediately notify
> > info@tigeranalytics.com and promptly delete the transmitted material
> from
> > your computer and server.   In no event shall this material be read,
> used,
> > stored, or retained by anyone other than the named addressee(s) without
> the
> > express written consent of the sender or the named addressee(s). Computer
> > viruses can be transmitted viaemail. The recipient should check this
> email and
> > any attachments for viruses. The company accepts no liability for any
> > damage caused by any virus transmitted by this email.
>

-- 
*Disclaimer*: This e-mail is intended to be delivered only to the named 
addressee(s). If this information is received by anyone other than the 
named addressee(s), the recipient(s) should immediately notify 
info@tigeranalytics.com and promptly delete the transmitted material from 
your computer and server.   In no event shall this material be read, used, 
stored, or retained by anyone other than the named addressee(s) without the 
express written consent of the sender or the named addressee(s). Computer 
viruses can be transmitted viaemail. The recipient should check this email and 
any attachments for viruses. The company accepts no liability for any 
damage caused by any virus transmitted by this email.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message