airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <hol...@pigscanfly.ca>
Subject Re: [jira] [Assigned] (AIRFLOW-3099) Errors raised when some blocs are missing in airflow.cfg
Date Sat, 22 Sep 2018 18:57:30 GMT
Great, thanks! I’ll send a longer description email in a few days (I’m
going to watch it over the weekend to make sure it doesn’t do anything
surprising).

On Sat, Sep 22, 2018 at 11:00 AM Kaxil Naik <kaxilnaik@gmail.com> wrote:

> Yes, it is restoring assignees. It's fine with me :)
>
> On Sat, Sep 22, 2018 at 1:03 AM Holden Karau <holden@pigscanfly.ca> wrote:
>
>> Thanks for the heads up :) So it should automatically restore the
>> assignee, which it looks like it did, and it's set up to only do this for
>> new PRs (no back-fills). I can turn it all the way off if it's annoying to
>> folks but otherwise it will automatically switch JIRAs to in-progress as
>> folks make PRs for them so when we go to look for JIRAs which are not being
>> worked on with the filters in JIRA it works :)
>>
>> On Fri, Sep 21, 2018 at 3:34 PM Kaxil Naik <kaxilnaik@gmail.com> wrote:
>>
>>> Hi Holden Karau,
>>>
>>> Not sure on what is happening, but seems like the dashboard you are
>>> working on is setting assignee. Pinging you just in-case if you aren't
>>> aware :)
>>>
>>> ---------- Forwarded message ---------
>>> From: Holden Karau's magical unicorn (JIRA) <jira@apache.org>
>>> Date: Fri, Sep 21, 2018 at 11:31 PM
>>> Subject: [jira] [Assigned] (AIRFLOW-3099) Errors raised when some blocs
>>> are missing in airflow.cfg
>>> To: <kaxilnaik@gmail.com>
>>>
>>>
>>>
>>>      [
>>> https://issues.apache.org/jira/browse/AIRFLOW-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>>> ]
>>>
>>> Holden Karau's magical unicorn reassigned AIRFLOW-3099:
>>> -------------------------------------------------------
>>>
>>>     Assignee: Holden Karau's magical unicorn  (was: Kaxil Naik)
>>>
>>> > Errors raised when some blocs are missing in airflow.cfg
>>> > --------------------------------------------------------
>>> >
>>> >                 Key: AIRFLOW-3099
>>> >                 URL:
>>> https://issues.apache.org/jira/browse/AIRFLOW-3099
>>> >             Project: Apache Airflow
>>> >          Issue Type: Bug
>>> >          Components: configuration
>>> >    Affects Versions: 1.10.0
>>> >            Reporter: Christophe
>>> >            Assignee: Holden Karau's magical unicorn
>>> >            Priority: Minor
>>> >             Fix For: 1.10.1
>>> >
>>> >
>>> > When we upgrade from a version of airflow to another one and new
>>> config bloc are available or if we delete useless blocs, lots of errors are
>>> raised if we don't have some blocs in airflow.cfg file.
>>> > We need to avoid these errors for non-required blocs.
>>> >
>>> > For the record logs (not exhaustive):
>>> >
>>> > {noformat}
>>> > [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
>>> sasl_enabled does not exist in the config!
>>> > [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
>>> host does not exist in the config!
>>> > [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
>>> port does not exist in the config!
>>> > [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
>>> username does not exist in the config!
>>> > [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
>>> password does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section hive Option
>>> default_hive_mapred_queue does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
>>> master does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
>>> framework_name does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
>>> task_cpu does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
>>> task_memory does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
>>> checkpoint does not exist in the config!
>>> > [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
>>> authenticate does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section elasticsearch
>>> Option elasticsearch_host does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section elasticsearch
>>> Option elasticsearch_log_id_template does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section elasticsearch
>>> Option elasticsearch_end_of_log_mark does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes
>>> Option worker_container_repository does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes
>>> Option worker_container_tag does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes
>>> Option delete_worker_pods does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes
>>> Option namespace does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes
>>> Option airflow_configmap does not exist in the config!
>>> > [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes
>>> Option dags_volume_subpath does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option dags_volume_claim does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option logs_volume_subpath does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option logs_volume_claim does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_repo does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_branch does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_user does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_password does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_subpath does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_sync_container_repository does not exist in the config!
>>> > [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes
>>> Option git_sync_container_tag does not exist in the config!
>>> > [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes
>>> Option git_sync_init_container_name does not exist in the config!
>>> > [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes
>>> Option worker_service_account_name does not exist in the config!
>>> > [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes
>>> Option image_pull_secrets does not exist in the config!
>>> > [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes
>>> Option gcp_service_account_keys does not exist in the config!
>>> > [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes
>>> Option in_cluster does not exist in the config!{noformat}
>>> >
>>>
>>>
>>>
>>> --
>>> This message was sent by Atlassian JIRA
>>> (v7.6.3#76005)
>>>
>>>
>>> --
>>> *Kaxil Naik*
>>> *Big Data Consultant *@ *Data Reply UK*
>>> *Certified *Google Cloud Data Engineer | *Certified* Apache Spark &
>>> Neo4j Developer
>>> *Phone: *+44 (0) 74820 88992
>>> *LinkedIn*: https://www.linkedin.com/in/kaxil
>>>
>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
>
> --
> *Kaxil Naik*
> *Big Data Consultant *@ *Data Reply UK*
> *Certified *Google Cloud Data Engineer | *Certified* Apache Spark & Neo4j
> Developer
> *Phone: *+44 (0) 74820 88992
> *LinkedIn*: https://www.linkedin.com/in/kaxil
>
-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message