airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Riccomini <criccom...@apache.org>
Subject Re: [VOTE] Release Airflow 1.8.2 based on Airflow 1.8.2 RC2
Date Wed, 05 Jul 2017 17:40:44 GMT
Nice, thanks Max!

On Mon, Jul 3, 2017 at 2:36 PM, Maxime Beauchemin <
maximebeauchemin@gmail.com> wrote:

> Hello,
>
> Apache Airflow (incubating) 1.8.2 (RC2) has been accepted.
>
> 5 “+1” votes received, 4 out of which are "binding":
>
> - Maxime Beauchemin (binding)
> - Bolke de Bruin (binding)
> - Chris Riccomini (binding)
> - Sumit Maheshwari  (binding)
>
> - Kengo Seki  (non-binding)
>
> Vote thread (start):
> *http://mail-archives.apache.org/mod_mbox/incubator-
> airflow-dev/201706.mbox/%3CCAHEEp7XRRk__hGUMjOCw%2BTW0Gc--
> 78qEewcsAsQBLrv1x6j71w%40mail.gmail.com%3E
> <http://mail-archives.apache.org/mod_mbox/incubator-
> airflow-dev/201706.mbox/%3CCAHEEp7XRRk__hGUMjOCw%2BTW0Gc--
> 78qEewcsAsQBLrv1x6j71w%40mail.gmail.com%3E>*
>
> Next steps:
> 1) will start the voting process at the IPMC mailinglist. I don’t expect
> changes.
> 2) Only after the positive voting on the IPMC and finalisation I will
> rebrand the RC to Release.
> 3) I will upload it to the incubator release page, then the tar ball needs
> to propagate to the mirrors.
> 4) Update the website
> 5) Finally, will upload to Pypi.
>
> Cheers,
>
> Max
>
> On Mon, Jul 3, 2017 at 12:11 PM, Bolke de Bruin <bdbruin@gmail.com> wrote:
>
> > Ping?
> >
> >
> > > On 30 Jun 2017, at 14:21, Bolke de Bruin <bdbruin@gmail.com> wrote:
> > >
> > > Max,
> > >
> > > I think you can close the vote?
> > >
> > > Bolke
> > >
> > >> On 27 Jun 2017, at 02:45, Kengo Seki <sekikn@apache.org> wrote:
> > >>
> > >> +1 (non-binding)
> > >>
> > >> - verified signatures and checksums
> > >> - ran scheduler and webserver, confirmed they worked fine
> > >> - confirmed the latest fix on v1.8 branch (AIRFLOW-809) is included
> > >>
> > >> Kengo Seki <sekikn@apache.org>
> > >>
> > >>
> > >> 2017-06-27 8:53 GMT+09:00 Chris Riccomini <criccomini@apache.org>:
> > >>> +1 (binding)
> > >>>
> > >>> Been running in our dev env, and everything looks good.
> > >>>
> > >>> On Mon, Jun 26, 2017 at 3:00 PM, Alex Guziel <alex.guziel@airbnb.com
> .
> > invalid
> > >>>> wrote:
> > >>>
> > >>>> Yeah that makes sense. It pages by default at 500 so it explains
why
> > we saw
> > >>>> it.
> > >>>>
> > >>>> On Mon, Jun 26, 2017 at 2:53 PM, Chris Riccomini <
> > criccomini@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> In 1.8.1, the "DAGs" page has "Show <blank> entries".
In 1.8.2, it
> > has
> > >>>>> "Show <25> entries". So it looks like prior to 1.8.2,
the
> pagination
> > was
> > >>>>> broken in the sense that it defaulted to the whole list. We
have
> 479
> > DAGs
> > >>>>> in one env, and it shows them all. It looks like someone fixed
the
> > entry
> > >>>> to
> > >>>>> default to 25 now, which exposed the problem for our environments.
> > >>>>>
> > >>>>> On Mon, Jun 26, 2017 at 2:47 PM, Alex Guziel <
> alex.guziel@airbnb.com
> > .
> > >>>>> invalid
> > >>>>>> wrote:
> > >>>>>
> > >>>>>> We're running 1.8.0 + some extras, and none of us added
pagination
> > >>>>>> recently, and our homepage is paginated. Are you sure it's
not the
> > >>>> number
> > >>>>>> of dags crossing the threshold? Maybe it's some Flask version
> thing?
> > >>>>>>
> > >>>>>> On Mon, Jun 26, 2017 at 2:45 PM, Chris Riccomini <
> > >>>> criccomini@apache.org>
> > >>>>>> wrote:
> > >>>>>>
> > >>>>>>> Yes, I did the 1.8.1 release.
> > >>>>>>>
> > >>>>>>> On Mon, Jun 26, 2017 at 2:44 PM, Alex Guziel <
> > alex.guziel@airbnb.com
> > >>>> .
> > >>>>>>> invalid
> > >>>>>>>> wrote:
> > >>>>>>>
> > >>>>>>>> There's no pagination in 1.8.1? Are you sure?
> > >>>>>>>>
> > >>>>>>>> On Mon, Jun 26, 2017 at 2:37 PM, Chris Riccomini
<
> > >>>>>> criccomini@apache.org>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> It's not happening on 1.8.1 (since there's
no pagination in
> that
> > >>>>>>>> version),
> > >>>>>>>>> so I'd count this as a regression. I wouldn't
say it's
> blocking,
> > >>>>> but
> > >>>>>>> it's
> > >>>>>>>>> pretty ugly.
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Jun 26, 2017 at 2:34 PM, Alex Guziel
<
> > >>>>> alex.guziel@airbnb.com
> > >>>>>> .
> > >>>>>>>>> invalid
> > >>>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> I'm not so sure this is a new issue. I
think we've seen it on
> > >>>> our
> > >>>>>>>>>> production for quite a while.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Jun 26, 2017 at 2:31 PM, Chris
Riccomini <
> > >>>>>>>> criccomini@apache.org>
> > >>>>>>>>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>> I am seeing a strange UI behavior on
1.8.2.RC2. I've opened a
> > >>>>>> JIRA
> > >>>>>>>>> here:
> > >>>>>>>>>>>
> > >>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1348
> > >>>>>>>>>>>
> > >>>>>>>>>>> Has anyone else seen this?
> > >>>>>>>>>>>
> > >>>>>>>>>>> On Mon, Jun 26, 2017 at 3:27 AM, Sumit
Maheshwari <
> > >>>>>>>>>> sumeet.manit@gmail.com>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>
> > >>>>>>>>>>>> +1, binding.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On Mon, Jun 26, 2017 at 3:49 PM,
Bolke de Bruin <
> > >>>>>>> bdbruin@gmail.com
> > >>>>>>>>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> We have been running it for
the last couple of days. No
> > >>>>>> issues
> > >>>>>>>> and
> > >>>>>>>>>>> seems
> > >>>>>>>>>>>>> more responsive.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> +1, binding
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> Bolke
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On 25 Jun 2017, at 01:10,
Maxime Beauchemin <
> > >>>>>>>>>>>> maximebeauchemin@gmail.com>
> > >>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Dear all,
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> 1.8.2 RC2 is baked and
available at:
> > >>>>>>>>>>>>>> https://dist.apache.org/repos/
> > >>>> dist/dev/incubator/airflow
> > >>>>> ,
> > >>>>>>>> public
> > >>>>>>>>>>> keys
> > >>>>>>>>>>>>>> are available
> > >>>>>>>>>>>>>> at https://dist.apache.org/repos/
> > >>>>>>>> dist/release/incubator/airflow.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Note that RC1 was the first
RC (skipped RC0) and was
> > >>>>> never
> > >>>>>>>>>> announced
> > >>>>>>>>>>>>> since
> > >>>>>>>>>>>>>> it had issues coming out
of the oven, so RC2 is the
> > >>>> first
> > >>>>>>>> public
> > >>>>>>>>>> RC.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> 1.8.2 RC2 is build on to
of 1.8.1 with these listed
> > >>>>>>> "cherries"
> > >>>>>>>> on
> > >>>>>>>>>>> top.
> > >>>>>>>>>>>> I
> > >>>>>>>>>>>>>> added the JIRAs that were
identified blockers and
> > >>>>> targeted
> > >>>>>>>>> 1.8.2. I
> > >>>>>>>>>>>>>> attempted to bring in all
of the JIRAs that targeted
> > >>>>> 1.8.2
> > >>>>>>> but
> > >>>>>>>>>> bailed
> > >>>>>>>>>>>> on
> > >>>>>>>>>>>>>> the ones that were generating
merge conflicts. I also
> > >>>>> added
> > >>>>>>> all
> > >>>>>>>>> of
> > >>>>>>>>>>> the
> > >>>>>>>>>>>>>> JIRAs that we've been running
in production at Airbnb.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Issues fixed:
> > >>>>>>>>>>>>>> 9a53e66 [AIRFLOW-809][AIRFLOW-1]
Use __eq__
> > >>>>> ColumnOperator
> > >>>>>>> When
> > >>>>>>>>>>> Testing
> > >>>>>>>>>>>>>> Booleans
> > >>>>>>>>>>>>>> 333e0b3 [AIRFLOW-1296]
Propagate SKIPPED to all
> > >>>>> downstream
> > >>>>>>>> tasks
> > >>>>>>>>>>>>>> 93825d5 [AIRFLOW-XXX] Re-enable
caching for hadoop
> > >>>>>> components
> > >>>>>>>>>>>>>> 33a9dcb [AIRFLOW-XXX] Pin
Hive and Hadoop to a specific
> > >>>>>>> version
> > >>>>>>>>> and
> > >>>>>>>>>>>>> create
> > >>>>>>>>>>>>>> writable warehouse dir
> > >>>>>>>>>>>>>> 7cff6cd [AIRFLOW-1308]
Disable nanny usage for Dask
> > >>>>>>>>>>>>>> 570b2ed [AIRFLOW-1294]
Backfills can loose tasks to
> > >>>>> execute
> > >>>>>>>>>>>>>> 3f48d48 [AIRFLOW-1291]
Update NOTICE and LICENSE files
> > >>>> to
> > >>>>>>> match
> > >>>>>>>>> ASF
> > >>>>>>>>>>>>>> requirements
> > >>>>>>>>>>>>>> 69bd269 [AIRFLOW-1160]
Update Spark parameters for
> > >>>> Mesos
> > >>>>>>>>>>>>>> 9692510 [AIRFLOW 1149][AIRFLOW-1149]
Allow for custom
> > >>>>>> filters
> > >>>>>>>> in
> > >>>>>>>>>>> Jinja2
> > >>>>>>>>>>>>>> templates
> > >>>>>>>>>>>>>> 6de5330 [AIRFLOW-1119]
Fix unload query so headers are
> > >>>> on
> > >>>>>>> first
> > >>>>>>>>>> row[]
> > >>>>>>>>>>>>>> b4e9eb8 [AIRFLOW-1089]
Add Spark application arguments
> > >>>>>>>>>>>>>> a4083f3 [AIRFLOW-1078]
Fix latest_runs endpoint for old
> > >>>>>> flask
> > >>>>>>>>>>> versions
> > >>>>>>>>>>>>>> 7a02841 [AIRFLOW-1074]
Don't count queued tasks for
> > >>>>>>> concurrency
> > >>>>>>>>>>> limits
> > >>>>>>>>>>>>>> a2c18a5 [AIRFLOW-1064]
Change default sort to job_id
> > >>>> for
> > >>>>>>>>>>>>>> TaskInstanceModelView
> > >>>>>>>>>>>>>> d1c64ab [AIRFLOW-1038]
Specify celery serialization
> > >>>>> options
> > >>>>>>>>>>> explicitly
> > >>>>>>>>>>>>>> b4ee88a [AIRFLOW-1036]
Randomize exponential backoff
> > >>>>>>>>>>>>>> 9fca409 [AIRFLOW-993] Update
date inference logic
> > >>>>>>>>>>>>>> 272c2f5 [AIRFLOW-1167]
Support microseconds in FTPHook
> > >>>>>>>>> modification
> > >>>>>>>>>>>> time
> > >>>>>>>>>>>>>> c7c0b72 [AIRFLOW-1179]
Fix Pandas 0.2x breaking Google
> > >>>>>>> BigQuery
> > >>>>>>>>>>> change
> > >>>>>>>>>>>>>> acd0166 [AIRFLOW-1263]
Dynamic height for charts
> > >>>>>>>>>>>>>> 7f33f6e [AIRFLOW-1266]
Increase width of gantt y axis
> > >>>>>>>>>>>>>> fc33c04 [AIRFLOW-1290]
set docs author to 'Apache
> > >>>>> Airflow'
> > >>>>>>>>>>>>>> 2e9eee3 [AIRFLOW-1282]
Fix known event column sorting
> > >>>>>>>>>>>>>> 2389a8a [AIRFLOW-1166]
Speed up
> > >>>>>>> _change_state_for_tis_without_
> > >>>>>>>>>> dagrun
> > >>>>>>>>>>>>>> bf966e6 [AIRFLOW-1192]
Some enhancements to
> > >>>>> qubole_operator
> > >>>>>>>>>>>>>> 57d5bcd [AIRFLOW-1281]
Sort variables by key field by
> > >>>>>> default
> > >>>>>>>>>>>>>> 802fc15 [AIRFLOW-1244]
Forbid creation of a pool with
> > >>>>> empty
> > >>>>>>>> name
> > >>>>>>>>>>>>>> 1232b6a [AIRFLOW-1243]
DAGs table has no default
> > >>>> entries
> > >>>>> to
> > >>>>>>>> show
> > >>>>>>>>>>>>>> b0ba3c9 [AIRFLOW-1227]
Remove empty column on the Logs
> > >>>>> view
> > >>>>>>>>>>>>>> c406652 [AIRFLOW-1226]
Remove empty column on the Jobs
> > >>>>> view
> > >>>>>>>>>>>>>> 51a83cc [AIRFLOW-1199]
Fix create modal
> > >>>>>>>>>>>>>> cac7d4c [AIRFLOW-1200]
Forbid creation of a variable
> > >>>> with
> > >>>>>> an
> > >>>>>>>>> empty
> > >>>>>>>>>>> key
> > >>>>>>>>>>>>>> 5f3ee52 [AIRFLOW-1186]
Sort dag.get_task_instances by
> > >>>>>>>>>> execution_date
> > >>>>>>>>>>>>>> f446c08 [AIRFLOW-1145]
Fix closest_date_partition
> > >>>>> function
> > >>>>>>> with
> > >>>>>>>>>>> before
> > >>>>>>>>>>>>> set
> > >>>>>>>>>>>>>> to True If we're looking
for the closest date before,
> > >>>> we
> > >>>>>>> should
> > >>>>>>>>>> take
> > >>>>>>>>>>>> the
> > >>>>>>>>>>>>>> latest date in the list
of date before.
> > >>>>>>>>>>>>>> 93b8e96 [AIRFLOW-1180]
Fix flask-wtf version for
> > >>>>>>>>>> test_csrf_rejection
> > >>>>>>>>>>>>>> bb56805 [AIRFLOW-1170]
DbApiHook insert_rows inserts
> > >>>>>>> parameters
> > >>>>>>>>>>>>> separately
> > >>>>>>>>>>>>>> 093b2f0 [AIRFLOW-1150]
Fix scripts execution in
> > >>>> sparksql
> > >>>>>>> hook[]
> > >>>>>>>>>>>>>> 777f181 [AIRFLOW-1168]
Add closing() to all connections
> > >>>>> and
> > >>>>>>>>> cursors
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Max
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>
> > >>>>
> > >
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message