drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arina Yelchiyeva <arina.yelchiy...@gmail.com>
Subject Re: [DISCUSS] Drill 1.12.0 release
Date Mon, 27 Nov 2017 16:52:19 GMT
Current status:

DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - fix is expected by the EOD in new pull request.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - unit test failures are fixed. Unit test performance
degraded x3 times!

Kind regards

On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - could not cherry-pick the commits. Needs fix.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - there are unit test failures. Needs fix.
>
> Kind regards
>
> On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <akumarb2010@gmail.com>
> wrote:
>
>> Hi Arina,
>>
>> Sorry for the delay. Just now we squashed Kafka storage plugin commits
>> into
>> one commit and pushed.
>>
>> Thanks & Regards,
>> B Anil Kumar.
>>
>> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com> wrote:
>>
>> > Current status:
>> >
>> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> code
>> > reviewer - Paul) - needs to squash the commits.
>> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> > reviewer - Paul) - needs to address some code review comments.
>> >
>> > Kind regards
>> > Arina
>> >
>> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
>> > arina.yelchiyeva@gmail.com> wrote:
>> >
>> > > Current status, we are close to the code freeze which will happen not
>> > > later then the end of the next week.
>> > >
>> > > Blocker:
>> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>> code
>> > > reviewer - Arina) - in progress.
>> > >
>> > > Targeted for 1.12 release:
>> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> code
>> > > reviewer - Paul) - needs next round of code review.
>> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>> waiting
>> > > for Parth code review.
>> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>> code
>> > > reviewer - Tim) - code review is done, waiting for the merge.
>> > >
>> > > Kind regards
>> > >
>> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cshi@mapr.com> wrote:
>> > >
>> > >> Hi Arina,
>> > >>
>> > >>
>> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>> > >> loading schema for storage plugins. Could you or Paul take a look at
>> the
>> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032?
>> I
>> > >> think both of you are familiar with this part.
>> > >>
>> > >>
>> > >> Thanks,
>> > >>
>> > >>
>> > >> Chunhui
>> > >>
>> > >> ________________________________
>> > >> From: Arina Yelchiyeva <arina.yelchiyeva@gmail.com>
>> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
>> > >> To: dev@drill.apache.org
>> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
>> > >>
>> > >> Yes, they are already in master.
>> > >>
>> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cgivre@gmail.com>
>> wrote:
>> > >>
>> > >> > We’re including the Networking functions in this release right?
>> > >> >
>> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>> > >> arina.yelchiyeva@gmail.com>
>> > >> > wrote:
>> > >> > >
>> > >> > > If changes will be done before cut off date, targeting mid
>> November
>> > >> that
>> > >> > it
>> > >> > > will be possible to include this Jira.
>> > >> > >
>> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cgivre@gmail.com>
>> > >> wrote:
>> > >> > >
>> > >> > >> Hi Arina,
>> > >> > >> Can we include DRILL-4091 Support for additional GIS
operations
>> in
>> > >> > version
>> > >> > >> 1.12?  In general the code looked pretty good.  There
was a unit
>> > test
>> > >> > >> missing which the developer submitted and some minor
formatting
>> > >> issues
>> > >> > >> which I’m still waiting on.
>> > >> > >> Thanks,
>> > >> > >> —C
>> > >> > >>
>> > >> > >>
>> > >> > >>
>> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>> > >> arina.yelchiyeva@gmail.com
>> > >> > >
>> > >> > >> wrote:
>> > >> > >>>
>> > >> > >>> Current status:
>> > >> > >>>
>> > >> > >>> Blocker:
>> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer
-
>> Vlad
>> > R.,
>> > >> > code
>> > >> > >>> reviewer - ?) - in progress.
>> > >> > >>>
>> > >> > >>> Targeted for 1.12 release:
>> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy
& Vlad S.,
>> code
>> > >> > >> reviewer -
>> > >> > >>> Arina) - code review in final stage.
>> > >> > >>> DRILL-4779: Kafka storage plugin support (developer
- Anil &
>> > Kamesh,
>> > >> > code
>> > >> > >>> reviewer - Paul) - in review.
>> > >> > >>> DRILL-5943: Avoid the strong check introduced by
DRILL-5582 for
>> > >> PLAIN
>> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth
&
>> Laurent) -
>> > >> > waiting
>> > >> > >>> for the code review.
>> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer
-
>> > Arina,
>> > >> > code
>> > >> > >>> reviewer - Tim) - waiting for the code review.
>> > >> > >>>
>> > >> > >>> Kind regards
>> > >> > >>> Arina
>> > >> > >>>
>> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva
<
>> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
>> > >> > >>>
>> > >> > >>>> Current status:
>> > >> > >>>>
>> > >> > >>>> Targeted for 1.12 release:
>> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> > >> rather
>> > >> > >> than
>> > >> > >>>> mock (developer - Paul, code reviewer - ?) -
waiting for the
>> code
>> > >> > review
>> > >> > >>>> DRILL-5842: Refactor and simplify the fragment,
operator
>> contexts
>> > >> for
>> > >> > >>>> testing (developer - Paul, code reviewer - ?)
- waiting for
>> the
>> > >> code
>> > >> > >>>> review
>> > >> > >>>> DRILL-5834: Adding network functions (developer
- Charles,
>> code
>> > >> > reviewer
>> > >> > >>>> - Arina) - waiting changes after code review
>> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy,
code
>> reviewer -
>> > >> > >> Arina) - waiting
>> > >> > >>>> for the code review
>> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string
by default
>> > >> > (developer -
>> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
>> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer
- Anil,
>> code
>> > >> > >> reviewer
>> > >> > >>>> - ?) - finishing implementation
>> > >> > >>>>
>> > >> > >>>> Under question:
>> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer
-
>> Jyothsna,
>> > >> code
>> > >> > >>>> reviewer - ?) - waiting for the status update
from the
>> developer
>> > >> > >>>>
>> > >> > >>>> Please free to suggest other items that are targeted
for 1.12
>> > >> release.
>> > >> > >>>> There are many Jiras that have fix version marked
as 1.12, it
>> > >> would be
>> > >> > >> good
>> > >> > >>>> if developers revisit them and update fix version
to the
>> actual
>> > >> one.
>> > >> > >>>> Link to the dashboard - https://issues.apache.org/
>> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>> > >> > DRILL&view=detail
>> > >> > >>>>
>> > >> > >>>> Kind regards
>> > >> > >>>> Arina
>> > >> > >>>>
>> > >> > >>>>
>> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra
<
>> > parthc@apache.org>
>> > >> > >> wrote:
>> > >> > >>>>
>> > >> > >>>>> I'm waiting to merge the SSL  changes in.
Waiting a couple of
>> > days
>> > >> > >> more to
>> > >> > >>>>> see if there are any more comments before
I merge the changes
>> > in.
>> > >> > >>>>>
>> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers
<
>> progers@mapr.com>
>> > >> > wrote:
>> > >> > >>>>>
>> > >> > >>>>>> Hi Arina,
>> > >> > >>>>>>
>> > >> > >>>>>> In addition to my own PRs, there are
several in the “active”
>> > >> queue
>> > >> > >> that
>> > >> > >>>>> we
>> > >> > >>>>>> could get in if we can just push them
over the line and
>> clear
>> > the
>> > >> > >> queue.
>> > >> > >>>>>> The owners of the PRs should check if
we are waiting on
>> them to
>> > >> take
>> > >> > >>>>> action.
>> > >> > >>>>>>
>> > >> > >>>>>> 977     DRILL-5849: Add freemarker lib
to
>> dependencyManagement
>> > to
>> > >> > >> ensure
>> > >> > >>>>>> prop…
>> > >> > >>>>>> 976     DRILL-5797: Choose parquet reader
from read columns
>> > >> > >>>>>> 975     DRILL-5743: Handling column family
and column scan
>> for
>> > >> hbase
>> > >> > >>>>>> 973     DRILL-5775: Select * query on
a maprdb binary table
>> > fails
>> > >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter
pushdown for the case
>> of
>> > >> > nested
>> > >> > >>>>>> field (reg. of DRILL-4264)
>> > >> > >>>>>> 950     Drill 5431: SSL Support
>> > >> > >>>>>> 949     DRILL-5795: Parquet Filter push
down at rowgroup
>> level
>> > >> > >>>>>> 936     DRILL-5772: Add unit tests to
indicate how utf-8
>> > support
>> > >> can
>> > >> > >> be
>> > >> > >>>>>> enabled / disabled in Drill
>> > >> > >>>>>> 904     DRILL-5717: change some date
time test cases with
>> > >> specific
>> > >> > >>>>>> timezone or Local
>> > >> > >>>>>> 892     DRILL-5645: negation of expression
causes null
>> pointer
>> > >> > >> exception
>> > >> > >>>>>> 889     DRILL-5691: enhance scalar sub
queries checking for
>> the
>> > >> > >>>>> cartesian
>> > >> > >>>>>> join
>> > >> > >>>>>>
>> > >> > >>>>>> (Items not on the list above have become
“inactive” for a
>> > >> variety of
>> > >> > >>>>>> reasons.)
>> > >> > >>>>>>
>> > >> > >>>>>> Thanks,
>> > >> > >>>>>>
>> > >> > >>>>>> - Paul
>> > >> > >>>>>>
>> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul
Rogers <progers@mapr.com>
>> > >> wrote:
>> > >> > >>>>>>>
>> > >> > >>>>>>> Hi Arina,
>> > >> > >>>>>>>
>> > >> > >>>>>>> I’d like to include the following
that are needed to
>> finish up
>> > >> the
>> > >> > >>>>>> “managed” sort and spill-to-disk
for hash agg:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory
allocation
>> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator
strictness for
>> > >> "managed"
>> > >> > >>>>>> operators
>> > >> > >>>>>>> #960, DRILL-5815: Option to set query
memory as percent of
>> > total
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following is needed to resolve
issues with HBase
>> support
>> > in
>> > >> > empty
>> > >> > >>>>>> batches:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions
to MapR DB from
>> > DRILL-5546
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following are nice-to-haves that
build on work already
>> > done
>> > >> in
>> > >> > >>>>> this
>> > >> > >>>>>> release, and that some of my own work
depends on:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture
to use
>> > >> > SystemOptionManager
>> > >> > >>>>>> rather than mock
>> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify
the fragment,
>> operator
>> > >> > >>>>> contexts
>> > >> > >>>>>> for testing
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following is not needed for 1.12
per-se, but is the
>> > >> foundation
>> > >> > >>>>> for a
>> > >> > >>>>>> project I’m working on; would be good
to get this in after
>> 2-3
>> > >> > months
>> > >> > >> of
>> > >> > >>>>>> review time:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #921, foundation for batch size limitation
>> > >> > >>>>>>>
>> > >> > >>>>>>> The key issue with each of the above
is that they each
>> need a
>> > >> > >>>>> committer
>> > >> > >>>>>> to review. Some have reviews from non-committers.
Any
>> > volunteers?
>> > >> > >>>>>>>
>> > >> > >>>>>>> Thanks,
>> > >> > >>>>>>>
>> > >> > >>>>>>> - Paul
>> > >> > >>>>>>>
>> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles
Givre <
>> cgivre@gmail.com>
>> > >> > wrote:
>> > >> > >>>>>>>>
>> > >> > >>>>>>>> Hi Arina,
>> > >> > >>>>>>>> I’d like to include Drill-5834,
Adding network functions.
>> > >> > >>>>>>>> https://github.com/apache/drill/pull/971
<
>> > >> > >> https://github.com/apache/
>> > >> > >>>>>> drill/pull/971>
>> > >> > >>>>>>>>
>> > >> > >>>>>>>> Hopefully I didn’t violate
too many coding standards this
>> > time
>> > >> ;-)
>> > >> > >>>>>>>> —C
>> > >> > >>>>>>>>
>> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM,
Arina Yelchiyeva <
>> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> I want to include DRILL-5337
(OpenTSDB plugin), I'll try
>> to
>> > >> > finish
>> > >> > >>>>> code
>> > >> > >>>>>>>>> review during this week.
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> Kind regards
>> > >> > >>>>>>>>> Arina
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08
PM, Arina Ielchiieva <
>> > >> > arina@apache.org
>> > >> > >>>
>> > >> > >>>>>> wrote:
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>>> Hi Drillers,
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> It's been several months
since the last release and it
>> is
>> > >> time
>> > >> > to
>> > >> > >>>>> do
>> > >> > >>>>>> the
>> > >> > >>>>>>>>>> next one. I am volunteering
to be the release manager.
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> If there are any issues
on which work is in progress,
>> that
>> > >> you
>> > >> > >>>>> feel we
>> > >> > >>>>>>>>>> *must* include in the
release, please post in reply to
>> this
>> > >> > >> thread.
>> > >> > >>>>>> Based
>> > >> > >>>>>>>>>> on your input we'll define
release cut off date.
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> Kind regards
>> > >> > >>>>>>>>>> Arina
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>
>> > >> > >>>>>>>
>> > >> > >>>>>>
>> > >> > >>>>>>
>> > >> > >>>>>
>> > >> > >>>>
>> > >> > >>>>
>> > >> > >>
>> > >> > >>
>> > >> >
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message