nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Burgess <>
Subject Re: [DISCUSS] Google Summer of Code 2018
Date Wed, 28 Feb 2018 13:33:08 GMT
Yes I do! Sorry all, I had sent the original message in haste to get
the information out for discussion, but didn't have the time at that
moment to share everything else, including my enthusiasm and some
actual ideas :) Here are some I came up with, note that many may not
be "industrial-strength" but still interesting student projects:

- Anything to do with provenance. Uwe has a wonderful idea that I will
respond to separately, but there are lots of applications and
approaches that can make use provenance, such as graph analytics (find
flow bottlenecks, e.g.), machine learning (predict likelihood of
reaching a failure connection based on attributes and/or content),
- An Apache Calcite adapter that can read from a NiFi Output Port.
This probably makes more sense from a SQL Streaming perspective than
emulating a relational DB, but is an interesting application of
Calcite and NiFi.
- An UpdateAttributeUsingJava processor (with a better name), this
could use Janino to quickly evaluate Java expressions that can
leverage attributes and perhaps all of Expression Language to perform
more powerful functions (without needing a full scripted processor)
- A RouteOnProbability processor, to support Monte Carlo simulations.
User-defined properties could have values whose sum is 1 and whose
keys become the outgoing relationship names.
- A SampleReservoir processor, to do reservoir sampling (good for
testing downstream flows without throwing a ton of data at it)
- YAML Record Reader/Writer

Looks like proposals are being accepted on March 18 (I don't know if
that's for students proposing/selecting projects or for organizations
to propose possible projects) , but there are a number of Apache Jira
issues already tagged as gsoc2018 [1].



On Wed, Feb 28, 2018 at 12:12 AM, Joe Witt <> wrote:
> Matt
> Did you have some ideas/features/enhancements in mind you think would
> be good to propose?
> Thanks
> Joe
> On Tue, Feb 27, 2018 at 6:56 PM, Matt Burgess <> wrote:
>> If you haven't heard yet, the Apache Software Foundation was selected
>> as an organization for this year's Google Summer of Code [1]. I've
>> seen activity on other Apache projects' mailing lists requesting ideas
>> for issues, features, components, etc. that could be good
>> proposals/ideas for GSoC, and I'd like to also make that request of
>> this community.
>> As Michael Mior (of Apache Calcite PMC) eloquently put it: "It's no
>> guarantee we would get someone to work on it, but it could be a good
>> push to move some isolated bits of functionality forward that may not
>> get much attention otherwise."
>> Thoughts?
>> Thanks in advance,
>> Matt
>> [1]

View raw message