flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andra Lungu <lungu.an...@gmail.com>
Subject Re: Gelly Roadmap
Date Wed, 03 Jun 2015 12:58:53 GMT
Hi Stephan,

Well the operators fro skewed graphs and the Gelly streaming project will
be done by the end of the semester. Otherwise Daniel and I won't graduate
:);
The Scala API is ongoing work (there is a link to the corresponding JIRA in
the roadmap);
The Library methods are in the making; First two are being written; the
second two are potential tasks for a Shivani, an intern I am supervising at
DIMA;
Graph Partitioning is also programmed for the near future. There is a JIRA
there with the corresponding conversations;
The generic iterations are still being discussed. We reached a conclusion
there, but as far as I know nobody is working on it yet;
Performance evaluation will probably be done with graphalytics, but that
and the bipartite graph support are future tasks (there is nobody working
on them yet);

The wish-list is exactly as its name states, a wish-list :) All the other
items are either currently addressed or will be addressed in the
foreseeable future.

The order is more or less the one on the roadmap. What's on the bottom is
more of a set of wishes, whereas the tasks at the beginning are considered
a priority and are being addressed.

Andra

On Wed, Jun 3, 2015 at 2:45 PM, Stephan Ewen <sewen@apache.org> wrote:

> Wow, this is an extremely big and ambitious roadmap.
>
> Are all these things realistically possible in the foreseeable future? Or
> is this more a wish-list?
>
> Do you have an idea what issues to approach in what order?
>
> On Wed, May 20, 2015 at 8:58 PM, Andra Lungu <lungu.andra@gmail.com>
> wrote:
>
> > The Roadmap is now available as a wiki page.
> > https://cwiki.apache.org/confluence/display/FLINK/Flink+Gelly
> >
> > We're still happy to hear comments/suggestions, if any :)
> >
> > On Wed, May 20, 2015 at 8:43 PM, Andra Lungu <lungu.andra@gmail.com>
> > wrote:
> >
> > > Thanks, Stephan!
> > >
> > > On Wed, May 20, 2015 at 8:42 PM, Stephan Ewen <sewen@apache.org>
> wrote:
> > >
> > >> All right, you should have permissions now.
> > >>
> > >> On Wed, May 20, 2015 at 8:37 PM, Andra Lungu <lungu.andra@gmail.com>
> > >> wrote:
> > >>
> > >> > Sure, but first I need permissions! :)
> > >> >
> > >> > "*NOTE*: Due to spamming, we can not give every confluence user edit
> > >> > permissions to the wiki. Just write to the dev@flink.apache.org
> (you
> > >> can
> > >> > also email to rmetzger <at> apache.org) mailing list to get
edit
> > >> > permissions."
> > >> >
> > >> > My user is lungu.andra
> > >> >
> > >> > Thanks!
> > >> >
> > >> > On Wed, May 20, 2015 at 4:27 PM, Vasiliki Kalavri <
> > >> > vasilikikalavri@gmail.com
> > >> > > wrote:
> > >> >
> > >> > > Thank you for your feedback and ideas everyone!
> > >> > >
> > >> > > @Andra, how about moving the roadmap to the wiki?
> > >> > >
> > >> > > On 20 May 2015 at 15:48, Kostas Tzoumas <ktzoumas@apache.org>
> > wrote:
> > >> > >
> > >> > > > :-D
> > >> > > >
> > >> > > > Great!
> > >> > > >
> > >> > > > On Tue, May 19, 2015 at 4:00 PM, Andra Lungu <
> > lungu.andra@gmail.com
> > >> >
> > >> > > > wrote:
> > >> > > >
> > >> > > > > Hi Kostas,
> > >> > > > >
> > >> > > > > We're way ahead of you! The first draft of the blog
post is
> > >> > internally
> > >> > > > > reviewed as we speak ;)
> > >> > > > >
> > >> > > > >
> > >> > > > > On Tue, May 19, 2015 at 3:49 PM, Kostas Tzoumas <
> > >> ktzoumas@apache.org
> > >> > >
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > > This is very cool!
> > >> > > > > >
> > >> > > > > > Would also love to see a blog post on Gelly at
some point,
> > >> perhaps
> > >> > > > > > finishing off with the roadmap
> > >> > > > > >
> > >> > > > > > On Tue, May 19, 2015 at 10:55 AM, Andra Lungu
<
> > >> > lungu.andra@gmail.com
> > >> > > >
> > >> > > > > > wrote:
> > >> > > > > >
> > >> > > > > > > Apache TinkerPop made it to the wish-list
:)
> > >> > > > > > > Thanks, Fabian!
> > >> > > > > > >
> > >> > > > > > > On Tue, May 19, 2015 at 9:42 AM, Flavio Pompermaier
<
> > >> > > > > > pompermaier@okkam.it>
> > >> > > > > > > wrote:
> > >> > > > > > >
> > >> > > > > > > > You're definitely right Fabian +1
> > >> > > > > > > >
> > >> > > > > > > > On Mon, May 18, 2015 at 2:03 PM, Fabian
Hueske <
> > >> > > fhueske@gmail.com>
> > >> > > > > > > wrote:
> > >> > > > > > > >
> > >> > > > > > > > > Integration with Apache TinkerPop3
could also be
> > >> interesting.
> > >> > > > > > > > > TinkerPop3 is an API for transactional
and analytical
> > >> graph
> > >> > > > > > processing
> > >> > > > > > > > and
> > >> > > > > > > > > supported by several Graph engines/databases.
> > >> > > > > > > > >
> > >> > > > > > > > > It might be interesting to see
if/how Gelly's and
> > >> TinkerPop's
> > >> > > > > > concepts
> > >> > > > > > > > > match and think about whether it
makes sense to
> > integrate
> > >> the
> > >> > > two
> > >> > > > > > > > projects
> > >> > > > > > > > > in some way.
> > >> > > > > > > > >
> > >> > > > > > > > > 2015-05-18 12:20 GMT+02:00 Gianmarco
De Francisci
> > Morales
> > >> <
> > >> > > > > > > > gdfm@apache.org
> > >> > > > > > > > > >:
> > >> > > > > > > > >
> > >> > > > > > > > > > Hi,
> > >> > > > > > > > > >
> > >> > > > > > > > > > Great job putting together
this roadmap!
> > >> > > > > > > > > >
> > >> > > > > > > > > > Regarding 1) you may find
this work relevant:
> > >> > > > > > > > > > http://arxiv.org/abs/1503.00626v1
> > >> > > > > > > > > >
> > >> > > > > > > > > > Regarding 2) the semi-streaming
model allows
> > polylog(n)
> > >> > > passes.
> > >> > > > > > > > > > If you allow only one pass,
it's a streaming model.
> > >> > > > > > > > > > In addition, I think models
such as the
> > turnstile/fully
> > >> > > dynamic
> > >> > > > > > (with
> > >> > > > > > > > > > addition and deletion) would
be more appropriate
> than
> > >> the
> > >> > > > > > incremental
> > >> > > > > > > > > one.
> > >> > > > > > > > > >
> > >> > > > > > > > > > Regarding 5) (when combined
with 2) there are some
> > good
> > >> > > recent
> > >> > > > > > > > algorithms
> > >> > > > > > > > > > for partitioning that you
might want to look at.
> > >> > > > > > > > > > http://dl.acm.org/citation.cfm?id=2556213
> > >> > > > > > > > > > http://dl.acm.org/citation.cfm?id=2339722
> > >> > > > > > > > > >
> > >> > > > > > > > > > Cheers,
> > >> > > > > > > > > >
> > >> > > > > > > > > > --
> > >> > > > > > > > > > Gianmarco
> > >> > > > > > > > > >
> > >> > > > > > > > > > On 18 May 2015 at 12:42, Vasiliki
Kalavri <
> > >> > > > > > vasilikikalavri@gmail.com
> > >> > > > > > > >
> > >> > > > > > > > > > wrote:
> > >> > > > > > > > > >
> > >> > > > > > > > > > > Hello everyone,
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > thank you Andra for putting
together this nice
> > >> document
> > >> > and
> > >> > > > for
> > >> > > > > > > > > sharing!
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > Gelly is already in a
state that matches the basic
> > >> > > > > functionality
> > >> > > > > > of
> > >> > > > > > > > > > > existing distributed
graph libraries. We're very
> > happy
> > >> > for
> > >> > > > this
> > >> > > > > > and
> > >> > > > > > > > > also
> > >> > > > > > > > > > > very grateful to everyone
who has contributed so
> > far!
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > We are also very excited
to keep on extending
> Gelly
> > >> and
> > >> > our
> > >> > > > > > vision
> > >> > > > > > > is
> > >> > > > > > > > > to
> > >> > > > > > > > > > > turn it into something
much more than "yet another
> > >> > library
> > >> > > > for
> > >> > > > > > > > running
> > >> > > > > > > > > > > PageRank-like algorithms".
The document that Andra
> > has
> > >> > > shared
> > >> > > > > > > > contains
> > >> > > > > > > > > > > ongoing work and our
ideas on mid- and long-term
> > >> plans,
> > >> > in
> > >> > > > > order
> > >> > > > > > to
> > >> > > > > > > > > make
> > >> > > > > > > > > > > this happen :)
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > We would love to get
the community's feedback on
> > >> this, so
> > >> > > > > please
> > >> > > > > > > feel
> > >> > > > > > > > > > free
> > >> > > > > > > > > > > to comment on the doc
or discuss individual points
> > >> here.
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > Cheers,
> > >> > > > > > > > > > > Vasia.
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > On 18 May 2015 at 11:01,
Andra Lungu <
> > >> > > lungu.andra@gmail.com>
> > >> > > > > > > wrote:
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > > Dear Squirrels,
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > The following document
is intended to give you
> an
> > >> > insight
> > >> > > > on
> > >> > > > > > > where
> > >> > > > > > > > > > > Flink's
> > >> > > > > > > > > > > > Graph API, Gelly,
is at the moment and
> especially
> > on
> > >> > the
> > >> > > > > > > direction
> > >> > > > > > > > in
> > >> > > > > > > > > > > which
> > >> > > > > > > > > > > > it's heading in
the near future.
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> https://docs.google.com/document/d/11ovK1xZZTl3Qinw6Ud1rqpaDhTvRHDv8PWBzcHITFkM/edit?usp=sharing
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > We would love to
hear about your comments/
> > >> suggestions/
> > >> > > > > > additions
> > >> > > > > > > > to
> > >> > > > > > > > > > the
> > >> > > > > > > > > > > > wish-list :)
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > Cheers,
> > >> > > > > > > > > > > > Andra
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message