streams-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Franklin <m.ben.frank...@gmail.com>
Subject Re: Springcleaning Branch + Discussion
Date Fri, 11 Apr 2014 19:36:47 GMT
On Fri, Apr 11, 2014 at 10:40 AM, Steve Blackmon <sblackmon@apache.org>wrote:

> Following up on springcleaning:
>
> Immediately below is a ticket-level summary of work performed in the
> springcleaning branch that is ready to merge.
>
> Further below are tickets that I think are appropriate to add
> regarding 'work-in-progress' items currently in springcleaning and
> master.
>
> I promise to be better about opening tickets and soliciting ideas and
> feedback prior to building and pushing going forward.
>
> You should see these tickets go into JIRA shortly.
>
> Steve
>
> -------
>
> Improve pom dependency management - move version declarations to
> appropriate modules & use properties
> Build counter interfaces & have streams-runtime-local automatically
> launch threads to log current counters for runtime handoff points, and
> for any streams component implementing counter interface
> Remove logging implementation dependencies from all modules other than
> runtimes
> Move all runtime implementations below streams-runtimes module
> Move all database libraries below streams-contrib module
> Implement object mapper that handles jodatime <-> RFC3397 strings
> Implement pig UDF wrappers for activityserializer and processor
> Resolve synchronization and dropped documents in persist-hdfs
> Resolve synchronization and dropped documents in persist-elasticsearch
>
> --
>
> Complete, test, and document datasift provider
> Complete, test, and document facebook public stream provider
> Complete, test, and document gnip-powertrack provider
> Complete, test, and document g+ provider
> Complete, test, and document sysomos provider
> Complete, test, and document mongo persist
> Complete, test, and document hbase persist
> Complete, test, and document kafka persist
> Complete, test, and document lucene processor
> Complete, test, and document tika processor
> Complete, test, and document urls processor
> Complete, test, and document storm runtime
>

I think we need another to document the architecture of these components
and where to get started on the website.  Right now, the only diagram we
have is the Camel one.


>
> On Mon, Apr 7, 2014 at 6:02 PM, Steve Blackmon <steve@blackmon.org> wrote:
> > The branch contains miscellaneous cleanup to poms, a pig runtime
> > binding, and a few new modules.  I think the branch could be merged -
> > I will solicit a group review and vote soon.  This is the first time
> > I'm moved around modules others had created, in the spirit of
> > organization and naming consistency with some of our latest commits.
> > Feel free to browse the branch commit logs and additions to
> > http://github.com/w2ogroup/streams-examples (which now have READMEs!)
> >
> > Best,
> > Steve Blackmon
> >
> > On Mon, Apr 7, 2014 at 4:45 PM, Matt Franklin <m.ben.franklin@gmail.com>
> wrote:
> >> On Mon, Apr 7, 2014 at 4:33 PM, Chris Geer <chris@cxtsoftware.com>
> wrote:
> >>
> >>> Ah, was looking here.
> >>>
> >>> https://github.com/apache/streams
> >>>
> >>> Why two different repos?
> >>>
> >>
> >> My guess is that when we converted to git, INFRA did not disable the SVN
> >> mirror.
> >>
> >>
> >>>
> >>>
> >>> On Mon, Apr 7, 2014 at 3:22 PM, Matt Franklin <
> m.ben.franklin@gmail.com
> >>> >wrote:
> >>>
> >>> > On Mon, Apr 7, 2014 at 4:05 PM, Chris Geer <chris@cxtsoftware.com>
> >>> wrote:
> >>> >
> >>> > > I'm not seeing that branch @ github. Which one are you referring
> to?
> >>> > >
> >>> >
> >>> > https://github.com/apache/incubator-streams/tree/springcleaning
> >>> >
> >>> >
> >>> > >
> >>> > >
> >>> > > On Mon, Apr 7, 2014 at 2:56 PM, Matt Franklin <
> >>> m.ben.franklin@gmail.com
> >>> > > >wrote:
> >>> > >
> >>> > > > What is the status of the Spring Cleaning branch? I see a
lot of
> work
> >>> > > going
> >>> > > > on there, but don't see the issue it is associated with?
> >>> > > >
> >>> > > > Everything I see looks like it is great, but I think we need
to
> >>> > increase
> >>> > > > the communication around some of these major efforts.
> >>> > > >
> >>> > >
> >>> >
> >>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message