oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Mattmann <chris.mattm...@gmail.com>
Subject Re: Multiple Processing Paradigms at Once
Date Wed, 06 Aug 2014 15:50:00 GMT
Hi Mike,

I think you are using the wengine branch of Apache OODT.
That is unmaintained. I would sincerely urge you to get
this working in trunk, that's where the developers are working
right now.


P.S. Let me think more about the below I have some ideas there.

Chris Mattmann

-----Original Message-----
From: Michael Starch <starchmd@umich.edu>
Reply-To: <dev@oodt.apache.org>
Date: Wednesday, August 6, 2014 8:29 AM
To: <dev@oodt.apache.org>
Subject: Multiple Processing Paradigms at Once

>I am working on upgrading OODT to allow it to process streaming data,
>alongside traditional non-streaming jobs.  This means that some jobs need
>to be run by the resource manager, and other jobs need to be submitted to
>the stream-processing.  Therefore, processing needs to be forked or
>multiplexed at some point in the life-cycle.
>There are two places where this can be done: workflow manager runners, and
>the resource manager.  Currently, I am  working on building workflow
>runners, and doing the job-multiplexing there because this cuts out one
>superfluous step for the streaming jobs (namely going to the resource
>manager before being routed).
>Are there any comments on this approach or does this approach make sense?
>-Michael Starch

View raw message