Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A795E200B33 for ; Wed, 29 Jun 2016 14:09:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A6356160A57; Wed, 29 Jun 2016 12:09:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id ECDBD160A4D for ; Wed, 29 Jun 2016 14:09:21 +0200 (CEST) Received: (qmail 41930 invoked by uid 500); 29 Jun 2016 12:09:20 -0000 Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@oodt.apache.org Delivered-To: mailing list dev@oodt.apache.org Received: (qmail 41918 invoked by uid 99); 29 Jun 2016 12:09:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Jun 2016 12:09:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 05C461A7657 for ; Wed, 29 Jun 2016 12:09:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.78 X-Spam-Level: *** X-Spam-Status: No, score=3.78 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_DBL_ABUSE_BOTCC=2.5] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=meteorite-bi.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Ny7oyJfkG-nB for ; Wed, 29 Jun 2016 12:09:16 +0000 (UTC) Received: from mail-lf0-f52.google.com (mail-lf0-f52.google.com [209.85.215.52]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id DF9345FD0E for ; Wed, 29 Jun 2016 12:09:15 +0000 (UTC) Received: by mail-lf0-f52.google.com with SMTP id q132so31919562lfe.3 for ; Wed, 29 Jun 2016 05:09:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meteorite-bi.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=ID/ab/uq2p88IrIkqzSQb+tPKrUMVICfCL2cLeoTzAQ=; b=pUb3G25NnCiUcSE9SKvaHP3OK4AyoRn77asBdbE7TEnhkwGuPPP+9jE8xyvtq/4uEq 9ZuO0pcNk/2017RUZQMtLGCO/3jkhZ3E1hzq1hMnrdTeBFzKxNHl3t2LzOXea/2zHPIl wkaOR+8Fm6NLvVKqRb1tGBCnQoXpdwP3iv5Cro/I6ZztUGxS0SqOmYWX+0v4SE3bFeWJ agPUub+iRAPrgM57V9cDU7RyIoVaRSxi6SAFxpSM8lRYjUtTA3pRvjHd2PGwqrGjh35n CV0s3hHQGarYpKr9wciefsyHQgHOYeTHaQ3Kht705M4d3lpLnqp1NEb2IQm74uGT7DsH YXWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=ID/ab/uq2p88IrIkqzSQb+tPKrUMVICfCL2cLeoTzAQ=; b=fDfVsOLzXAz09MAu186odiyWQQIsNjzZeRZWhi7dna8bEuMkegPu1CS8wZVhzSdXp/ dgzg4/8wNic1oDeWaSVTW6iwZj2TI2szAv6Em9bTQ2J+yv7xJzksm33u/2CBH0QbuwQs EdvFjiqefO3s9f9yKyWiUFkCuwmGwdKQA33Dy7QirJBtdml1XdoJ8jasXqbE0dUQ7bgc 4N+mWWa0FDMjpLHwnQEzUtknYaGNPFS6sAHAzVG2ErHoJn2S+YvXgXE9QjSD+TlGNKQM KR1wqfRla1o8YQolJw8XQDYcDyl64AzXSLXTyctisk2s5CRetudzuCyO0kPQbgIFHSbj PnZw== X-Gm-Message-State: ALyK8tJ+5Yx3yH7L0SHGhYME8Hx1Q8QCb+8CyP2GFmtHBfGdBKUZUd3xTRbzu3fL8mGnBMC5IlLt3e8G9okyew== X-Received: by 10.25.22.70 with SMTP id m67mr2499315lfi.25.1467202153895; Wed, 29 Jun 2016 05:09:13 -0700 (PDT) MIME-Version: 1.0 Received: by 10.114.200.226 with HTTP; Wed, 29 Jun 2016 05:08:54 -0700 (PDT) In-Reply-To: References: From: Tom Barber Date: Wed, 29 Jun 2016 13:08:54 +0100 Message-ID: Subject: Re: [Discuss] Planning for 1.0 -> 2.0 To: "dev@oodt.apache.org" Content-Type: multipart/alternative; boundary=001a11406e54326f630536699fc6 archived-at: Wed, 29 Jun 2016 12:09:22 -0000 --001a11406e54326f630536699fc6 Content-Type: text/plain; charset=UTF-8 Oh and I want to finish off that website template I started and get an improved and easier to maintain website launched! Tom On Tue, Jun 28, 2016 at 11:43 PM, Tom Barber wrote: > Hello there folks, > > So I figured we might as well start a discussion about what we'd like OODT > 2.0 to look like. > > Personally I think there is a big bu0nch of cool stuff we could bring to > the platform that would extend and modernise it with minimal(ish) effort. > > Personal Priority: > > - Merging the long lost Avro implementation to rid us of XMLRPC :) > - Implement a Kafka pipeline under the hood for internal message > passing > - I mentioned this on the list a couple of weeks ago, implementing a > message pub/sub platform would allow for multiple components to subscribe > to a stream very easily, also it would allow us to persist messages for > audit purposes, giving users traceability within the platform. > - Revamp OpsUI with a Hue style interface > - if you've never used Hue, personally, its what I believe Ops UI for > OODT 2.0 should reflect (http://demo.gethue.com/) a central place > where people can adminster a lot of the common functionality of the system > without dropping down into weird scripts etc, and just nice and user > friendly. > - Integrate new Curator tool > - We have a new curator tool written by Mike Starch, its a great way > of ingesting data graphically and we'll look at getting it into OODT shortly > - Horizontal scale out capabilities > - Again, going back to a requirement I had earlier in the year, in my > case specifically around File Manager, but it should work across the board, > adding more file managers in different locations should work well and > scale out nicely without any scripting or hacks to make it work. > > > Nice to haves: > > - Improved workflows with CommonWL and other workflow additions > - Integrating with other workflows would be cool and help bring in a > more diverse userbase. > - Much improved REST interfaces > - Lets rid ourselves of Wicket and get some proper REST stuff in that > allows users to create new UI's easily and modify existing UI's to fit a > purpose. Of course REST interfaces can be hit programattically and by non > Java based programs which benifits other people. > - Depreciate of older modules > - There's a lot of stuff in OODT, lets give it a spring clean! > - Centralised Config with Gossip/Zookeeper > - Sort of in line with the horizontal scale, but to make it really > seamless, it would be great to use Gossip or ZK to centralise > configurations so that when new nodes are added everyone is aware, or when > stuff fails, leader election etc! > > > Thats my list off the top of my head, there will certainly be more, add > your own and we'll try and come up with a roadmap. > > I'm very interested to hear from users like Val, who have a more objective > opinion of OODT :) > > Thanks > > Tom > > --001a11406e54326f630536699fc6--