climate-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Goodman, Alexander (US 398K)" <alexander.good...@jpl.nasa.gov.INVALID>
Subject RE: [EXTERNAL] Re: [DISCUSS] Retire OCW?
Date Wed, 20 Nov 2019 16:08:28 GMT
Since the plots didn't attach in the last message, here they are:

https://i.imgur.com/mAuq0R5.png
https://i.imgur.com/TeRYSPI.png

Thanks,
Alex
-----Original Message-----
From: Goodman, Alexander (US 398K) <alexander.goodman@jpl.nasa.gov.INVALID> 
Sent: Wednesday, November 20, 2019 8:05 AM
To: dev@climate.apache.org
Subject: RE: [EXTERNAL] Re: [DISCUSS] Retire OCW?

Hi Michael,

Please see this overview slide:
https://i.imgur.com/VnijQ5C.png

Here is also a link of some older slides which have a lot more details:
https://docs.google.com/presentation/d/1nhD3_fZmVcmBnq9NiMBYeDMsxr5kIimI7dE9NNUQJEM/edit?usp=sharing

I also created an end-to-end processing benchmark that I compared with the current OCW, which
I have attached in two plots: One with regridding and one without, since the difference is
so vast. I first presented these results at the AMS Annual meeting last year in Phoenix.

Let me know if you have any questions.

Thanks,
Alex
-----Original Message-----
From: Michael Anderson <michael.arthur.anderson@gmail.com>
Sent: Tuesday, November 19, 2019 5:59 PM
To: dev@climate.apache.org
Subject: [EXTERNAL] Re: [DISCUSS] Retire OCW?

Do you have an overview of the new library you could share?  It'd be interesting how big the
gap between the old and new would be / rough LOE to add parity.

On Tue, Nov 19, 2019 at 7:35 PM Alex Goodman <goodman@apache.org> wrote:

> Hi Lewis,
>
> To add some more specifics, the new xarray-based API I have developed 
> for OCW called BCDP (Big Climate Data Pipeline) has recently been 
> approved for release to open source. Keep in mind, this is a 
> completely new API that is not backwards compatible, so we were 
> planning to maintain both the old and new API under one repository 
> (either as separate subfolders or git
> branches) until the new API has enough functionality to fully replace 
> the old one. To accelerate this process and encourage more 
> development, both Kyo and I are seeking some additional funding 
> sources which we should be more certain about early next year. When I 
> first conceived BCDP, I was originally planning on releasing it to 
> open source as a separate project outside of OCW, but after some 
> discussion we thought that it would be better to maintain the OCW brand for it if possible.
>
> Does this make sense?
>
> Thanks,
> Alex
> On 2019/11/20 00:17:22, lewis john mcgibbney <lewismc@apache.org> wrote:
> > I got this from Kyo offline
> >
> > “There is enough motivation to keep OCW going. Alex has almost 
> > refactored OCW and Seungwon Lee's CMDA will be a part of OCW.”
> >
> > Some of us will remember that CMDA was retired from the Apache 
> > Incubator previously.
> >
> > It would be great if these plans could be hashed out on the mailing 
> > list
> so
> > we can move forward either way.
> >
> > Lewis
> >
> > On Thu, Nov 14, 2019 at 09:32 Lewis John Mcgibbney < 
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > Hi Folks,
> > > Project activity is very low and new contributions are not being
> reviewed.
> > > Simply, is it time to retire OCW to the Apache Attic?
> > > Best
> > > Lewis
> > >
> > > --
> > >
> > > *Lewis*
> > > Dr. Lewis J. McGibbney Ph.D, B.Sc
> > > *Skype*: lewis.john.mcgibbney
> > >
> > >
> > >
> > > --
> > http://home.apache.org/~lewismc/
> > http://people.apache.org/keys/committer/lewismc
> >
>
Mime
View raw message