Mailing-List: contact ooo-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: ooo-dev@incubator.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAP-ksoi7CdW2EsXC8S-4iu4=uESNRdZ1kUP8DrTJ==jU5twxNA@mail.gmail.com>
References: 
 <CAP-ksog+fhtTuuHwvBUcAqF3rs25vFqtoFsEWj3kOwmOsrjm3Q@mail.gmail.com>
	<7889A547-AE0D-4F38-826A-BB512778DD41@comcast.net>
	<CAP-ksoi7CdW2EsXC8S-4iu4=uESNRdZ1kUP8DrTJ==jU5twxNA@mail.gmail.com>
Date: Mon, 28 May 2012 16:15:08 -0400
Message-ID: 
 <CAP-ksojGH4mKcYyajJv9Zx06oQ=fXs+PM-We_EwgBchcOyRrYA@mail.gmail.com>
Subject: Re: Download charts (prototype)
From: Rob Weir <robweir@apache.org>
To: ooo-dev@incubator.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Sun, May 27, 2012 at 7:09 PM, Rob Weir <robweir@apache.org> wrote:
> On Sun, May 27, 2012 at 4:03 PM, Dave Fisher <dave2wave@comcast.net> wrot=
e:
>> I know that this can be done in the CMS and buildbot. I want to find out=
 how exactly. Ping me in a few days.
>>
>
> Some quick design thoughts. =C2=A0 What I have now is a python script tha=
t
> generates CSV file for import into Calc. =C2=A0 This is good for general
> calculations and playing with the data, but it is not the exact format
> that the timeplot widget (http://www.simile-widgets.org/timeplot/)
> needs.
>
> The widget wants comma-separated values, with ISO date, daily count
> and cumulative count.
>
> So one easy technique is to maintain a data file with daily values for
> the above, and append a line to that data file each day. =C2=A0 I can ada=
pt
> the python script to spit out the new line of data to stdout, if you
> can figure out how we enable cron processing for ooo-site.
>

Just checked in a new script:

https://svn.apache.org/repos/asf/incubator/ooo/devtools/aoo-stats/get-aoo-s=
tats.py

This one takes a single command line arg, the date of interest, for example=
:

python get-aoo-stats.ppy 2012-05-28

It then writes out the download stats for that date to stdout.

-Rob
> As far as I can tell, the SourceForge stats are based on UTC, so the
> "day" ends at midnight UTC. =C2=A0However, there is a lag on the data, an=
d
> that lag appears to be variable. =C2=A0So we might need to take a
> conservative approach and collect the data for day N on day N+1 at
> 1200 UTC or something like that.
>
> Note: the widget makes it easy to plot other data sets as well. =C2=A0So =
if
> anyone has any other ideas for data that could be aggregated as some
> form of "project dashboard", let's discuss. =C2=A0For example, is there a=
ny
> easy way to get mailing list stats (posts? =C2=A0subscribers?), Bugzilla
> data (bugs created? =C2=A0bugs closed?) =C2=A0Forum stats? =C2=A0Even if =
the data can
> only be manually collected for now, we have the ability to add it.
>
> -Rob
>
>> Regards,
>> Dave
>>
>> Sent from my iPhone
>>
>> On May 26, 2012, at 11:29 AM, Rob Weir <robweir@apache.org> wrote:
>>
>>> http://people.apache.org/~robweir/aoo-downloads.html
>>>
>>> The data is in a text file
>>> (http://people.apache.org/~robweir/data.txt) which is generated using
>>> the SourceForge REST API plus some python, a variation of the script I
>>> uploaded earlier
>>> (https://svn.apache.org/repos/asf/incubator/ooo/devtools/aoo-stats/aoo-=
stats.py)
>>>
>>> Right now those two processes are unconnected. =C2=A0I generate the dat=
a on
>>> my laptop and upload an updated data.txt. =C2=A0Ideally I'd like to mig=
rate
>>> this to openoffice.org and =C2=A0automate this by running the python sc=
ript
>>> via cron on a daily basis.
>>>
>>> -Rob