Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@crunch.apache.org
Received-SPF: pass (nike.apache.org: domain of stepinto@live.com designates
 65.55.111.76 as permitted sender)
Message-ID: <BLU0-SMTP314A0FA91B63DBDC5940736ADFD0@phx.gbl>
MIME-Version: 1.0
In-Reply-To: 
 <CANb5z2LVDY4e4XLYP7jU+0J3DTd-J1Q1_0fntquyqUs5Zwrhbw@mail.gmail.com>
References: <BLU0-SMTP12513C2A3C2A7C5E15B6E89ADFC0@phx.gbl>
 <CANb5z2LVDY4e4XLYP7jU+0J3DTd-J1Q1_0fntquyqUs5Zwrhbw@mail.gmail.com>
From: Chao Shi <stepinto@live.com>
Date: Wed, 27 Feb 2013 14:56:31 +0800
Subject: Re: About status web page
To: dev@crunch.apache.org
Content-Type: multipart/alternative; boundary="089e011821cc59699604d6af476b"

--089e011821cc59699604d6af476b
Content-Type: text/plain; charset="ISO-8859-1"

It seems luigi uses a swig wrapper of graphviz. There is also a swig
wrapper for Java.

I also found Oozie has a nice GWT based
UI<https://issues.apache.org/jira/secure/attachment/12539680/Whole-Screen.png>.
But I think it too heavy. I'm open to other options.

On Wed, Feb 27, 2013 at 12:02 AM, Josh Wills <josh.wills@gmail.com> wrote:

> Hey Chao,
>
> I am woefully inept when it comes to data visualization technologies. What
> do the guys from Spotify do to visualize their workflows?
>
> https://github.com/spotify/luigi
>
> J
>
>
> On Mon, Feb 25, 2013 at 10:13 PM, Chao Shi <stepinto@live.com> wrote:
>
> > Hi Crunch Devs,
> >
> > I'm interested in adding a web status page to crunch. I'm working on a
> > prototype first, which simply runs a jetty server and renders the dot
> file
> > produced by DotFileWriter at browser. The dot rendering work is done by
> > viz.js <https://github.com/mdaines/viz.js>. It can successfully render
> the
> > plan into SVG.
> >
> > I think there are 2 issues I hit with viz.js:
> >
> > 1. The license of viz.js is unclear. It is compiled from GraphViz source
> > code with emscripten. GraphViz is Eclipse Public License 1.0.
> >
> > 2. viz.js is big and slow. It is a 1.4MB compressed JS. It takes 1 or 2
> > seconds on my laptop to render my pipeline (30+ MRs). I think it good to
> > have the graph refresh frequently and show the running status of the
> > pipeline (i.e. whether MRs are done or not). Thus the rendering time
> would
> > be too slow.
> >
> > Another approach is to call graphviz command at server side, if viz.js is
> > not possible. I can't find any pure Java implementation of graphviz.
> >
> > Looking forward to your advices.
> >
> > Thanks,
> > Chao
> >
>

--089e011821cc59699604d6af476b--