flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sachin Goel <sachingoel0...@gmail.com>
Subject Re: Web interface to submit jobs
Date Thu, 05 Nov 2015 11:04:45 GMT
Disabling the access for secure installation: Pretty easy. Writing it right
now.

@mxm: Thanks. I haven't implemented any handlers for actually running the
job. I hope to finish it by this weekend.

One quick question: The runtime monitor will be running the job itself,
i.e., the main method of program's entry class. Will that be a major issue,
that one thread is performing this work [although the server is capable to
handling several requests in parallel]?

-- Sachin Goel
Computer Science, IIT Delhi
m. +91-9871457685

On Thu, Nov 5, 2015 at 4:28 PM, Maximilian Michels <mxm@apache.org> wrote:

> @Robert: I'm in favor of having a submission page which can be deactivated.
> My point was simply that we don't have proper security support right now. I
> agree with Stephan that we'll need to support it!
>
> @Stephan: Good suggestion to disable the submission page for the per-job
> YARN cluster.
>
> @Sachin: Looks nice. Probably there should also be an option to view the
> plan like in the web client. Should not be so hard since we already have
> the visualization in place on other pages.
>
> On Thu, Nov 5, 2015 at 11:53 AM, Sachin Goel <sachingoel0101@gmail.com>
> wrote:
>
> > Ah. Sharing the links then:
> >
> >
> https://drive.google.com/file/d/0B0Xlv1qTgpjDT0ZCd0pSU3VYMUU/view?usp=sharing
> >
> >
> https://drive.google.com/file/d/0B0Xlv1qTgpjDeG51azRRc0FJYjQ/view?usp=sharing
> >
> >
> https://drive.google.com/file/d/0B0Xlv1qTgpjDSHZXQ0h5S0FBS3c/view?usp=sharing
> >
> > -- Sachin Goel
> > Computer Science, IIT Delhi
> > m. +91-9871457685
> >
> > On Thu, Nov 5, 2015 at 4:18 PM, Robert Metzger <rmetzger@apache.org>
> > wrote:
> >
> > > Hey Sachin, I think you can not upload images to apache mailing lists.
> > >
> > > On Thu, Nov 5, 2015 at 11:46 AM, Sachin Goel <sachingoel0101@gmail.com
> >
> > > wrote:
> > >
> > > > Okay. I think that does it. I've already designed the basic
> interface,
> > > > although the major part for uploading jars and actually running the
> job
> > > are
> > > > left. :')
> > > > Here are some screenshots:
> > > > [image: Inline image 2][image: Inline image 1][image: Inline image 3]
> > > >
> > > > -- Sachin Goel
> > > > Computer Science, IIT Delhi
> > > > m. +91-9871457685
> > > >
> > > > On Thu, Nov 5, 2015 at 4:12 PM, Maximilian Michels <mxm@apache.org>
> > > wrote:
> > > >
> > > >> +1 The web client needs to go.
> > > >>
> > > >> I don't really see how how a submission page on the job manager
> would
> > > make
> > > >> security worse. At the moment, anyone who sends an Akka message to
> the
> > > job
> > > >> manager, can execute arbitrary code..
> > > >>
> > > >> On Thu, Nov 5, 2015 at 11:16 AM, Flavio Pompermaier <
> > > pompermaier@okkam.it
> > > >> >
> > > >> wrote:
> > > >>
> > > >> > +1 to remove the old web client in favor of an improved dashboard
> > (not
> > > >> so
> > > >> > urgent however)
> > > >> >
> > > >> > On Thu, Nov 5, 2015 at 11:11 AM, Robert Metzger <
> > rmetzger@apache.org>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi,
> > > >> > > I personally like the idea of allowing users to submit a
job
> from
> > > the
> > > >> web
> > > >> > > interface a lot. In particular for users new to the system,
its
> a
> > > very
> > > >> > > convenient feature.
> > > >> > > We would also get rid of this ugly, old web client :)
> > > >> > >
> > > >> > > Regarding security: We can always add a configuration parameter
> > > which
> > > >> > > allows users to disable the feature.
> > > >> > >
> > > >> > > Please share the screenshot with us :)
> > > >> > >
> > > >> > > On Thu, Nov 5, 2015 at 10:08 AM, Sachin Goel <
> > > >> sachingoel0101@gmail.com>
> > > >> > > wrote:
> > > >> > >
> > > >> > > > The current authentication mechanism is via htaccess,
in the
> > > >> webclient.
> > > >> > > The
> > > >> > > > dashboard however isn't secured at all.
> > > >> > > >
> > > >> > > > -- Sachin Goel
> > > >> > > > Computer Science, IIT Delhi
> > > >> > > > m. +91-9871457685
> > > >> > > >
> > > >> > > > On Thu, Nov 5, 2015 at 2:33 PM, Aljoscha Krettek <
> > > >> aljoscha@apache.org>
> > > >> > > > wrote:
> > > >> > > >
> > > >> > > > > The reason why we didn’t want to have it in
the JobManager
> > > >> interface
> > > >> > by
> > > >> > > > > default is that it could be a security concern.
I also see,
> > > >> however,
> > > >> > > that
> > > >> > > > > security in general is not very strong right now.
> > > >> > > > >
> > > >> > > > > > On 05 Nov 2015, at 09:58, Matthias J. Sax
<
> mjsax@apache.org
> > >
> > > >> > wrote:
> > > >> > > > > >
> > > >> > > > > > I like the idea in general! Not sure if integrating
it
> into
> > > >> > > JobMangaer
> > > >> > > > > > Webinterface is good or not... What would
be the pros/cons
> > for
> > > >> > > > > > standalone vs. integrated?
> > > >> > > > > >
> > > >> > > > > > -Matthias
> > > >> > > > > >
> > > >> > > > > > On 11/05/2015 05:23 AM, Sachin Goel wrote:
> > > >> > > > > >> Hi all
> > > >> > > > > >> Are there any plans to upgrade the webclient
interface?
> It
> > > >> could
> > > >> > > > > certainly
> > > >> > > > > >> use an upgrade compared to the much better
dashboard .
> > > >> > > > > >> If so, is integrating them into one the
best way to go?
> We
> > > can
> > > >> > have
> > > >> > > a
> > > >> > > > > tab
> > > >> > > > > >> under Job Manager on the dashboard.
> > > >> > > > > >>
> > > >> > > > > >> I can share screenshots of the UI I designed
last night,
> if
> > > >> it's
> > > >> > > not a
> > > >> > > > > >> terrible idea to do this. :')
> > > >> > > > > >>
> > > >> > > > > >> Cheers!
> > > >> > > > > >> Sachin
> > > >> > > > > >>
> > > >> > > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message