accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andres Danter <adan...@gmail.com>
Subject Re: GSOC Idea - Accumulo Control Panel
Date Mon, 15 Apr 2013 17:27:20 GMT
Keith,

Thanks for the tip.  I went ahead and made the change.  I'm not sure if
there are any BigTop tickets that need to be linked.  I'll do a search for
that later.

Thanks again,

Andres


On Mon, Apr 15, 2013 at 12:46 PM, Keith Turner <keith@deenlo.com> wrote:

> Andres,
>
> You can link tickets in Jira.  Go to "More Actions->Link" on the
> ticket page.  This is a little better than putting tickets in
> comments, the link will automatically show up in both tickets.
>
> Are there any BigTop tickets that should be linked to these tickets?
>
> Keith
>
> On Sun, Apr 14, 2013 at 7:49 PM, Andres Danter <adanter@gmail.com> wrote:
> > Billie,
> > Thanks.  I have created the ticket for Ambari (AMBARI-1930).  I started
> > putting together the proposal, but I need to do a lot of research and
> > thinking before I can finish it.  I'll keep working on that this week.
> >
> > Take care,
> >
> > Andres
> > <https://issues.apache.org/jira/browse/AMBARI-1930>
> >
> >
> > On Sun, Apr 14, 2013 at 7:04 PM, Billie Rinaldi <
> billie.rinaldi@gmail.com>wrote:
> >
> >> Andres,
> >>
> >> I would go with issue type "improvement," leave the priority major, and
> the
> >> component blank for now. The rest looks great.
> >>
> >> Billie
> >>
> >> On Apr 14, 2013 4:23 PM, "Andres Danter" <adanter@gmail.com> wrote:
> >> >
> >> > Billie,
> >> >
> >> > I'm a newbie at creating tickets on JIRA.  I want to make sure I have
> the
> >> > right information for each of the fields:
> >> >
> >> > Project:  Ambari
> >> > Issue Type: Task  (or Wish?)
> >> > Summary:  Integrate Ambari with Accumulo
> >> > Priority:  Minor (?)
> >> > Components:  build (?)
> >> > Affects Versions:  <blank>
> >> > Fix Versions: <blank>
> >> > Environment: <blank>
> >> > Description:  This task is for Google Summer of Code 2013.  The goal
> is
> >> to
> >> > integrate Ambari with Accumulo to provide a more robust and extensible
> >> > management layer for Accumulo clusters.  The Accumulo tickets related
> to
> >> > this Ambari task are the following:
> >> > ACCUMULO-136
> >> > ACCUMULO-196
> >> >
> >> > Original Estimate:  <blank>
> >> > Labels: gsoc2013, Accumulo
> >> >
> >> > Is the description enough, or should I add more information?
> >> >
> >> > Once I get your blessing, I'll create the ticket.
> >> >
> >> > Thanks,
> >> >
> >> > Andres
> >> >
> >> >
> >> > On Sun, Apr 14, 2013 at 12:22 AM, Billie Rinaldi
> >> > <billie.rinaldi@gmail.com>wrote:
> >> >
> >> > > On Apr 13, 2013 3:17 PM, "Andres Danter" <adanter@gmail.com>
wrote:
> >> > > >
> >> > > > Hi Billie,
> >> > > >
> >> > > > Thanks for passing the information onto the Ambari group.  I'm
> glad
> >> that
> >> > > > they were receptive.  I will subscribe to the Ambari dev group
> later
> >> > > > today.  Do you need me to create the Ambari ticket?
> >> > >
> >> > > Yes, that would be great. Thanks, Andres.
> >> > >
> >> > > Billie
> >> > >
> >> > > >
> >> > > > Andres
> >> > > >
> >> > > >
> >> > > > On Sat, Apr 13, 2013 at 10:29 AM, Billie Rinaldi
> >> > > > <billie.rinaldi@gmail.com>wrote:
> >> > > >
> >> > > > > Andres,
> >> > > > >
> >> > > > > I approached the Ambari PMC and they responded positively.
In
> >> > > particular,
> >> > > > > Yusaku had the following comment about your outline:
> >> > > > >
> >> > > > > "That sounds like a great idea, Billie.
> >> > > > > Adding Accumulo support will provide an excellent example
on
> how to
> >> > > extend
> >> > > > > the stack and plug it into Ambari for installation, management,
> and
> >> > > > > monitoring.
> >> > > > > This will help future effort by the community to add additional
> >> service
> >> > > > > component to be Ambari-compatible.  Also this project will
help
> >> > > discover
> >> > > > > any improvements that need to be made in order to ease such
> stack
> >> > > extension
> >> > > > > effort.
> >> > > > > BTW, Ambari has the framework to support 2 and 7 as it does
with
> >> other
> >> > > > > service components."
> >> > > > >
> >> > > > > Go ahead and subscribe to the Ambari dev list, if you haven't
> >> already.
> >> > > We
> >> > > > > should also open an Ambari ticket for the project and link
it to
> >> > > relevant
> >> > > > > Accumulo ticket(s).
> >> > > > >
> >> > > > > Additional monitoring features will be a good thing to add
if
> you
> >> get
> >> > > done
> >> > > > > the other goals and still have some time left. Ambari is
> currently
> >> > > doing
> >> > > > > the same thing for HBase, so hopefully we can learn from
them.
> >> > > > >
> >> > > > > Looking forward to working with you!
> >> > > > > Billie
> >> > > > > On Apr 12, 2013 5:58 PM, "Andres Danter" <adanter@gmail.com>
> >> wrote:
> >> > > > >
> >> > > > >> Thanks, Billie.  I'm liking this task more and more.
 I would
> love
> >> to
> >> > > take
> >> > > > >> this on for GSoC.  Please run it by the Ambari PMC.
 I will
> start
> >> > > drafting
> >> > > > >> the proposal this weekend.
> >> > > > >>
> >> > > > >> Just to be clear, the goal would be to integrate Ambari
with
> >> Accumulo
> >> > > in
> >> > > > >> order to achieve the following capabilities (I've expanded
> David's
> >> > > > >> original
> >> > > > >> list of features):
> >> > > > >>
> >> > > > >> 1. Control (start/stop) Accumulo processes on any cluster
node
> >> > > > >> 2. Have the ability to edit Accumulo configuration files
via a
> >> > > web-based
> >> > > > >> editor (I don't think Ambari provides this.  Please
let me
> know if
> >> I'm
> >> > > > >> wrong)
> >> > > > >> 3. Have the ability to schedule restart of Accumulo
processes
> >> after a
> >> > > > >> configuration change
> >> > > > >> 4. Push Accumulo code and configuration files to a new
cluster
> >> node
> >> > > > >> 5.  Gracefully remove a node from a cluster
> >> > > > >> 6.  Gather system and/or application metrics that can
be used
> to
> >> > > monitor
> >> > > > >> the system and perhaps create reports on usability
> >> > > > >> 7.  Be able to monitor and control the Accumulo cluster
from a
> >> > > web-based
> >> > > > >> GUI  (this kind of goes with #2 above)
> >> > > > >> 8.  Allow read-only monitor sessions, as well as full-admin
> >> sessions
> >> > > and
> >> > > > >> have the ability to strictly manage who can access either.
>  (this
> >> I
> >> > > got
> >> > > > >> from ACCUMULO-196)
> >> > > > >> 9.  Provide the ability to authenticate user sessions
with SSL
> >> > > > >> (see ACCUMULO-196)
> >> > > > >>
> >> > > > >> It seems like the product of this work would largely
replace
> the
> >> > > current
> >> > > > >> Accumulo Monitor.  If that is the case, are there features
of
> the
> >> > > monitor
> >> > > > >> which you would like to see integrated?
> >> > > > >>
> >> > > > >> I will have about 3 months to complete this work (actually
> about
> >> > > 220-240
> >> > > > >> hours), so that list is doable.  Most of the work will
involve
> the
> >> GUI
> >> > > > >> portions, unless Ambari already comes with much of the
> >> functionality.
> >> > >  If
> >> > > > >> the list is too short, please let me know.
> >> > > > >>
> >> > > > >> I guess I should sign up to the Ambari mailing list
as well,
> >> right?
> >> > > > >>
> >> > > > >> Thanks again and I look forward to being your mentee
and to
> >> working
> >> > > with
> >> > > > >> the Accumulo community.
> >> > > > >>
> >> > > > >> Andres
> >> > > > >>
> >> > > > >>
> >> > > > >> On Fri, Apr 12, 2013 at 3:43 PM, David Medinets <
> >> > > david.medinets@gmail.com
> >> > > > >> >wrote:
> >> > > > >>
> >> > > > >> > The project is open source ... we can't stop you!
> >> > > > >> >
> >> > > > >> >
> >> > > > >> > On Fri, Apr 12, 2013 at 2:25 PM, Andres Danter
<
> >> adanter@gmail.com
> >> >
> >> > > > >> wrote:
> >> > > > >> >
> >> > > > >> > > Could the work of integrating Accumulo with
Ambari be
> >> something
> >> > > that
> >> > > > >> you
> >> > > > >> > > would allow a student to tackle for GSoC?
 I don't want to
> >> step on
> >> > > > >> > anyone's
> >> > > > >> > > planned work, but such a task really interests
me.  I want
> to
> >> > > tackle
> >> > > > >> > > something with some meat, if you know what
I mean.
> >> > > > >> > >
> >> > > > >> > >
> >> > > > >> > >
> >> > > > >> > > On Fri, Apr 12, 2013 at 11:47 AM, David Medinets
> >> > > > >> > > <david.medinets@gmail.com>wrote:
> >> > > > >> > >
> >> > > > >> > > > Thanks for the reminder. I had forgotten
the name of
> Ambari.
> >> > > > >> > > >
> >> > > > >> > > >
> >> > > > >> > > > On Fri, Apr 12, 2013 at 10:37 AM, Keith
Turner <
> >> > > keith@deenlo.com>
> >> > > > >> > wrote:
> >> > > > >> > > >
> >> > > > >> > > > > On Fri, Apr 12, 2013 at 10:29 AM,
David Medinets
> >> > > > >> > > > > <david.medinets@gmail.com>
wrote:
> >> > > > >> > > > > > It might be interesting to
have a tool which could:
> >> > > > >> > > > > >
> >> > > > >> > > > > > a) shut down any accumulo process
on any server.
> >> > > > >> > > > > > b) start any accumulo process
on any server.
> >> > > > >> > > > > > c) edit the various configuration
files through a web
> >> > > interface.
> >> > > > >> > > > > > d) automate restart accumulo
processes, as needed,
> after
> >> > > > >> > > configuration
> >> > > > >> > > > > > change.
> >> > > > >> > > > > > e) push accumulo code and configuration
to a new
> server.
> >> > > > >> > > > > > f) gracefully shutdown and
remove a server from the
> >> cluster.
> >> > > > >> > > > > >
> >> > > > >> > > > > > Anything else? If this sounds
like a good idea, let's
> >> create
> >> > > a
> >> > > > >> JIRA
> >> > > > >> > > > > ticket
> >> > > > >> > > > > > with the right tags.
> >> > > > >> > > > >
> >> > > > >> > > > > This sounds like Apache Ambari,
which we should
> possibly
> >> > > integrate
> >> > > > >> > > > > with. See ACCUMULO-136
> >> > > > >> > > > >
> >> > > > >> > > >
> >> > > > >> > >
> >> > > > >> >
> >> > > > >>
> >> > > > >
> >> > >
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message