hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hdev ml <hde...@gmail.com>
Subject Re: Capacity Scheduler APIs
Date Thu, 15 Mar 2012 20:41:05 GMT
Thanks Shailesh/Harsh,

I will try the hadoop command first and then the internal code.

Thanks again.

Harshad.

On Thu, Mar 15, 2012 at 12:06 PM, Harsh J <harsh@cloudera.com> wrote:

> To refresh your queues, you may do, as your MR admin user:
>
> $ hadoop mradmin -refreshQueues
>
> Am not sure if this covers CS config refreshes, but let us know if it does.
> The above command is present in Apache Hadoop 1.x.
>
> On Fri, Mar 16, 2012 at 12:08 AM, Shailesh <shailesh.shailu1@gmail.com
> >wrote:
>
> > Hi Harshad,
> >
> > Have you looked into CapacitySchedulerConf.java class?
> >
> >
> http://www.java2s.com/Open-Source/Java/Database-DBMS/hadoop-0.20.1/org/apache/hadoop/mapred/CapacitySchedulerConf.java.htm
> >
> > I don't know whether it can be done without restarting the cluster or
> > namenode.
> >
> > On Thu, Mar 15, 2012 at 2:03 PM, hdev ml <hdevml@gmail.com> wrote:
> >
> > > Thanks for the email Shailesh.
> > >
> > > I am looking for some Java API to manage queues.
> > >
> > > I have already defined queues in the capacity-scheduler.xml and
> > everything
> > > works fine.
> > >
> > > But my question is, can the same thing be done without restarting the
> > > cluster or namenode? The only option I see is Java API, hence the
> > question.
> > >
> > > Please let me know.
> > >
> > > Harshad
> > >
> > > On Thu, Mar 15, 2012 at 10:33 AM, Shailesh <shailesh.shailu1@gmail.com
> > > >wrote:
> > >
> > > > Hi Harshad,
> > > > have you looked into the file conf/capacity-scheduler.xml? you can
> > assign
> > > > and change parameters like capacity of each queue, reclaim time and
> job
> > > > priorities. Is that what you're looking for?
> > > >
> > > > Shailesh
> > > >
> > > > On Thu, Mar 15, 2012 at 12:57 PM, hdev ml <hdevml@gmail.com> wrote:
> > > >
> > > > > Does anybody have an answer to this question?
> > > > >
> > > > > Harshad
> > > > >
> > > > > On Wed, Mar 14, 2012 at 1:51 PM, hdev ml <hdevml@gmail.com>
wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > are there any capacity scheduler apis that I can use?
> > > > > >
> > > > > > e.g. adding, removing queues, tuning properties on the fly and
so
> > on.
> > > > > >
> > > > > > Any help is appreciated.
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > Harshad
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Harsh J
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message