hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stas Oskin <stas.os...@gmail.com>
Subject Re: Getting free and used space
Date Sat, 02 May 2009 15:02:22 GMT
Hi.

Actually, I'm trying to use the getDiskStatus() function, but it doesn't
seem to work so well in 0.18.3.

Can someone advice of a reliable way to get the HDFS overall free and used
space?
Same function that reports the space to the NameNode web panel?

Thanks.

2009/5/2 Edward Capriolo <edlinuxguru@gmail.com>

> You can also pull these variables from the name node, datanode with
> JMX. I am doing this to graph them with cacti. Both the JMX READ/WRITE
> and READ user can access this variable.
>
> On Tue, Apr 28, 2009 at 8:29 AM, Stas Oskin <stas.oskin@gmail.com> wrote:
> > Hi.
> >
> > Any idea if the getDiskStatus() function requires superuser rights?
> >
> > Or it can work for any user?
> >
> > Thanks.
> >
> > 2009/4/9 Aaron Kimball <aaron@cloudera.com>
> >
> >> You can insert this propery into the jobconf, or specify it on the
> command
> >> line e.g.: -D hadoop.job.ugi=username,group,group,group.....
> >>
> >> - Aaron
> >>
> >> On Wed, Apr 8, 2009 at 7:04 AM, Brian Bockelman <bbockelm@cse.unl.edu
> >> >wrote:
> >>
> >> > Hey Stas,
> >> >
> >> > What we do locally is apply the latest patch for this issue:
> >> > https://issues.apache.org/jira/browse/HADOOP-4368
> >> >
> >> > This makes getUsed (actually, it switches to FileSystem.getStatus) not
> a
> >> > privileged action.
> >> >
> >> > As far as specifying the user ... gee, I can't think of it off the top
> of
> >> > my head.  It's a variable you can insert into the JobConf, but I'd
> have
> >> to
> >> > poke around google or the code to remember which one (I try to not
> >> override
> >> > it if possible).
> >> >
> >> > Brian
> >> >
> >> >
> >> > On Apr 8, 2009, at 8:51 AM, Stas Oskin wrote:
> >> >
> >> >  Hi.
> >> >>
> >> >> Thanks for the explanation.
> >> >>
> >> >> Now for the easier part - how do I specify the user when connecting?
> :)
> >> >>
> >> >> Is it a config file level, or run-time level setting?
> >> >>
> >> >> Regards.
> >> >>
> >> >> 2009/4/8 Brian Bockelman <bbockelm@cse.unl.edu>
> >> >>
> >> >>  Hey Stas,
> >> >>>
> >> >>> Did you try this as a privileged user?  There might be some
> permission
> >> >>> errors... in most of the released versions, getUsed() is only
> available
> >> >>> to
> >> >>> the Hadoop superuser.  It may be that the exception isn't
> propagating
> >> >>> correctly.
> >> >>>
> >> >>> Brian
> >> >>>
> >> >>>
> >> >>> On Apr 8, 2009, at 3:13 AM, Stas Oskin wrote:
> >> >>>
> >> >>> Hi.
> >> >>>
> >> >>>>
> >> >>>> I'm trying to use the API to get the overall used and free
spaces.
> >> >>>>
> >> >>>> I tried this function getUsed(), but it always returns 0.
> >> >>>>
> >> >>>> Any idea?
> >> >>>>
> >> >>>> Thanks.
> >> >>>>
> >> >>>>
> >> >>>
> >> >>>
> >> >
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message