mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin Mahler <benjamin.mah...@gmail.com>
Subject Re: Disk space in UI on EC2 instances
Date Wed, 10 Jul 2013 20:40:54 GMT
Whoops, here you go (I actually compiled it this time ;)):

symlink.c:

#include <errno.h>
#include <string.h>

#include <sys/statvfs.h>

#include <iostream>

int main()
{
  // First check with the symlink.
  struct statvfs buf;
  if (::statvfs("/tmp/mesos", &buf) < 0) {
    std::cerr << "failed to statvfs: " << strerror(errno) << std::endl;
  } else {
    std::cerr << "/tmp/mesos bytes free: " << buf.f_bavail * buf.f_frsize
<< std::endl;
  }

  // Now try the actual path.
  if (::statvfs("/media/ephemeral0/var/log/mesos-slaves", &buf) < 0) {
    std::cerr << "failed to statvfs: " << strerror(errno) << std::endl;
  } else {
    std::cerr << "/media/ephemeral0/var/log/mesos-slaves bytes free: " <<
buf.f_bavail * buf.f_frsize << std::endl;
  }
}


$ g++ symlink.c
$ ./a.out


On Wed, Jul 10, 2013 at 1:22 PM, Gary Malouf <malouf.gary@gmail.com> wrote:

> I first tried using the path symlinked to - the ui still shows just 1gb of
> available disk space.  This is what is on the root volume - even though the
> work directory is on the much larger and empty instance one.
>
>
> Trying to run the program Ben suggested:
>
> On CentOS 6.3, I get the following:
>
> [root@mesos-test-02 tmp]# gcc symlink.c
> symlink.c:3:20: error: iostream: No such file or directory
> symlink.c: In function ‘main’:
> symlink.c:10: error: expected expression before ‘:’ token
> symlink.c:13: error: expected expression before ‘:’ token
> symlink.c:17: error: expected expression before ‘:’ token
> symlink.c:20: error: duplicate label ‘std’
> symlink.c:13: note: previous definition of ‘std’ was here
> symlink.c:20: error: expected expression before ‘:’ token
>
> I tried compiling with g++, but got:
>
> [root@mesos-test-02 tmp]# g++ symlink.c
> symlink.c: In function ‘int main()’:
> symlink.c:10: error: ‘ErrnoError’ was not declared in this scope
> symlink.c:17: error: ‘ErrnoError’ was not declared in this scope
>
> -Gary
>
>
> On Wed, Jul 10, 2013 at 3:30 PM, Gary Malouf <malouf.gary@gmail.com>
> wrote:
>
> > I am running mesos-0.12.0-incubating.  Does the bug affect that one as
> > well?
> >
> >
> > On Wed, Jul 10, 2013 at 2:38 PM, Gary Malouf <malouf.gary@gmail.com
> >wrote:
> >
> >> Also relevant (copied from UI):
> >>
> >> Active Slaves (see all <http://localhost:5050/#/slaves>)   ID<
> http://localhost:5050/#/>
> >> Host <http://localhost:5050/#/>  CPUs <http://localhost:5050/#/>
 Mem<
> http://localhost:5050/#/>
> >> Disk <http://localhost:5050/#/>  Registered <http://localhost:5050/#/>
>   …3744-1
> >> <http://localhost:5050/#/>  mesos-test-02
> >> <http://localhost:5050/#/slaves/201307092108-1315739402-5050-3744-1> 1
> 3
> >> GB 1 GB  21 hours ago <http://localhost:5050/#/>   …3744-0
> >> <http://localhost:5050/#/>  mesos-test-01
> >> <http://localhost:5050/#/slaves/201307092108-1315739402-5050-3744-0> 1
> 3
> >> GB 1 GB  21 hours ago <http://localhost:5050/#/>
> >>
> >>
> >> On Wed, Jul 10, 2013 at 2:36 PM, Gary Malouf <malouf.gary@gmail.com
> >wrote:
> >>
> >>> It says it is taking up 65% of the available disk space.  This is
> >>> strange since I have the work directory (/tmp/mesos) symlinked to an
> >>> instance volume that has almost 150GB free.
> >>>
> >>> I've put the relative terminal output below - I think the strong
> >>> preference would be for mesos to sensibly detect the stuff rather than
> it
> >>> be explicitly enumerated in configuration.
> >>>
> >>> slave.cpp:1233] Current disk usage 64.76%. Max allowed age: 2.47days
> >>>
> >>> [root@mesos-test-02 log]# du -hcs /media/ephemeral0/
> >>> 13M    /media/ephemeral0/
> >>> 13M    total
> >>>
> >>> [root@mesos-test-02 log]# df -h
> >>> Filesystem            Size  Used Avail Use% Mounted on
> >>> /dev/xvde1            5.0G  3.2G  1.5G  69% /
> >>> tmpfs                 1.8G     0  1.8G   0% /dev/shm
> >>> /dev/xvdf             394G  211M  374G   1% /media/ephemeral0
> >>>
> >>> [root@mesos-test-02 tmp]# ls -la
> >>> total 232
> >>> drwxrwxrwt.  4 root root   4096 Jul 10 18:33 .
> >>> dr-xr-xr-x. 22 root root   4096 Jul  9 16:49 ..
> >>> -rw-r--r--   1 root root 217689 Jul  9 21:58 chronos-1.log
> >>> drwxr-xr-x   2 root root   4096 Jul 10 01:03 hsperfdata_root
> >>> drwxrwxrwt   2 root root   4096 Jul  9 15:46 .ICE-unix
> >>> lrwxrwxrwx   1 root root     38 Jul  9 20:03 mesos ->
> >>> /media/ephemeral0/var/log/mesos-slaves
> >>>
> >>>
> >>> Thanks,
> >>>
> >>> Gary
> >>>
> >>>
> >>>
> >>>
> >>> On Tue, Jul 9, 2013 at 4:11 PM, Gary Malouf <malouf.gary@gmail.com
> >wrote:
> >>>
> >>>> Hi everyone,
> >>>>
> >>>> I have Mesos running with Chronos.  The UI shows the disk space being
> >>>> very low (1GB), but I have the log and slave work directories
> symlinked to
> >>>> locations on a disk with 374GB of free space.  How does the Mesos ui
> >>>> determine disk space?
> >>>>
> >>>> -Gary
> >>>>
> >>>
> >>>
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message