mesos-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benjamin Mahler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MESOS-2532) UserCgroupIsolatorTest failures due to: "Failed to prepare isolator: cgroup already exists"
Date Mon, 23 Mar 2015 20:59:52 GMT

    [ https://issues.apache.org/jira/browse/MESOS-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376624#comment-14376624
] 

Benjamin Mahler commented on MESOS-2532:
----------------------------------------

Looked with [~jieyu], it looks like these tests generate their own non-unique container IDs
and these can get left-over after the tests complete:

{code}
TYPED_TEST(UserCgroupIsolatorTest, ROOT_CGROUPS_UserCgroup)
{
  // ...

  ContainerID containerId;
  containerId.set_value("container");
{code}

{noformat}
[bmahler@smfd-atr-11-sr1 build]$ ls -l /sys/fs/cgroup/cpu/mesos/container
total 0
-rw-r--r-- 1 root root 0 Jan  8 18:29 cgroup.clone_children
--w--w--w- 1 root root 0 Jan  8 18:29 cgroup.event_control
-rw-r--r-- 1 root root 0 Jan  8 18:29 cgroup.procs
-rw-r--r-- 1 root root 0 Jan  8 18:29 cpu.cfs_period_us
-rw-r--r-- 1 root root 0 Jan  8 18:29 cpu.cfs_quota_us
-rw-r--r-- 1 root root 0 Jan  8 18:29 cpu.rt_period_us
-rw-r--r-- 1 root root 0 Jan  8 18:29 cpu.rt_runtime_us
-rw-r--r-- 1 root root 0 Jan  8 18:29 cpu.shares
-r--r--r-- 1 root root 0 Jan  8 18:29 cpu.stat
-rw-r--r-- 1 root root 0 Jan  8 18:29 notify_on_release
-rw-r--r-- 1 root root 0 Jan  8 18:29 tasks
{noformat}

> UserCgroupIsolatorTest failures due to: "Failed to prepare isolator: cgroup already exists"
> -------------------------------------------------------------------------------------------
>
>                 Key: MESOS-2532
>                 URL: https://issues.apache.org/jira/browse/MESOS-2532
>             Project: Mesos
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.22.0
>            Reporter: Benjamin Mahler
>              Labels: twitter
>
> This is on a CentOS machine:
> {code: title=sudo make check -j24 MESOS_VERBOSE=1 GLOG_v=1 GTEST_FILTER="UserCgroupIsolatorTest*"}
> -------------------------------------------------------------
> We cannot run any cgroups tests that require mounting
> hierarchies because you have the following hierarchies mounted:
> /sys/fs/cgroup/cpu, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/freezer, /sys/fs/cgroup/memory,
/sys/fs/cgroup/perf_event
> We'll disable the CgroupsNoHierarchyTest test fixture for now.
> -------------------------------------------------------------
> -------------------------------------------------------------
> We cannot run any Docker tests because:
> Failed to execute 'docker version': exited with status 127
> -------------------------------------------------------------
> Note: Google Test filter = UserCgroupIsolatorTest*-DockerContainerizerTest.ROOT_DOCKER_Launch_Executor:DockerContainerizerTest.ROOT_DOCKER_Launch_Executor_Bridged:DockerContainerizerTest.ROOT_DOCKER_Launch:DockerContainerizerTest.ROOT_DOCKER_Kill:DockerContainerizerTest.ROOT_DOCKER_Usage:DockerContainerizerTest.ROOT_DOCKER_Update:DockerContainerizerTest.DISABLED_ROOT_DOCKER_Recover:DockerContainerizerTest.ROOT_DOCKER_Logs:DockerContainerizerTest.ROOT_DOCKER_Default_CMD:DockerContainerizerTest.ROOT_DOCKER_Default_CMD_Override:DockerContainerizerTest.ROOT_DOCKER_Default_CMD_Args:DockerContainerizerTest.ROOT_DOCKER_SlaveRecoveryTaskContainer:DockerContainerizerTest.DISABLED_ROOT_DOCKER_SlaveRecoveryExecutorContainer:DockerContainerizerTest.ROOT_DOCKER_PortMapping:DockerContainerizerTest.ROOT_DOCKER_LaunchSandboxWithColon:DockerContainerizerTest.ROOT_DOCKER_DestroyWhileFetching:DockerContainerizerTest.ROOT_DOCKER_DestroyWhilePulling:DockerTest.ROOT_DOCKER_interface:DockerTest.ROOT_DOCKER_CheckCommandWithShell:DockerTest.ROOT_DOCKER_CheckPortResource:DockerTest.ROOT_DOCKER_CancelPull:CgroupsNoHierarchyTest.ROOT_CGROUPS_NOHIERARCHY_MountUnmountHierarchy:SlaveCount/Registrar_BENCHMARK_Test.performance/0:SlaveCount/Registrar_BENCHMARK_Test.performance/1:SlaveCount/Registrar_BENCHMARK_Test.performance/2:SlaveCount/Registrar_BENCHMARK_Test.performance/3
> [==========] Running 3 tests from 3 test cases.
> [----------] Global test environment set-up.
> [----------] 1 test from UserCgroupIsolatorTest/0, where TypeParam = mesos::internal::slave::CgroupsMemIsolatorProcess
> userdel: user mesos.test.unprivileged.user does not exist
> [ RUN      ] UserCgroupIsolatorTest/0.ROOT_CGROUPS_UserCgroup
> Using temporary directory '/tmp/UserCgroupIsolatorTest_0_ROOT_CGROUPS_UserCgroup_ASJu3B'
> ../../src/tests/isolator_tests.cpp:1067: Failure
> (isolator.get()->prepare( containerId, executorInfo, os::getcwd(), UNPRIVILEGED_USERNAME)).failure():
Failed to prepare isolator: cgroup already exists
> [  FAILED  ] UserCgroupIsolatorTest/0.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsMemIsolatorProcess
(18 ms)
> [----------] 1 test from UserCgroupIsolatorTest/0 (18 ms total)
> [----------] 1 test from UserCgroupIsolatorTest/1, where TypeParam = mesos::internal::slave::CgroupsCpushareIsolatorProcess
> userdel: user mesos.test.unprivileged.user does not exist
> [ RUN      ] UserCgroupIsolatorTest/1.ROOT_CGROUPS_UserCgroup
> Using temporary directory '/tmp/UserCgroupIsolatorTest_1_ROOT_CGROUPS_UserCgroup_VIwHI4'
> ../../src/tests/isolator_tests.cpp:1067: Failure
> (isolator.get()->prepare( containerId, executorInfo, os::getcwd(), UNPRIVILEGED_USERNAME)).failure():
Failed to prepare isolator: cgroup already exists
> [  FAILED  ] UserCgroupIsolatorTest/1.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsCpushareIsolatorProcess
(11 ms)
> [----------] 1 test from UserCgroupIsolatorTest/1 (12 ms total)
> [----------] 1 test from UserCgroupIsolatorTest/2, where TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess
> userdel: user mesos.test.unprivileged.user does not exist
> [ RUN      ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup
> Using temporary directory '/tmp/UserCgroupIsolatorTest_2_ROOT_CGROUPS_UserCgroup_Cm2jhz'
> I0323 20:47:15.297801  2047 perf_event.cpp:71] Creating PerfEvent isolator
> I0323 20:47:15.312007  2047 perf_event.cpp:109] PerfEvent isolator will profile for 10secs
every 1mins for events: { cpu-cycles }
> I0323 20:47:15.312500  2069 perf_event.cpp:221] Preparing perf event cgroup for container
> ../../src/tests/isolator_tests.cpp:1067: Failure
> (isolator.get()->prepare( containerId, executorInfo, os::getcwd(), UNPRIVILEGED_USERNAME)).failure():
Failed to prepare isolator: cgroup already exists
> [  FAILED  ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess
(18 ms)
> [----------] 1 test from UserCgroupIsolatorTest/2 (18 ms total)
> [----------] Global test environment tear-down
> [==========] 3 tests from 3 test cases ran. (2207 ms total)
> [  PASSED  ] 0 tests.
> [  FAILED  ] 3 tests, listed below:
> [  FAILED  ] UserCgroupIsolatorTest/0.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsMemIsolatorProcess
> [  FAILED  ] UserCgroupIsolatorTest/1.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsCpushareIsolatorProcess
> [  FAILED  ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess
> {code}
> cc [~idownes] [~jieyu]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message