Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
From: Traiano Welcome <traiano@gmail.com>
Date: Mon, 24 Jul 2017 22:11:09 +0400
Message-ID: <CAFKCRV+hcKHN+e6t7=CpQpQU74z=9vF+Tq63WQKRpRWmaNAM6g@mail.gmail.com>
Subject: FATAL mapred.MesosScheduler: Failed to initialize the TaskScheduler
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary="001a1137709aac64eb05551423b1"
archived-at: Mon, 24 Jul 2017 18:11:20 -0000

--001a1137709aac64eb05551423b1
Content-Type: text/plain; charset="UTF-8"

Hi List

I'm working on configuring hadoop to use the mesos scheduler, using the
procedure outlined in "Apache Mesos Essentials" here:

https://pastebin.com/y1ERJZqq

Currently I've a 3 node mesos cluster, with an HDFS namenode communicating
successfully with two HDFS data nodes. However, when I try to start up the
jobtracker it fails with the following error:

17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize
the TaskScheduler
java.lang.ClassNotFoundException:
org.apache.hadoop.mapred.JobQueueTaskScheduler

Some more context around the error:

 17/07/22 18:44:38 INFO mapred.CompletedJobStatusStore: Completed job
store is inactive
 17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize
the TaskScheduler
 java.lang.ClassNotFoundException:
org.apache.hadoop.mapred.JobQueueTaskScheduler

    at java.net.URLClassLoader$1.run(URLClassLoader.java:359)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:348)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:347)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:312)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:195)
    at   org.apache.hadoop.mapred.MesosScheduler.start(MesosScheduler.java:160)
    at    org.apache.hadoop.mapred.JobTracker.offerService(JobTracker.java:2186)
    at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4548)
17/07/22 18:44:38 INFO mapred.JobTracker: SHUTDOWN_MSG:

Is there some way I could debug this further to trace the root cause of
this error?

Here is a full paste of the debug output when starting up the jobtracker:

 https://pastebin.com/a61wN4vQ

Many thanks for any help!

Traiano

--001a1137709aac64eb05551423b1
Content-Type: text/html; charset="UTF-8"

<div dir="ltr">Hi List<br><div><br>I&#39;m working on configuring hadoop to use the mesos scheduler, using the procedure outlined in &quot;Apache Mesos Essentials&quot; here:<div><div class="gmail-post-text">

<p><a href="https://pastebin.com/y1ERJZqq" rel="nofollow noreferrer">https://pastebin.com/y1ERJZqq</a></p>

<p>Currently I&#39;ve a 3 node mesos cluster, with an HDFS namenode 
communicating successfully with two HDFS data nodes. However, when I try
 to start up the jobtracker it fails with the following error:</p>

<pre><code>17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the TaskScheduler
java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.JobQueueTaskScheduler
</code></pre>

<p>Some more context around the error:</p>

<pre><code> 17/07/22 18:44:38 INFO mapred.CompletedJobStatusStore: Completed job store is inactive
 17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the TaskScheduler
 java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.JobQueueTaskScheduler

    at java.net.URLClassLoader$1.run(URLClassLoader.java:359)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:348)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:347)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:312)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:195)
    at   org.apache.hadoop.mapred.MesosScheduler.start(MesosScheduler.java:160)
    at    org.apache.hadoop.mapred.JobTracker.offerService(JobTracker.java:2186)
    at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4548)
17/07/22 18:44:38 INFO mapred.JobTracker: SHUTDOWN_MSG: 
</code></pre>

<p>Is there some way I could debug this further to trace the root cause of this error?</p>

<p>Here is a full paste of the debug output when starting up the jobtracker:</p>

<pre><code> <a href="https://pastebin.com/a61wN4vQ">https://pastebin.com/a61wN4vQ</a>
<br><br></code></pre><pre><code>Many thanks for any help!<br></code></pre><pre><code>Traiano<br></code></pre><pre><code><br></code></pre>
    </div></div></div></div>

--001a1137709aac64eb05551423b1--