hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hamedreza Berenjian <hamedreza_berenj...@yahoo.com>
Subject a question
Date Thu, 25 Jul 2013 15:17:07 GMT
Hi,
I want to enable adaptivescheduler in hadoop 0.20.203.0. I have a jar file from this scheduler.(I
am sure that this jar file works properly.).I put jar file in  HADOOP_HOME/lib and I set
HADOOP_CLASSPATH in hadop-env.sh.and I set the required property of scheduler in mapred-site.xml. when
I run my cluster, all of jobtracker,datanode,.... start. But when I go to UI of scheduler(http://localhost:50030/scheduler),
I face with error 404. what should I do?please help me ....
 
my jobtracker log is:
2013-07-25 07:34:14,229 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG:   host = master/192.168.0.112
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.203.0
STARTUP_MSG:   build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203
-r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
************************************************************/
2013-07-25 07:34:14,317 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
from hadoop-metrics2.properties
2013-07-25 07:34:14,326 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
source MetricsSystem,sub=Stats registered.
2013-07-25 07:34:14,328 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
snapshot period at 10 second(s).
2013-07-25 07:34:14,328 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker
metrics system started
2013-07-25 07:34:14,545 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
source ugi registered.
2013-07-25 07:34:14,548WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name
ugi already exists!
2013-07-25 07:34:14,550 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2013-07-25 07:34:14,551 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with
(memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks)
(-1, -1, -1, -1)
2013-07-25 07:34:14,552 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude)
list
2013-07-25 07:34:14,557 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-07-25 07:34:14,558 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2013-07-25 07:34:14,629 INFO org.apache.hadoop.mapred.JobTracker: Starting jobtracker with
owner as maedeh
2013-07-25 07:34:14,654 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
source RpcDetailedActivityForPort9001 registered.
2013-07-25 07:34:14,654 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
source RpcActivityForPort9001 registered.
2013-07-25 07:34:14,657 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
2013-07-25 07:34:20,142 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
via org.mortbay.log.Slf4jLog
2013-07-25 07:34:20,370 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-07-25 07:34:20,533 INFO org.apache.hadoop.http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort()
before open() is -1. Opening the listener on 50030
2013-07-25 07:34:20,535 INFO org.apache.hadoop.http.HttpServer: listener.getLocalPort() returned
50030 webServer.getConnectors()[0].getLocalPort() returned 50030
2013-07-25 07:34:20,535 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50030
2013-07-25 07:34:20,535 INFO org.mortbay.log: jetty-6.1.x
2013-07-25 07:34:21,435 INFO org.mortbay.log: Started SelectChannelConnector@0.0.0.0:50030
2013-07-25 07:34:21,443 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
source jvm registered.
2013-07-25 07:34:21,443 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
source JobTrackerMetrics registered.
2013-07-25 07:34:21,444 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up at: 9001
2013-07-25 07:34:21,444 INFO org.apache.hadoop.mapred.JobTracker: JobTracker webserver: 50030
2013-07-25 07:34:25,330 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory
2013-07-25 07:34:25,987 INFO org.apache.hadoop.mapred.JobHistory: Creating DONE folder at
file:/home/maedeh/hadoop-0.20.203.0/logs/history/done
2013-07-25 07:34:25,999 INFO org.apache.hadoop.mapred.JobTracker: History server being initialized
in embedded mode
2013-07-25 07:34:26,001 INFO org.apache.hadoop.mapred.JobHistoryServer: Started job history
server at: localhost:50030
2013-07-25 07:34:26,001 INFO org.apache.hadoop.mapred.JobTracker: Job History Server web address:
localhost:50030
2013-07-25 07:34:26,004 INFO org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job
store is inactive
2013-07-25 07:34:27,798 INFO org.apache.hadoop.mapred.AdaptiveScheduler: Successfully configured
AdaptiveScheduler
2013-07-25 07:34:27,798 INFO org.apache.hadoop.mapred.JobTracker: Refreshing hosts information
2013-07-25 07:34:27,807 INFO org.apache.hadoop.util.HostsFileReader: Setting the includes
file to 
2013-07-25 07:34:27,807 INFO org.apache.hadoop.util.HostsFileReader: Setting the excludes
file to 
2013-07-25 07:34:27,807 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude)
list
2013-07-25 07:34:27,807 INFO org.apache.hadoop.mapred.JobTracker: Decommissioning 0 nodes
2013-07-25 07:34:27,809 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2013-07-25 07:34:27,810 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9001: starting
2013-07-25 07:34:27,810 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 9001: starting
2013-07-25 07:34:27,812 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.mapred.JobTracker: Starting RUNNING
2013-07-25 07:34:27,814 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 9001: starting
2013-07-25 07:34:36,628 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/slave1
2013-07-25 07:34:36,629 INFO org.apache.hadoop.mapred.JobTracker: Adding tracker tracker_slave1:localhost/127.0.0.1:34317
to host slave1
2013-07-25 07:34:40,978 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/slave2
2013-07-25 07:34:40,978 INFO org.apache.hadoop.mapred.JobTracker: Adding tracker tracker_slave2:localhost/127.0.0.1:41451
to host slave2
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message