hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Molina <rmol...@hortonworks.com>
Subject Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please
Date Tue, 04 Dec 2012 20:58:51 GMT
Hi Dibyendu,
I believe TT is trying to do some cleanup.  What is currently in

/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local

Regards,
Robert

On Tue, Dec 4, 2012 at 4:49 AM, Nitin Pawar <nitinpawar432@gmail.com> wrote:

> surprising to see that TT is restarting without any error after it checks
> for the directory ownership mapred local directories.
>
> can you try putting tasktracker startup in debug mode? (which version of
> JDK are you using? )
>
>
> On Tue, Dec 4, 2012 at 4:59 PM, Mohammad Tariq <dontariq@gmail.com> wrote:
>
>> I see. Could you please post your JT logs? Also, comment out "127.0.1.1"
>> in your "/etc/hosts" and try to restart the cluster. I am assuming rest of
>> the things are working fine.
>>
>> (I am sorry as I am not able to post any direct answer, as it's very
>> difficult to diagnose the actual problem without error logs).
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <
>> dibyendu.dets@gmail.com> wrote:
>>
>>> THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
>>> ALSO --- THANK YOU FOR THE REPLY
>>>
>>>
>>> 2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:20:46,983 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:20:47,044 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:20:47,445 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:20:47,445 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:20:48,478 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:20:59,164 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:21:11,971 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:21:12,031 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:21:12,032 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:21:12,032 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:21:12,443 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:21:22,728 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:23:20,876 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:23:20,937 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:23:20,939 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:23:20,939 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:23:21,969 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:23:32,658 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:24:12,577 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:24:12,638 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:24:13,038 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:24:13,038 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:24:13,267 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:24:21,373 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:26:45,403 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:26:45,464 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:26:45,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:26:45,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:26:46,092 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:26:56,381 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:27:10,119 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:27:10,180 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:27:10,581 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:27:10,581 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:27:10,824 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:27:16,383 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:27:25,458 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:27:25,519 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:27:25,823 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:27:25,823 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:27:26,661 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:27:37,267 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:27:44,677 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:27:44,739 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:27:45,140 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:27:45,140 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:27:46,176 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:27:56,864 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:33:24,250 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:33:24,313 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:33:24,614 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:33:24,614 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:33:24,851 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:33:35,155 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:36:05,810 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:36:05,869 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:36:05,872 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:36:05,872 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:36:06,104 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:36:16,791 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:40:23,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2012-12-04 15:40:23,925 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:40:24,559 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:40:34,846 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>
>>>
>>> On 12/4/12, Dibyendu Karmakar <dibyendu.dets@gmail.com> wrote:
>>> > Yes, the jps command gives me the following...
>>> >
>>> > on 172.16.4.120 ---
>>> > 10160 SecondaryNameNode
>>> > 9794 NameNode
>>> > 9980 DataNode
>>> > 9388 Jps
>>> > 16267 JobTracker
>>> >
>>> > on 172.16.4.14 --
>>> > 6812 Jps
>>> > 4523 DataNode
>>> >
>>> >
>>> > On 12/4/12, Mohammad Tariq <dontariq@gmail.com> wrote:
>>> >> Hello Dibyendu,
>>> >>
>>> >>        Are you able to see anything at http://172.16.4.120:50030?What
>>> >> does
>>> >> JPS show on your terminal? Whatever logs you have posted here look
>>> >> incomplete to me. Can you do a quick recheck?
>>> >>
>>> >> Regards,
>>> >>     Mohammad Tariq
>>> >>
>>> >>
>>> >>
>>> >> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>>> >> <dibyendu.dets@gmail.com>wrote:
>>> >>
>>> >>> Hiii, I am new in hadoop. Trying to configure it in fully distributed
>>> >>> mode.
>>> >>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>> >>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>> >>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>> >>> HELP PLEASE...
>>> >>>
>>> >>> I'm using hadoop 1.0.3 version.
>>> >>> I am using 2 computers -
>>> >>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER +
>>> DATANODE
>>> >>> 172.16.4.14 - DATANODE
>>> >>>
>>> >>> My conf is somewhat -
>>> >>> < core-site.xml >
>>> >>> fs.default.name ------ hdfs://172.16.4.120:9001
>>> >>> hadoop.tmp.dir ------
>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>> >>>
>>> >>> < hdfs-site.xml >
>>> >>> dfs.replication -- 2
>>> >>> dfs.name.dir ---
>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>> >>> dfs.data.dir --- /tmp/hadoop_data
>>> >>>
>>> >>> < mapred-site.xml >
>>> >>> mapred.job.tracker --- 172.16.4.120:9002
>>> >>>
>>> >>> < slaves >
>>> >>> 172.16.4.14
>>> >>> 172.16.4.120
>>> >>>
>>> >>> < masters >
>>> >>> 172.16.4.120
>>> >>>
>>> >>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>> >>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log
>
>>> >>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>> >>> STARTUP_MSG:
>>> >>> /************************************************************
>>> >>> STARTUP_MSG: Starting TaskTracker
>>> >>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> >>> STARTUP_MSG:   args = []
>>> >>> STARTUP_MSG:   version = 1.0.3
>>> >>> STARTUP_MSG:   build =
>>> >>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0-r
>>> >>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> >>> ************************************************************/
>>> >>> 2012-12-04 15:40:23,864 INFO
>>> >>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
from
>>> >>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>>> source
>>> >>> MetricsSystem,sub=Stats registered.
>>> >>> 2012-12-04 15:40:24,326 INFO
>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> >>> period at 10 second(s).
>>> >>> 2012-12-04 15:40:24,326 INFO
>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>>> metrics
>>> >>> system started
>>> >>> 2012-12-04 15:40:24,559 INFO
>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>>> source
>>> >>> ugi registered.
>>> >>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>> >>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> >>> org.mortbay.log.Slf4jLog
>>> >>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer:
Added
>>> >>> global filtersafety
>>> >>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> >>> 2012-12-04 15:40:34,846 INFO
>>> >>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> >>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> >>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>> >>> Starting tasktracker with owner as dibyendu_karmakar
>>> >>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>> >>> Good mapred local directories are:
>>> >>>
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>> >>>
>>> >>> PLEASE HELP ANYONE...
>>> >>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>> >>> THANK YOU SO MUCH...
>>> >>> --
>>> >>> Dibyendu Karmakar,
>>> >>> < dibyendu.dets@gmail.com >
>>> >>>
>>> >>
>>> >
>>> >
>>> > --
>>> > Dibyendu Karmakar,
>>> > < dibyendu.dets@gmail.com >
>>> >
>>>
>>>
>>> --
>>> Dibyendu Karmakar,
>>> < dibyendu.dets@gmail.com >
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
>

Mime
View raw message