giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hassan Eslami (JIRA)" <j...@apache.org>
Subject [jira] [Created] (GIRAPH-1009) Spammy 'lost reservation' messages from ZooKeeper in workers' log at the end of the computation.
Date Tue, 26 May 2015 16:34:17 GMT
Hassan Eslami created GIRAPH-1009:
-------------------------------------

             Summary: Spammy 'lost reservation' messages from ZooKeeper in workers' log at
the end of the computation.
                 Key: GIRAPH-1009
                 URL: https://issues.apache.org/jira/browse/GIRAPH-1009
             Project: Giraph
          Issue Type: Bug
          Components: bsp, zookeeper
    Affects Versions: 1.2.0-SNAPSHOT
         Environment: All environment, while running with more than one worker.
            Reporter: Hassan Eslami
            Priority: Minor
             Fix For: 1.2.0-SNAPSHOT


When running Giraph with more than one worker, ZooKeeper usually throws a bunch of 'lost reservation'
info log messages for input splits at the end of the computation in workers' log. This clutters
log file of workers, specially in cases where the job is running on a large graph with fairly
large number of input splits.

Here are examples of these log messages:
...
{{INFO    2015-05-19 14:44:58,894 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1126 lost
reservation}}
{{INFO    2015-05-19 14:44:58,894 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2585 lost
reservation}}
{{INFO    2015-05-19 14:44:58,895 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1166 lost
reservation}}
{{INFO    2015-05-19 14:44:58,895 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1212 lost
reservation}}
{{INFO    2015-05-19 14:44:58,895 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1666 lost
reservation}}
{{INFO    2015-05-19 14:44:58,896 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2282 lost
reservation}}
{{INFO    2015-05-19 14:44:58,896 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
 - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1302 lost
reservation}}
{{INFO 2015-05-19 14:44:58,896 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler
- process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2364 lost
reservation}}
...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message