Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6FF7818C3A for ; Tue, 15 Mar 2016 22:00:35 +0000 (UTC) Received: (qmail 4413 invoked by uid 500); 15 Mar 2016 22:00:35 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 4361 invoked by uid 500); 15 Mar 2016 22:00:35 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 4330 invoked by uid 500); 15 Mar 2016 22:00:35 -0000 Delivered-To: apmail-incubator-giraph-dev@incubator.apache.org Received: (qmail 4276 invoked by uid 99); 15 Mar 2016 22:00:34 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Mar 2016 22:00:34 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A89662C1F60 for ; Tue, 15 Mar 2016 22:00:34 +0000 (UTC) Date: Tue, 15 Mar 2016 22:00:34 +0000 (UTC) From: "Hassan Eslami (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (GIRAPH-1009) Spammy 'lost reservation' messages from ZooKeeper in workers' log at the end of the computation. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hassan Eslami resolved GIRAPH-1009. ----------------------------------- Resolution: Fixed > Spammy 'lost reservation' messages from ZooKeeper in workers' log at the end of the computation. > ------------------------------------------------------------------------------------------------ > > Key: GIRAPH-1009 > URL: https://issues.apache.org/jira/browse/GIRAPH-1009 > Project: Giraph > Issue Type: Bug > Components: bsp, zookeeper > Affects Versions: 1.2.0-SNAPSHOT > Environment: All environment, while running with more than one worker. > Reporter: Hassan Eslami > Assignee: Hassan Eslami > Priority: Minor > Labels: log, worker, zookeeper > Fix For: 1.2.0-SNAPSHOT > > Original Estimate: 72h > Remaining Estimate: 72h > > When running Giraph with more than one worker, ZooKeeper usually throws a bunch of 'lost reservation' info log messages for input splits at the end of the computation in workers' log. This clutters log file of workers, specially in cases where the job is running on a large graph with fairly large number of input splits. > Here are examples of these log messages: > ... > {{INFO 2015-05-19 14:44:58,894 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1126 lost reservation}} > {{INFO 2015-05-19 14:44:58,894 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2585 lost reservation}} > {{INFO 2015-05-19 14:44:58,895 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1166 lost reservation}} > {{INFO 2015-05-19 14:44:58,895 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1212 lost reservation}} > {{INFO 2015-05-19 14:44:58,895 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1666 lost reservation}} > {{INFO 2015-05-19 14:44:58,896 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2282 lost reservation}} > {{INFO 2015-05-19 14:44:58,896 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1302 lost reservation}} > {{INFO 2015-05-19 14:44:58,896 \[main-EventThread\] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2364 lost reservation}} > ... -- This message was sent by Atlassian JIRA (v6.3.4#6332)