Return-Path: Delivered-To: apmail-hadoop-chukwa-dev-archive@minotaur.apache.org Received: (qmail 99876 invoked from network); 21 Apr 2009 23:20:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 21 Apr 2009 23:20:10 -0000 Received: (qmail 19136 invoked by uid 500); 21 Apr 2009 23:20:10 -0000 Delivered-To: apmail-hadoop-chukwa-dev-archive@hadoop.apache.org Received: (qmail 19116 invoked by uid 500); 21 Apr 2009 23:20:10 -0000 Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@hadoop.apache.org Delivered-To: mailing list chukwa-dev@hadoop.apache.org Received: (qmail 19065 invoked by uid 99); 21 Apr 2009 23:20:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Apr 2009 23:20:10 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Apr 2009 23:20:08 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id B97D4234C051 for ; Tue, 21 Apr 2009 16:19:47 -0700 (PDT) Message-ID: <1225530871.1240355987758.JavaMail.jira@brutus> Date: Tue, 21 Apr 2009 16:19:47 -0700 (PDT) From: "Cheng (JIRA)" To: chukwa-dev@hadoop.apache.org Subject: [jira] Assigned: (CHUKWA-155) Job History status arrive out of order causing the status to update incorrectly. In-Reply-To: <1186542020.1240010415280.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CHUKWA-155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng reassigned CHUKWA-155: ---------------------------- Assignee: Cheng (was: Jerome Boulon) > Job History status arrive out of order causing the status to update incorrectly. > -------------------------------------------------------------------------------- > > Key: CHUKWA-155 > URL: https://issues.apache.org/jira/browse/CHUKWA-155 > Project: Hadoop Chukwa > Issue Type: Bug > Components: data collection, Data Processors > Environment: Redhat 5.1, Java 6 > Reporter: Eric Yang > Assignee: Cheng > Priority: Critical > Attachments: chukwa-155.patch > > > Job history contains lines like: > Job JOBID="job_200903310541_1747" JOB_STATUS="RUNNING" . > ... > Job JOBID="job_200903310541_1747" FINISH_TIME="1238542231308" JOB_STATUS="SUCCESS" FINISHED_MAPS="1338" FINISHED_REDUCES="760" FAILED_MAPS="78" FAILED_REDUCES="43" COUNTERS="..." . > When pushing the data through collectors and demux, the data can arrive out of order. The database is updated with status "RUNNING" instead of "SUCCESS". > Chukwa Sequence ID can be used to sort out of order data before the data is pumped to database. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.