Return-Path: X-Original-To: apmail-incubator-chukwa-dev-archive@www.apache.org Delivered-To: apmail-incubator-chukwa-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EA6E39BCB for ; Mon, 25 Jun 2012 01:13:43 +0000 (UTC) Received: (qmail 6917 invoked by uid 500); 25 Jun 2012 01:13:43 -0000 Delivered-To: apmail-incubator-chukwa-dev-archive@incubator.apache.org Received: (qmail 6883 invoked by uid 500); 25 Jun 2012 01:13:43 -0000 Mailing-List: contact chukwa-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@incubator.apache.org Delivered-To: mailing list chukwa-dev@incubator.apache.org Received: (qmail 6875 invoked by uid 99); 25 Jun 2012 01:13:43 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 25 Jun 2012 01:13:43 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id A99B81404AA for ; Mon, 25 Jun 2012 01:13:43 +0000 (UTC) Date: Mon, 25 Jun 2012 01:13:42 +0000 (UTC) From: "Eric Yang (JIRA)" To: chukwa-dev@incubator.apache.org Message-ID: <1597360179.49535.1340586823696.JavaMail.jiratomcat@issues-vm> In-Reply-To: <1146066018.5211.1328221377799.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Assigned] (CHUKWA-632) Logs getting lost in hbase using TsProcessor MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CHUKWA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned CHUKWA-632: -------------------------------- Assignee: Abhijit Dhar > Logs getting lost in hbase using TsProcessor > -------------------------------------------- > > Key: CHUKWA-632 > URL: https://issues.apache.org/jira/browse/CHUKWA-632 > Project: Chukwa > Issue Type: Bug > Affects Versions: 0.5.0 > Reporter: Abhijit Dhar > Assignee: Abhijit Dhar > Attachments: patch.txt > > > When collector writes to hbase using TsProcessor, it is using timestamp as the key. If there are multiple log statements with the same timestamp, which is the key, it looses them in hbase. > As a fix, I extended AbstractProcessor and built my key using timestamp and the AbstractProcessor.startOffset. But, for that, it has to be protected or a getter on it in AbstractProcessor class to be able to use it. > Also, the way OutputCollector.collect method works, it might need to redo the way rowKey is created. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira