hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2603) full system application test scenario: event log
Date Sun, 23 May 2010 20:13:23 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870452#action_12870452
] 

Andrew Purtell commented on HBASE-2603:
---------------------------------------

Since this is real data, instead of generic Lucene and Katta (or hbasene + Solr), consider
anomaly detection:

   * An online variant of http://www2.berkeley.intel-research.net/~hling/research/minelog_sysml08.pdf

   * SALSA/Mochi (http://www.usenix.org/event/wasl08/tech/full_papers/tan/tan_html/), incorporated
into Apache Chukwa (http://wiki.apache.org/hadoop/Anomaly_Detection_Framework_with_Chukwa)

Need to sanity check for gross failures but folding in the above could raise red flags about
possible subtle problems. 

> full system application test scenario: event log
> ------------------------------------------------
>
>                 Key: HBASE-2603
>                 URL: https://issues.apache.org/jira/browse/HBASE-2603
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>            Reporter: Andrew Purtell
>
> Variation on webtable.
> Instead of crawler or crawler simulation for generating content, configure log4j to use
an appender that writes into HBase. Optionally run at DEBUG log level to increase the evil.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message