hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milind Bhandarkar (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2118) Consider implementing a LogAppender based on HBase
Date Sun, 28 Oct 2007 20:01:50 GMT
Consider implementing a LogAppender based on HBase

                 Key: HADOOP-2118
                 URL: https://issues.apache.org/jira/browse/HADOOP-2118
             Project: Hadoop
          Issue Type: New Feature
          Components: contrib/hbase
    Affects Versions: 0.14.3
         Environment: All
            Reporter: Milind Bhandarkar
            Priority: Minor
             Fix For: 0.16.0

Since HBase already emulates appends to DFS-based HStore, and allows query on these tables,
please consider implementing a LogAppender based on HBase. This will allow storage of job-logs
and counters to DFS while making them query-able. Since HBase already has a web-based query
interface, it will be very useful for "real-time" queries to see what is going wrong with
the job.

When DFS has appends (HADOOP-1700), HBase will surely take advantage of them, but the rest
of the framework need not change.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message