chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <ey...@yahoo-inc.com>
Subject Enhance demux parsers
Date Sun, 11 Jul 2010 03:05:35 GMT
Hi all,

I am planning on modifying AbstractProcessor to have 2 additional methods:

Public String getTableName
Public String getColumnFamily

This allows HBaseWriter to validate the output schema and add data to
different Htable.  This should have no impact to existing demux.

Another approach is to use annotation and insert annotation to existing
parser class like:

Public class HadoopLogProcessor extends Abstract Processor {
  @Table
  public static final String recordType = ³HadoopLog²;
  @ColumnFamily
  public static final String nameNodeType = ³NameNode²;
  @ColumnFamily
  public static final String dataNodeType = ³DataNode²;
...
}

Which method makes more sense?

Regards,
Eric

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message