ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mohamed Jameel Naina Mohamed (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AMBARI-10145) Add support for tee to another Storage service
Date Mon, 01 Aug 2016 18:21:20 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-10145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mohamed Jameel Naina Mohamed updated AMBARI-10145:
--------------------------------------------------
    Description: 
AMS should provide extension to drain metrics to other sources. 

Proposal: 

 In PhoenixHBaseAccessor add support to drain aggregated metrics to additional sinks apart
from writing to HBase. This change required introducing new config to register a class which
drain metrics. Here is the proposed sink interface


public interface TimelineMetricsAggregatorSink {

  public void saveHostAggregateRecords(Map<TimelineMetric, MetricHostAggregate> hostAggregateMap,
      String tableName);
  
  public void saveClusterTimeAggregateRecords(Map<TimelineClusterMetric, MetricHostAggregate>
records,
      String tableName) ;
  
  public void saveClusterAggregateRecords(Map<TimelineClusterMetric, MetricClusterAggregate>
records) ;
}

new config: timeline.metrics.service.aggregator.sink.class

  was:
- Define an interface based on HBaseTimlineMetricsStore. Decouple implementation from the
contract.
- Implement a Circular Buffer to cache the arriving metrics with a dequeue thread that sends
the cached metrics to a MetricsSystemTeeEndpoint
- Define MetricsSystemTeeEndpoint interface with simple methods to read configs and sinkData
- Allow for handling exceptions like NoDataException, TimeoutOnTeeException, TeeEndpointUnavailableException
- Make the bounded buffer size configurable.
- Allow configurable send interval
- Allow user to configure precision settings, e.g.: Send data every hour and only 5 minute
aggregates.


> Add support for tee to another Storage service
> ----------------------------------------------
>
>                 Key: AMBARI-10145
>                 URL: https://issues.apache.org/jira/browse/AMBARI-10145
>             Project: Ambari
>          Issue Type: Task
>          Components: ambari-metrics
>    Affects Versions: 2.1.0
>            Reporter: Siddharth Wagle
>            Assignee: Mohamed Jameel Naina Mohamed
>
> AMS should provide extension to drain metrics to other sources. 
> Proposal: 
>  In PhoenixHBaseAccessor add support to drain aggregated metrics to additional sinks
apart from writing to HBase. This change required introducing new config to register a class
which drain metrics. Here is the proposed sink interface
> public interface TimelineMetricsAggregatorSink {
>   public void saveHostAggregateRecords(Map<TimelineMetric, MetricHostAggregate>
hostAggregateMap,
>       String tableName);
>   
>   public void saveClusterTimeAggregateRecords(Map<TimelineClusterMetric, MetricHostAggregate>
records,
>       String tableName) ;
>   
>   public void saveClusterAggregateRecords(Map<TimelineClusterMetric, MetricClusterAggregate>
records) ;
> }
> new config: timeline.metrics.service.aggregator.sink.class



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message