gobblin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (GOBBLIN-758) Use keys to push messages to kafka. Implemented Metric and Event reporters that push messages without serialization.
Date Mon, 06 May 2019 22:38:00 GMT

     [ https://issues.apache.org/jira/browse/GOBBLIN-758?focusedWorklogId=238178&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-238178
]

ASF GitHub Bot logged work on GOBBLIN-758:
------------------------------------------

                Author: ASF GitHub Bot
            Created on: 06/May/19 22:37
            Start Date: 06/May/19 22:37
    Worklog Time Spent: 10m 
      Work Description: vikrambohra commented on issue #2622: [GOBBLIN-758] Added new reporters
to emit MetricReport and GobblinTrackingEvent without serializing them. Also added random
key generator for reporters.
URL: https://github.com/apache/incubator-gobblin/pull/2622#issuecomment-489812641
 
 
   @sv2000 
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 238178)
    Time Spent: 1.5h  (was: 1h 20m)

> Use keys to push messages to kafka. Implemented Metric and Event reporters that push
messages without serialization.
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-758
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-758
>             Project: Apache Gobblin
>          Issue Type: Improvement
>            Reporter: Vikram Bohra
>            Priority: Major
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> This ticket introduces the following changes.
> 1) It reduces the number of connections to Kafka by using a randomly generated key for
each instance of the reporter.
> 2) Introduces a KeyValuePusher interface that provides a cleaner way to push key value
messages to kafka.
> 3) Default implementation of the above interface for kafka. 
> 4) New Reporters for reporting GobblinTrackingEvent and MetricReport without serializing
them.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message