pinot-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xian...@apache.org
Subject [incubator-pinot] branch sharded_consumer_type_support_with_kinesis updated (063a06f -> 6240808)
Date Sun, 03 Jan 2021 02:17:24 GMT
This is an automated email from the ASF dual-hosted git repository.

xiangfu pushed a change to branch sharded_consumer_type_support_with_kinesis
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard 063a06f  fixing compilation
 discard 4da5a2c  Return message batch instead of list in the fetch result
 discard 8d0248a  Add isEndOfPartition check in checkpoints
 discard 203aa08  Handle timeout exception in consumer and make shard iterator type configurable
 discard d922695  Add test code for kinesis
 discard dbdcaf0  Change shard metadata logic
 discard 47b1664  Refactor: get shard iterator methods
 discard bb8e08f  Handle closed connections
 discard 00db7a2  Refactor code
 discard b0a2468  Handle exceptions
 discard 422688d  Add license header
 discard 900450d  fetch records with timeout
 discard b0eeec6  Add Kinesis config wrapper
 discard ee95eeb  Add license headers
 discard 2463bd1  Reformat code
 discard 9567c18  Move shardId out of checkpoint to partition group metadata
 discard ba3d100  Fix consumer code
 discard c9cd79c  Refactor kinesis shard metadata interface and add shardId to the metadata
 discard 56efa08  Refactor PartitionGroupMetadataMap interface
 discard 76cfcf1  Add kinesis code to handle offsets
 discard 1a8a80a  Add PartitionGroupMetdataMap interface
 discard 60195b0  Add initial implementation of Kinesis consumer
 discard abc6588  Add interfaces for V2 consumers
     add 6f4336e  default methods to avoid interface changes
     new 87d0c26  Add interfaces for V2 consumers
     new e094e49  Add initial implementation of Kinesis consumer
     new 5b44917  Add PartitionGroupMetdataMap interface
     new e7a5314  Add kinesis code to handle offsets
     new 855e39d  Refactor PartitionGroupMetadataMap interface
     new 86fd014  Refactor kinesis shard metadata interface and add shardId to the metadata
     new f9c317d  Fix consumer code
     new d8b18cd  Move shardId out of checkpoint to partition group metadata
     new 9bdc27f  Reformat code
     new f3db54c  Add license headers
     new 2399cbb  Add Kinesis config wrapper
     new 4eb2aa6  fetch records with timeout
     new b0f82c4  Add license header
     new 2c1bb76  Handle exceptions
     new bdbab1e  Refactor code
     new 173b3c4  Handle closed connections
     new 6fcdf3e  Refactor: get shard iterator methods
     new 97d3ffc  Change shard metadata logic
     new 0af84b1  Add test code for kinesis
     new bd7f673  Handle timeout exception in consumer and make shard iterator type configurable
     new abe6647  Add isEndOfPartition check in checkpoints
     new eac6c90  Return message batch instead of list in the fetch result
     new 6240808  fixing compilation

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (063a06f)
            \
             N -- N -- N   refs/heads/sharded_consumer_type_support_with_kinesis (6240808)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 23 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../realtime/LLRealtimeSegmentDataManager.java     |  3 +-
 .../impl/fakestream/FakeStreamConsumerFactory.java |  8 +---
 .../fakestream/FakeStreamMetadataProvider.java     | 11 -----
 ...lakyConsumerRealtimeClusterIntegrationTest.java |  5 ---
 .../stream/kafka09/KafkaConsumerFactory.java       |  7 ---
 .../kafka09/KafkaStreamMetadataProvider.java       | 46 +------------------
 .../kafka09/KafkaPartitionLevelConsumerTest.java   |  2 +-
 .../stream/kafka20/KafkaConsumerFactory.java       |  7 ---
 .../kafka20/KafkaStreamMetadataProvider.java       | 52 ----------------------
 .../pinot/plugin/stream/kinesis/KinesisConfig.java | 10 ++---
 .../plugin/stream/kinesis/KinesisConsumerTest.java | 29 ++++++------
 .../spi/stream/PartitionGroupInfoFetcher.java      |  4 +-
 .../pinot/spi/stream/StreamConsumerFactory.java    |  4 +-
 .../pinot/spi/stream/StreamMetadataProvider.java   | 36 ++++++++++++---
 14 files changed, 63 insertions(+), 161 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Mime
View raw message