beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2469) Handling Kinesis shards splits and merges
Date Mon, 11 Dec 2017 17:40:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286318#comment-16286318
] 

ASF GitHub Bot commented on BEAM-2469:
--------------------------------------

pawel-kaczmarczyk opened a new pull request #4243: [BEAM-2469] Handling Kinesis shards splits
and merges
URL: https://github.com/apache/beam/pull/4243
 
 
   Follow this checklist to help us incorporate your contribution quickly and easily:
   
    - [X] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM/issues/)
filed for the change (usually before you start working on it).  Trivial changes like typos
do not require a JIRA issue.  Your pull request should address just this issue, without pulling
in other changes.
    - [X] Each commit in the pull request should have a meaningful subject line and body.
    - [X] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`,
where you replace `BEAM-XXX` with the appropriate JIRA issue.
    - [X] Write a pull request description that is detailed enough to understand what the
pull request does, how, and why.
    - [X] Run `mvn clean verify` to make sure basic checks pass. A more thorough check will
be performed on your pull request automatically.
    - [ ] If this contribution is large, please file an Apache [Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.pdf).
   
   ---
   This pull requests tries to address stream resharding operations described in detail [here](http://docs.aws.amazon.com/streams/latest/dev/kinesis-using-sdk-java-resharding.html).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Handling Kinesis shards splits and merges
> -----------------------------------------
>
>                 Key: BEAM-2469
>                 URL: https://issues.apache.org/jira/browse/BEAM-2469
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Paweł Kaczmarczyk
>            Assignee: Paweł Kaczmarczyk
>
> Kinesis stream consists of [shards|http://docs.aws.amazon.com/streams/latest/dev/key-concepts.html#shard]
that allow for capacity scaling. In order to increase/decrease the capacity shards have to
be split/merged together. Such operations are currently not handled properly and will end
with errors.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message