Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D7CE519F84 for ; Tue, 19 Apr 2016 10:17:07 +0000 (UTC) Received: (qmail 90587 invoked by uid 500); 19 Apr 2016 10:17:07 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 90534 invoked by uid 500); 19 Apr 2016 10:17:07 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 90523 invoked by uid 99); 19 Apr 2016 10:17:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Apr 2016 10:17:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 4044A1A044F for ; Tue, 19 Apr 2016 10:17:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.771 X-Spam-Level: X-Spam-Status: No, score=-3.771 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id XlTdN0dHRBgR for ; Tue, 19 Apr 2016 10:17:05 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with SMTP id 0F3C05F3A1 for ; Tue, 19 Apr 2016 10:17:04 +0000 (UTC) Received: (qmail 90509 invoked by uid 99); 19 Apr 2016 10:17:04 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Apr 2016 10:17:04 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 4F823DFBC6; Tue, 19 Apr 2016 10:17:04 +0000 (UTC) From: tzulitai To: issues@flink.incubator.apache.org Reply-To: issues@flink.incubator.apache.org Message-ID: Subject: [GitHub] flink pull request: [FLINK-3229] Flink streaming consumer for AWS ... Content-Type: text/plain Date: Tue, 19 Apr 2016 10:17:04 +0000 (UTC) GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/1911 [FLINK-3229] Flink streaming consumer for AWS Kinesis I've been using this consumer for a while in off-production environments. I understand we should have good test coverage for each PR, but since Kinesis is a hosted service, reliable integration tests are hard to pull off. To speed up merging Kinesis connector for the next release, I'm submitting the consumer now for some early reviews. On the other hand, since @rmetzger is submitting a separate PR for Kinesis producer, I'd like to postpone writing more tests for the consumer, as well as corresponding modification to the document until both the consumer and producer are in place. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tzulitai/flink FLINK-3229 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/1911.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1911 ---- commit 0e7c4eccca132e0fcf35262b36229e681c77530e Author: Gordon Tai Date: 2016-04-16T03:33:17Z [FLINK-3229] Initial working version for FlinkKinesisConsumer. commit 6d46a6d09c346e490053a2f6319616a5178dab4e Author: Gordon Tai Date: 2016-04-17T09:34:55Z [FLINK-3229] Change access level of `assignShards` and `validatePropertiesConfig` to protected for testing purposes commit c92b491fce8b3c35b409bc6f308d25ce52835027 Author: Gordon Tai Date: 2016-04-17T11:12:00Z [FLINK-3229] Fix coding stype violations regarding leading spaces in indentations commit bc9f771c0f36618ce07772cfdefe7d87a35800fb Author: Gordon Tai Date: 2016-04-19T09:56:57Z [FLINK-3229] Change scope of flink-streaming-java module to provided commit fc454efaac5dc7969ad4834b892f26799cfe5a33 Author: Gordon Tai Date: 2016-04-19T09:58:46Z [FLINK-3229] Basic unit test for stable shard-to-consumer assignment ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---