beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nawaid Shamim (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public
Date Tue, 11 Jul 2017 14:07:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nawaid Shamim updated BEAM-2581:
--------------------------------
    Description: 
Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to provided
AWS credential or AWSKinesisClient - `withClientProvider` as described on [here](https://beam.apache.org/documentation/sdks/javadoc/2.0.0/)

{code}
There's also possibility to start reading using arbitrary point in time - in this case you
need to provide Instant object:
 p.apply(KinesisIO.read()
     .from("streamName", instant)
     .withClientProvider(new KinesisClientProvider() {
                        @Override
                        public AmazonKinesis get() {
                            return null;
                        }
      })
  .apply( ... ) // other transformations
{code}

The above code requires org.apache.beam.sdk.io.kinesis.KinesisClientProvider interface to
be public.



  was:
Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to provided
AWS credential or AWSKinesisClient - `withClientProvider` as described on [here](https://beam.apache.org/documentation/sdks/javadoc/2.0.0/)


 public class MyCustomKinesisClientProvider implements KinesisClientProvider {
   {@literal @}Override
   public AmazonKinesis get() {
     // set up your client here
   }
 }
 
Usage is pretty straightforward:

{code}

{noformat}

There's also possibility to start reading using arbitrary point in time - in this case you
need to provide Instant object:
 p.apply(KinesisIO.read()
     .from("streamName", instant)
     .withClientProvider(new KinesisClientProvider() {
                        @Override
                        public AmazonKinesis get() {
                            return null;
                        }
      })
  .apply( ... ) // other transformations
{code}

The above code requires org.apache.beam.sdk.io.kinesis.KinesisClientProvider interface to
be public.




> KinesisClientProvider interface needs to be public
> --------------------------------------------------
>
>                 Key: BEAM-2581
>                 URL: https://issues.apache.org/jira/browse/BEAM-2581
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>    Affects Versions: 2.0.0
>            Reporter: Nawaid Shamim
>            Assignee: Davor Bonaci
>            Priority: Minor
>
> Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to
provided AWS credential or AWSKinesisClient - `withClientProvider` as described on [here](https://beam.apache.org/documentation/sdks/javadoc/2.0.0/)
> {code}
> There's also possibility to start reading using arbitrary point in time - in this case
you need to provide Instant object:
>  p.apply(KinesisIO.read()
>      .from("streamName", instant)
>      .withClientProvider(new KinesisClientProvider() {
>                         @Override
>                         public AmazonKinesis get() {
>                             return null;
>                         }
>       })
>   .apply( ... ) // other transformations
> {code}
> The above code requires org.apache.beam.sdk.io.kinesis.KinesisClientProvider interface
to be public.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message