flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From C DINESH <dinesh.kitt...@gmail.com>
Subject Re: Stateful-fun-Basic-Hello
Date Tue, 26 May 2020 13:02:44 GMT
Thanks Gordan and Igal,


I understood the services file now. It is working now.

cheers,
Dinesh.




On Tue, May 26, 2020 at 5:50 PM C DINESH <dinesh.kittu99@gmail.com> wrote:

> Hi Igal,
>
> org.apache.flink.statefun.sdk.spi.StatefulFunctionModule is not there in
> META-INF/services/
>
> [image: Screenshot 2020-05-26 at 5.46.35 PM.png]
>
> Here I am attaching the POM file. Please suggest me how can i fix.
>
>
>
> On Tue, May 26, 2020 at 3:44 PM Igal Shilman <igal@ververica.com> wrote:
>
>> Hi,
>> Can you verify that your jar contains the following file
>> META-INF/services/org.apache.flink.statefun.sdk.spi.StatefulFunctionModule ?
>>
>> Thanks,
>> Igal.
>>
>> On Tue, May 26, 2020 at 11:49 AM C DINESH <dinesh.kittu99@gmail.com>
>> wrote:
>>
>>> Hi Gordon,
>>>
>>> Thanks for your response.
>>>
>>> After adding this conf to flink-yml.
>>>
>>> `classloader.parent-first-patterns.additional:
>>> org.apache.flink.statefun;org.apache.kafka;com.google.protobuf`
>>>
>>> It gave me one more error
>>>
>>> The main method caused an error: Invalid configuration:
>>> jobmanager.scheduler; Currently the only supported scheduler is 'legacy'
>>>
>>> I updated to
>>>
>>> jobmanager.scheduler : legacy
>>>
>>> in flink-conf.yaml
>>>
>>> But know I got one more error. Which is self-explanatory. But actually I
>>> have provided ingress and egress in the module. I have attached a screen
>>> shot of my code. Please suggest me what to do.
>>>
>>> $ ./bin/flink run -c
>>> org.apache.flink.statefun.flink.core.StatefulFunctionsJob
>>> /Users/dineshchiramana/learning/flink_learning/stateful-fun-hello-java/target/stateful-fun-hello-java-1.0-SNAPSHOT-jar-with-dependencies.jar
>>>
>>>
>>>
>>> ------------------------------------------------------------
>>>
>>>  The program finished with the following exception:
>>>
>>>
>>> org.apache.flink.client.program.ProgramInvocationException: The main
>>> method caused an error: There are no ingress defined.
>>>
>>> at
>>> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:335)
>>>
>>> at
>>> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
>>>
>>> at
>>> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:138)
>>>
>>> at
>>> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:662)
>>>
>>> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:210)
>>>
>>> at
>>> org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:893)
>>>
>>> at
>>> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:966)
>>>
>>> at
>>> org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
>>>
>>> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:966)
>>>
>>> Caused by: java.lang.IllegalStateException: There are no ingress defined.
>>>
>>> at
>>> org.apache.flink.statefun.flink.core.StatefulFunctionsUniverseValidator.validate(StatefulFunctionsUniverseValidator.java:25)
>>>
>>> at
>>> org.apache.flink.statefun.flink.core.StatefulFunctionsJob.main(StatefulFunctionsJob.java:66)
>>>
>>> at
>>> org.apache.flink.statefun.flink.core.StatefulFunctionsJob.main(StatefulFunctionsJob.java:41)
>>>
>>> at
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>>> Method)
>>>
>>> at
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>
>>> at
>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>
>>> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>
>>> at
>>> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
>>>
>>> ... 8 more
>>>
>>>
>>>
>>>
>>> Cheers,
>>> Dinesh.
>>>
>>>
>>> On Tue, May 26, 2020 at 9:59 AM Tzu-Li (Gordon) Tai <tzulitai@apache.org>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> You're right, maybe the documentation needs a bit more directions
>>>> there, especially for people who are newer to Flink.
>>>>
>>>> 1. How to increase parallelism
>>>>
>>>> There are two ways to do this. Either set the `parallelism.default`
>>>> also in the flink-conf.yaml, or use the -p command line option when
>>>> starting the application via packaged Docker images.
>>>>
>>>> 2. How to enable checkpointing
>>>>
>>>> You would have to set execution.checkpointing.mode and
>>>> execution.checkpointing.interval configs, also in flink-conf.yaml.
>>>>
>>>> For example, the mode can be set to `EXACTLY_ONCE` and interval to
>>>> `5sec` to have exactly-once mode checkpoints at 5 second intervals.
>>>>
>>>>
>>>> In general, the Statefun specific configurations are listed here [1].
>>>> All other configurations available in Flink are also available in
>>>> Stateful Functions as well.
>>>>
>>>> Cheers,
>>>> Gordon
>>>>
>>>> [1]
>>>> https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.0/deployment-and-operations/configurations.html
>>>>
>>>> On Tue, May 26, 2020, 11:42 AM C DINESH <dinesh.kittu99@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Team,
>>>>>
>>>>> I mean to say that know I understood. but in the documentation page
>>>>> flink-conf.yaml is not mentioned
>>>>>
>>>>> On Mon, May 25, 2020 at 7:18 PM C DINESH <dinesh.kittu99@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Thanks Gordon,
>>>>>>
>>>>>> I read the documentation several times. But I didn't understand at
>>>>>> that time, flink-conf.yaml is not there.
>>>>>>
>>>>>> can you please suggest
>>>>>> 1. how to increase parallelism
>>>>>> 2. how to give checkpoints to the job
>>>>>>
>>>>>> As far as I know there is no documentation regarding this. or Are
>>>>>> these features are not there yet?
>>>>>>
>>>>>> Cheers,
>>>>>> Dinesh.
>>>>>>
>>>>>

Mime
View raw message