streams-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sblackmon <sblack...@apache.org>
Subject Re: Getting started / tutorial help
Date Wed, 05 Oct 2016 22:17:31 GMT
Trevor, others,

I’ve opened a few pull requests containing a Flink example module with integration tests
demonstrating five pipelines working end-to-end in local mode.

https://github.com/apache/incubator-streams/pull/289

https://github.com/apache/incubator-streams-examples/pull/12

If you have a chance to code review and replicate this, that would be terrific.  I believe
this demonstrates clearly that Streams is suitable for embedding within real-time parallel
processing frameworks.

As we discussed in Berlin there are a lot of cool possible demos based on feeding social streams
into Zeppelin workbooks and/or Flink complex event processing libraries.

Steve

On September 30, 2016 at 9:20:09 AM, Steve Blackmon (steve@blackmon.org) wrote:

Trevor,

I don’t see sample.json in the code tree:

https://github.com/apache/incubator-streams-examples/tree/flink/flink/flink-twitter-collection/src/main/jsonschema

Did you happen create that file while trying to run the job or copy it there inadvertently?

The jsonschema2pojo plugin will parse any .json files in that directory and it will fail if
they aren’t proper json schemas.

Please keep me posted on your progress.

Cheers,
Steve
On September 30, 2016 at 9:00:53 AM, Trevor Grant (trevor.d.grant@gmail.com) wrote:

Hey all,

just trying to get started on Apache Streams.

I was trying to build the examples (on the Flink branch), when I
-DskipTests I can get a build but when I do mvn clean package I get the
following errors:

skip non existing resourceDirectory
/home/rawkintrevo/gits/incubator-streams-examples/flink/flink-twitter-collection/src/main/xmlschema
[INFO] skip non existing resourceDirectory
/home/rawkintrevo/gits/incubator-streams-examples/flink/flink-twitter-collection/src/main/resources
[INFO] skip non existing resourceDirectory
/home/rawkintrevo/gits/incubator-streams-examples/flink/flink-twitter-collection/src/site/diagrams
[INFO]
[INFO] --- jsonschema2pojo-maven-plugin:0.4.1:generate (default) @
flink-twitter-collection ---
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] streams-examples-flink ............................ SUCCESS [1.752s]
[INFO] flink-twitter-collection .......................... FAILURE [4.383s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 7.455s
[INFO] Finished at: Fri Sep 30 07:58:14 GMT-06:00 2016
[INFO] Final Memory: 30M/430M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.jsonschema2pojo:jsonschema2pojo-maven-plugin:0.4.1:generate (default)
on project flink-twitter-collection: Execution default of goal
org.jsonschema2pojo:jsonschema2pojo-maven-plugin:0.4.1:generate failed:
Error parsing document:
file:/home/rawkintrevo/gits/incubator-streams-examples/flink/flink-twitter-collection/src/main/jsonschema/sample.json:
Unexpected end-of-input within/between OBJECT entries
[ERROR] at [Source:
file:/home/rawkintrevo/gits/incubator-streams-examples/flink/flink-twitter-collection/src/main/jsonschema/sample.json;
line: 69, column: 2279]


Should I be worried?

tg

Trevor Grant
Data Scientist
https://github.com/rawkintrevo
http://stackexchange.com/users/3002022/rawkintrevo
http://trevorgrant.org

*"Fortunate is he, who is able to know the causes of things." -Virgil*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message