flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Biplob Biswas <revolutioni...@gmail.com>
Subject No Alerts with FinkCEP
Date Fri, 26 May 2017 12:25:55 GMT
Hi,

I just started exploring Flink CEP a day back and I thought I can use it to
make a simple event processor. For that I looked into the CEP examples by
Till and some other articles. 

Now I have 2 questions which i would like to ask:

*Part 1:*

I came up with the following piece of code, but this is not working as
expected.

///**************** Main ******************///


FlinkKafkaConsumer010<String> consumer = new FlinkKafkaConsumer010<>(
            "testTopic",
            new SimpleStringSchema(),
            props);

    DataStream<String> input = env.addSource(consumer);
    LOG.info("About to process events");
    DataStream<ReadEventType> events =
            input
                    //.map(s -> s.f1)
                    .map(new MapStringToRRE())
                    .filter(Objects::nonNull);

    //events.print();

    DataStream<ReadEventType> partitionedInput = events
            .keyBy((KeySelector<ReadEventType, String>) value ->
value.getRawTransactionItem().getChargedAccount());

    Pattern<ReadEventType, ?> pattern =
Pattern.<ReadEventType>begin("first")
            .where(event -> event.getFormat() == FormatType.FILE)
            .followedBy("second")
            .where(event -> event.getFormat() == FormatType.FILE)
            .within(Time.seconds(1));

    PatternStream<ReadEventType> patternStream =
CEP.pattern(partitionedInput, pattern);

    DataStream<String> alerts =
patternStream.select((PatternSelectFunction<ReadEventType, String>)
CEPForBAMRRE::createAlert);

    alerts.print();

    env.execute("CEP monitoring job");
  }


///*********** Alert Function returning just concat of txn id
***************///

  private static String createAlert(Map<String, ReadEventType> pattern) {
    return pattern.get("first").getTransactionItem().getUid() + " " +
            pattern.get("second").getTransactionItem().getUid();
  }

///******************* properties for kafka **************///

  private static Properties getDefaultProperties(Properties prop){
    prop.put("group.id", "FlinkCEP");
    prop.put("bootstrap.servers", BOOTSTRAP_SERVERS);
    prop.put("zookeeper.connect", ZKEEPER);
    prop.put("auto.offset.reset", "earliest");
    return prop;
  }


As my kafka topic only sends me events with formattype = FILE, I was
expecting to see multiple alerts being raised. But thats not the case, i am
not getting any alert at the moment.

Can anyone point out what am I doing wrong? 

PART 2: 

Also, my main aim for using CEP is to read from different topics and raise
alert if a second event is *not* followed by a first event within a given
time interval. How can I achieve it with FlinkCEP? for now I can only see
that if 2 events follow within a time interval an alert should be raised. 


Thanks & Regards,
Biplob



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/No-Alerts-with-FinkCEP-tp13333.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message