spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From franklyn <>
Subject Differentiate Spark streaming in event logs
Date Mon, 19 Oct 2015 18:47:15 GMT
Hi I'm running a job to collect some analytics on spark jobs by analyzing
their event logs. We write the event logs to a single HDFS folder and then
pick them up in another job. I'd like to differentiate between regular spark
jobs and spark streaming jobs in the event logs, i was wondering if there is
an event/property/key that is different between the two.



View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message