spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "萝卜丝炒饭" <1427357...@qq.com>
Subject issue about the windows slice of stream
Date Sat, 24 Jun 2017 06:51:52 GMT
Hi all,
I found an issue about the windows slice of dstream.
My code is :


ssc = new StreamingContext( conf, Seconds(1))


val content = ssc.socketTextStream('ip','port')
content.countByValueAndWindow( Seconds(2),  Seconds(8)).foreach( println(xxxx))
The key is that slide is greater than windows.
I checked the output.The result from  foreach( println(xxxx)) was wrong.
I found the stream was cut apart wrong.
Can I open a JIRA please?


thanks
Fei Shao
Mime
View raw message