spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Yuanjian (JIRA)" <>
Subject [jira] [Commented] (SPARK-10816) EventTime based sessionization
Date Fri, 28 Sep 2018 06:06:00 GMT


Li Yuanjian commented on SPARK-10816:

Great thanks for [~kabhwan] notice me, just linked SPARK-22565 as duplicated with this, sorry
for just searching "session window" before and lost this, will still find others duplicated

As discussed in SPARK-22565, we also meet this problem while doing the migration of streaming
app running on other system to Structure Streaming. We solved this by implement the session
window as build-in function and gave internal beta version based on Apache Spark 2.3.0 just
week ago. After steady running online for real product env, we are doing the code clean work
and doc translating.

As discussed with Jungtaek, we also wished to join the discussion here and will give PR and
design doc today.

The preview pr I'll submit contains others patch. cc [~liulinhong] [~ivoson]  [~yanlin-Lynn]
[~LiangchangZ] , please watching this issue.

> EventTime based sessionization
> ------------------------------
>                 Key: SPARK-10816
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>          Components: Structured Streaming
>            Reporter: Reynold Xin
>            Priority: Major
>         Attachments: SPARK-10816 Support session window natively.pdf

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message