spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anbu <anbutec...@gmail.com>
Subject Windowing LAG function Usage in Spark2.2 Dataset scala
Date Thu, 14 Mar 2019 03:55:19 GMT
Hi,

To calculate LAG functions difference for the two data_date(current date and
previous date) on the same column
Could you please help me to implement the below scenario using scala spark
Dataset.
uniq_im - LAG(uniq_im,1,0) OVER PARTITION BY(name,sit,plc,country,state)
order by (data_date) as calc_value.

could you please help me how to implement using spark scala Dataset.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message