spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheng Hao (JIRA)" <>
Subject [jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage
Date Fri, 03 Jul 2015 01:16:04 GMT


Cheng Hao commented on SPARK-8159:

Will that possible to add all of the expressions support in a SINGLE PR for Python API and
another SINGLE PR for R, after we finish all of the expressions?

At least we can save the of jenkins resources compare to adding them one by one.

> Improve SQL/DataFrame expression coverage
> -----------------------------------------
>                 Key: SPARK-8159
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Reynold Xin
> This is an umbrella ticket to track new expressions we are adding to SQL/DataFrame.
> For each new expression, we should:
> 1. Add a new Expression implementation in org.apache.spark.sql.catalyst.expressions
> 2. If applicable, implement the code generated version (by implementing genCode).
> 3. Add comprehensive unit tests (for all the data types the expressions support).
> 4. If applicable, add a new function for DataFrame in org.apache.spark.sql.functions,
and python/pyspark/sql/ for Python.
> For date/time functions, put them in expressions/datetime.scala, and create a DateTimeFunctionSuite.scala
for testing.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message