phoenix-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From twdsilva <...@git.apache.org>
Subject [GitHub] phoenix issue #423: PHOENIX-5059 Use the Datasource v2 api in the spark conn...
Date Thu, 03 Jan 2019 05:51:40 GMT
Github user twdsilva commented on the issue:

    https://github.com/apache/phoenix/pull/423
  
    The PR adds ```PhoenixDataSource``` which implements the new [DataSourceV2 API](https://issues.apache.org/jira/browse/SPARK-15689).
This will allow further optimizations in the future such as limit and aggregate pushdown,
see [SPARK-22386](https://issues.apache.org/jira/browse/SPARK-22386) 
    
    ```PhoenixSparkIT``` and ```PhoenixSparkITTenantSpecific``` were converted to use this
API. 
    ```PhoenixRelation``` and related classes that implemented the old API were deprecated.
    I also bumped up the spark version to  2.4.0 and set the java source and target version
to 1.8 for the maven-compiler-plugin.
    
    @jmahonin can you please review?



---

Mime
View raw message