drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yash Sharma" <yash...@gmail.com>
Subject Review Request 29816: DRILL-92: Cassandra Storage Engine
Date Mon, 12 Jan 2015 18:57:45 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29816/
-----------------------------------------------------------

Review request for drill.


Repository: drill-git


Description
-------

Cassandra storage engine implementation using the datastax Java driver.
Storage plugin format:
{
  "type": "cassandra",
  "host": "localhost",
  "port": 9042,
  "enabled": true
}

Known Issues:
- Subscan doesnot use min/max filters, hence pulls entire data
- Filter pushdown is broken. Currently only Drill side filters work.


Diffs
-----

  contrib/pom.xml d75dc79 
  contrib/storage-cassandra/pom.xml PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraCompareFunctionsProcessor.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraDatabaseSchema.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraFilterBuilder.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraGroupScan.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraPushDownFilterForScan.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraRecordReader.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraScanBatchCreator.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraScanSpec.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraSchemaFactory.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraStoragePlugin.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraStoragePluginConfig.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/CassandraSubScan.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/DrillCassandraConstants.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/java/org/apache/drill/exec/store/cassandra/connection/CassandraConnectionManager.java
PRE-CREATION 
  contrib/storage-cassandra/src/main/resources/bootstrap-storage-plugins.json PRE-CREATION

  contrib/storage-cassandra/src/main/resources/drill-module.conf PRE-CREATION 
  contrib/storage-cassandra/src/test/java/org/apache/drill/cassandra/BaseCassandraTest.java
PRE-CREATION 
  contrib/storage-cassandra/src/test/java/org/apache/drill/cassandra/CassandraFilterPushdownTest.java
PRE-CREATION 
  contrib/storage-cassandra/src/test/java/org/apache/drill/cassandra/CassandraProjectPushdownTest.java
PRE-CREATION 
  contrib/storage-cassandra/src/test/java/org/apache/drill/cassandra/CassandraRecordReaderTest.java
PRE-CREATION 
  contrib/storage-cassandra/src/test/java/org/apache/drill/cassandra/CassandraTestConstants.java
PRE-CREATION 
  contrib/storage-cassandra/src/test/resources/cassandra-plans/cassandra_scan_screen_physical.json
PRE-CREATION 
  contrib/storage-cassandra/src/test/resources/cassandra-plans/cassandra_scan_screen_with_columns_physical.json
PRE-CREATION 
  distribution/pom.xml 2aefe08 
  distribution/src/assemble/bin.xml 8f6e90d 

Diff: https://reviews.apache.org/r/29816/diff/


Testing
-------

Testing done via Sqlline and Web Interface. 
Tested with Physical plan and Sql query via New Test framework.

Testcases:

CassandraRecordReaderTest
- testPlanLocal
- testPlanLocalWithColumns

CassandraProjectPushdownTest
- testProjection

CassandraFilterPushdownTest
- testSelectAll
- testFilter
- testFilter1
- testFilter2
- testFilterZeroRecords
- testFilterWithOrCondition
- testFilterWithAndCondition


Thanks,

Yash Sharma


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message