incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "OptiqProposal" by AshutoshChauhan
Date Mon, 05 May 2014 22:16:21 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "OptiqProposal" page has been changed by AshutoshChauhan:
https://wiki.apache.org/incubator/OptiqProposal?action=diff&rev1=2&rev2=3

Comment:
Updated "Relationships with Other Apache Products" section based on feedback from mailing
list.

  === Relationships with Other Apache Products ===
  
  As mentioned in the Alignment section, Optiq is being used by Apache Hive and Apache Drill,
and has adapters for Apache Phoenix and Apache Spark. Optiq often operates on data in a Hadoop
environment, so collaboration with other Hadoop projects is desirable and highly likely.
+ 
+ Unsurprisingly there is some overlap in capabilities between Optiq and other Apache projects.
Several projects that are databases or database-like have query-planning capabilities. These
include Hive, Drill, Phoenix, Spark, Apache Derby, Apache Pig, Apache Jena and Apache Tajo.
Optiq’s query planner is extensible at run time, and does not have a preferred runtime engine
on which to execute compiled queries. These capabilities, and the large corpus of pre-built
rules, are what allow Optiq to be embedded in other projects.
+ 
+ Several other Apache projects access third-party data sources, including Hive, Pig, Drill,
Spark and Apache MetaModel. Optiq allows users to optimize access to third-party data sources
by writing rules to push processing down to the data source, and provide a cost model to choose
the optimal location for processing. That said, maintaining a library of adapters is burdensome,
and so it would make sense to collaborate with other projects on adapter libraries, and re-use
libraries where possible.
+ 
+ Optiq supports several front ends for submitting queries. The most popular is SQL, with
driver connectivity via JDBC (and ODBC planned). Other Apache projects with a SQL parser include
Hive, Spark, Phoenix, Derby, Tajo. Drill uses Optiq’s parser and JDBC stack; both Phoenix
and Drill have expressed interest in collaborating on JDBC and ODBC. Optiq’s Linq4j API
is similar to the fluent query-builder APIs in Spark and MetaModel. Use of a front end is
not required; for instance, Hive integrates with Optiq by directly building a graph of RelNode
objects.
  
  === An Excessive Fascination with the Apache Brand ===
  

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message