drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tshi...@apache.org
Subject [17/50] [abbrv] drill git commit: Re-enabled _drafts folder
Date Fri, 01 May 2015 18:08:13 GMT
Re-enabled _drafts folder


Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/81ee68a8
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/81ee68a8
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/81ee68a8

Branch: refs/heads/gh-pages
Commit: 81ee68a828034a7c50dbb0492e571175503fa832
Parents: 5716a41
Author: Tomer Shiran <tshiran@gmail.com>
Authored: Wed Apr 29 19:52:00 2015 -0700
Committer: Tomer Shiran <tshiran@gmail.com>
Committed: Wed Apr 29 19:52:00 2015 -0700

----------------------------------------------------------------------
 .gitignore                                      |  1 -
 _layouts.old/default.html                       | 15 -------
 _layouts.old/docpage.html                       | 25 -----------
 _layouts.old/page.html                          |  9 ----
 _layouts.old/post.html                          | 45 --------------------
 blog/_drafts/drill-0.9-released.md              | 32 ++++++++++++++
 ...-parquet-graudates-to-a-top-level-project.md | 12 +++---
 blog/_posts/2015-05-04-drill-0.9-released.md    | 32 --------------
 8 files changed, 38 insertions(+), 133 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/.gitignore
----------------------------------------------------------------------
diff --git a/.gitignore b/.gitignore
index bdf6a75..fca57d5 100644
--- a/.gitignore
+++ b/.gitignore
@@ -1,4 +1,3 @@
 _site/*
-blog/_drafts/*
 .sass-cache/*
 .DS_Store

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/_layouts.old/default.html
----------------------------------------------------------------------
diff --git a/_layouts.old/default.html b/_layouts.old/default.html
deleted file mode 100644
index 3d0342d..0000000
--- a/_layouts.old/default.html
+++ /dev/null
@@ -1,15 +0,0 @@
-<!DOCTYPE html>
-<html>
-
-{% include head.html %}
-
-<body onResize="resized();">
-<div class="page-wrap">
-  {% include menu.html %}
-  {{ content }}
-</div>
-
-{% include footer.html %}
-{% include scripts.html %}
-</body>
-</html>

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/_layouts.old/docpage.html
----------------------------------------------------------------------
diff --git a/_layouts.old/docpage.html b/_layouts.old/docpage.html
deleted file mode 100644
index 9beb032..0000000
--- a/_layouts.old/docpage.html
+++ /dev/null
@@ -1,25 +0,0 @@
----
-layout: default
----
-
-
-<link href="{{ site.baseurl }}/css/docpage.css" rel="stylesheet" type="text/css">
-
-
-{% include breadcrumbs.html %}
-{% include doc_toc_categories.html %}
-
-<div class="int_title">
-<h1>{{ page.title }}</h1>
-{% if page.description %}<p>{{ page.description }}</p>{% endif %}
-</div>
-
-<div class="int_text" align="left">
-    {% include doc_toc.html %}
-  <div class="main-content">
-    <a class="edit-link" href="https://github.com/apache/drill/blob/gh-pages/TODO{{ page.path
| remove: 'repo/' }}" target="_blank"><i class="fa fa-pencil-square-o"></i></a>
-    {{ content }}
-  </div>
-  {% include doc_nav.html %}
-</div>
-

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/_layouts.old/page.html
----------------------------------------------------------------------
diff --git a/_layouts.old/page.html b/_layouts.old/page.html
deleted file mode 100644
index 31d2871..0000000
--- a/_layouts.old/page.html
+++ /dev/null
@@ -1,9 +0,0 @@
----
-layout: default
----
-<div class="int_title">
-<h1>{{ page.title }}</h1>
-{% if page.description %}<p>{{ page.description }}</p>{% endif %}
-</div>
-
-<div class="int_text" align="left">{{ content }}</div>

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/_layouts.old/post.html
----------------------------------------------------------------------
diff --git a/_layouts.old/post.html b/_layouts.old/post.html
deleted file mode 100644
index 070bf62..0000000
--- a/_layouts.old/post.html
+++ /dev/null
@@ -1,45 +0,0 @@
----
-layout: default
----
-<div class="post int_text">
-
-  <header class="post-header">
-    <h1 class="post-title">{{ page.title }}</h1>
-    <p class="post-meta">
-    {% if page.authors.size > 1 %}
-    <strong>Authors:</strong>
-    <ul>
-      {% for alias in page.authors %}
-        {% assign author = site.data.authors[alias] %}
-        <li>{{ author.name }} ({{ author.title}}, {{ author.org}})</li>
-      {% endfor %}
-    </ul>
-    {% else %}
-      {% assign alias = page.authors[0] %}
-      {% assign author = site.data.authors[alias] %}
-      <strong>Author:</strong> {{ author.name }} ({{ author.title}}, {{ author.org}})
-    {% endif %}
-{% unless page.nodate %}<br/><strong>Date:</strong> {{ page.date | date:
"%b %-d, %Y" }}{% endunless %}
-{% if page.meta %}{{ page.meta }}{% endif %}</p>
-  </header>
-  <div class="addthis_sharing_toolbox"></div>
-
-  <article class="post-content">
-    {{ content }}
-  </article>
- <div id="disqus_thread"></div>
-    <script type="text/javascript">
-        /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
-        var disqus_shortname = 'drill'; // required: replace example with your forum shortname
-
-        /* * * DON'T EDIT BELOW THIS LINE * * */
-        (function() {
-            var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async
= true;
-            dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
-            (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
-        })();
-    </script>
-    <noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments
powered by Disqus.</a></noscript>
-    
-</div>
-<script type="text/javascript" src="//s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d"
async="async"></script>

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/blog/_drafts/drill-0.9-released.md
----------------------------------------------------------------------
diff --git a/blog/_drafts/drill-0.9-released.md b/blog/_drafts/drill-0.9-released.md
new file mode 100644
index 0000000..5291f6a
--- /dev/null
+++ b/blog/_drafts/drill-0.9-released.md
@@ -0,0 +1,32 @@
+---
+layout: post
+title: "Drill 0.9 Released"
+code: drill-0.9-released
+excerpt: The community has just released Drill 0.9, which includes 199 resolved JIRAs and
numerous enhancements.
+authors: ["tshiran", "jnadeau"]
+---
+It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{
site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability
of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes
[199 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813).
Some of the noteworthy features in Drill 0.9 are:
+
+* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill
now supports username/password authentication through the Java and C++ clients, as well as
JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials.
Users can choose to use an external user directory such as Active Directory or LDAP. To enable
authentication, set the `security.user.auth` option in `drill-override.conf`.
+* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries
now execute and access resources using the identity of the user who submitted the query. Previously,
all queries would run as the same user (eg, `drill`). With the new impersonation capability,
the query will fail if the submitting user does not have permission to read the requested
file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation`
option in `drill-override.conf`.
+* **Ownership chaining**. Drill now allows views with different owners to be chained. This
represents a very flexible access control solution. For example, an administrator with access
to raw, sensitive data could create a view called `masked` which would expose only a subset
of the data to other users. The administrator would enable users to read the `masked` view
but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies
how many ownership changed are allowed in a chain, thereby providing administrators (or data
stewards) more control over sharing of data.
+* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/)
- a set of extensions to the JSON format for supporting additional data types. We decided
to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so
a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is
just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo`
is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
+  We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`,
`$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)).
We're in the process of adding some additional qualifiers to make sure that all of MongoDB's
extended types are supported (this is particularly important when querying data in MongoDB).
+* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill
can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly
known as Elasticsearch).
+* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675)
and more). It can be challenging for a complex distributed system like Drill to translate
low-level internal conditions into actionable messages to the user. This release includes
several enhancements that enable Drill to accomplish just that in a variety of cases.
+* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410)
and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional
query engine - it's the first analytical query engine with a JSON data model. This has required
us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements
have now been contributed back to those projects, and Drill is using the latest versions which
include these enhancements.
+* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)).
Drill includes two new `sys` tables that provide real-time metrics about memory utilization
and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what
information is available:
+
+    ```sql
+    SELECT * FROM sys.drillmemory;
+    SELECT * FROM sys.drillbitthreads;
+    ```
+
+* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)).
Drill previously had some issues with tables that had more than 4095 colums. This limitation
has been addressed.
+
+You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you may check
out the official [release notes](https://cwiki.apache.org/confluence/display/DRILL/Release+Notes)
for more details.
+
+We're gearing up for Drill's 1.0 release later this month. Stay tuned!
+
+Happy Drilling!  
+Tomer Shiran and Jacques Nadeau
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/blog/_posts/2015-04-30-apache-parquet-graudates-to-a-top-level-project.md
----------------------------------------------------------------------
diff --git a/blog/_posts/2015-04-30-apache-parquet-graudates-to-a-top-level-project.md b/blog/_posts/2015-04-30-apache-parquet-graudates-to-a-top-level-project.md
index 6fbc4a0..e8e0a56 100644
--- a/blog/_posts/2015-04-30-apache-parquet-graudates-to-a-top-level-project.md
+++ b/blog/_posts/2015-04-30-apache-parquet-graudates-to-a-top-level-project.md
@@ -5,13 +5,13 @@ code: apache-parquet-graudates-to-a-top-level-project
 excerpt: The Apache Parquet project has graduated to a top-level project (TLP) at the Apache
Software Foundation.
 authors: ["tshiran"]
 ---
-It's an exciting day. Apache Parquet, the de-facto standard open source columnar format,
has graduated to an Apache top-level project.
+It's an exciting day. Apache Parquet, the de-facto standard columnar format for Hadoop, has
graduated to an Apache top-level project.
 
-The Drill project supports a variety of file formats, but Parquet is the highest performing
format, and it's the one we recommend to anyone who wants to maximize the performance of their
queries.
+The Drill project supports a variety of file formats, but Parquet is the highest performing
format, and it's the one we recommend to anyone who wants to maximize the performance of their
queries. We've had the pleasure of working closely with the Parquet community for over two
years, and it's exciting to see how much the project has evolved.
 
-We've had the pleasure of working closely with the Parquet community for over a year, and
it's exciting to see how much the project has evolved. We've made a number of contributions
to the project, and we're gearing up for a major contribution after the Parquet 1.7 release.
+We've made a number of contributions to the project, including support for self-describing
data. We just implemented off-heap memory management for the Parquet readers and writers,
which will improve Parquet's memory handling. (This enhancement will be available in Parquet
1.8.)
 
-I wanted to congratulate Twitter's Julian Le Dem ([@j_](https://twitter.com/j_)), VP of Apache
Parquet, and the entire Parquet community on the graduation milestone. Oh, and how can I get
a two-letter Twitter handle?
+I wanted to congratulate Twitter's Julien Le Dem ([@j_](https://twitter.com/j_)), VP of Apache
Parquet, and the entire Parquet community on the graduation milestone. Oh, and how can I get
a two-letter Twitter handle?
 
-Happy Drilling!
-Tomer Shiran
+Happy Drilling!  
+Tomer Shiran
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/81ee68a8/blog/_posts/2015-05-04-drill-0.9-released.md
----------------------------------------------------------------------
diff --git a/blog/_posts/2015-05-04-drill-0.9-released.md b/blog/_posts/2015-05-04-drill-0.9-released.md
deleted file mode 100644
index 20e5ca4..0000000
--- a/blog/_posts/2015-05-04-drill-0.9-released.md
+++ /dev/null
@@ -1,32 +0,0 @@
----
-layout: post
-title: "Drill 0.9 Released"
-code: drill-0.9-released
-excerpt: The community has just released Drill 0.9, which includes 243 resolved JIRAs and
numerous enhancements.
-authors: ["tshiran", "jnadeau"]
----
-It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{
site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability
of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes
[199 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813).
Some of the noteworthy features in Drill 0.9 are:
-
-* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill
now supports username/password authentication through the Java and C++ clients, as well as
JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials.
Users can choose to use an external user directory such as Active Directory or LDAP. To enable
authentication, set the `security.user.auth` option in `drill-override.conf`.
-* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries
now execute and access resources using the identity of the user who submitted the query. Previously,
all queries would run as the same user (eg, `drill`). With the new impersonation capability,
the query will fail if the submitting user does not have permission to read the requested
file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation`
option in `drill-override.conf`.
-* **Ownership chaining**. Drill now allows views with different owners to be chained. This
represents a very flexible access control solution. For example, an administrator with access
to raw, sensitive data could create a view called `masked` which would expose only a subset
of the data to other users. The administrator would enable users to read the `masked` view
but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies
how many ownership changed are allowed in a chain, thereby providing administrators (or data
stewards) more control over sharing of data.
-* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/)
- a set of extensions to the JSON format for supporting additional data types. We decided
to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so
a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is
just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo`
is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
-  We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`,
`$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)).
We're in the process of adding some additional qualifiers to make sure that all of MongoDB's
extended types are supported (this is particularly important when querying data in MongoDB).
-* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675)
and more). It can be challenging for a complex distributed system like Drill to translate
low-level internal conditions into actionable messages to the user. This release includes
several enhancements that enable Drill to accomplish just that in a variety of cases.
-* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410)
and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional
query engine - it's the first analytical query engine with a JSON data model. This has required
us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements
have now been contributed back to those projects, and Drill is using the latest versions which
include these enhancements.
-* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill
can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly
known as Elasticsearch).
-* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)).
Drill includes two new `sys` tables that provide real-time metrics about memory utilization
and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what
information is available:
-
-    ```sql
-    SELECT * FROM sys.drillmemory;
-    SELECT * FROM sys.drillbitthreads;
-    ```
-
-* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)).
Drill previously had some issues with tables that had more than 4095 colums. This limitation
has been addressed.
-
-You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you may check
out the official [release notes](https://cwiki.apache.org/confluence/display/DRILL/Release+Notes)
for more details.
-
-We're gearing up for Drill's 1.0 release later this month. Stay tuned!
-
-Happy Drilling!  
-Tomer Shiran and Jacques Nadeau
\ No newline at end of file


Mime
View raw message