drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bridg...@apache.org
Subject [6/9] drill git commit: reorg rn, 1.0 > 1.1
Date Mon, 06 Jul 2015 23:26:45 GMT
http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/020-1.0.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/020-1.0.0-rn.md b/_docs/rn/020-1.0.0-rn.md
new file mode 100755
index 0000000..73fd453
--- /dev/null
+++ b/_docs/rn/020-1.0.0-rn.md
@@ -0,0 +1,493 @@
+---
+title: "Apache Drill 1.0.0 Release Notes"
+parent: "Release Notes"
+---
+ Today we're happy to announce the availability of Drill 1.0.0, providing additional enhancements and bug fixes. This release includes the following new features, enhancements, and bug fixes:
+    
+<h2>        Sub-task
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2150'>DRILL-2150</a>] -         Create an abstraction for repeated value vectors.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2358'>DRILL-2358</a>] -         Ensure DrillScanRel differentiates skip-all, scan-all &amp; scan-some in a backward compatible fashion
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2893'>DRILL-2893</a>] -         ScanBatch throws a NullPointerException instead of returning OUT_OF_MEMORY
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2895'>DRILL-2895</a>] -         AbstractRecordBatch.buildSchema() should properly handle OUT_OF_MEMORY outcome
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2902'>DRILL-2902</a>] -         Add support for context UDFs: user (and its synonyms session_user, system_user) and current_schema
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2905'>DRILL-2905</a>] -         RootExec implementations should properly handle IterOutcome.OUT_OF_MEMORY
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2920'>DRILL-2920</a>] -         properly handle OutOfMemoryException
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2947'>DRILL-2947</a>] -         AllocationHelper.allocateNew() doesn&#39;t have a consistent behavior when it can&#39;t allocate
+</li>
+</ul>
+                        
+<h2>        Bug
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-148'>DRILL-148</a>] -         Remove sandbox directory from source control, it is no longer utilized
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-625'>DRILL-625</a>] -         Server does not release resources even after client connection is closed
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-708'>DRILL-708</a>] -         TRUNC(n1) function returns a decimal instead of int
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-994'>DRILL-994</a>] -         Reduce hbase timeout when it is not reachable
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1245'>DRILL-1245</a>] -         Drill should pinpoint to the &quot;Problem Record&quot; when it fails to parse a json file
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1440'>DRILL-1440</a>] -         Allow delimited files to have customizable quote characters
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1460'>DRILL-1460</a>] -         JsonReader fails reading files with decimal numbers and integers in the same field
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1502'>DRILL-1502</a>] -         Can&#39;t connect to mongo when requiring auth
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1503'>DRILL-1503</a>] -         CTAS does not work against mongo plugin
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1542'>DRILL-1542</a>] -         Early fragment termination causes non running intermediate fragments to error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1545'>DRILL-1545</a>] -         Json files can only be read when they have a .json extension
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1727'>DRILL-1727</a>] -         REPEATED_CONTAINS sometimes doesn&#39;t work
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1827'>DRILL-1827</a>] -         Unit test framework reports expected and actual values backwards in unordered comparison
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1832'>DRILL-1832</a>] -         Select * from json file failed with java.lang.IllegalArgumentException: null
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1866'>DRILL-1866</a>] -         Tests that include limit sporadically fail when run as part of entire test suite on Linux
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1891'>DRILL-1891</a>] -         Error message does not get propagated correctly when reading from JSON file
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1973'>DRILL-1973</a>] -         Tableau query causes parsing error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1980'>DRILL-1980</a>] -         Create table with a Cast to interval day results in a file which cannot be read
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2005'>DRILL-2005</a>] -         Create table fails to write out a parquet file created from hive- read works fine
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2006'>DRILL-2006</a>] -         Implement text reader with advanced capabilities
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2036'>DRILL-2036</a>] -         select * query returns wrong result when column name in json file changes case
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2073'>DRILL-2073</a>] -         Filter on a field in a nested repeated type throws an exception
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2074'>DRILL-2074</a>] -         Queries fail with OutOfMemory Exception when Hash Join &amp; Agg are turned off
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2085'>DRILL-2085</a>] -         Failed to propagate error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2091'>DRILL-2091</a>] -         NPE in AbstractSqlAccessor
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2093'>DRILL-2093</a>] -         Columns of time and timestamp data type are not stored correctly in json format on CTAS
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2140'>DRILL-2140</a>] -         RPC Error querying JSON with empty nested maps
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2141'>DRILL-2141</a>] -         Data type error in group by and order by for JSON
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2158'>DRILL-2158</a>] -          Failure while attempting to start Drillbit in embedded mode. 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2179'>DRILL-2179</a>] -         better handle column called &#39;Timestamp&#39;
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2181'>DRILL-2181</a>] -         Throw proper error message when flatten is used within an &#39;order by&#39; or &#39;group by&#39;
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2201'>DRILL-2201</a>] -         clear error message on join on complex type
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2208'>DRILL-2208</a>] -         Error message must be updated when query contains operations on a flattened column
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2219'>DRILL-2219</a>] -         Concurrent modification exception in TopLevelAllocator if a child allocator is added during loop in close()
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2221'>DRILL-2221</a>] -         CTAS (JSON) creates unreadable files when writing empty arrays
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2228'>DRILL-2228</a>] -         Projecting &#39;*&#39; returns all nulls when we have flatten in a filter and order by
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2229'>DRILL-2229</a>] -         SQL syntax errors should use SQLSyntaxErrorException
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2232'>DRILL-2232</a>] -         Flatten functionality not well defined when we use flatten in an order by without projecting it
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2264'>DRILL-2264</a>] -         Incorrect data when we use aggregate functions with flatten
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2277'>DRILL-2277</a>] -         COUNT(*) should return 0 instead of an empty result set when there are no records
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2281'>DRILL-2281</a>] -         Drill never returns when we use aggregate functions after a join with an order by
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2292'>DRILL-2292</a>] -         CTAS broken when we have repeated maps
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2301'>DRILL-2301</a>] -         Query fails when multiple table aliases are provided for CTEs
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2340'>DRILL-2340</a>] -         count(*) fails with subquery not containing limit
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2350'>DRILL-2350</a>] -         Star query failed with exception on JSON data
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2376'>DRILL-2376</a>] -         UNION ALL on Aggregates with GROUP BY returns incomplete results
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2404'>DRILL-2404</a>] -         After we cancel a query, DRILL sometimes hangs for the next query
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2408'>DRILL-2408</a>] -         CTAS should not create empty folders when underlying query returns no results
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2411'>DRILL-2411</a>] -         Scalar SUM/AVG over empty result set returns no rows instead of NULL
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2423'>DRILL-2423</a>] -         DROP VIEW against non-existent views fails with ZK error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2425'>DRILL-2425</a>] -         Wrong results when identifier change cases within the same data file
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2437'>DRILL-2437</a>] -         enhance exception injection to support session level injections
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2452'>DRILL-2452</a>] -         ResultSet.getDouble should not throw an exception when the underlying type is a FLOAT
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2476'>DRILL-2476</a>] -         Handle IterOutcome.STOP in buildSchema()
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2506'>DRILL-2506</a>] -         IOOB with order by and limit
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2511'>DRILL-2511</a>] -         Assert with full outer join when one of the join predicates is of a required type (nullabe parquet)
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2528'>DRILL-2528</a>] -         Drill-JDBC-All Jar uses outdated classes
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2532'>DRILL-2532</a>] -         Glob not always fired for DFS storage engine
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2533'>DRILL-2533</a>] -         Metrics displayed in the profile UI should be rounded off instead of being truncated
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2535'>DRILL-2535</a>] -         Column labels on drill profile page are incorrect
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2536'>DRILL-2536</a>] -         Peak Mem column in the profile page displays 0 when value is less than 1MB
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2545'>DRILL-2545</a>] -         Killing a JDBC client program does not kill the query on drillbits
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2548'>DRILL-2548</a>] -         JDBC driver prints misleading SQL exception on getting record batches with no data
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2552'>DRILL-2552</a>] -         ZK disconnect to foreman node results in hung query on client
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2554'>DRILL-2554</a>] -         Incorrect results for repeated values when using jdbc
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2569'>DRILL-2569</a>] -         Minor fragmentId in Profile UI gets truncated to the last 2 digits
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2570'>DRILL-2570</a>] -         Broken JDBC-All Jar packaging can cause missing XML classes
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2589'>DRILL-2589</a>] -         Creating a view with duplicate column names should fail or give a warning to the user
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2598'>DRILL-2598</a>] -         Order by with limit on complex type throw IllegalStateException
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2617'>DRILL-2617</a>] -         Errors in the execution stack will cause DeferredException to throw an IllegalStateException
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2624'>DRILL-2624</a>] -         org.apache.drill.common.StackTrace prints garbage for line numbers
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2662'>DRILL-2662</a>] -         Exception type not being included when propagating exception message
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2723'>DRILL-2723</a>] -         Inaccurate row count estimate for text files results in BroadcastExchange
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2750'>DRILL-2750</a>] -         Running 1 or more queries against Drillbits having insufficient DirectMem renders the Drillbits in an unusable state
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2753'>DRILL-2753</a>] -         Implicit cast fails when comparing a double column and a varchar literal
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2754'>DRILL-2754</a>] -         Allocation bug in splitAndTransfer method causing some flatten queries to fail
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2755'>DRILL-2755</a>] -         Use and handle InterruptedException during query processing
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2757'>DRILL-2757</a>] -         Verify operators correctly handle low memory conditions and cancellations
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2776'>DRILL-2776</a>] -         querying a .json file that contains a repeated type returns the wrong results 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2778'>DRILL-2778</a>] -         Killing the drillbit which is the foreman results in hung sqlline
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2780'>DRILL-2780</a>] -         java.lang.IllegalStateException files open exceptions in drillbit.out
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2793'>DRILL-2793</a>] -         Killing a non foreman node results in direct memory being held on
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2801'>DRILL-2801</a>] -         ORDER BY produces extra records
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2806'>DRILL-2806</a>] -         Querying data from compressed csv file returns nulls and unreadable data
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2809'>DRILL-2809</a>] -         Increase the default value of partitioner_sender_threads_factor
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2811'>DRILL-2811</a>] -         Need option to specify Drillbit in the connection URI to connect to that specific Drillbit
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2816'>DRILL-2816</a>] -         system error does not display the original Exception message
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2823'>DRILL-2823</a>] -         Merge join should use implicit cast
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2824'>DRILL-2824</a>] -         Function resolution should be deterministic
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2826'>DRILL-2826</a>] -         Improve resilience to memory leaks and unclosed allocators
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2841'>DRILL-2841</a>] -         Web UI very slow in a multi node machine
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2847'>DRILL-2847</a>] -         DrillBufs from the RPC layer are being leaked
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2848'>DRILL-2848</a>] -         Disable decimal data type by default
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2849'>DRILL-2849</a>] -         Difference in query results over CSV file created by CTAS, compared to results over original CSV file 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2865'>DRILL-2865</a>] -         Drillbit runs out of memory on multiple consecutive CTAS
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2870'>DRILL-2870</a>] -         Fix return type of aggregate functions to be nullable
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2871'>DRILL-2871</a>] -         Plan for TPC-H 20 changed with DRILL-1384 (or DRILL-2761) causing performance degradation
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2872'>DRILL-2872</a>] -         Result from json file returns data from map type fields as &quot;null&quot;
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2875'>DRILL-2875</a>] -         IllegalStateException when querying the public yelp json dataset
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2878'>DRILL-2878</a>] -         FragmentExecutor.closeOutResources() is not called if an exception happens in the Foreman before the fragment executor starts running
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2884'>DRILL-2884</a>] -         Have cancel() cause &quot;query canceled&quot; rather than just &quot;ResultSet closed&quot;
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2886'>DRILL-2886</a>] -         JDBC driver doesn&#39;t detect lost connection
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2887'>DRILL-2887</a>] -         Fix bad applications of JdbcTest.connect()
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2889'>DRILL-2889</a>] -         Rename JdbcTest to JdbcTestBase.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2894'>DRILL-2894</a>] -         FixedValueVectors shouldn&#39;t set it&#39;s data buffer to null when it fails to allocate it
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2897'>DRILL-2897</a>] -         Update Limit 0 to avoid parallelization
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2904'>DRILL-2904</a>] -         Fix wrong &quot;before rows&quot; message to &quot;after rows&quot; message
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2907'>DRILL-2907</a>] -         Drill performance degrades significantly over time - resource leak
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2914'>DRILL-2914</a>] -         regression: Mondrian query534.q, drill give wrong result
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2921'>DRILL-2921</a>] -         Query with a mix of distinct and not distinct scalar aggregates runs out of memory
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2927'>DRILL-2927</a>] -         Pending query in resource queue starts after timeout
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2928'>DRILL-2928</a>] -         C++ Client - io_service needs to be reset if it runs out of work
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2932'>DRILL-2932</a>] -         Error text reported via System.out.println rather than thrown SQLException&#39;s message
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2934'>DRILL-2934</a>] -         Exception when distinct aggregate is compared to numeric literal with decimal point 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2936'>DRILL-2936</a>] -         TPCH 4 and 18 SF100 hangs when hash agg is turned off
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2940'>DRILL-2940</a>] -         Large allocations are not released until GC kicks in
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2942'>DRILL-2942</a>] -         Allow Use of epoll RPC layer on Linux
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2943'>DRILL-2943</a>] -         Drill parsing error during deserialization for an Order-By
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2944'>DRILL-2944</a>] -         Switch to G1GC to reduce GC cpu overhead.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2951'>DRILL-2951</a>] -         Tables are not visible when Drillbit is specified in the connection URL
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2953'>DRILL-2953</a>] -         Group By + Order By query results are not ordered.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2957'>DRILL-2957</a>] -         Netty Memory Manager doesn&#39;t move empty chunks between lists
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2959'>DRILL-2959</a>] -         Compression codecs are leaking or slow to recapture memory
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2960'>DRILL-2960</a>] -         Default hive storage plugin missing from fresh drill install
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2961'>DRILL-2961</a>] -         Statement.setQueryTimeout() should throw a SQLException
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2962'>DRILL-2962</a>] -         Correlated subquery with scalar aggregate or scalar aggregate with expression throws  and error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2963'>DRILL-2963</a>] -         Exists with empty left batch causes IllegalStateException
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2966'>DRILL-2966</a>] -         HAVING clause with CASE statement with IN predicate causes assertion
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2968'>DRILL-2968</a>] -         crash on parquet file
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2971'>DRILL-2971</a>] -         If Bit&lt;&gt;Bit connection is unexpectedly closed and we were already blocked on writing to socket, we&#39;ll stay forever in ResettableBarrier.await()
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2973'>DRILL-2973</a>] -         Error messages not showing up in sqlline
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2976'>DRILL-2976</a>] -         Set default of extended JSON support for output to false until issues are resolved
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2977'>DRILL-2977</a>] -         In WorkManager, startFragmentPendingRemote() and addFragmentRunner() need to be permuted
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2978'>DRILL-2978</a>] -         FragmentManager is not removed from the WorkEventBus if it&#39;s FragmentExecutor is cancelled before it starts running
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2979'>DRILL-2979</a>] -         Storage HBase doesn&#39;t support customized hbase property zookeeper.znode.parent
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2989'>DRILL-2989</a>] -         TPCDS Query corrupts Drillbits and causing subsequent unrelated queries to hang (and timeout)
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2993'>DRILL-2993</a>] -         SQLLine hangs when we cancel a query in the middle of displaying results
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2994'>DRILL-2994</a>] -         Incorrect error message when disconnecting from server (using direct connection to drillbit)
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2998'>DRILL-2998</a>] -         Update C++ client to send/receive heartbeat message 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3000'>DRILL-3000</a>] -         I got JIRA report #3000.  Now ... to use it for good or evil?
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3001'>DRILL-3001</a>] -         Some functional tests fail when new text reader is disabled
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3005'>DRILL-3005</a>] -         Spurious Error messages when using PrintingResultsListener
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3006'>DRILL-3006</a>] -         CTAS with interval data type creates invalid parquet file
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3007'>DRILL-3007</a>] -         Update Drill configuration settings to avoid mmap threshold increases on Linux
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3009'>DRILL-3009</a>] -         Reduce the IN list threshold to take advantage of Values operator
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3010'>DRILL-3010</a>] -         Convert bad command error messages into UserExceptions in SqlHandlers
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3012'>DRILL-3012</a>] -         Values Operator doesn&#39;t propagate operator id
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3017'>DRILL-3017</a>] -         NPE when cleaning up some RecordReader implementations
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3018'>DRILL-3018</a>] -         Queries with scalar aggregate  and non equality (non correlated) fail to plan
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3020'>DRILL-3020</a>] -         Some exception message text not displayed in SQLLine, etc.; copy to thrown SQLException&#39;s message
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3022'>DRILL-3022</a>] -         Ensure sequential shutdown of Drillbits
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3033'>DRILL-3033</a>] -         Add memory leak fixes found so far in DRILL-1942 to 1.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3037'>DRILL-3037</a>] -         Unable to query on hdfs after moving to 0.9.0 version
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3046'>DRILL-3046</a>] -         Memory Leak after cancelling a query
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3047'>DRILL-3047</a>] -         Command failed while establishing connection
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3048'>DRILL-3048</a>] -         Disable assertions by default
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3049'>DRILL-3049</a>] -         Increase sort spooling threshold
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3050'>DRILL-3050</a>] -         Increase query context max memory
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3051'>DRILL-3051</a>] -         Integer overflow in TimedRunnable
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3052'>DRILL-3052</a>] -         canceling a fragment executor before it starts running will cause the Foreman to wait indefinitely for a terminal message from that fragment
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3057'>DRILL-3057</a>] -         A query that used to work before now fails in the optimizer
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3058'>DRILL-3058</a>] -         RemoteConnection of RPC double closes the connection
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3061'>DRILL-3061</a>] -         Fix memory leaks in TestDrillbitResilience
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3062'>DRILL-3062</a>] -         regression: Mondrian query447.q - lots of rows missing in result set
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3063'>DRILL-3063</a>] -         TestQueriesOnLargeFile leaks memory with 16M limit
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3065'>DRILL-3065</a>] -         Memory Leak at ExternalSortBatch
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3066'>DRILL-3066</a>] -         AtomicRemainder - Tried to close remainder, but it has already been closed.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3069'>DRILL-3069</a>] -         Wrong result for aggregate query with filter  on SF100 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3070'>DRILL-3070</a>] -         Memory Leak when we run out of memory
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3071'>DRILL-3071</a>] -         RecordBatchLoader#load leaks memory if an exception is thrown while loading the batch.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3072'>DRILL-3072</a>] -         Profile UI fails to load when there is an empty json profile
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3074'>DRILL-3074</a>] -         ReconnectingClient.waitAndRun can stuck in infinite loop if it fails to establish the connection
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3077'>DRILL-3077</a>] -         sqlline&#39;s return code is 0 even when it force exits due to failed sql command
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3079'>DRILL-3079</a>] -         Move JSON Execution Plan parsing to FragmentExecutor
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3080'>DRILL-3080</a>] -         Error message is invalid if workload queue times out
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3081'>DRILL-3081</a>] -         Fix situation where Drill reports null &lt;--&gt; null in connection error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3085'>DRILL-3085</a>] -         In ExternalSortBatch, Memory Leak in Runtime Generation Code
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3087'>DRILL-3087</a>] -         Union All returns incorrect results.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3088'>DRILL-3088</a>] -         IllegalStateException: Cleanup before finished. 0 out of 1 strams have finished
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3089'>DRILL-3089</a>] -         Revert to 4 forked test and allow override from command line
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3092'>DRILL-3092</a>] -         Memory leak when an allocation fails near the creation of a RecordBatchData object
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3093'>DRILL-3093</a>] -         Leaking RawBatchBuffer
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3098'>DRILL-3098</a>] -         Set Unix style &quot;line.separator&quot; for tests
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3099'>DRILL-3099</a>] -         FileSelection&#39;s selectionRoot does not include the scheme and authority
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3100'>DRILL-3100</a>] -         TestImpersonationDisabledWithMiniDFS fails on Windows
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3101'>DRILL-3101</a>] -         Setting &quot;slice_target&quot; to 1 changes the order of the columns in a &quot;select *&quot; query with order by
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3103'>DRILL-3103</a>] -         EncoderException: RpcEncoder must produce at least one message.
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3105'>DRILL-3105</a>] -         OutOfMemoryError: GC overhead limit exceeded
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3107'>DRILL-3107</a>] -         Dynamic partition pruning fails on Windows (TestDirectoryExplorerUDFs)
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3109'>DRILL-3109</a>] -         Cancellation from sqlline is broken with the updated version
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3110'>DRILL-3110</a>] -         OutOfMemoryError causes memory accounting leak 
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3112'>DRILL-3112</a>] -         Drill UI profile page shows exceptions where a long running query is submitted via the UI
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3114'>DRILL-3114</a>] -         Sqlline throws exception at launch
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3115'>DRILL-3115</a>] -         SQLLine colors do not work well with CYGWIN
+</li>
+</ul>
+                    
+<h2>        Improvement
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1662'>DRILL-1662</a>] -         drillbit.sh stop should timeout
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2433'>DRILL-2433</a>] -         Implicit cast between date and timestamp is missing in joins
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2508'>DRILL-2508</a>] -         Add new column to sys.options table that exposes whether or not the current system value is the default
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2602'>DRILL-2602</a>] -         Throw an error on schema change during streaming aggregation
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2697'>DRILL-2697</a>] -         Pause injections should pause indefinitely until signalled
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2725'>DRILL-2725</a>] -         Faster work assignment logic
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2772'>DRILL-2772</a>] -         Display status of query when viewing the query&#39;s profile page
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2946'>DRILL-2946</a>] -         Tableau 9.0 Desktop Enablement Document
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2955'>DRILL-2955</a>] -         Enable color in sqlline for exceptions
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2969'>DRILL-2969</a>] -         Readers don&#39;t report number of records read in profile
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2981'>DRILL-2981</a>] -         Add simplified activity log
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2982'>DRILL-2982</a>] -         Tableau 9.0 Server Enablement Documentation
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2984'>DRILL-2984</a>] -         UserException is logging through its parent class logger
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3027'>DRILL-3027</a>] -         Add convenience methods to test builder for creating nested baseline values
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3053'>DRILL-3053</a>] -         add unchecked exception injection site in ChildAllocator
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3084'>DRILL-3084</a>] -         Add drill-* convenience methods for common cli startup commands
+</li>
+</ul>
+            
+<h2>        New Feature
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1573'>DRILL-1573</a>] -         Add configuration to skip header row in text files
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2382'>DRILL-2382</a>] -         enhance exception injection to support node-specific injections
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2383'>DRILL-2383</a>] -         add exception and pause injections for testing drillbit stability
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2658'>DRILL-2658</a>] -         Add ilike and regex substring functions
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2958'>DRILL-2958</a>] -         Move Drill to alternative cost-based planner for Join planning
+</li>
+</ul>
+                                                    
+<h2>        Task
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2316'>DRILL-2316</a>] -         Docs Enhancement: Data Sources and File Formats, Basics Tutorial
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2336'>DRILL-2336</a>] -         configuration storage plugin docs update
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2364'>DRILL-2364</a>] -         JSON Data Model Reference 2nd draft
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2381'>DRILL-2381</a>] -         write lexical structures section, JSON/Parquet reference fixes, updates to data types
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2397'>DRILL-2397</a>] -         Enhance SQL Ref Data Types docs
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2736'>DRILL-2736</a>] -         review feedback on multitenancy and user auth
+</li>
+</ul>
+
+You can now [download Drill 1.0.0]({{ site.baseurl }}/download/).
+
+
+

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/030-0.9.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/030-0.9.0-rn.md b/_docs/rn/030-0.9.0-rn.md
new file mode 100755
index 0000000..edae5c8
--- /dev/null
+++ b/_docs/rn/030-0.9.0-rn.md
@@ -0,0 +1,29 @@
+---
+title: "Apache Drill 0.9.0 Release Notes"
+parent: "Release Notes"
+---
+It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{ site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes [200 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813). Some of the noteworthy features in Drill 0.9 are:
+
+* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill now supports username/password authentication through the Java and C++ clients, as well as JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials. Users can choose to use an external user directory such as Active Directory or LDAP. To enable authentication, set the `security.user.auth` option in `drill-override.conf`.
+* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries now execute and access resources using the identity of the user who submitted the query. Previously, all queries would run as the same user (eg, `drill`). With the new impersonation capability, the query will fail if the submitting user does not have permission to read the requested file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation` option in `drill-override.conf`.
+* **Ownership chaining**. Drill now allows views with different owners to be chained. This represents a very flexible access control solution. For example, an administrator with access to raw, sensitive data could create a view called `masked` which would expose only a subset of the data to other users. The administrator would enable users to read the `masked` view but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies how many ownership changed are allowed in a chain, thereby providing administrators (or data stewards) more control over sharing of data.
+* **MongoDB authentication** ([DRILL-1502](https://issues.apache.org/jira/browse/DRILL-1502)). Drill can now connect to a MongoDB cluster that requires authentication.
+* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/) - a set of extensions to the JSON format for supporting additional data types. We decided to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo` is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
+  We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`, `$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)). We're in the process of adding some additional qualifiers to make sure that all of MongoDB's extended types are supported (this is particularly important when querying data in MongoDB).
+* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly known as Elasticsearch).
+* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675) and more). It can be challenging for a complex distributed system like Drill to translate low-level internal conditions into actionable messages to the user. This release includes several enhancements that enable Drill to accomplish just that in a variety of cases.
+* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410) and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional query engine - it's the first analytical query engine with a JSON data model. This has required us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements have now been contributed back to those projects, and Drill is using the latest versions which include these enhancements.
+* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)). Drill includes two new `sys` tables that provide real-time metrics about memory utilization and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what information is available:
+
+    ```sql
+    SELECT * FROM sys.drillmemory;
+    SELECT * FROM sys.drillbitthreads;
+    ```
+
+* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)). Drill previously had some issues with tables that had more than 4095 colums. This limitation has been addressed.
+
+You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you can check out the official [release notes]({{ site.baseurl }}/docs/release-notes/) for more details.
+
+We're gearing up for Drill's 1.0 release later this month. Stay tuned!
+
+

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/030-alpha-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/030-alpha-rn.md b/_docs/rn/030-alpha-rn.md
deleted file mode 100644
index 256300a..0000000
--- a/_docs/rn/030-alpha-rn.md
+++ /dev/null
@@ -1,39 +0,0 @@
----
-title: "Apache Drill M1 Release Notes (Apache Drill Alpha)"
-parent: "Release Notes"
----
-### Milestone 1 Goals
-
-The first release of Apache Drill is designed as a technology preview for
-people to better understand the architecture and vision. It is a functional
-release tying to piece together the key components of a next generation MPP
-query engine. It is designed to allow milestone 2 (M2) to focus on
-architectural analysis and performance optimization.
-
-  * Provide a new optimistic DAG execution engine for data analysis
-  * Build a new columnar shredded in-memory format and execution model that minimizes data serialization/deserialization costs and operator complexity
-  * Provide a model for runtime generated functions and relational operators that minimizes complexity and maximizes performance
-  * Support queries against columnar on disk format (Parquet) and JSON
-  * Support the most common set of standard SQL read-only phrases using ANSI standards. Includes: SELECT, FROM, WHERE, HAVING, ORDER, GROUP BY, IN, DISTINCT, LEFT JOIN, RIGHT JOIN, INNER JOIN
-  * Support schema-on-read querying and execution
-  * Build a set of columnar operation primitives including Merge Join, Sort, Streaming Aggregate, Filter, Selection Vector removal.
-  * Support unlimited level of subqueries and correlated subqueries
-  * Provided an extensible query-language agnostic JSON-base logical data flow syntax.
-  * Support complex data type manipulation via logical plan operations
-
-### Known Issues
-
-SQL Parsing  
-Because Apache Drill is built to support late-bound changing schemas while SQL
-is statically typed, there are couple of special requirements that are
-required writing SQL queries. These are limited to the current release and
-will be correct in a future milestone release.
-
-  * All tables are exposed as a single map field that contains
-  * Drill Alpha doesn't support implicit or explicit casts outside those required above.
-  * Drill Alpha does not include, there are currently a couple of differences for how to write a query in order to query against UDFs
-  * Drill currently supports simple and aggregate functions using scalar, repeated and
-  * Nested data support incomplete. Drill Alpha supports nested data structures as well repeated fields. 
-
-
-

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/030-m1-alpha-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/030-m1-alpha-rn.md b/_docs/rn/030-m1-alpha-rn.md
deleted file mode 100644
index 256300a..0000000
--- a/_docs/rn/030-m1-alpha-rn.md
+++ /dev/null
@@ -1,39 +0,0 @@
----
-title: "Apache Drill M1 Release Notes (Apache Drill Alpha)"
-parent: "Release Notes"
----
-### Milestone 1 Goals
-
-The first release of Apache Drill is designed as a technology preview for
-people to better understand the architecture and vision. It is a functional
-release tying to piece together the key components of a next generation MPP
-query engine. It is designed to allow milestone 2 (M2) to focus on
-architectural analysis and performance optimization.
-
-  * Provide a new optimistic DAG execution engine for data analysis
-  * Build a new columnar shredded in-memory format and execution model that minimizes data serialization/deserialization costs and operator complexity
-  * Provide a model for runtime generated functions and relational operators that minimizes complexity and maximizes performance
-  * Support queries against columnar on disk format (Parquet) and JSON
-  * Support the most common set of standard SQL read-only phrases using ANSI standards. Includes: SELECT, FROM, WHERE, HAVING, ORDER, GROUP BY, IN, DISTINCT, LEFT JOIN, RIGHT JOIN, INNER JOIN
-  * Support schema-on-read querying and execution
-  * Build a set of columnar operation primitives including Merge Join, Sort, Streaming Aggregate, Filter, Selection Vector removal.
-  * Support unlimited level of subqueries and correlated subqueries
-  * Provided an extensible query-language agnostic JSON-base logical data flow syntax.
-  * Support complex data type manipulation via logical plan operations
-
-### Known Issues
-
-SQL Parsing  
-Because Apache Drill is built to support late-bound changing schemas while SQL
-is statically typed, there are couple of special requirements that are
-required writing SQL queries. These are limited to the current release and
-will be correct in a future milestone release.
-
-  * All tables are exposed as a single map field that contains
-  * Drill Alpha doesn't support implicit or explicit casts outside those required above.
-  * Drill Alpha does not include, there are currently a couple of differences for how to write a query in order to query against UDFs
-  * Drill currently supports simple and aggregate functions using scalar, repeated and
-  * Nested data support incomplete. Drill Alpha supports nested data structures as well repeated fields. 
-
-
-

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/040-0.6.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/040-0.6.0-rn.md b/_docs/rn/040-0.6.0-rn.md
deleted file mode 100755
index 5b4ee00..0000000
--- a/_docs/rn/040-0.6.0-rn.md
+++ /dev/null
@@ -1,32 +0,0 @@
----
-title: "Apache Drill 0.6.0 Release Notes"
-parent: "Release Notes"
----
-Apache Drill 0.6.0, the second beta release for Drill, is designed to help
-enthusiasts start working and experimenting with Drill. It also continues the
-Drill monthly release cycle as we drive towards general availability.
-
-This release is available as [binary](http://www.apache.org/dyn/closer.cgi/inc
-ubator/drill/drill-0.5.0-incubating/apache-drill-0.5.0-incubating.tar.gz) and 
-[source](http://www.apache.org/dyn/closer.cgi/incubator/drill/drill-0.5.0-incu
-bating/apache-drill-0.5.0-incubating-src.tar.gz) tarballs that are compiled
-against Apache Hadoop. Drill has been tested against MapR, Cloudera, and
-Hortonworks Hadoop distributions. There are associated build profiles and
-JIRAs that can help you run Drill against your preferred distribution.
-
-Apache Drill 0.6.0 Key Features
-
-This release is primarily a bug fix release, with [more than 30 JIRAs closed](
-https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&vers
-ion=12327472), but there are some notable features:
-
-  * Direct ANSI SQL access to MongoDB, using the latest [MongoDB Plugin for Apache Drill]({{ site.baseurl }}/docs/mongodb-plugin-for-apache-drill)
-  * Filesystem query performance improvements with partition pruning
-  * Ability to use the file system as a persistent store for query profiles and diagnostic information
-  * Window function support (alpha)
-
-Apache Drill 0.6.0 Key Notes and Limitations
-
-  * The current release supports in-memory and beyond-memory execution. However, you must disable memory-intensive hash aggregate and hash join operations to leverage this functionality.
-  * While the Drill execution engine supports dynamic schema changes during the course of a query, some operators have yet to implement support for this behavior, such as Sort. Other operations, such as streaming aggregate, may have partial support that leads to unexpected results.
-

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/050-0.7.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/050-0.7.0-rn.md b/_docs/rn/050-0.7.0-rn.md
deleted file mode 100755
index 00c0f05..0000000
--- a/_docs/rn/050-0.7.0-rn.md
+++ /dev/null
@@ -1,56 +0,0 @@
----
-title: "Apache Drill 0.7.0 Release Notes"
-parent: "Release Notes"
----
-Apache Drill 0.7.0, the third beta release for Drill, is designed to help
-enthusiasts start working and experimenting with Drill. It also continues the
-Drill monthly release cycle as we drive towards general availability.
-
-This release is available as
-[binary](http://www.apache.org/dyn/closer.cgi/drill/drill-0.7.0/apache-
-drill-0.7.0.tar.gz) and
-[source](http://www.apache.org/dyn/closer.cgi/drill/drill-0.7.0/apache-
-drill-0.7.0-src.tar.gz) tarballs that are compiled against Apache Hadoop.
-Drill has been tested against MapR, Cloudera, and Hortonworks Hadoop
-distributions. There are associated build profiles and JIRAs that can help you
-run Drill against your preferred distribution
-
-Apache Drill 0.7.0 Key Features
-
-  * No more dependency on UDP/Multicast - Making it possible for Drill to work well in the following scenarios:
-
-    * UDP multicast not enabled (as in EC2)
-
-    * Cluster spans multiple subnets
-
-    * Cluster has multihome configuration
-
-  * New functions to natively work with nested data - KVGen and Flatten 
-
-  * Support for Hive 0.13 (Hive 0.12 with Drill is not supported any more) 
-
-  * Improved performance when querying Hive tables and File system through partition pruning
-
-  * Improved performance for HBase with LIKE operator pushdown
-
-  * Improved memory management
-
-  * Drill web UI monitoring and query profile improvements
-
-  * Ability to parse files without explicit extensions using default storage format specification
-
-  * Fixes for dealing with complex/nested data objects in Parquet/JSON
-
-  * Fast schema return - Improved experience working with BI/query tools by returning metadata quickly
-
-  * Several hang related fixes
-
-  * Parquet writer fixes for handling large datasets
-
-  * Stability improvements in ODBC and JDBC drivers
-
-Apache Drill 0.7.0 Key Notes and Limitations
-
-  * The current release supports in-memory and beyond-memory execution. However, you must disable memory-intensive hash aggregate and hash join operations to leverage this functionality.
-  * While the Drill execution engine supports dynamic schema changes during the course of a query, some operators have yet to implement support for this behavior, such as Sort. Other operations, such as streaming aggregate, may have partial support that leads to unexpected results.
-

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/050-0.8.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/050-0.8.0-rn.md b/_docs/rn/050-0.8.0-rn.md
new file mode 100755
index 0000000..55e4eab
--- /dev/null
+++ b/_docs/rn/050-0.8.0-rn.md
@@ -0,0 +1,28 @@
+---
+title: "Apache Drill 0.8.0 Release Notes"
+parent: "Release Notes"
+---
+Apache Drill 0.8.0, continues the Drill release cycle as we drive towards general availability.
+This release includes [243 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328812) and numerous enhancements.
+
+This release is available as
+[binary](http://www.apache.org/dyn/closer.cgi/drill/drill-0.8.0/apache-drill-0.8.0.tar.gz) and
+[source](http://www.apache.org/dyn/closer.cgi/drill/drill-0.8.0/apache-drill-0.8.0-src.tar.gz) tarballs that are compiled against Apache Hadoop.
+Drill has been tested against MapR, Cloudera, and Hortonworks Hadoop
+distributions. There are associated build profiles and JIRAs that can help you
+run Drill against your preferred distribution
+
+Apache Drill 0.8.0 Key Features:
+
+- **Bytecode rewriting**. Drill now leverages code optimization techniques such as bytecode rewriting and inlining to enhance the speed of many queries by reducing overall memory usage and CPU instructions.
+- **Advanced partition pruning**. Drill can now prune partitions based on arbitrarily complex expressions. For example, specify WHERE dir0 LIKE '2015-%' and your query will look inside the directory "2015-01" but not inside "2014-12".
+- **Real-time query diagnostics**. You can now see exactly what your queries are doing in real-time, making it easy to troubleshoot, optimize and manage execution.
+- **Large records, large # of files**. Drill was previously limited to small records of up to 128KB. It now supports records of any size. In addition, query performance has been improved when dealing with large numbers of files thanks to a variety of optimizations such as parallel metadata reads.
+- **More SQL**. Drill now features complete support for UNION ALL and COUNT(DISTINCT). Drill 0.8 also includes new functions such as unix_timestamp and the window functions sum, count and rank. Note that these window functions should be considered beta.
+- **Better compression**. Drill can now query compressed JSON files. In addition, the user can control Parquet compression in CTAS (CREATE TABLE AS) statements.
+- **Performance**. Drill 0.8 includes broadcast joins, disk-based joins, parallel metadata reads and many other performance-related enhancements.
+- 	**Reliability**. Drill 0.8 includes a variety of fixes that improve the stability of the drillbit daemon, the sqlline shell and the ODBC and JDBC drivers.
+- 	**HBase 0.98 support**. You can now run SQL queries on any HBase 0.98 table.
+
+
+

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/060-0.7.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/060-0.7.0-rn.md b/_docs/rn/060-0.7.0-rn.md
new file mode 100755
index 0000000..00c0f05
--- /dev/null
+++ b/_docs/rn/060-0.7.0-rn.md
@@ -0,0 +1,56 @@
+---
+title: "Apache Drill 0.7.0 Release Notes"
+parent: "Release Notes"
+---
+Apache Drill 0.7.0, the third beta release for Drill, is designed to help
+enthusiasts start working and experimenting with Drill. It also continues the
+Drill monthly release cycle as we drive towards general availability.
+
+This release is available as
+[binary](http://www.apache.org/dyn/closer.cgi/drill/drill-0.7.0/apache-
+drill-0.7.0.tar.gz) and
+[source](http://www.apache.org/dyn/closer.cgi/drill/drill-0.7.0/apache-
+drill-0.7.0-src.tar.gz) tarballs that are compiled against Apache Hadoop.
+Drill has been tested against MapR, Cloudera, and Hortonworks Hadoop
+distributions. There are associated build profiles and JIRAs that can help you
+run Drill against your preferred distribution
+
+Apache Drill 0.7.0 Key Features
+
+  * No more dependency on UDP/Multicast - Making it possible for Drill to work well in the following scenarios:
+
+    * UDP multicast not enabled (as in EC2)
+
+    * Cluster spans multiple subnets
+
+    * Cluster has multihome configuration
+
+  * New functions to natively work with nested data - KVGen and Flatten 
+
+  * Support for Hive 0.13 (Hive 0.12 with Drill is not supported any more) 
+
+  * Improved performance when querying Hive tables and File system through partition pruning
+
+  * Improved performance for HBase with LIKE operator pushdown
+
+  * Improved memory management
+
+  * Drill web UI monitoring and query profile improvements
+
+  * Ability to parse files without explicit extensions using default storage format specification
+
+  * Fixes for dealing with complex/nested data objects in Parquet/JSON
+
+  * Fast schema return - Improved experience working with BI/query tools by returning metadata quickly
+
+  * Several hang related fixes
+
+  * Parquet writer fixes for handling large datasets
+
+  * Stability improvements in ODBC and JDBC drivers
+
+Apache Drill 0.7.0 Key Notes and Limitations
+
+  * The current release supports in-memory and beyond-memory execution. However, you must disable memory-intensive hash aggregate and hash join operations to leverage this functionality.
+  * While the Drill execution engine supports dynamic schema changes during the course of a query, some operators have yet to implement support for this behavior, such as Sort. Other operations, such as streaming aggregate, may have partial support that leads to unexpected results.
+

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/060-0.8.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/060-0.8.0-rn.md b/_docs/rn/060-0.8.0-rn.md
deleted file mode 100755
index 55e4eab..0000000
--- a/_docs/rn/060-0.8.0-rn.md
+++ /dev/null
@@ -1,28 +0,0 @@
----
-title: "Apache Drill 0.8.0 Release Notes"
-parent: "Release Notes"
----
-Apache Drill 0.8.0, continues the Drill release cycle as we drive towards general availability.
-This release includes [243 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328812) and numerous enhancements.
-
-This release is available as
-[binary](http://www.apache.org/dyn/closer.cgi/drill/drill-0.8.0/apache-drill-0.8.0.tar.gz) and
-[source](http://www.apache.org/dyn/closer.cgi/drill/drill-0.8.0/apache-drill-0.8.0-src.tar.gz) tarballs that are compiled against Apache Hadoop.
-Drill has been tested against MapR, Cloudera, and Hortonworks Hadoop
-distributions. There are associated build profiles and JIRAs that can help you
-run Drill against your preferred distribution
-
-Apache Drill 0.8.0 Key Features:
-
-- **Bytecode rewriting**. Drill now leverages code optimization techniques such as bytecode rewriting and inlining to enhance the speed of many queries by reducing overall memory usage and CPU instructions.
-- **Advanced partition pruning**. Drill can now prune partitions based on arbitrarily complex expressions. For example, specify WHERE dir0 LIKE '2015-%' and your query will look inside the directory "2015-01" but not inside "2014-12".
-- **Real-time query diagnostics**. You can now see exactly what your queries are doing in real-time, making it easy to troubleshoot, optimize and manage execution.
-- **Large records, large # of files**. Drill was previously limited to small records of up to 128KB. It now supports records of any size. In addition, query performance has been improved when dealing with large numbers of files thanks to a variety of optimizations such as parallel metadata reads.
-- **More SQL**. Drill now features complete support for UNION ALL and COUNT(DISTINCT). Drill 0.8 also includes new functions such as unix_timestamp and the window functions sum, count and rank. Note that these window functions should be considered beta.
-- **Better compression**. Drill can now query compressed JSON files. In addition, the user can control Parquet compression in CTAS (CREATE TABLE AS) statements.
-- **Performance**. Drill 0.8 includes broadcast joins, disk-based joins, parallel metadata reads and many other performance-related enhancements.
-- 	**Reliability**. Drill 0.8 includes a variety of fixes that improve the stability of the drillbit daemon, the sqlline shell and the ODBC and JDBC drivers.
-- 	**HBase 0.98 support**. You can now run SQL queries on any HBase 0.98 table.
-
-
-

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/070-0.6.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/070-0.6.0-rn.md b/_docs/rn/070-0.6.0-rn.md
new file mode 100755
index 0000000..5b4ee00
--- /dev/null
+++ b/_docs/rn/070-0.6.0-rn.md
@@ -0,0 +1,32 @@
+---
+title: "Apache Drill 0.6.0 Release Notes"
+parent: "Release Notes"
+---
+Apache Drill 0.6.0, the second beta release for Drill, is designed to help
+enthusiasts start working and experimenting with Drill. It also continues the
+Drill monthly release cycle as we drive towards general availability.
+
+This release is available as [binary](http://www.apache.org/dyn/closer.cgi/inc
+ubator/drill/drill-0.5.0-incubating/apache-drill-0.5.0-incubating.tar.gz) and 
+[source](http://www.apache.org/dyn/closer.cgi/incubator/drill/drill-0.5.0-incu
+bating/apache-drill-0.5.0-incubating-src.tar.gz) tarballs that are compiled
+against Apache Hadoop. Drill has been tested against MapR, Cloudera, and
+Hortonworks Hadoop distributions. There are associated build profiles and
+JIRAs that can help you run Drill against your preferred distribution.
+
+Apache Drill 0.6.0 Key Features
+
+This release is primarily a bug fix release, with [more than 30 JIRAs closed](
+https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&vers
+ion=12327472), but there are some notable features:
+
+  * Direct ANSI SQL access to MongoDB, using the latest [MongoDB Plugin for Apache Drill]({{ site.baseurl }}/docs/mongodb-plugin-for-apache-drill)
+  * Filesystem query performance improvements with partition pruning
+  * Ability to use the file system as a persistent store for query profiles and diagnostic information
+  * Window function support (alpha)
+
+Apache Drill 0.6.0 Key Notes and Limitations
+
+  * The current release supports in-memory and beyond-memory execution. However, you must disable memory-intensive hash aggregate and hash join operations to leverage this functionality.
+  * While the Drill execution engine supports dynamic schema changes during the course of a query, some operators have yet to implement support for this behavior, such as Sort. Other operations, such as streaming aggregate, may have partial support that leads to unexpected results.
+

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/070-0.9.0-rn copy.md
----------------------------------------------------------------------
diff --git a/_docs/rn/070-0.9.0-rn copy.md b/_docs/rn/070-0.9.0-rn copy.md
deleted file mode 100755
index edae5c8..0000000
--- a/_docs/rn/070-0.9.0-rn copy.md	
+++ /dev/null
@@ -1,29 +0,0 @@
----
-title: "Apache Drill 0.9.0 Release Notes"
-parent: "Release Notes"
----
-It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{ site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes [200 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813). Some of the noteworthy features in Drill 0.9 are:
-
-* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill now supports username/password authentication through the Java and C++ clients, as well as JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials. Users can choose to use an external user directory such as Active Directory or LDAP. To enable authentication, set the `security.user.auth` option in `drill-override.conf`.
-* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries now execute and access resources using the identity of the user who submitted the query. Previously, all queries would run as the same user (eg, `drill`). With the new impersonation capability, the query will fail if the submitting user does not have permission to read the requested file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation` option in `drill-override.conf`.
-* **Ownership chaining**. Drill now allows views with different owners to be chained. This represents a very flexible access control solution. For example, an administrator with access to raw, sensitive data could create a view called `masked` which would expose only a subset of the data to other users. The administrator would enable users to read the `masked` view but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies how many ownership changed are allowed in a chain, thereby providing administrators (or data stewards) more control over sharing of data.
-* **MongoDB authentication** ([DRILL-1502](https://issues.apache.org/jira/browse/DRILL-1502)). Drill can now connect to a MongoDB cluster that requires authentication.
-* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/) - a set of extensions to the JSON format for supporting additional data types. We decided to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo` is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
-  We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`, `$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)). We're in the process of adding some additional qualifiers to make sure that all of MongoDB's extended types are supported (this is particularly important when querying data in MongoDB).
-* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly known as Elasticsearch).
-* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675) and more). It can be challenging for a complex distributed system like Drill to translate low-level internal conditions into actionable messages to the user. This release includes several enhancements that enable Drill to accomplish just that in a variety of cases.
-* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410) and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional query engine - it's the first analytical query engine with a JSON data model. This has required us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements have now been contributed back to those projects, and Drill is using the latest versions which include these enhancements.
-* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)). Drill includes two new `sys` tables that provide real-time metrics about memory utilization and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what information is available:
-
-    ```sql
-    SELECT * FROM sys.drillmemory;
-    SELECT * FROM sys.drillbitthreads;
-    ```
-
-* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)). Drill previously had some issues with tables that had more than 4095 colums. This limitation has been addressed.
-
-You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you can check out the official [release notes]({{ site.baseurl }}/docs/release-notes/) for more details.
-
-We're gearing up for Drill's 1.0 release later this month. Stay tuned!
-
-

http://git-wip-us.apache.org/repos/asf/drill/blob/219fb0bc/_docs/rn/070-0.9.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/070-0.9.0-rn.md b/_docs/rn/070-0.9.0-rn.md
deleted file mode 100755
index edae5c8..0000000
--- a/_docs/rn/070-0.9.0-rn.md
+++ /dev/null
@@ -1,29 +0,0 @@
----
-title: "Apache Drill 0.9.0 Release Notes"
-parent: "Release Notes"
----
-It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{ site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes [200 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813). Some of the noteworthy features in Drill 0.9 are:
-
-* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill now supports username/password authentication through the Java and C++ clients, as well as JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials. Users can choose to use an external user directory such as Active Directory or LDAP. To enable authentication, set the `security.user.auth` option in `drill-override.conf`.
-* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries now execute and access resources using the identity of the user who submitted the query. Previously, all queries would run as the same user (eg, `drill`). With the new impersonation capability, the query will fail if the submitting user does not have permission to read the requested file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation` option in `drill-override.conf`.
-* **Ownership chaining**. Drill now allows views with different owners to be chained. This represents a very flexible access control solution. For example, an administrator with access to raw, sensitive data could create a view called `masked` which would expose only a subset of the data to other users. The administrator would enable users to read the `masked` view but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies how many ownership changed are allowed in a chain, thereby providing administrators (or data stewards) more control over sharing of data.
-* **MongoDB authentication** ([DRILL-1502](https://issues.apache.org/jira/browse/DRILL-1502)). Drill can now connect to a MongoDB cluster that requires authentication.
-* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/) - a set of extensions to the JSON format for supporting additional data types. We decided to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo` is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
-  We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`, `$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)). We're in the process of adding some additional qualifiers to make sure that all of MongoDB's extended types are supported (this is particularly important when querying data in MongoDB).
-* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly known as Elasticsearch).
-* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675) and more). It can be challenging for a complex distributed system like Drill to translate low-level internal conditions into actionable messages to the user. This release includes several enhancements that enable Drill to accomplish just that in a variety of cases.
-* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410) and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional query engine - it's the first analytical query engine with a JSON data model. This has required us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements have now been contributed back to those projects, and Drill is using the latest versions which include these enhancements.
-* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)). Drill includes two new `sys` tables that provide real-time metrics about memory utilization and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what information is available:
-
-    ```sql
-    SELECT * FROM sys.drillmemory;
-    SELECT * FROM sys.drillbitthreads;
-    ```
-
-* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)). Drill previously had some issues with tables that had more than 4095 colums. This limitation has been addressed.
-
-You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you can check out the official [release notes]({{ site.baseurl }}/docs/release-notes/) for more details.
-
-We're gearing up for Drill's 1.0 release later this month. Stay tuned!
-
-


Mime
View raw message