incubator-hcatalog-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ga...@apache.org
Subject svn commit: r1332447 - in /incubator/hcatalog/trunk: CHANGES.txt RELEASE_NOTES.txt src/docs/src/documentation/content/xdocs/install.xml src/docs/src/documentation/content/xdocs/rpminstall.xml src/docs/src/documentation/content/xdocs/site.xml
Date Mon, 30 Apr 2012 22:13:57 GMT
Author: gates
Date: Mon Apr 30 22:13:56 2012
New Revision: 1332447

URL: http://svn.apache.org/viewvc?rev=1332447&view=rev
Log:
HCATALOG-395 Hcat 0.4 last minute doc fixes

Removed:
    incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/rpminstall.xml
Modified:
    incubator/hcatalog/trunk/CHANGES.txt
    incubator/hcatalog/trunk/RELEASE_NOTES.txt
    incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
    incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml

Modified: incubator/hcatalog/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/incubator/hcatalog/trunk/CHANGES.txt?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/CHANGES.txt (original)
+++ incubator/hcatalog/trunk/CHANGES.txt Mon Apr 30 22:13:56 2012
@@ -122,6 +122,8 @@ Release 0.4.0 - Unreleased
   OPTIMIZATIONS
 
   BUG FIXES
+  HCAT-395 Hcat 0.4 last minute doc fixes (gates)
+
   HCAT-382 NPE in pig when a binary field is null (rohini vi avandana)
 
   HCAT-386 e2e tests should respect JAVA_HOME when it's set (gates)

Modified: incubator/hcatalog/trunk/RELEASE_NOTES.txt
URL: http://svn.apache.org/viewvc/incubator/hcatalog/trunk/RELEASE_NOTES.txt?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/RELEASE_NOTES.txt (original)
+++ incubator/hcatalog/trunk/RELEASE_NOTES.txt Mon Apr 30 22:13:56 2012
@@ -2,8 +2,13 @@ These notes are for HCatalog 0.4.0 relea
 
 Highlights
 ==========
-
-This is the initial relase of Apache HCatalog.  It provides read and write capability for
Pig and Hadoop, and read capability for Hive.
+ 
+HCatalog is a table management and storage management layer for Hadoop that
+enables users with different data processing tools – Pig, MapReduce, and Hive,
+to easily share data on the grid. HCatalog’s table abstraction presents users
+with a relational view of data in the Hadoop distributed file system (HDFS)
+and ensures that users need not worry about where or in what format their data
+is stored – RCFile format, text files, sequence files.
 
 System Requirements
 ===================
@@ -13,41 +18,57 @@ System Requirements
 2. Ant build tool, version 1.8 or higher:  http://ant.apache.org - to build
    source only
 3. This release is compatible with Hadoop 1.0.1.
-4. This release is compatible with Pig 0.8.1 and Pig 0.9.1 or 0.9.2.
+4. This release is compatible with Pig 0.8.1, Pig 0.9.1, and 0.9.2.
 5. This release is compatible with Hive 0.8.1.
-6. This release is compatible with HBase 0.92.0.  See Notes below for more
-   information on HBase.
 
 Trying the Release
 ==================
 1. Download hcatalog-src-0.4.0-incubating.tar.gz
-2. Unpack the file: tar -xzvpf hcatalog-src-0.4.0-incubating.tar.gz
-3. Move into the installation directory: cd hcatalog-0.4.0-incubating
-4. Run "umask 0022 && ant jar test -Dhcatalog.version=0.4.0" to run unit tests.
-5. Run ant tar -Dforrest.home=/path/to/forrest/install -Dhcatalog.version=0.4.0
-   to build installable tarball.
-6. cd build
-7. Move hcatalog-0.4.0.tar.gz to somewhere you have write permissions (e.g. /home/me/hcat-insall)
-8. cd to your tar-ball location (e.g. cd /home/me/hcat-install)
-9. Untar hcatalog-0.4.0.tar.gz: tar -xvzpf hcatalog-0.4.0.tar.gz
-10. Move into hcatalog-0.4.0
-11. Install the hcatalog server by running share/hcatalog/scripts/hcat_server_install.sh
-    You may find instructions in share/doc/hcatalog/install.html useful
-12. If you are upgrading from HCatalog 0.2.0 you will need to upgrade your
-    metastore.  The upgrade script can be found in server installation at
-    share/hcatalog/hive/external/metastore/scripts/upgrade/mysql/upgrade-0.7.0-to-0.8.0.mysql.sql
-13. Export HADOOP_HOME and HADOOP_CONF_DIR to appropriate values.
-14. Run share/hcatalog/scripts/hcat_server_start.sh to start the hcatalog server.
-15. To use the command line interface use bin/hcat
-16. To use with Hadoop MapReduce jobs, use the HCatInputFormat and
-    HCatOutputFormat classes.
-17. To use with Pig, use the HCatLoader and HCatStorer classes.
+2. Follow the directions at
+   http://incubator.apache.org/hcatalog/docs/r0.4.0/install.html
+3. If you are upgrading from HCatalog 0.2.0 you will need to upgrade your
+   metastore.  The upgrade script can be found in server installation at
+   share/hcatalog/hive/external/metastore/scripts/upgrade/mysql/upgrade-0.7.0-to-0.8.0.mysql.sql
+   This should be done after you install the server and before you start it.
+
+
 
 Relevant Documentation
 ======================
 See http://incubator.apache.org/hcatalog/docs/r0.4.0
 These notes are for HCatalog 0.4.0 release.
 
+Changes Since Last Release
+==========================
+HCatalog 0.3 was not released.  HCatalog 0.2 was the last release of HCatalog.
+Major changes since the last release include:
+  - Full support for reading from and writing to Hive.
+  - Support for deeply nested maps, arrays, and structs.
+  - Switch from StorageDrivers to SerDes.  See "Backward Incompatibilities"
+    below.
+  - Addition of JSonSerDe to support reading and writing JSON data.
+  - Rather than releasing rpms from HCatalog, we rely on the rpms provided by
+    Apache Bigtop.
+  - The HCatalog binary distribution no longer includes Apache Hive.  We now
+    require that Hive first be installed.
+  - The HCatalog source distribution no longer includes Apache Hive source.
+    It now pulls the required jars via maven.
+
+
+For a full list of changes see CHANGES.txt located in the same directory as this file.
+
+Backward Incompatibilities
+==========================
+- HCatalog no longer supports its own StorageDriver classes for data 
+  (de)serialization.  Instead it uses Hive's SerDe classes.
+- Rather than releasing rpms from HCatalog, we rely on the rpms provided by
+  Apache Bigtop.
+- The HCatalog binary distribution no longer includes Apache Hive.  We now
+  require that Hive first be installed.
+- The HCatalog source distribution no longer includes Apache Hive source.
+  It now pulls the required jars via maven.
+
+
 Notes
 =====
-HBase integration with HCatalog is experimental not yet ready for production use.
+HBase integration with HCatalog is experimental and not yet ready for production use.

Modified: incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml (original)
+++ incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml Mon Apr
30 22:13:56 2012
@@ -126,6 +126,16 @@
     purposes of these instructions we will refer to this machine as
     <em>hcatsvr.acme.com</em>.</p>
 
+    <p>If you have not already done so, install Hive 0.9 on this machine.  You
+    can use the
+    <a href="http://hive.apache.org/releases.html">binary distributions</a> 
+    provided by Hive or rpms available from
+    <a href="http://incubator.apache.org/bigtop/">Apache Bigtop</a>.  If you
use
+    the Apache Hive binary distribution, select a directory, henceforth 
+    referred to as <code>hive_home</code>, and untar the distribution there.
+    If you use the rpms, <code>hive_home</code> will be
+    <code>/usr/lib/hive</code>.</p>
+
     <p>Install the MySQL Java connector libraries on <em>hcatsvr.acme.com</em>.
     You can obtain these from
     <a href="http://www.mysql.com/downloads/connector/j/5.1.html">MySQL's
@@ -234,15 +244,6 @@
         </tr>
     </table>
 
-    <p>A more potent script exists in the form of src/packages/hcat-configure.sh
-      which can configure the hive-site.xml to conform to the changes mentioned
-      above. It has predefined values for the most of the above mentioned fields
-      except for the ConnectionPassword and keytabs. It is capable of taking 
-      those fields too as parameters in the command line. Just run it once 
-      without parameters to see a full description of the usage of the script.
-      Users looking to automate the hcat installation should look to leverage
-      this script.
-    </p>
     <p>You can now procede to starting the server.</p>
   </section>
 
@@ -271,7 +272,7 @@
     <title>Stopping the Server</title>
 
     <p>To stop the HCatalog server, change directories to the <em>root</em>
-    directory and invoking <code>sbin/hcat_server.sh stop</code></p>
+    directory and invoking <code>HIVE_HOME=</code><em>hive_home</em><code>
sbin/hcat_server.sh stop</code></p>
 
   </section>
 

Modified: incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml (original)
+++ incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml Mon Apr 30
22:13:56 2012
@@ -41,7 +41,6 @@ See http://forrest.apache.org/docs/linki
   <docs label="HCatalog"> 
     <index label="Overview" href="index.html" />
     <index label="Installation From Tarball" href="install.html" />
-    <index label="RPM Installation" href="rpminstall.html" />
     <index label="Load &amp; Store Interfaces" href="loadstore.html" />
     <index label="Input &amp; Output Interfaces " href="inputoutput.html" />
     <index label="Command Line Interface " href="cli.html" />



Mime
View raw message