incubator-hcatalog-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ga...@apache.org
Subject svn commit: r1332464 - in /incubator/hcatalog/branches/branch-0.4: ./ src/docs/src/documentation/content/xdocs/
Date Mon, 30 Apr 2012 23:16:26 GMT
Author: gates
Date: Mon Apr 30 23:16:26 2012
New Revision: 1332464

URL: http://svn.apache.org/viewvc?rev=1332464&view=rev
Log:
HCATALOG-393 Several hcat 0.4 document fixes

Modified:
    incubator/hcatalog/branches/branch-0.4/CHANGES.txt
    incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/cli.xml
    incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/index.xml
    incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/inputoutput.xml
    incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/install.xml
    incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/loadstore.xml

Modified: incubator/hcatalog/branches/branch-0.4/CHANGES.txt
URL: http://svn.apache.org/viewvc/incubator/hcatalog/branches/branch-0.4/CHANGES.txt?rev=1332464&r1=1332463&r2=1332464&view=diff
==============================================================================
--- incubator/hcatalog/branches/branch-0.4/CHANGES.txt (original)
+++ incubator/hcatalog/branches/branch-0.4/CHANGES.txt Mon Apr 30 23:16:26 2012
@@ -115,6 +115,8 @@ Release 0.4.0 - Unreleased
   OPTIMIZATIONS
 
   BUG FIXES
+  HCAT-393 Several hcat 0.4 document fixes (daijy via gates)
+
   HCAT-395 Hcat 0.4 last minute doc fixes (gates)
 
   HCAT-394 HCatalog 0.4 should pull hive-0.9.0 from maven instead of 0.9.0-SNAPSHOT (gates)

Modified: incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/cli.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/cli.xml?rev=1332464&r1=1332463&r2=1332464&view=diff
==============================================================================
--- incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/cli.xml
(original)
+++ incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/cli.xml
Mon Apr 30 23:16:26 2012
@@ -27,7 +27,7 @@
 <section>
 	<title>Set Up</title>
 <p>The HCatalog command line interface (CLI) can be invoked as
-<code>HIVE_HOME=</code><em>hive_home hcat_home</em><code>bin/hcat</code>
+<code>HIVE_HOME=</code><em>hive_home hcat_home</em><code>/bin/hcat</code>
 where <em>hive_home</em> is the directory where Hive has been installed and
 <em>hcat_home</em> is the directory where HCatalog has been installed.</p>
 
@@ -82,6 +82,7 @@ Usage: hcat  { -e "&lt;query&gt;" | -f "
      <li>ALTER TABLE ... REBUILD</li> 
      <li>ALTER TABLE ... CONCATENATE</li>
      <li>ANALYZE TABLE ... COMPUTE STATISTICS</li>
+     <li>ALTER TABLE ARCHIVE/UNARCHIVE PARTITION</li>
    </ul>
 
 <section>
@@ -161,6 +162,10 @@ Usage: hcat  { -e "&lt;query&gt;" | -f "
 	
 	<!-- ==================================================================== -->
 <section>
+	<title>"dfs" command and "set" command</title>
+	<p>Supported. Behavior same as Hive.</p>
+</section>
+<section>
 	<title>Other Commands</title>
 	<p>Any command not listed above is NOT supported and throws an exception with the
message "Operation Not Supported". </p>
 </section>

Modified: incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/index.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/index.xml?rev=1332464&r1=1332463&r2=1332464&view=diff
==============================================================================
--- incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/index.xml
(original)
+++ incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/index.xml
Mon Apr 30 23:16:26 2012
@@ -44,7 +44,7 @@
 <title>Interfaces</title>   
 <p>The HCatalog interface for Pig consists of HCatLoader and HCatStorer, which implement
the Pig load and store interfaces respectively. HCatLoader accepts a table to read data from;
you can indicate which partitions to scan by immediately following the load statement with
a partition filter statement. HCatStorer accepts a table to write to and optionally a specification
of partition keys to create a new partition. You can write to a single partition by specifying
the partition key(s) and value(s) in the STORE clause; and you can write to multiple partitions
if the partition key(s) are columns in the data being stored. HCatLoader is implemented on
top of HCatInputFormat and HCatStorer is implemented on top of HCatOutputFormat (see <a
href="loadstore.html">HCatalog Load and Store</a>).</p>
 
-<p>HCatInputFormat and HCatOutputFormat are HCatalog's interface for MapReduce; they
implement Hadoop's InputFormat and OutputFormat, respectively. HCatInputFormat accepts a table
to read data from and optionally a selection predicate to indicate which partitions to scan.
HCatOutputFormat accepts a table to write to and optionally a specification of partition keys
to create a new partition. You can write to a single partition by specifying the partition
key(s) and value(s) in the STORE clause; and you can write to multiple partitions if the partition
key(s) are columns in the data being stored. (See <a href="inputoutput.html">HCatalog
Input and Output</a>.)</p>
+<p>The HCatalog interface for MapReduce – HCatInputFormat and HCatOutputFormat
– is an implementation of Hadoop InputFormat and OutputFormat. HCatInputFormat accepts
a table to read data from and optionally a selection predicate to indicate which partitions
to scan. HCatOutputFormat accepts a table to write to and optionally a specification of partition
keys to create a new partition. You can write to a single partition by specifying the partition
key(s) and value(s) in the setOutput method; and you can write to multiple partitions if the
partition key(s) are columns in the data being stored. (See <a href="inputoutput.html">HCatalog
Input and Output</a>.)</p>
 
 <p>Note: There is no Hive-specific interface. Since HCatalog uses Hive's metastore,
Hive can read data in HCatalog directly.</p>
 
@@ -81,7 +81,7 @@ store Z into 'data/processedevents/20100
 
 <p>With HCatalog, HCatalog will send a JMS message that data is available. The Pig
job can then be started.</p>
 <source>
-A = load 'rawevents' using HCatLoader;
+A = load 'rawevents' using HCatLoader();
 B = filter A by date = '20100819' and by bot_finder(zeta) = 0;
 …
 store Z into 'processedevents' using HCatStorer("date=20100819");

Modified: incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/inputoutput.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/inputoutput.xml?rev=1332464&r1=1332463&r2=1332464&view=diff
==============================================================================
--- incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/inputoutput.xml
(original)
+++ incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/inputoutput.xml
Mon Apr 30 23:16:26 2012
@@ -149,28 +149,21 @@ pass the Hive and HCatalog jars MapReduc
 export HADOOP_HOME=&lt;path_to_hadoop_install&gt;
 export HCAT_HOME=&lt;path_to_hcat_install&gt;
 export LIB_JARS=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar,
-$HCAT_HOME/share/hcatalog/lib/hive-metastore-0.8.1.jar,$HCAT_HOME/share/hcatalog/lib/libthrift-0.7.0.jar,
-$HCAT_HOME/share/hcatalog/lib/hive-exec-0.8.1.jar,$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar,
-$HCAT_HOME/share/hcatalog/lib/jdo2-api-2.3-ec.jar,$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar,
-$HCAT_HOME/share/hcatalog/lib/antlr-runtime-3.0.1.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-connectionpool-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-core-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-enhancer-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-rdbms-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/commons-dbcp-1.4.jar,
-$HCAT_HOME/share/hcatalog/lib/commons-pool-1.5.4.jar
+$HIVE_HOME/lib/hive-metastore-0.9.0.jar,
+$HIVE_HOME/lib/libthrift-0.7.0.jar,
+$HIVE_HOME/lib/hive-exec-0.9.0.jar,
+$HIVE_HOME/lib/libfb303-0.7.0.jar,
+$HIVE_HOME/lib/jdo2-api-2.3-ec.jar,
+$HIVE_HOME/lib/slf4j-api-1.6.1.jar
+
 export HADOOP_CLASSPATH=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:
-$HCAT_HOME/share/hcatalog/lib/hive-metastore-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libthrift-0.7.0.jar:
-$HCAT_HOME/share/hcatalog/lib/hive-exec-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar:
-$HCAT_HOME/share/hcatalog/lib/jdo2-api-2.3-ec.jar:$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar:
-$HCAT_HOME/share/hcatalog/lib/antlr-runtime-3.0.1.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-connectionpool-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-core-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-enhancer-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-rdbms-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/commons-dbcp-1.4.jar:
-$HCAT_HOME/share/hcatalog/lib/commons-pool-1.5.4.jar:
-$HCAT_HOME/etc/hcatalog
+$HIVE_HOME/lib/hive-metastore-0.9.0.jar:
+$HIVE_HOME/lib/libthrift-0.7.0.jar:
+$HIVE_HOME/lib/hive-exec-0.9.0.jar:
+$HIVE_HOME/lib/libfb303-0.7.0.jar:
+$HIVE_HOME/lib/jdo2-api-2.3-ec.jar:
+$HIVE_HOME/conf:$HADOOP_HOME/conf:
+$HIVE_HOME/lib/slf4j-api-1.6.1.jar
 
 $HADOOP_HOME/bin/hadoop --config $HADOOP_HOME/conf jar &lt;path_to_jar&gt;
 &lt;main_class&gt; -libjars $LIB_JARS &lt;program_arguments&gt;

Modified: incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/install.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/install.xml?rev=1332464&r1=1332463&r2=1332464&view=diff
==============================================================================
--- incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/install.xml
(original)
+++ incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/install.xml
Mon Apr 30 23:16:26 2012
@@ -113,7 +113,7 @@
     where you have installed Hive.  If you are using Hive rpms, then this will
     be <code>/usr/lib/hive</code>.</p>
 
-    <p><code>mysql -u hive -D hivemetastoredb -h</code><em>hivedb.acme.com</em><code>
-p &lt; </code><em>hive_home</em><code>scripts/metastore/upgrade/mysql/hive-schema-0.9.0.mysql.sql</code></p>
+    <p><code>mysql -u hive -D hivemetastoredb -h</code><em>hivedb.acme.com</em><code>
-p &lt; </code><em>hive_home</em><code>/scripts/metastore/upgrade/mysql/hive-schema-0.9.0.mysql.sql</code></p>
 
     <p><strong>Thrift Server Setup</strong></p>
 

Modified: incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/loadstore.xml
URL: http://svn.apache.org/viewvc/incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/loadstore.xml?rev=1332464&r1=1332463&r2=1332464&view=diff
==============================================================================
--- incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/loadstore.xml
(original)
+++ incubator/hcatalog/branches/branch-0.4/src/docs/src/documentation/content/xdocs/loadstore.xml
Mon Apr 30 23:16:26 2012
@@ -115,19 +115,15 @@ variable. In the case where you have ins
 <source>
 export HADOOP_HOME=&lt;path_to_hadoop_install&gt;
 export HCAT_HOME=&lt;path_to_hcat_install&gt;
-PIG_CLASSPATH=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:$HCAT_HOME/share/hcatalog/lib/
-hive-metastore-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libthrift-0.7.0.jar:$HCAT_HOME/
-share/hcatalog/lib/hive-exec-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar:
-$HCAT_HOME/share/hcatalog/lib/jdo2-api-2.3-ec.jar:$HCAT_HOME/etc/hcatalog:$HADOOP_HOME/
-conf:$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar
+export PIG_CLASSPATH=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:$HIVE_HOME/lib/hive-metastore-0.9.0.jar:
+$HIVE_HOME/lib/libthrift-0.7.0.jar:$HIVE_HOME/lib/hive-exec-0.9.0.jar:$HIVE_HOME/lib/libfb303-0.7.0.jar:
+$HIVE_HOME/lib/jdo2-api-2.3-ec.jar:$HIVE_HOME/conf:$HADOOP_HOME/conf:$HIVE_HOME/lib/slf4j-api-1.6.1.jar
+
 export PIG_OPTS=-Dhive.metastore.uris=thrift://&lt;hostname&gt;:&lt;port&gt;
 
-&lt;path_to_pig_install&gt;/bin/pig -Dpig.additional.jars=$HCAT_HOME/share/hcatalog/
-hcatalog-0.4.0.jar:$HCAT_HOME/share/hcatalog/lib/hive-metastore-0.8.1.jar:$HCAT_HOME/
-share/hcatalog/lib/libthrift-0.7.0.jar:$HCAT_HOME/share/hcatalog/lib/hive-exec-0.8.1.jar:
-$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar:$HCAT_HOME/share/hcatalog/lib/jdo2-
-api-2.3-ec.jar:$HCAT_HOME/etc/hcatalog:$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar
- &lt;script.pig&gt;
+&lt;path_to_pig_install&gt;/bin/pig -Dpig.additional.jars=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:
+$HIVE_HOME/lib/hive-metastore-0.9.0.jar:$HIVE_HOME/lib/libthrift-0.7.0.jar:$HIVE_HOME/lib/hive-exec-0.9.0.jar:
+$HIVE_HOME/lib/libfb303-0.7.0.jar:$HIVE_HOME/lib/jdo2-api-2.3-ec.jar:$HIVE_HOME/lib/slf4j-api-1.6.1.jar
&lt;script.pig&gt;
 </source>
 
 <p><strong>Authentication</strong></p>



Mime
View raw message