From hcatalog-commits-return-487-apmail-incubator-hcatalog-commits-archive=incubator.apache.org@incubator.apache.org Sun Oct 2 21:06:35 2011 Return-Path: X-Original-To: apmail-incubator-hcatalog-commits-archive@minotaur.apache.org Delivered-To: apmail-incubator-hcatalog-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 52E2B7A41 for ; Sun, 2 Oct 2011 21:06:35 +0000 (UTC) Received: (qmail 80998 invoked by uid 500); 2 Oct 2011 21:06:35 -0000 Delivered-To: apmail-incubator-hcatalog-commits-archive@incubator.apache.org Received: (qmail 80969 invoked by uid 500); 2 Oct 2011 21:06:35 -0000 Mailing-List: contact hcatalog-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hcatalog-dev@incubator.apache.org Delivered-To: mailing list hcatalog-commits@incubator.apache.org Received: (qmail 80961 invoked by uid 99); 2 Oct 2011 21:06:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Oct 2011 21:06:35 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Oct 2011 21:06:25 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id 2C3442388B1B; Sun, 2 Oct 2011 21:05:41 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1178252 [7/34] - in /incubator/hcatalog/site: author/src/documentation/content/xdocs/ publish/docs/ publish/docs/r0.2.0/ publish/docs/r0.2.0/api/ publish/docs/r0.2.0/api/org/ publish/docs/r0.2.0/api/org/apache/ publish/docs/r0.2.0/api/org/... Date: Sun, 02 Oct 2011 21:05:30 -0000 To: hcatalog-commits@incubator.apache.org From: hashutosh@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20111002210541.2C3442388B1B@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Added: incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/HCatUtil.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/HCatUtil.html?rev=1178252&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/HCatUtil.html (added) +++ incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/HCatUtil.html Sun Oct 2 21:05:22 2011 @@ -0,0 +1,817 @@ + + + + + + +HCatUtil (HCatalog 0.2.0-incubating API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package   Class  Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV CLASS  + NEXT CLASS + FRAMES   + NO FRAMES   +  + + + +
+ SUMMARY: NESTED | FIELD | CONSTR | METHOD +DETAIL: FIELD | CONSTR | METHOD
+ + + +
+ +

+ +org.apache.hcatalog.common +
+Class HCatUtil

+
+java.lang.Object
+  extended by org.apache.hcatalog.common.HCatUtil
+
+
+
+
public class HCatUtil
extends java.lang.Object
+ + +

+

+ +

+ + + + + + + + + + + +
+Constructor Summary
HCatUtil() + +
+           
+  + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+Method Summary
+static voidcancelJobTrackerDelegationToken(java.lang.String tokenStrForm, + java.lang.String tokenSignature) + +
+           
+static booleancheckJobContextIfRunningFromBackend(org.apache.hadoop.mapreduce.JobContext j) + +
+           
+static byte[]decodeBytes(java.lang.String str) + +
+           
+static java.lang.Objectdeserialize(java.lang.String str) + +
+           
+static java.lang.StringencodeBytes(byte[] bytes) + +
+           
+static org.apache.hadoop.security.token.Token<org.apache.hadoop.mapreduce.security.token.delegation.DelegationTokenIdentifier>extractJobTrackerToken(java.lang.String tokenStrForm, + java.lang.String tokenSignature) + +
+           
+static HCatSchemaextractSchemaFromStorageDescriptor(org.apache.hadoop.hive.metastore.api.StorageDescriptor sd) + +
+           
+static org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.delegation.AbstractDelegationTokenIdentifier>extractThriftToken(java.lang.String tokenStrForm, + java.lang.String tokenSignature) + +
+           
+static java.util.List<org.apache.hadoop.hive.metastore.api.FieldSchema>getFieldSchemaList(java.util.List<HCatFieldSchema> hcatFields) + +
+           
+static java.util.List<HCatFieldSchema>getHCatFieldSchemaList(org.apache.hadoop.hive.metastore.api.FieldSchema... fields) + +
+           
+static java.util.List<HCatFieldSchema>getHCatFieldSchemaList(java.util.List<org.apache.hadoop.hive.metastore.api.FieldSchema> fields) + +
+           
+static org.apache.hadoop.security.token.Token<org.apache.hadoop.mapreduce.security.token.delegation.DelegationTokenIdentifier>getJobTrackerDelegationToken(org.apache.hadoop.conf.Configuration conf, + java.lang.String userName) + +
+           
+static org.apache.hadoop.hive.metastore.api.TablegetTable(org.apache.hadoop.hive.metastore.HiveMetaStoreClient client, + java.lang.String dbName, + java.lang.String tableName) + +
+           
+static HCatSchemagetTableSchemaWithPtnCols(org.apache.hadoop.hive.metastore.api.Table table) + +
+           
+static voidlogAllTokens(org.apache.commons.logging.Log logger, + org.apache.hadoop.mapreduce.JobContext context) + +
+           
+static voidlogEntrySet(org.apache.commons.logging.Log logger, + java.lang.String itemName, + java.util.Set<? extends java.util.Map.Entry> entrySet) + +
+           
+static voidlogHiveConf(org.apache.commons.logging.Log logger, + org.apache.hadoop.hive.conf.HiveConf hc) + +
+          debug log the hive conf
+static voidlogList(org.apache.commons.logging.Log logger, + java.lang.String itemName, + java.util.List<? extends java.lang.Object> list) + +
+           
+static voidlogMap(org.apache.commons.logging.Log logger, + java.lang.String itemName, + java.util.Map<? extends java.lang.Object,? extends java.lang.Object> map) + +
+           
+static voidlogStackTrace(org.apache.commons.logging.Log logger) + +
+          Logging stack trace
+static voidlogToken(org.apache.commons.logging.Log logger, + java.lang.String itemName, + org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.TokenIdentifier> t) + +
+           
+static java.lang.Stringserialize(java.io.Serializable obj) + +
+           
+static booleanvalidateExecuteBitPresentIfReadOrWrite(org.apache.hadoop.fs.permission.FsAction perms) + +
+          Ensure that read or write permissions are not granted without also granting execute permissions.
+static booleanvalidateMorePermissive(org.apache.hadoop.fs.permission.FsAction first, + org.apache.hadoop.fs.permission.FsAction second) + +
+          Test if the first FsAction is more permissive than the second.
+static java.util.List<org.apache.hadoop.hive.metastore.api.FieldSchema>validatePartitionSchema(org.apache.hadoop.hive.metastore.api.Table table, + HCatSchema partitionSchema) + +
+          Validate partition schema, checks if the column types match between the partition + and the existing table schema.
+  + + + + + + + +
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
+  +

+ + + + + + + + +
+Constructor Detail
+ +

+HCatUtil

+
+public HCatUtil()
+
+
+ + + + + + + + +
+Method Detail
+ +

+checkJobContextIfRunningFromBackend

+
+public static boolean checkJobContextIfRunningFromBackend(org.apache.hadoop.mapreduce.JobContext j)
+
+
+
+
+
+
+ +

+serialize

+
+public static java.lang.String serialize(java.io.Serializable obj)
+                                  throws java.io.IOException
+
+
+ +
Throws: +
java.io.IOException
+
+
+
+ +

+deserialize

+
+public static java.lang.Object deserialize(java.lang.String str)
+                                    throws java.io.IOException
+
+
+ +
Throws: +
java.io.IOException
+
+
+
+ +

+encodeBytes

+
+public static java.lang.String encodeBytes(byte[] bytes)
+
+
+
+
+
+
+ +

+decodeBytes

+
+public static byte[] decodeBytes(java.lang.String str)
+
+
+
+
+
+
+ +

+getHCatFieldSchemaList

+
+public static java.util.List<HCatFieldSchema> getHCatFieldSchemaList(org.apache.hadoop.hive.metastore.api.FieldSchema... fields)
+                                                              throws HCatException
+
+
+ +
Throws: +
HCatException
+
+
+
+ +

+getHCatFieldSchemaList

+
+public static java.util.List<HCatFieldSchema> getHCatFieldSchemaList(java.util.List<org.apache.hadoop.hive.metastore.api.FieldSchema> fields)
+                                                              throws HCatException
+
+
+ +
Throws: +
HCatException
+
+
+
+ +

+extractSchemaFromStorageDescriptor

+
+public static HCatSchema extractSchemaFromStorageDescriptor(org.apache.hadoop.hive.metastore.api.StorageDescriptor sd)
+                                                     throws HCatException
+
+
+ +
Throws: +
HCatException
+
+
+
+ +

+getFieldSchemaList

+
+public static java.util.List<org.apache.hadoop.hive.metastore.api.FieldSchema> getFieldSchemaList(java.util.List<HCatFieldSchema> hcatFields)
+
+
+
+
+
+
+ +

+getTable

+
+public static org.apache.hadoop.hive.metastore.api.Table getTable(org.apache.hadoop.hive.metastore.HiveMetaStoreClient client,
+                                                                  java.lang.String dbName,
+                                                                  java.lang.String tableName)
+                                                           throws java.lang.Exception
+
+
+ +
Throws: +
java.lang.Exception
+
+
+
+ +

+getTableSchemaWithPtnCols

+
+public static HCatSchema getTableSchemaWithPtnCols(org.apache.hadoop.hive.metastore.api.Table table)
+                                            throws java.io.IOException
+
+
+ +
Throws: +
java.io.IOException
+
+
+
+ +

+validatePartitionSchema

+
+public static java.util.List<org.apache.hadoop.hive.metastore.api.FieldSchema> validatePartitionSchema(org.apache.hadoop.hive.metastore.api.Table table,
+                                                                                                       HCatSchema partitionSchema)
+                                                                                                throws java.io.IOException
+
+
Validate partition schema, checks if the column types match between the partition + and the existing table schema. Returns the list of columns present in the partition + but not in the table. +

+

+
Parameters:
table - the table
partitionSchema - the partition schema +
Returns:
the list of newly added fields +
Throws: +
java.io.IOException - Signals that an I/O exception has occurred.
+
+
+
+ +

+validateMorePermissive

+
+public static boolean validateMorePermissive(org.apache.hadoop.fs.permission.FsAction first,
+                                             org.apache.hadoop.fs.permission.FsAction second)
+
+
Test if the first FsAction is more permissive than the second. This is useful in cases where + we want to ensure that a file owner has more permissions than the group they belong to, for eg. + More completely(but potentially more cryptically) + owner-r >= group-r >= world-r : bitwise and-masked with 0444 => 444 >= 440 >= 400 >= 000 + owner-w >= group-w >= world-w : bitwise and-masked with &0222 => 222 >= 220 >= 200 >= 000 + owner-x >= group-x >= world-x : bitwise and-masked with &0111 => 111 >= 110 >= 100 >= 000 +

+

+ +
Returns:
true if first FsAction is more permissive than the second, false if not.
+
+
+
+ +

+validateExecuteBitPresentIfReadOrWrite

+
+public static boolean validateExecuteBitPresentIfReadOrWrite(org.apache.hadoop.fs.permission.FsAction perms)
+
+
Ensure that read or write permissions are not granted without also granting execute permissions. + Essentially, r-- , rw- and -w- are invalid, + r-x, -wx, rwx, ---, --x are valid +

+

+
Parameters:
perms - The FsAction to verify +
Returns:
true if the presence of read or write permission is accompanied by execute permissions
+
+
+
+ +

+getJobTrackerDelegationToken

+
+public static org.apache.hadoop.security.token.Token<org.apache.hadoop.mapreduce.security.token.delegation.DelegationTokenIdentifier> getJobTrackerDelegationToken(org.apache.hadoop.conf.Configuration conf,
+                                                                                                                                                                   java.lang.String userName)
+                                                                                                                                                            throws java.lang.Exception
+
+
+ +
Throws: +
java.lang.Exception
+
+
+
+ +

+cancelJobTrackerDelegationToken

+
+public static void cancelJobTrackerDelegationToken(java.lang.String tokenStrForm,
+                                                   java.lang.String tokenSignature)
+                                            throws java.lang.Exception
+
+
+ +
Throws: +
java.lang.Exception
+
+
+
+ +

+extractThriftToken

+
+public static org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.delegation.AbstractDelegationTokenIdentifier> extractThriftToken(java.lang.String tokenStrForm,
+                                                                                                                                                                 java.lang.String tokenSignature)
+                                                                                                                                                          throws org.apache.hadoop.hive.metastore.api.MetaException,
+                                                                                                                                                                 org.apache.thrift.TException,
+                                                                                                                                                                 java.io.IOException
+
+
+ +
Throws: +
org.apache.hadoop.hive.metastore.api.MetaException +
org.apache.thrift.TException +
java.io.IOException
+
+
+
+ +

+extractJobTrackerToken

+
+public static org.apache.hadoop.security.token.Token<org.apache.hadoop.mapreduce.security.token.delegation.DelegationTokenIdentifier> extractJobTrackerToken(java.lang.String tokenStrForm,
+                                                                                                                                                             java.lang.String tokenSignature)
+                                                                                                                                                      throws org.apache.hadoop.hive.metastore.api.MetaException,
+                                                                                                                                                             org.apache.thrift.TException,
+                                                                                                                                                             java.io.IOException
+
+
+ +
Throws: +
org.apache.hadoop.hive.metastore.api.MetaException +
org.apache.thrift.TException +
java.io.IOException
+
+
+
+ +

+logStackTrace

+
+public static void logStackTrace(org.apache.commons.logging.Log logger)
+
+
Logging stack trace +

+

+
Parameters:
logger -
+
+
+
+ +

+logHiveConf

+
+public static void logHiveConf(org.apache.commons.logging.Log logger,
+                               org.apache.hadoop.hive.conf.HiveConf hc)
+
+
debug log the hive conf +

+

+
Parameters:
logger -
hc -
+
+
+
+ +

+logList

+
+public static void logList(org.apache.commons.logging.Log logger,
+                           java.lang.String itemName,
+                           java.util.List<? extends java.lang.Object> list)
+
+
+
+
+
+
+ +

+logMap

+
+public static void logMap(org.apache.commons.logging.Log logger,
+                          java.lang.String itemName,
+                          java.util.Map<? extends java.lang.Object,? extends java.lang.Object> map)
+
+
+
+
+
+
+ +

+logEntrySet

+
+public static void logEntrySet(org.apache.commons.logging.Log logger,
+                               java.lang.String itemName,
+                               java.util.Set<? extends java.util.Map.Entry> entrySet)
+
+
+
+
+
+
+ +

+logAllTokens

+
+public static void logAllTokens(org.apache.commons.logging.Log logger,
+                                org.apache.hadoop.mapreduce.JobContext context)
+                         throws java.io.IOException
+
+
+ +
Throws: +
java.io.IOException
+
+
+
+ +

+logToken

+
+public static void logToken(org.apache.commons.logging.Log logger,
+                            java.lang.String itemName,
+                            org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.TokenIdentifier> t)
+                     throws java.io.IOException
+
+
+ +
Throws: +
java.io.IOException
+
+
+ +
+ + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package   Class  Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV CLASS  + NEXT CLASS + FRAMES   + NO FRAMES   +  + + + +
+ SUMMARY: NESTED | FIELD | CONSTR | METHOD +DETAIL: FIELD | CONSTR | METHOD
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/AuthUtils.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/AuthUtils.html?rev=1178252&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/AuthUtils.html (added) +++ incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/AuthUtils.html Sun Oct 2 21:05:22 2011 @@ -0,0 +1,144 @@ + + + + + + +Uses of Class org.apache.hcatalog.common.AuthUtils (HCatalog 0.2.0-incubating API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.common.AuthUtils

+
+No usage of org.apache.hcatalog.common.AuthUtils +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/ErrorType.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/ErrorType.html?rev=1178252&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/ErrorType.html (added) +++ incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/ErrorType.html Sun Oct 2 21:05:22 2011 @@ -0,0 +1,251 @@ + + + + + + +Uses of Class org.apache.hcatalog.common.ErrorType (HCatalog 0.2.0-incubating API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.common.ErrorType

+
+ + + + + + + + + +
+Packages that use ErrorType
org.apache.hcatalog.common  
+  +

+ + + + + +
+Uses of ErrorType in org.apache.hcatalog.common
+  +

+ + + + + + + + + + + + + + + + + +
Methods in org.apache.hcatalog.common that return ErrorType
+ ErrorTypeHCatException.getErrorType() + +
+          Gets the error type.
+static ErrorTypeErrorType.valueOf(java.lang.String name) + +
+          Returns the enum constant of this type with the specified name.
+static ErrorType[]ErrorType.values() + +
+          Returns an array containing the constants of this enum type, in +the order they are declared.
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.common with parameters of type ErrorType
+static java.lang.StringHCatException.buildErrorMessage(ErrorType type, + java.lang.String extraMessage, + java.lang.Throwable cause) + +
+          Builds the error message string.
+  +

+ + + + + + + + + + + + + + + + + +
Constructors in org.apache.hcatalog.common with parameters of type ErrorType
HCatException(ErrorType errorType) + +
+          Instantiates a new hcat exception.
HCatException(ErrorType errorType, + java.lang.String extraMessage) + +
+          Instantiates a new hcat exception.
HCatException(ErrorType errorType, + java.lang.String extraMessage, + java.lang.Throwable cause) + +
+          Instantiates a new hcat exception.
HCatException(ErrorType errorType, + java.lang.Throwable cause) + +
+          Instantiates a new hcat exception.
+  +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/HCatConstants.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/HCatConstants.html?rev=1178252&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/HCatConstants.html (added) +++ incubator/hcatalog/site/publish/docs/r0.2.0/api/org/apache/hcatalog/common/class-use/HCatConstants.html Sun Oct 2 21:05:22 2011 @@ -0,0 +1,144 @@ + + + + + + +Uses of Class org.apache.hcatalog.common.HCatConstants (HCatalog 0.2.0-incubating API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.common.HCatConstants

+
+No usage of org.apache.hcatalog.common.HCatConstants +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + +