From hcatalog-commits-return-906-apmail-incubator-hcatalog-commits-archive=incubator.apache.org@incubator.apache.org Thu May 17 18:37:43 2012 Return-Path: X-Original-To: apmail-incubator-hcatalog-commits-archive@minotaur.apache.org Delivered-To: apmail-incubator-hcatalog-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9D61C97A8 for ; Thu, 17 May 2012 18:37:43 +0000 (UTC) Received: (qmail 6889 invoked by uid 500); 17 May 2012 18:37:43 -0000 Delivered-To: apmail-incubator-hcatalog-commits-archive@incubator.apache.org Received: (qmail 6844 invoked by uid 500); 17 May 2012 18:37:43 -0000 Mailing-List: contact hcatalog-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hcatalog-dev@incubator.apache.org Delivered-To: mailing list hcatalog-commits@incubator.apache.org Received: (qmail 6833 invoked by uid 99); 17 May 2012 18:37:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 May 2012 18:37:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 May 2012 18:37:31 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id A9A402388C7D; Thu, 17 May 2012 18:36:20 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1339782 [21/41] - in /incubator/hcatalog/site: author/src/documentation/content/xdocs/ publish/ publish/docs/r0.4.0/ publish/docs/r0.4.0/api/ publish/docs/r0.4.0/api/org/ publish/docs/r0.4.0/api/org/apache/ publish/docs/r0.4.0/api/org/apac... Date: Thu, 17 May 2012 18:36:06 -0000 To: hcatalog-commits@incubator.apache.org From: gates@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20120517183620.A9A402388C7D@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Added: incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReadEntity.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReadEntity.html?rev=1339782&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReadEntity.html (added) +++ incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReadEntity.html Thu May 17 18:35:47 2012 @@ -0,0 +1,256 @@ + + + + + + +Uses of Class org.apache.hcatalog.data.transfer.ReadEntity (HCatalog 0.4.0-dev API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.data.transfer.ReadEntity

+
+ + + + + + + + + + + + + +
+Packages that use ReadEntity
org.apache.hcatalog.data.transfer  
org.apache.hcatalog.data.transfer.impl  
+  +

+ + + + + +
+Uses of ReadEntity in org.apache.hcatalog.data.transfer
+  +

+ + + + + + + + + +
Fields in org.apache.hcatalog.data.transfer declared as ReadEntity
+protected  ReadEntityHCatReader.re + +
+           
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer that return ReadEntity
+ ReadEntityReadEntity.Builder.build() + +
+           
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer with parameters of type ReadEntity
+static HCatReaderDataTransferFactory.getHCatReader(ReadEntity re, + java.util.Map<java.lang.String,java.lang.String> config) + +
+          This should be called once from master node to obtain an instance of HCatReader
+  +

+ + + + + + + + +
Constructors in org.apache.hcatalog.data.transfer with parameters of type ReadEntity
HCatReader(ReadEntity re, + java.util.Map<java.lang.String,java.lang.String> config) + +
+          This constructor will be invoked by DataTransferFactory at master node.
+  +

+ + + + + +
+Uses of ReadEntity in org.apache.hcatalog.data.transfer.impl
+  +

+ + + + + + + + +
Constructors in org.apache.hcatalog.data.transfer.impl with parameters of type ReadEntity
HCatInputFormatReader(ReadEntity info, + java.util.Map<java.lang.String,java.lang.String> config) + +
+           
+  +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReaderContext.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReaderContext.html?rev=1339782&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReaderContext.html (added) +++ incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/ReaderContext.html Thu May 17 18:35:47 2012 @@ -0,0 +1,226 @@ + + + + + + +Uses of Class org.apache.hcatalog.data.transfer.ReaderContext (HCatalog 0.4.0-dev API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.data.transfer.ReaderContext

+
+ + + + + + + + + + + + + +
+Packages that use ReaderContext
org.apache.hcatalog.data.transfer  
org.apache.hcatalog.data.transfer.impl  
+  +

+ + + + + +
+Uses of ReaderContext in org.apache.hcatalog.data.transfer
+  +

+ + + + + + + + + +
Fields in org.apache.hcatalog.data.transfer declared as ReaderContext
+protected  ReaderContextHCatReader.info + +
+           
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer that return ReaderContext
+abstract  ReaderContextHCatReader.prepareRead() + +
+          This should be called at master node to obtain ReaderContext which then should be + serialized and sent to slave nodes.
+  +

+ + + + + +
+Uses of ReaderContext in org.apache.hcatalog.data.transfer.impl
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer.impl that return ReaderContext
+ ReaderContextHCatInputFormatReader.prepareRead() + +
+           
+  +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.Builder.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.Builder.html?rev=1339782&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.Builder.html (added) +++ incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.Builder.html Thu May 17 18:35:47 2012 @@ -0,0 +1,204 @@ + + + + + + +Uses of Class org.apache.hcatalog.data.transfer.WriteEntity.Builder (HCatalog 0.4.0-dev API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.data.transfer.WriteEntity.Builder

+
+ + + + + + + + + +
+Packages that use WriteEntity.Builder
org.apache.hcatalog.data.transfer  
+  +

+ + + + + +
+Uses of WriteEntity.Builder in org.apache.hcatalog.data.transfer
+  +

+ + + + + + + + + + + + + + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer that return WriteEntity.Builder
+ WriteEntity.BuilderWriteEntity.Builder.withDatabase(java.lang.String dbName) + +
+           
+ WriteEntity.BuilderWriteEntity.Builder.withPartition(java.util.Map<java.lang.String,java.lang.String> partKVs) + +
+           
+ WriteEntity.BuilderWriteEntity.Builder.withRegion(java.lang.String region) + +
+           
+ WriteEntity.BuilderWriteEntity.Builder.withTable(java.lang.String tblName) + +
+           
+  +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.html?rev=1339782&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.html (added) +++ incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriteEntity.html Thu May 17 18:35:47 2012 @@ -0,0 +1,256 @@ + + + + + + +Uses of Class org.apache.hcatalog.data.transfer.WriteEntity (HCatalog 0.4.0-dev API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.data.transfer.WriteEntity

+
+ + + + + + + + + + + + + +
+Packages that use WriteEntity
org.apache.hcatalog.data.transfer  
org.apache.hcatalog.data.transfer.impl  
+  +

+ + + + + +
+Uses of WriteEntity in org.apache.hcatalog.data.transfer
+  +

+ + + + + + + + + +
Fields in org.apache.hcatalog.data.transfer declared as WriteEntity
+protected  WriteEntityHCatWriter.we + +
+           
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer that return WriteEntity
+ WriteEntityWriteEntity.Builder.build() + +
+           
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer with parameters of type WriteEntity
+static HCatWriterDataTransferFactory.getHCatWriter(WriteEntity we, + java.util.Map<java.lang.String,java.lang.String> config) + +
+          This should be called at master node to obtain an instance of HCatWriter
+  +

+ + + + + + + + +
Constructors in org.apache.hcatalog.data.transfer with parameters of type WriteEntity
HCatWriter(WriteEntity we, + java.util.Map<java.lang.String,java.lang.String> config) + +
+          This constructor will be used at master node
+  +

+ + + + + +
+Uses of WriteEntity in org.apache.hcatalog.data.transfer.impl
+  +

+ + + + + + + + +
Constructors in org.apache.hcatalog.data.transfer.impl with parameters of type WriteEntity
HCatOutputFormatWriter(WriteEntity we, + java.util.Map<java.lang.String,java.lang.String> config) + +
+           
+  +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriterContext.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriterContext.html?rev=1339782&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriterContext.html (added) +++ incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/class-use/WriterContext.html Thu May 17 18:35:47 2012 @@ -0,0 +1,292 @@ + + + + + + +Uses of Class org.apache.hcatalog.data.transfer.WriterContext (HCatalog 0.4.0-dev API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+
+

+Uses of Class
org.apache.hcatalog.data.transfer.WriterContext

+
+ + + + + + + + + + + + + +
+Packages that use WriterContext
org.apache.hcatalog.data.transfer  
org.apache.hcatalog.data.transfer.impl  
+  +

+ + + + + +
+Uses of WriterContext in org.apache.hcatalog.data.transfer
+  +

+ + + + + + + + + +
Fields in org.apache.hcatalog.data.transfer declared as WriterContext
+protected  WriterContextHCatWriter.info + +
+           
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer that return WriterContext
+abstract  WriterContextHCatWriter.prepareWrite() + +
+          External system should invoke this method exactly once from a master node.
+  +

+ + + + + + + + + + + + + + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer with parameters of type WriterContext
+abstract  voidHCatWriter.abort(WriterContext context) + +
+          This method should be called at master node.
+abstract  voidHCatWriter.commit(WriterContext context) + +
+          This method should be called at master node.
+static HCatWriterDataTransferFactory.getHCatWriter(WriterContext cntxt) + +
+          This should be called at slave nodes to obtain an instance of HCatWriter
+static HCatWriterDataTransferFactory.getHCatWriter(WriterContext cntxt, + StateProvider sp) + +
+          This should be called at slave nodes to obtain an instance of HCatWriter + If external system has some mechanism for providing state to HCatalog, this constructor + can be used.
+  +

+ + + + + +
+Uses of WriterContext in org.apache.hcatalog.data.transfer.impl
+  +

+ + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer.impl that return WriterContext
+ WriterContextHCatOutputFormatWriter.prepareWrite() + +
+           
+  +

+ + + + + + + + + + + + + +
Methods in org.apache.hcatalog.data.transfer.impl with parameters of type WriterContext
+ voidHCatOutputFormatWriter.abort(WriterContext context) + +
+           
+ voidHCatOutputFormatWriter.commit(WriterContext context) + +
+           
+  +

+

+ + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package  Class   Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV  + NEXT + FRAMES   + NO FRAMES   +  + + + +
+ + + +
+ + + Added: incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/impl/HCatInputFormatReader.html URL: http://svn.apache.org/viewvc/incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/impl/HCatInputFormatReader.html?rev=1339782&view=auto ============================================================================== --- incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/impl/HCatInputFormatReader.html (added) +++ incubator/hcatalog/site/publish/docs/r0.4.0/api/org/apache/hcatalog/data/transfer/impl/HCatInputFormatReader.html Thu May 17 18:35:47 2012 @@ -0,0 +1,345 @@ + + + + + + +HCatInputFormatReader (HCatalog 0.4.0-dev API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package   Class  Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV CLASS  + NEXT CLASS + FRAMES   + NO FRAMES   +  + + + +
+ SUMMARY: NESTED | FIELD | CONSTR | METHOD +DETAIL: FIELD | CONSTR | METHOD
+ + + +
+ +

+ +org.apache.hcatalog.data.transfer.impl +
+Class HCatInputFormatReader

+
+java.lang.Object
+  extended by org.apache.hcatalog.data.transfer.HCatReader
+      extended by org.apache.hcatalog.data.transfer.impl.HCatInputFormatReader
+
+
+
+
public class HCatInputFormatReader
extends HCatReader
+ + +

+This reader reads via HCatInputFormat +

+ +

+

+ +

+ + + + + + + +
+Field Summary
+  + + + + + + + +
Fields inherited from class org.apache.hcatalog.data.transfer.HCatReader
conf, info, re, sp
+  + + + + + + + + + + + + + +
+Constructor Summary
HCatInputFormatReader(org.apache.hadoop.mapreduce.InputSplit split, + org.apache.hadoop.conf.Configuration config, + StateProvider sp) + +
+           
HCatInputFormatReader(ReadEntity info, + java.util.Map<java.lang.String,java.lang.String> config) + +
+           
+  + + + + + + + + + + + + + + + +
+Method Summary
+ ReaderContextprepareRead() + +
+          This should be called at master node to obtain ReaderContext which then should be + serialized and sent to slave nodes.
+ java.util.Iterator<HCatRecord>read() + +
+          This should be called at slave nodes to read HCatRecords
+  + + + + + + + +
Methods inherited from class org.apache.hcatalog.data.transfer.HCatReader
getConf
+  + + + + + + + +
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
+  +

+ + + + + + + + +
+Constructor Detail
+ +

+HCatInputFormatReader

+
+public HCatInputFormatReader(org.apache.hadoop.mapreduce.InputSplit split,
+                             org.apache.hadoop.conf.Configuration config,
+                             StateProvider sp)
+
+
+
+ +

+HCatInputFormatReader

+
+public HCatInputFormatReader(ReadEntity info,
+                             java.util.Map<java.lang.String,java.lang.String> config)
+
+
+ + + + + + + + +
+Method Detail
+ +

+prepareRead

+
+public ReaderContext prepareRead()
+                          throws HCatException
+
+
Description copied from class: HCatReader
+
This should be called at master node to obtain ReaderContext which then should be + serialized and sent to slave nodes. +

+

+
Specified by:
prepareRead in class HCatReader
+
+
+ +
Returns:
ReaderContext +
Throws: +
HCatException
+
+
+
+ +

+read

+
+public java.util.Iterator<HCatRecord> read()
+                                    throws HCatException
+
+
Description copied from class: HCatReader
+
This should be called at slave nodes to read HCatRecords +

+

+
Specified by:
read in class HCatReader
+
+
+ +
Returns:
Iterator of HCatRecord +
Throws: +
HCatException
+
+
+ +
+ + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + +
Overview  Package   Class  Use  Tree  Deprecated  Index  Help 
+		 + +
+ PREV CLASS  + NEXT CLASS + FRAMES   + NO FRAMES   +  + + + +
+ SUMMARY: NESTED | FIELD | CONSTR | METHOD +DETAIL: FIELD | CONSTR | METHOD
+ + + +
+ + +