Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0FA6B200C84 for ; Mon, 24 Apr 2017 00:21:45 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0E6FE160BA6; Sun, 23 Apr 2017 22:21:45 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B4D00160BB9 for ; Mon, 24 Apr 2017 00:21:42 +0200 (CEST) Received: (qmail 91600 invoked by uid 500); 23 Apr 2017 22:21:41 -0000 Mailing-List: contact commits-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@arrow.apache.org Delivered-To: mailing list commits@arrow.apache.org Received: (qmail 91531 invoked by uid 99); 23 Apr 2017 22:21:41 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 23 Apr 2017 22:21:41 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 87703E1864; Sun, 23 Apr 2017 22:21:41 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: wesm@apache.org To: commits@arrow.apache.org Date: Sun, 23 Apr 2017 22:21:45 -0000 Message-Id: In-Reply-To: <3f95e85bb56341f2bd250dea8f663432@git.apache.org> References: <3f95e85bb56341f2bd250dea8f663432@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [05/30] arrow-site git commit: Add Python documentation snapshot archived-at: Sun, 23 Apr 2017 22:21:45 -0000 http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.list_.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.list_.html b/docs/python/generated/pyarrow.list_.html new file mode 100644 index 0000000..a8ad220 --- /dev/null +++ b/docs/python/generated/pyarrow.list_.html @@ -0,0 +1,290 @@ + + + + + + + + + + + pyarrow.list_ — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.list_

+
+
+pyarrow.list_(DataType value_type)
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.memory_map.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.memory_map.html b/docs/python/generated/pyarrow.memory_map.html new file mode 100644 index 0000000..5df473a --- /dev/null +++ b/docs/python/generated/pyarrow.memory_map.html @@ -0,0 +1,287 @@ + + + + + + + + + + + pyarrow.memory_map — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.memory_map

+
+
+pyarrow.memory_map(path, mode='r')
+

Open memory map at file path. Size of the memory map cannot change

+ +++ + + + + + +
Parameters:
    +
  • path (string) –
    • +
  • mode ({'r', 'w'}, default 'r') –
    • +
+
Returns:

mmap (MemoryMappedFile)

+
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.null.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.null.html b/docs/python/generated/pyarrow.null.html new file mode 100644 index 0000000..39a4399 --- /dev/null +++ b/docs/python/generated/pyarrow.null.html @@ -0,0 +1,290 @@ + + + + + + + + + + + pyarrow.null — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.null

+
+
+pyarrow.null()
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.parquet.ParquetDataset.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.parquet.ParquetDataset.html b/docs/python/generated/pyarrow.parquet.ParquetDataset.html new file mode 100644 index 0000000..bec8787 --- /dev/null +++ b/docs/python/generated/pyarrow.parquet.ParquetDataset.html @@ -0,0 +1,311 @@ + + + + + + + + + + + pyarrow.parquet.ParquetDataset — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.parquet.ParquetDataset

+
+
+class pyarrow.parquet.ParquetDataset(path_or_paths, filesystem=None, schema=None, metadata=None, split_row_groups=False, validate_schema=True)[source]
+

Encapsulates details of reading a complete Parquet dataset possibly +consisting of multiple files and partitions in subdirectories

+ +++ + + + +
Parameters:
    +
  • path_or_paths (str or List[str]) – A directory name, single file name, or list of file names
    • +
  • filesystem (Filesystem, default None) – If nothing passed, paths assumed to be found in the local on-disk +filesystem
    • +
  • metadata (pyarrow.parquet.FileMetaData) – Use metadata obtained elsewhere to validate file schemas
    • +
  • schema (pyarrow.parquet.Schema) – Use schema obtained elsewhere to validate file schemas. Alternative to +metadata parameter
    • +
  • split_row_groups (boolean, default False) – Divide files into pieces for each row group in the file
    • +
  • validate_schema (boolean, default True) – Check that individual file schemas are all the same / compatible
    • +
+
+
+
+__init__(path_or_paths, filesystem=None, schema=None, metadata=None, split_row_groups=False, validate_schema=True)[source]
+
+ +

Methods

+ ++++ + + + + + + + + + + + +
__init__(path_or_paths[, filesystem, ...])
read([columns, nthreads])Read multiple Parquet files as a single pyarrow.Table
validate_schemas()
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.parquet.ParquetFile.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.parquet.ParquetFile.html b/docs/python/generated/pyarrow.parquet.ParquetFile.html new file mode 100644 index 0000000..1aaf78d --- /dev/null +++ b/docs/python/generated/pyarrow.parquet.ParquetFile.html @@ -0,0 +1,323 @@ + + + + + + + + + + + pyarrow.parquet.ParquetFile — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.parquet.ParquetFile

+
+
+class pyarrow.parquet.ParquetFile(source, metadata=None)[source]
+

Reader interface for a single Parquet file

+ +++ + + + +
Parameters:
    +
  • source (str or pyarrow.io.NativeFile) – Readable source. For passing Python file objects or byte buffers, +see pyarrow.io.PythonFileInterface or pyarrow.io.BufferReader.
    • +
  • metadata (ParquetFileMetadata, default None) – Use existing metadata object, rather than reading from file.
    • +
+
+
+
+__init__(source, metadata=None)[source]
+
+ +

Methods

+ ++++ + + + + + + + + + + + +
__init__(source[, metadata])
read([columns, nthreads])Read a Table from Parquet format
read_row_group(i[, columns, nthreads])Read a single row group from a Parquet file
+

Attributes

+ ++++ + + + + + + + + + + + +
metadata
num_row_groups
schema
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.parquet.read_table.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.parquet.read_table.html b/docs/python/generated/pyarrow.parquet.read_table.html new file mode 100644 index 0000000..83c2bb3 --- /dev/null +++ b/docs/python/generated/pyarrow.parquet.read_table.html @@ -0,0 +1,289 @@ + + + + + + + + + + + pyarrow.parquet.read_table — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.parquet.read_table

+
+
+pyarrow.parquet.read_table(source, columns=None, nthreads=1, metadata=None)[source]
+

Read a Table from Parquet format

+ +++ + + + + + +
Parameters:
    +
  • source (str or pyarrow.io.NativeFile) – Location of Parquet dataset. If a string passed, can be a single file +name or directory name. For passing Python file objects or byte +buffers, see pyarrow.io.PythonFileInterface or pyarrow.io.BufferReader.
    • +
  • columns (list) – If not None, only these columns will be read from the file.
    • +
  • nthreads (int, default 1) – Number of columns to read in parallel. Requires that the underlying +file source is threadsafe
    • +
  • metadata (FileMetaData) – If separately computed
    • +
+
Returns:

pyarrow.Table – Content of the file as a table (of columns)

+
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.parquet.write_metadata.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.parquet.write_metadata.html b/docs/python/generated/pyarrow.parquet.write_metadata.html new file mode 100644 index 0000000..d3ef08d --- /dev/null +++ b/docs/python/generated/pyarrow.parquet.write_metadata.html @@ -0,0 +1,282 @@ + + + + + + + + + + + pyarrow.parquet.write_metadata — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.parquet.write_metadata

+
+
+pyarrow.parquet.write_metadata(schema, where, version='1.0')[source]
+

Write metadata-only Parquet file from schema

+ +++ + + + +
Parameters:
    +
  • schema (pyarrow.Schema) –
    • +
  • where (string or pyarrow.io.NativeFile) –
    • +
  • version ({"1.0", "2.0"}, default "1.0") – The Parquet format version, defaults to 1.0
    • +
+
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/679f060e/docs/python/generated/pyarrow.parquet.write_table.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.parquet.write_table.html b/docs/python/generated/pyarrow.parquet.write_table.html new file mode 100644 index 0000000..37400f2 --- /dev/null +++ b/docs/python/generated/pyarrow.parquet.write_table.html @@ -0,0 +1,287 @@ + + + + + + + + + + + pyarrow.parquet.write_table — pyarrow documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+ + + + + + + + + + + + + + + + +
+ + + + +
+
+
+
+ +
+

pyarrow.parquet.write_table

+
+
+pyarrow.parquet.write_table(table, where, row_group_size=None, version='1.0', use_dictionary=True, compression='snappy', **kwargs)[source]
+

Write a Table to Parquet format

+ +++ + + + +
Parameters:
    +
  • table (pyarrow.Table) –
    • +
  • where (string or pyarrow.io.NativeFile) –
    • +
  • row_group_size (int, default None) – The maximum number of rows in each Parquet RowGroup. As a default, +we will write a single RowGroup per file.
    • +
  • version ({"1.0", "2.0"}, default "1.0") – The Parquet format version, defaults to 1.0
    • +
  • use_dictionary (bool or list) – Specify if we should use dictionary encoding in general or only for +some columns.
    • +
  • compression (str or dict) – Specify the compression codec, either on a general basis or per-column.
    • +
+
+
+ +
+ + +
+
+ +
+
+ + +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file