parquet-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jul...@apache.org
Subject parquet-format git commit: PARQUET-757: Add NULL type to Bring Parquet logical types to par with Arrow
Date Fri, 04 Nov 2016 17:35:14 GMT
Repository: parquet-format
Updated Branches:
  refs/heads/master 98c5e2b85 -> 4bddbadf7


PARQUET-757: Add NULL type to Bring Parquet logical types to par with Arrow

Author: Julien Le Dem <julien@dremio.com>

Closes #45 from julienledem/types and squashes the following commits:

2956b63 [Julien Le Dem] review feedback
94236c4 [Julien Le Dem] PARQUET-757: Bring Parquet logical types to par with Arrow


Project: http://git-wip-us.apache.org/repos/asf/parquet-format/repo
Commit: http://git-wip-us.apache.org/repos/asf/parquet-format/commit/4bddbadf
Tree: http://git-wip-us.apache.org/repos/asf/parquet-format/tree/4bddbadf
Diff: http://git-wip-us.apache.org/repos/asf/parquet-format/diff/4bddbadf

Branch: refs/heads/master
Commit: 4bddbadf79e20a32152076fbedae0c3ce77fb531
Parents: 98c5e2b
Author: Julien Le Dem <julien@dremio.com>
Authored: Fri Nov 4 10:35:08 2016 -0700
Committer: Julien Le Dem <julien@dremio.com>
Committed: Fri Nov 4 10:35:08 2016 -0700

----------------------------------------------------------------------
 LogicalTypes.md                | 4 ++++
 src/main/thrift/parquet.thrift | 8 +++++++-
 2 files changed, 11 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/parquet-format/blob/4bddbadf/LogicalTypes.md
----------------------------------------------------------------------
diff --git a/LogicalTypes.md b/LogicalTypes.md
index 8c73f69..c411dbf 100644
--- a/LogicalTypes.md
+++ b/LogicalTypes.md
@@ -366,3 +366,7 @@ optional group my_map (MAP_KEY_VALUE) {
 }
 ```
 
+## Null
+Sometimes when discovering the schema of existing data values are always null and there's
no type information.
+The `NULL` type can be used to annotates a column that is always null.
+(Similar to Null type in Avro)

http://git-wip-us.apache.org/repos/asf/parquet-format/blob/4bddbadf/src/main/thrift/parquet.thrift
----------------------------------------------------------------------
diff --git a/src/main/thrift/parquet.thrift b/src/main/thrift/parquet.thrift
index ac4d50e..e89bc80 100644
--- a/src/main/thrift/parquet.thrift
+++ b/src/main/thrift/parquet.thrift
@@ -174,7 +174,13 @@ enum ConvertedType {
    * particular timezone or date.
    */
   INTERVAL = 21;
-  
+
+  /**
+   * Annotates a column that is always null
+   * Sometimes when discovering the schema of existing data
+   * values are always null
+   */
+  NULL = 25;
 }
 
 /**


Mime
View raw message