Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9954D18155 for ; Mon, 22 Jun 2015 19:07:00 +0000 (UTC) Received: (qmail 28754 invoked by uid 500); 22 Jun 2015 19:07:00 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 28726 invoked by uid 500); 22 Jun 2015 19:07:00 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 28716 invoked by uid 99); 22 Jun 2015 19:07:00 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Jun 2015 19:07:00 +0000 Date: Mon, 22 Jun 2015 19:07:00 +0000 (UTC) From: "Steven Phillips (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (DRILL-3333) Add support for auto-partitioning in parquet writer MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-3333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Phillips updated DRILL-3333: ----------------------------------- Attachment: DRILL-3333.patch > Add support for auto-partitioning in parquet writer > --------------------------------------------------- > > Key: DRILL-3333 > URL: https://issues.apache.org/jira/browse/DRILL-3333 > Project: Apache Drill > Issue Type: Bug > Reporter: Steven Phillips > Assignee: Aman Sinha > Attachments: DRILL-3333.patch, DRILL-3333.patch > > > When a table is created with a partition by clause, the parquet writer will create separate files for the different partition values. The data will first be sorted by the partition keys, and the parquet writer will create new file when it encounters a new value for the partition columns. > When data is queried against the data that was created this way, partition pruning will work if the filter contains a partition column. And unlike directory based partitioning, no view is required, nor is it necessary to reference the dir* column names. -- This message was sent by Atlassian JIRA (v6.3.4#6332)