hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lili Ma <lil...@apache.org>
Subject Re: COPY command for external tables
Date Thu, 28 Jul 2016 09:22:52 GMT
Hi Alex,

Could you kindly share the user scenario for copying data to external
table? Why don't we copy to internal table directly? Thanks :)  I thought
external table can directly points to the file which we need copy when
created.

Thanks
Lili

2016-07-28 6:53 GMT+08:00 Oleksandr Diachenko <odiachenko@pivotal.io>:

> Hi,
>
> Recently we discovered that COPY command for external tables is not
> transactional.
> It means if user is running COPY command and during this process underlying
> HDFS fails - the end state of table is inconstant.
> As a result I filled a JIRA -
> https://issues.apache.org/jira/browse/HAWQ-956
> .
>
> From user perspective, COPY command might also need to support additional
> options, to make import/export process more flexible.
>
>    - Number of error lines to tolerate.
>    - Batch size to commit.
>    - TBD
>
> Please feel free to join discussion.
>
> Regards, Alex.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message