hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Oleksandr Diachenko <odiache...@pivotal.io>
Subject COPY command for external tables
Date Wed, 27 Jul 2016 22:53:05 GMT
Hi,

Recently we discovered that COPY command for external tables is not
transactional.
It means if user is running COPY command and during this process underlying
HDFS fails - the end state of table is inconstant.
As a result I filled a JIRA - https://issues.apache.org/jira/browse/HAWQ-956
.

>From user perspective, COPY command might also need to support additional
options, to make import/export process more flexible.

   - Number of error lines to tolerate.
   - Batch size to commit.
   - TBD

Please feel free to join discussion.

Regards, Alex.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message