From commits-return-13280-archive-asf-public=cust-asf.ponee.io@hudi.apache.org Thu Mar 12 17:56:18 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id C180818064F for ; Thu, 12 Mar 2020 18:56:17 +0100 (CET) Received: (qmail 26139 invoked by uid 500); 12 Mar 2020 17:56:17 -0000 Mailing-List: contact commits-help@hudi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hudi.apache.org Delivered-To: mailing list commits@hudi.apache.org Received: (qmail 26129 invoked by uid 99); 12 Mar 2020 17:56:17 -0000 Received: from ec2-52-202-80-70.compute-1.amazonaws.com (HELO gitbox.apache.org) (52.202.80.70) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Mar 2020 17:56:17 +0000 From: GitBox To: commits@hudi.apache.org Subject: [GitHub] [incubator-hudi] vinothchandar commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction Message-ID: <158403577683.30619.18349875438136973413.gitbox@gitbox.apache.org> References: In-Reply-To: Date: Thu, 12 Mar 2020 17:56:16 -0000 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit vinothchandar commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-598336174 > if compaction at t2 takes a long time, incremental reads using HoodieParquetInputFormat may make progress to read commits at t3 IIUC this is because you are incremental pulling from the parquet only table? I thought we can already incremental pull via logs. no? cc @n3nash .. is this really needed since it will add complexity to the system.. Eventually, I would like incremental query/pull on MOR to be just based on logs.. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org With regards, Apache Git Services