From dev-return-4271-archive-asf-public=cust-asf.ponee.io@hudi.apache.org Tue Aug 3 03:58:24 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 05477180621 for ; Tue, 3 Aug 2021 05:58:24 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id E8D5A60F2D for ; Tue, 3 Aug 2021 03:58:22 +0000 (UTC) Received: (qmail 4575 invoked by uid 500); 3 Aug 2021 03:58:20 -0000 Mailing-List: contact dev-help@hudi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hudi.apache.org Delivered-To: mailing list dev@hudi.apache.org Received: (qmail 4409 invoked by uid 99); 3 Aug 2021 03:58:19 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Aug 2021 03:58:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id 657AB1FF513 for ; Tue, 3 Aug 2021 03:58:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: 0.25 X-Spam-Level: X-Spam-Status: No, score=0.25 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=0.2, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamproc1-he-de.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id z-oDVykKxJE4 for ; Tue, 3 Aug 2021 03:58:18 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::52d; helo=mail-ed1-x52d.google.com; envelope-from=ambarishgiri04@gmail.com; receiver= Received: from mail-ed1-x52d.google.com (mail-ed1-x52d.google.com [IPv6:2a00:1450:4864:20::52d]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 115FC7FAD9 for ; Tue, 3 Aug 2021 03:58:17 +0000 (UTC) Received: by mail-ed1-x52d.google.com with SMTP id p21so27254418edi.9 for ; Mon, 02 Aug 2021 20:58:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=HlbR8j2JxGdEgT5qluQgjrTDelWfRLfn9KH4KKqRHhs=; b=jiyGUmkARXIeHaDVT2Ps5lFsrxRF3DtO1MjJNdsrUwrSo5XsrAKaiR0PnmPCILEueG wgquaSkRle2qrYPjTw8i40qE3+Edw56jSyPVdgDaPfoyYI4AIsoyTzxhTXrgtTi1w7wJ ChmKs+oOQJQo5b9q8a04+aQtE76dvR/8cDDMZ9doFi6owDLD3pdhyLNBN8vN6OgHID55 zW2SrmcnFWkG6OIWSD6DYVla3S7W9oa4cjiSnkndAKqsiaO3yeEq7/YkBqe2OH8e3q0c x1Yh0VFo/lzHrLo70d8SAIPj9SZkdTs2muAJuQctKl79aANS1NbF3BgNscyiNUhINuHj L7tA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=HlbR8j2JxGdEgT5qluQgjrTDelWfRLfn9KH4KKqRHhs=; b=QaSidWZqamkBkntC85I4bHmQwwRlqVFSOCk8gtFildpulcKjuvNESm3suEuGMcQAEf +Mmr9l+ZhgQ3dMLO+M7julIK4gdiAfAGJqHx73nm3Y8yYV9qbYwwWa4TksuKgrakog1W pRYfCeJ9CqwQaGgp2kth0Qzf3ouNyqewzInuxh4UZloeCtRNliO4ZsVn9akkN9v7Ss9G U6XtTMDUJapIr0IhQgLrdaZ4o9nNysZG+Fh16DZYvpo7ivueHlb9EpFzCigvRLRtqn5Z BVzSC1HuhKNWI3jxXL5BlhldmdolYi5H2zMmInxt4HCg9wSqKSzzWSe59EUbxOKY40C3 nAIw== X-Gm-Message-State: AOAM532scq1x+RHc8T/J1R+YSSUf74pdfp8E4MTHYCV3meK8nIg/nbiK 2SrVSQO/96fPMStA/76DGh5ryXLseRMez2OpwH42Zom+/4A= X-Google-Smtp-Source: ABdhPJzjF815jPsBYRocJsQoGYbnN/ssexFIqhnXxO9v2ZwB78Zas8cEQyAcuDOo7Tqpv8wvzzPWmB4RKZcnojd2N8A= X-Received: by 2002:a05:6402:184b:: with SMTP id v11mr23489201edy.267.1627963097173; Mon, 02 Aug 2021 20:58:17 -0700 (PDT) MIME-Version: 1.0 From: Ambarish Giri Date: Tue, 3 Aug 2021 09:28:06 +0530 Message-ID: Subject: Reg. org.apache.hudi.exception.HoodieException: Invalid query type :read_optimized To: dev@hudi.apache.org Content-Type: multipart/alternative; boundary="0000000000001d519f05c89fb28d" --0000000000001d519f05c89fb28d Content-Type: text/plain; charset="UTF-8" Hi Team, I am an Architect in a reputable Product based IT firm. I am in the evaluation process to use Hudi to incorporate a refreshable data lake. I am currently running the setup in my local machine and using a spark datasource to write and read from the Hudi temp table. I have evaluated the Cow and MoR write mechanisms but while trying to read the Hudi table using Read_Optimized type I am getting the below exception: Exception in thread "main" org.apache.hudi.exception.HoodieException: Invalid query type :read_optimized at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:81) at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:46) at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:332) at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:242) Below is the how I am trying to read from the Hudi location: spark.read .format("hudi") .option(DataSourceReadOptions.QUERY_TYPE_OPT_KEY, DataSourceReadOptions.QUERY_TYPE_READ_OPTIMIZED_OPT_VAL) .load(s"$basePath/$tableName") .show(50,false) Kindly suggest if I am doing anything wrong? Below are the versions I am currently using : apache hudi 0.7.0 spark 2.4.7 scala 2.12 Kindly let me know in case anymore details are required. Regards, Ambarish Giri 9951742695 --0000000000001d519f05c89fb28d--