From dev-return-4272-archive-asf-public=cust-asf.ponee.io@hudi.apache.org Tue Aug 3 15:10:46 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 32F2A180654 for ; Tue, 3 Aug 2021 17:10:46 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id AA0DC6178F for ; Tue, 3 Aug 2021 15:10:39 +0000 (UTC) Received: (qmail 43727 invoked by uid 500); 3 Aug 2021 15:10:38 -0000 Mailing-List: contact dev-help@hudi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hudi.apache.org Delivered-To: mailing list dev@hudi.apache.org Received: (qmail 43707 invoked by uid 99); 3 Aug 2021 15:10:38 -0000 Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Aug 2021 15:10:38 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id BE39BC04A7 for ; Tue, 3 Aug 2021 15:10:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org X-Spam-Flag: NO X-Spam-Score: 0.002 X-Spam-Level: X-Spam-Status: No, score=0.002 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamproc1-he-fi.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([116.203.227.195]) by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024) with ESMTP id m09Y55rq1ay4 for ; Tue, 3 Aug 2021 15:10:37 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.160.180; helo=mail-qt1-f180.google.com; envelope-from=n.siva.b@gmail.com; receiver= Received: from mail-qt1-f180.google.com (mail-qt1-f180.google.com [209.85.160.180]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id B2B4ABD38E for ; Tue, 3 Aug 2021 15:10:36 +0000 (UTC) Received: by mail-qt1-f180.google.com with SMTP id h27so14112733qtu.9 for ; Tue, 03 Aug 2021 08:10:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=VBBm4Y7gLPM/OmJbFQlkO3Dc3DxBe4d7M1UPqN+Nezo=; b=p2gj7o9HXTIszzJ5D+3xI1aOylittuidaFGoa6hetusokzkjOAqcY8I0axObnBPhrG Hv/9BUBtHTwe5IHi7WJNwnW2yHCHf9oZMRiYG/KLTC2e/DOV7hyMah8qBRNHyhWEY6Gu 1JRxa7utSOIUthNQDiBno309VkBDGVkDp3SAQ+/I/wbfgrlIRIT0yM8FuAeGkJpvCQIK AAQKha9U/EmumcaamQqFr4QgDGWQ4J9kcqiSlyY+Wlh8IKPYQ/Z4rxft1vaoMvLY1vuh w4Hp9FYev1ayHpDzodT1lxwKFAjH3HtPKJdGSnXIyOGdQum31NmOuy3efiimFF819boE FqOQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=VBBm4Y7gLPM/OmJbFQlkO3Dc3DxBe4d7M1UPqN+Nezo=; b=U+InT8L9BBvH8OtkQRQDi4v+92bv+EjMs4VQGtlyV+LNvumxFzC0jO60s1GIC/fi1g rvEXI0feCnb9gtwfzcWnMjvQt3WaYKiEkbHHqSj+BgD9yrxHiK5GPlulJPISc2Cc9k32 9cbQw+zkm2/Y+08EisAFHNi3yWZc6vBKBEuDxB5xvZFsRHFVttfyTjypZBTPMydpX6UG +RwuDwys/NRZD+sRDXcpVvoioHqs6Mxk00ouzfszq6OGwjG9hycUVb4WgqybVC5A92QI 171W2ISk0rX3u6+AnhIqo9s4PBbmQkQNQiiHgdtQ/f707oH1GhAo2tAHuw9oB2zpaNLV vECw== X-Gm-Message-State: AOAM531LLo+wpD1YCGKwjtE4y5TrSP4R+hQCNm0oVAEzCrz/vaYo7pdT sd0nrI+/JaTiQh0Yt6s22KbggFF5UHilv9OnAC7wxVlkn2E= X-Google-Smtp-Source: ABdhPJxwk8j10xYrpf6890joueKE93KAhrYfy5Hp57UHQ9Mk600c4b4OJjM+T9byXtVSeJ/WZZSpUhIut67wLhD1/D4= X-Received: by 2002:ac8:7e89:: with SMTP id w9mr19170340qtj.8.1628003429474; Tue, 03 Aug 2021 08:10:29 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Sivabalan Date: Tue, 3 Aug 2021 11:10:18 -0400 Message-ID: Subject: Re: Reg. org.apache.hudi.exception.HoodieException: Invalid query type :read_optimized To: dev@hudi.apache.org Content-Type: multipart/alternative; boundary="0000000000001b687105c8a91629" --0000000000001b687105c8a91629 Content-Type: text/plain; charset="UTF-8" Hey Ambarish, I have created a github issue. Let's follow up there. On Mon, Aug 2, 2021 at 11:58 PM Ambarish Giri wrote: > Hi Team, > > I am an Architect in a reputable Product based IT firm. > I am in the evaluation process to use Hudi to incorporate a refreshable > data lake. > I am currently running the setup in my local machine and using a spark > datasource to write and read from the Hudi temp table. > I have evaluated the Cow and MoR write mechanisms but while trying to read > the Hudi table using Read_Optimized type I am getting the below exception: > > Exception in thread "main" org.apache.hudi.exception.HoodieException: > Invalid query type :read_optimized > at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:81) > at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:46) > at > > org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:332) > at > > org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:242) > > Below is the how I am trying to read from the Hudi location: > > spark.read > .format("hudi") > .option(DataSourceReadOptions.QUERY_TYPE_OPT_KEY, > DataSourceReadOptions.QUERY_TYPE_READ_OPTIMIZED_OPT_VAL) > .load(s"$basePath/$tableName") > .show(50,false) > > Kindly suggest if I am doing anything wrong? > > Below are the versions I am currently using : > apache hudi 0.7.0 > spark 2.4.7 > scala 2.12 > > Kindly let me know in case anymore details are required. > > Regards, > Ambarish Giri > 9951742695 > -- Regards, -Sivabalan --0000000000001b687105c8a91629--