From issues-return-161114-archive-asf-public=cust-asf.ponee.io@beam.apache.org Fri Apr 23 18:38:03 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id A131118065E for ; Fri, 23 Apr 2021 20:38:03 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id ACBF761533 for ; Fri, 23 Apr 2021 18:38:02 +0000 (UTC) Received: (qmail 53751 invoked by uid 500); 23 Apr 2021 18:38:01 -0000 Mailing-List: contact issues-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list issues@beam.apache.org Received: (qmail 53714 invoked by uid 99); 23 Apr 2021 18:38:01 -0000 Received: from mailrelay1-he-de.apache.org (HELO mailrelay1-he-de.apache.org) (116.203.21.61) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Apr 2021 18:38:01 +0000 Received: from jira2-he-de.apache.org (unknown [IPv6:2a01:4f8:242:1f49::2]) by mailrelay1-he-de.apache.org (ASF Mail Server at mailrelay1-he-de.apache.org) with ESMTPS id 370823E8B3 for ; Fri, 23 Apr 2021 18:38:00 +0000 (UTC) Received: from jira2-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira2-he-de.apache.org (ASF Mail Server at jira2-he-de.apache.org) with ESMTP id 1D012C804CB for ; Fri, 23 Apr 2021 18:38:00 +0000 (UTC) Date: Fri, 23 Apr 2021 18:38:00 +0000 (UTC) From: "ASF GitHub Bot (Jira)" To: issues@beam.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=3D5= 88058&page=3Dcom.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpan= el#worklog-588058 ] ASF GitHub Bot logged work on BEAM-8933: ---------------------------------------- Author: ASF GitHub Bot Created on: 23/Apr/21 18:37 Start Date: 23/Apr/21 18:37 Worklog Time Spent: 10m=20 Work Description: codecov[bot] edited a comment on pull request #1458= 6: URL: https://github.com/apache/beam/pull/14586#issuecomment-823474654 # [Codecov](https://codecov.io/gh/apache/beam/pull/14586?src=3Dpr&el=3Dh= 1&utm_medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campa= ign=3Dpr+comments&utm_term=3DThe+Apache+Software+Foundation) Report > Merging [#14586](https://codecov.io/gh/apache/beam/pull/14586?src=3Dpr= &el=3Ddesc&utm_medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dcomment&= utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Software+Foundation) (1d0a= f69) into [master](https://codecov.io/gh/apache/beam/commit/22a68fa76f5ee99= 755df6fcad1fab77a65bb627f?el=3Ddesc&utm_medium=3Dreferral&utm_source=3Dgith= ub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+S= oftware+Foundation) (22a68fa) will **increase** coverage by `0.17%`. > The diff coverage is `n/a`. =20 [![Impacted file tree graph](https://codecov.io/gh/apache/beam/pull/1458= 6/graphs/tree.svg?width=3D650&height=3D150&src=3Dpr&token=3DqcbbAh8Fj1&utm_= medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3D= pr+comments&utm_term=3DThe+Apache+Software+Foundation)](https://codecov.io/= gh/apache/beam/pull/14586?src=3Dpr&el=3Dtree&utm_medium=3Dreferral&utm_sour= ce=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm_term=3DThe= +Apache+Software+Foundation) =20 ```diff @@ Coverage Diff @@ ## master #14586 +/- ## =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + Coverage 83.47% 83.65% +0.17% =20 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Files 449 444 -5 =20 Lines 59014 59079 +65 =20 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + Hits 49263 49420 +157 =20 + Misses 9751 9659 -92 =20 ``` =20 =20 | [Impacted Files](https://codecov.io/gh/apache/beam/pull/14586?src=3Dpr= &el=3Dtree&utm_medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dcomment&= utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Software+Foundation) | Cov= erage =CE=94 | | |---|---|---| | [...python/apache\_beam/examples/complete/distribopt.py](https://codec= ov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Dreferr= al&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm= _term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0N= yb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrcy= 9weXRob24vYXBhY2hlX2JlYW0vZXhhbXBsZXMvY29tcGxldGUvZGlzdHJpYm9wdC5weQ=3D=3D)= | | | | [.../examples/snippets/transforms/elementwise/pardo.py](https://codeco= v.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Dreferra= l&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm_= term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0Ny= b24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrcy9= weXRob24vYXBhY2hlX2JlYW0vZXhhbXBsZXMvc25pcHBldHMvdHJhbnNmb3Jtcy9lbGVtZW50d2= lzZS9wYXJkby5weQ=3D=3D) | | | | [...cs/sdks/python/apache\_beam/io/source\_test\_utils.py](https://cod= ecov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Drefe= rral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&u= tm_term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX= 0Nyb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rr= cy9weXRob24vYXBhY2hlX2JlYW0vaW8vc291cmNlX3Rlc3RfdXRpbHMucHk=3D) | | | | [...d/srcs/sdks/python/apache\_beam/ml/gcp/cloud\_dlp.py](https://code= cov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Drefer= ral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&ut= m_term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0= Nyb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrc= y9weXRob24vYXBhY2hlX2JlYW0vbWwvZ2NwL2Nsb3VkX2RscC5weQ=3D=3D) | | | | [...thon/apache\_beam/examples/complete/autocomplete.py](https://codec= ov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Dreferr= al&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm= _term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0N= yb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrcy= 9weXRob24vYXBhY2hlX2JlYW0vZXhhbXBsZXMvY29tcGxldGUvYXV0b2NvbXBsZXRlLnB5) | |= | | [...python/apache\_beam/typehints/typecheck\_test\_py3.py](https://cod= ecov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Drefe= rral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&u= tm_term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX= 0Nyb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rr= cy9weXRob24vYXBhY2hlX2JlYW0vdHlwZWhpbnRzL3R5cGVjaGVja190ZXN0X3B5My5weQ=3D= =3D) | | | | [.../srcs/sdks/python/apache\_beam/metrics/execution.py](https://codec= ov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Dreferr= al&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm= _term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0N= yb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrcy= 9weXRob24vYXBhY2hlX2JlYW0vbWV0cmljcy9leGVjdXRpb24ucHk=3D) | | | | [.../apache\_beam/ml/gcp/videointelligenceml\_test\_it.py](https://cod= ecov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Drefe= rral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&u= tm_term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX= 0Nyb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rr= cy9weXRob24vYXBhY2hlX2JlYW0vbWwvZ2NwL3ZpZGVvaW50ZWxsaWdlbmNlbWxfdGVzdF9pdC5= weQ=3D=3D) | | | | [...am/testing/benchmarks/chicago\_taxi/process\_tfma.py](https://code= cov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Drefer= ral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&ut= m_term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0= Nyb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrc= y9weXRob24vYXBhY2hlX2JlYW0vdGVzdGluZy9iZW5jaG1hcmtzL2NoaWNhZ29fdGF4aS9wcm9j= ZXNzX3RmbWEucHk=3D) | | | | [...ache\_beam/testing/benchmarks/chicago\_taxi/setup.py](https://code= cov.io/gh/apache/beam/pull/14586/diff?src=3Dpr&el=3Dtree&utm_medium=3Drefer= ral&utm_source=3Dgithub&utm_content=3Dcomment&utm_campaign=3Dpr+comments&ut= m_term=3DThe+Apache+Software+Foundation#diff-YmVhbV9QcmVDb21taXRfUHl0aG9uX0= Nyb24vc3JjL3Nka3MvcHl0aG9uL3Rlc3Qtc3VpdGVzL3RveC9weTM4L2J1aWxkL3NyY3Mvc2Rrc= y9weXRob24vYXBhY2hlX2JlYW0vdGVzdGluZy9iZW5jaG1hcmtzL2NoaWNhZ29fdGF4aS9zZXR1= cC5weQ=3D=3D) | | | | ... and [883 more](https://codecov.io/gh/apache/beam/pull/14586/diff?s= rc=3Dpr&el=3Dtree-more&utm_medium=3Dreferral&utm_source=3Dgithub&utm_conten= t=3Dcomment&utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Software+Found= ation) | | =20 ------ =20 [Continue to review full report at Codecov](https://codecov.io/gh/apache= /beam/pull/14586?src=3Dpr&el=3Dcontinue&utm_medium=3Dreferral&utm_source=3D= github&utm_content=3Dcomment&utm_campaign=3Dpr+comments&utm_term=3DThe+Apac= he+Software+Foundation). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/c= odecov-delta?utm_medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dcommen= t&utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Software+Foundation) > `=CE=94 =3D absolute (impact)`, `=C3=B8 =3D not affected`, = `? =3D missing data` > Powered by [Codecov](https://codecov.io/gh/apache/beam/pull/14586?src= =3Dpr&el=3Dfooter&utm_medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dc= omment&utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Software+Foundation= ). Last update [22a68fa...1d0af69](https://codecov.io/gh/apache/beam/pull/1= 4586?src=3Dpr&el=3Dlastupdated&utm_medium=3Dreferral&utm_source=3Dgithub&ut= m_content=3Dcomment&utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Softwa= re+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-r= equest-comments?utm_medium=3Dreferral&utm_source=3Dgithub&utm_content=3Dcom= ment&utm_campaign=3Dpr+comments&utm_term=3DThe+Apache+Software+Foundation). =20 --=20 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 588058) Time Spent: 18h 10m (was: 18h) > BigQuery IO should support reading Arrow format over Storage API > ---------------------------------------------------------------- > > Key: BEAM-8933 > URL: https://issues.apache.org/jira/browse/BEAM-8933 > Project: Beam > Issue Type: Improvement > Components: io-java-gcp > Reporter: Kirill Kozlov > Assignee: Miguel Anzo > Priority: P3 > Time Spent: 18h 10m > Remaining Estimate: 0h > > As of right now BigQuery uses Avro format for reading and writing. > We should add a config to BigQueryIO to specify which format to use: Arro= w or Avro (with Avro as default). -- This message was sent by Atlassian Jira (v8.3.4#803005)