arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From PARTHA DUTTA <partha.du...@gmail.com>
Subject [Python] Possible to filter member of struct field?
Date Wed, 13 Jan 2021 18:56:55 GMT
I have a Parquet file which has a field defined as a struct:
workEmail: struct<address: string>
  child 0, address: string
    -- field metadata --
    PARQUET:field_id: '13'
  -- field metadata --
  PARQUET:field_id: '1'

I am trying to write a filter as a DNF to query a specific value for
workEmail.address but pyarrow does not seem to accept the DNF:

tbl = pyarrow.parquet.read_table(filename, use_legacy_dataset=False,
columns=["workEmail"], filters=[("workEmail.address", "=", "some@one.com")])

Is this supported? If not, any other workarounds?

-- 
Partha Dutta
partha.dutta@gmail.com

Mime
View raw message