hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Updated] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator
Date Sat, 21 Mar 2020 09:21:00 GMT

     [ https://issues.apache.org/jira/browse/HUDI-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ASF GitHub Bot updated HUDI-728:
--------------------------------
    Labels: pull-request-available  (was: )

> Support for complex record keys with TimestampBasedKeyGenerator
> ---------------------------------------------------------------
>
>                 Key: HUDI-728
>                 URL: https://issues.apache.org/jira/browse/HUDI-728
>             Project: Apache Hudi (incubating)
>          Issue Type: Improvement
>          Components: DeltaStreamer, Usability
>            Reporter: Pratyaksh Sharma
>            Assignee: Pratyaksh Sharma
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.6.0
>
>
> We have TimestampBasedKeyGenerator for defining custom partition paths and we have ComplexKeyGenerator
for supporting having combination of fields as record key or partition key. 
>  
> However we do not have support for the case where one wants to have combination of fields
as record key along with being able to define custom partition paths. This use case recently
came up at my organisation. 
>  
> How about having CustomTimestampBasedKeyGenerator which supports the above use case?
This class can simply extend TimestampBasedKeyGenerator and allow users to have combination
of fields as record key.
>  
> We will try to have the implementation as generic as possible. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message