hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HUDI-1860) Add INSERT_OVERWRITE support to DeltaStreamer
Date Mon, 19 Jul 2021 12:45:00 GMT

    [ https://issues.apache.org/jira/browse/HUDI-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383316#comment-17383316
] 

ASF GitHub Bot commented on HUDI-1860:
--------------------------------------

hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
       "triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
       "triggerType" : "PUSH"
     }, {
       "hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
       "triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
       "triggerType" : "PUSH"
     }, {
       "hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
       "triggerID" : "873419073",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
       "triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
       "triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
       "triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
       "triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
       "triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
       "triggerType" : "PUSH"
     }, {
       "hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
       "triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
       "triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
       "triggerID" : "879154991",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
       "triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
       "triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
       "triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
       "triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
       "triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
       "triggerType" : "PUSH"
     }, {
       "hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
       "triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
       "triggerType" : "PUSH"
     }, {
       "hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
       "triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
       "triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
       "triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
       "triggerType" : "PUSH"
     }, {
       "hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
       "triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
       "triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
       "triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
       "triggerType" : "PUSH"
     }, {
       "hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
       "triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012",
       "triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
   * da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
   * d055e23ffb53336e100dab0689980dcf714cd8ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012)

   * d3a2190ce3fc62e1fbebb48efac1598616f79824 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Add INSERT_OVERWRITE support to DeltaStreamer
> ---------------------------------------------
>
>                 Key: HUDI-1860
>                 URL: https://issues.apache.org/jira/browse/HUDI-1860
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: Sagar Sumit
>            Assignee: Samrat Deb
>            Priority: Major
>              Labels: pull-request-available
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> As discussed in [this RFC|https://cwiki.apache.org/confluence/display/HUDI/RFC+-+14+%3A+JDBC+incremental+puller],
having full fetch mode use the inser_overwrite to write to sync would be better as it can
handle schema changes. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message