hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-hudi] satishkotha opened a new pull request #1318: [HUDI-571] CLI - add option to print additional commit metadata
Date Mon, 10 Feb 2020 18:44:51 GMT
satishkotha opened a new pull request #1318: [HUDI-571] CLI - add option to print additional
commit metadata
URL: https://github.com/apache/incubator-hudi/pull/1318
 
 
   ## What is the purpose of the pull request
   
   Following up from debugging session last week to print additional metadata for commits.
Additional metadata includes partition paths, fileIds, sizes etc
   
   Note that this is added for both active and archived commits. The command line flag added
(--includeExtraMetadata is similar to what we used for compactions)
   
   ## Brief change log
   Add includeExtraMetadata for CLI commands to list commits
   
   ## Verify this pull request
   ->commits show --includeExtraMetadata true
   ╔═════════════╤════════════════╤════════════╤══════════════════════════════════════╤════════════════╤════════════╤═════════════╤═════════════╤═══════════════════╤════════════════════╤══════════════════╤══════════════════════════╤═══════════════════════╤═══════════════════╤═════════════════════════════════╤═══════════════════╗
   ║ action      │ instant        │ partition  │ file_id                         
    │ prev_instant   │ num_writes │ num_inserts │ num_deletes │ num_update_writes
│ total_write_errors │ total_log_blocks │ total_corrupt_log_blocks │ total_rollback_blocks
│ total_log_records │ total_updated_records_compacted │ total_write_bytes ║
   ╠═════════════╪════════════════╪════════════╪══════════════════════════════════════╪════════════════╪════════════╪═════════════╪═════════════╪═══════════════════╪════════════════════╪══════════════════╪══════════════════════════╪═══════════════════════╪═══════════════════╪═════════════════════════════════╪═══════════════════╣
   ║ deltacommit │ 20200210180215 │ null       │ da59f86c-c1ac-4f32-bce7-f97b6a3fb35e
│ 20200210010321 │ 2          │ 0           │ 0           │ 0                 │
0                  │ 0                │ 0                        │ 0               
     │ 0                 │ 0                               │ 28128             ║
   ╟─────────────┼────────────────┼────────────┼──────────────────────────────────────┼────────────────┼────────────┼─────────────┼─────────────┼───────────────────┼────────────────────┼──────────────────┼──────────────────────────┼───────────────────────┼───────────────────┼─────────────────────────────────┼────────
   
   
   ->commits show
   ║ CommitTime     │ Total Bytes Written │ Total Files Added │ Total Files Updated
│ Total Partitions Written │ Total Records Written │ Total Update Records Written │
Total Errors ║
   ╠════════════════╪═════════════════════╪═══════════════════╪═════════════════════╪══════════════════════════╪═══════════════════════╪══════════════════════════════╪══════════════╣
   ║ 20200210180215 │ 886.8 MB            │ 0                 │ 1681             
  │ 276                      │ 1535368               │ 18183                       
│ 0            ║
   ╟────────────────┼─────────────────────┼───────────────────┼─────────────────────┼──────────────────────────┼───────────────────────┼──────────────────────────────┼──────────────╢
   
   
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella
JIRA.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message