hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Oliver-Luo <...@git.apache.org>
Subject [GitHub] incubator-hawq pull request: HAWQ-760. Add hawq register to suppor...
Date Mon, 30 May 2016 01:28:51 GMT
Github user Oliver-Luo commented on the pull request:

    https://github.com/apache/incubator-hawq/pull/679#issuecomment-222395517
  
    > The main hawq register steps are as follows:
    > get_files_in_hdfs(filepath)
    > check_parquet_format(options, files)
    > firstsegno = get_metadata_from_database(options, databasename, seg_name)
    > move_files_in_hdfs(options, databasename, tablename, files, firstsegno, True)
    > insert_metadata_into_database(options, databasename, tablename, seg_name, firstsegno,
sizes)
    
    If one of the reads fails, we just exit cause no file has been changed. If move_files_in_hdfs
fails, the metadata will not be inserted. If insert_metadata_into_database fails, we will
move the files back to their original location.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message