hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tzolov <...@git.apache.org>
Subject [GitHub] incubator-hawq pull request: HAWQ-178: Add JSON plugin support in ...
Date Wed, 03 Feb 2016 16:57:04 GMT
Github user tzolov commented on the pull request:

    https://github.com/apache/incubator-hawq/pull/302#issuecomment-179344304
  
    In the last commit(s): 
    * Added tests to cover corner cases like malformed json records or compressed input files.
The _combined_ test coverage is > 95%. @hornn is there an integration tests/environment
to itest PXF plugins?
    * Improved handling of malformed json records/fields. If the json record is not parsable
the Resolver will produce a row with empty fields.  If a field in the record is missing then
an empty db field is created.
    * Factored out the column metadata computation logic and data in a dedicated `ColumnDescriptorCache`
class. Now the cached descriptor metadata is created only once inside the `JsonResolver` constructor.
Previously it use to be re-computed on each `JsonResolver.getFields()` method call. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message