carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chenliang613 <>
Subject [GitHub] incubator-carbondata pull request #614: [CARBONDATA-714]Documented how to ha...
Date Mon, 06 Mar 2017 23:21:58 GMT
Github user chenliang613 commented on a diff in the pull request:
    --- Diff: docs/ ---
    @@ -18,30 +18,57 @@
     # FAQs
    -* **Auto Compaction not Working**
    -    The Property in need to be set to
    +* [What are Bad Records?](#what-are-bad-records)
    +* [Where are Bad Records Stored in CarbonData?](#where-are-bad-records-stored-in-carbondata)
    +* [How to handle Bad Records?](#how-to-handle-bad-records)
    +* [How to resolve store location can’t be found?](#how-to-resolve-store-location-can-not-be-found)
    +* [What is Carbon Lock Type?](#what-is-carbon-lock-type)
    +* [How to resolve Abstract Method Error?](#how-to-resolve-abstract-method-error)
    -* **Getting Abstract method error**
    +## What are Bad Records?
    +Records that fail to get loaded into the CarbonData due to data type incompatibility
or are empty or have incompatible format are classified as Bad Records.
    -    You need to specify the spark version while using Maven to build project.
    +## Where are Bad Records Stored in CarbonData?
    +The bad records are stored at the location set in carbon.badRecords.location in
    +By default **carbon.badRecords.location** specifies the following location ``/opt/Carbon/Spark/badrecords``.
    -* **Getting NotImplementedException for subquery using IN and EXISTS**
    +## How to handle Bad Records?
    +While loading data we can specify the approach to handle Bad Records. In order to analyse
the cause of the Bad Records the parameter ``BAD_RECORDS_LOGGER_ENABLE`` must be set to value
``TRUE``. There are three approaches to handle Bad Records which can be specified  by the
parameter ``BAD_RECORDS_ACTION``.
    -    Subquery with in and exists not supported in CarbonData.
    -* **Getting Exceptions on creating  a view**
    -    View not supported in CarbonData.
    -* **How to verify if ColumnGroups have been created as desired.**
    +- To pad the incorrect values of the csv rows with NULL value and load the data in CarbonData,
set the following in the query :
    --- End diff --
    Please add "How to ignore the bad records" ?
    Please find the detail discussion at here :

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message