orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ORC-373) Option to disable dictionary encoding
Date Sat, 02 Jun 2018 01:39:00 GMT
Prasanth Jayachandran created ORC-373:
-----------------------------------------

             Summary: Option to disable dictionary encoding 
                 Key: ORC-373
                 URL: https://issues.apache.org/jira/browse/ORC-373
             Project: ORC
          Issue Type: Bug
    Affects Versions: 1.5.2
            Reporter: Prasanth Jayachandran
            Assignee: Prasanth Jayachandran


Currently dictionary check happens after first creating first row group entry. Even when row
indexes are disabled, rows end up in red-black tree first before getting flushed during write
stripe.
If dictionary threshold is set to <= 0.0 disable dictionary and write directly to stream.
This is useful for hive streaming ingest where delta files explicitly disables dictionaries.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message