hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bogdan Raducanu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-12537) RLEv2 doesn't seem to work
Date Sat, 28 Nov 2015 00:35:10 GMT

     [ https://issues.apache.org/jira/browse/HIVE-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bogdan Raducanu updated HIVE-12537:
-----------------------------------
    Description: 
Putting 1 million constant int32 values produces an ORC file of 1MB.
Perhaps I'm doing something wrong or is actually working as expected.
Will attach code.
Output from FileDump:



Rows: 1000000
Compression: NONE
Type: int

Stripe Statistics:
  Stripe 1:
    Column 0: count: 1000000 hasNull: false min: 123 max: 123 sum: 123000000

File Statistics:
  Column 0: count: 1000000 hasNull: false min: 123 max: 123 sum: 123000000

Stripes:
  Stripe: offset: 3 data: 1003847 rows: 1000000 tail: 41 index: 2871
    Stream: column 0 section ROW_INDEX start: 3 length 2871
    Stream: column 0 section DATA start: 2874 length 1003847
    Encoding column 0: DIRECT_V2

File length: 1006860 bytes
Padding length: 0 bytes
Padding ratio: 0%


  was:
Putting 1 million constant int32 values produces an ORC file of 1MB.
Perhaps I'm doing something wrong or is actually working as expect.
Will attach code.
Output from FileDump:



Rows: 1000000
Compression: NONE
Type: int

Stripe Statistics:
  Stripe 1:
    Column 0: count: 1000000 hasNull: false min: 123 max: 123 sum: 123000000

File Statistics:
  Column 0: count: 1000000 hasNull: false min: 123 max: 123 sum: 123000000

Stripes:
  Stripe: offset: 3 data: 1003847 rows: 1000000 tail: 41 index: 2871
    Stream: column 0 section ROW_INDEX start: 3 length 2871
    Stream: column 0 section DATA start: 2874 length 1003847
    Encoding column 0: DIRECT_V2

File length: 1006860 bytes
Padding length: 0 bytes
Padding ratio: 0%



> RLEv2 doesn't seem to work
> --------------------------
>
>                 Key: HIVE-12537
>                 URL: https://issues.apache.org/jira/browse/HIVE-12537
>             Project: Hive
>          Issue Type: Bug
>          Components: File Formats
>    Affects Versions: 1.2.1
>            Reporter: Bogdan Raducanu
>
> Putting 1 million constant int32 values produces an ORC file of 1MB.
> Perhaps I'm doing something wrong or is actually working as expected.
> Will attach code.
> Output from FileDump:
> Rows: 1000000
> Compression: NONE
> Type: int
> Stripe Statistics:
>   Stripe 1:
>     Column 0: count: 1000000 hasNull: false min: 123 max: 123 sum: 123000000
> File Statistics:
>   Column 0: count: 1000000 hasNull: false min: 123 max: 123 sum: 123000000
> Stripes:
>   Stripe: offset: 3 data: 1003847 rows: 1000000 tail: 41 index: 2871
>     Stream: column 0 section ROW_INDEX start: 3 length 2871
>     Stream: column 0 section DATA start: 2874 length 1003847
>     Encoding column 0: DIRECT_V2
> File length: 1006860 bytes
> Padding length: 0 bytes
> Padding ratio: 0%



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message