hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance
Date Thu, 11 Dec 2014 21:13:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243152#comment-14243152
] 

Prasanth Jayachandran commented on HIVE-8121:
---------------------------------------------

IMO, there are many pitfalls of doing microbenchmarking like the one in this patch.

Lots of them are highlighted in this video by Aleksey Shipilëv (the guy who leads the development
of JMH)
https://parleys.com/play/52ae09bde4b04354fb7e7cfd/chapter67/about

IMHO, we should use JMH for any sorts of micro-benchmarking to get correct and more accurate
results.

> Create micro-benchmarks for ParquetSerde and evaluate performance
> -----------------------------------------------------------------
>
>                 Key: HIVE-8121
>                 URL: https://issues.apache.org/jira/browse/HIVE-8121
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Brock Noland
>            Assignee: Sergio Peña
>
> These benchmarks should not execute queries but test only the ParquetSerde code to ensure
we are as efficient as possible. 
> The output of this JIRA is:
> 1) Benchmark tool exists
> 2) We create new tasks under HIVE-8120 to track the improvements required



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message