hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13189) Consider using Joda DateTimeFormatter instead of SimpleDateFormat in GenericUDFDateAdd
Date Tue, 01 Mar 2016 15:42:18 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajesh Balamohan updated HIVE-13189:
------------------------------------
    Issue Type: Improvement  (was: Bug)

> Consider using Joda DateTimeFormatter instead of SimpleDateFormat in GenericUDFDateAdd
> --------------------------------------------------------------------------------------
>
>                 Key: HIVE-13189
>                 URL: https://issues.apache.org/jira/browse/HIVE-13189
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Rajesh Balamohan
>
> Quite an amount was spent by tasks in trying to parse date string in GenericUDFDateAdd.
 
> {noformat}
>   java.lang.Thread.State: RUNNABLE
>         at java.text.DecimalFormat.subparse(DecimalFormat.java:1467)
>         at java.text.DecimalFormat.parse(DecimalFormat.java:1268)
>         at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:2088)
>         at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1455)
>         at java.text.DateFormat.parse(DateFormat.java:355)
>         at org.apache.hadoop.hive.ql.udf.generic.GenericUDFDateAdd.evaluate(GenericUDFDateAdd.java:172)
>         at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186)
>         at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)
>         at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87)
>         at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPGreaterThan.evaluate(GenericUDFOPGreaterThan.java:80)
>         at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186)
>         at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)
>         at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:65)
>         at org.apache.hadoop.hive.ql.exec.FilterOperator.process(FilterOperator.java:108)
>         at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:838)
>         at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:644)
> {noformat}
> Joda DateTimeFormatter can be considered for better performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message