spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cxzl25 <...@git.apache.org>
Subject [GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version
Date Fri, 22 Jun 2018 07:29:00 GMT
Github user cxzl25 commented on the issue:

    https://github.com/apache/spark/pull/21596
  
    https://github.com/apache/spark/pull/20738
    
    Bump jackson from 2.6.7&2.6.7.1 to 2.7.7
    Jackson(>=2.7.7) fixes the possibility of missing tail data when the length of the
value is in a range
    [https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.7.7](https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.7.7)
    [https://github.com/FasterXML/jackson-core/issues/30](https://github.com/FasterXML/jackson-core/issues/307)
    
    spark-shell:
    ```
    val value = "x" * 3000
    val json = s"""{"big": "$value"}"""
    spark.sql("select length(get_json_object(\'"+json+"\','$.big'))" ).collect
    res0: Array[org.apache.spark.sql.Row] = Array([2991])
    ```
    expect result : 3000 
    actual  result : 2991


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message