phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "iduanyingjie (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PHOENIX-4584) when use phoenix-spark reading phoenix data, there will be data loss in spark DataFrame
Date Tue, 06 Feb 2018 06:37:00 GMT

     [ https://issues.apache.org/jira/browse/PHOENIX-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

iduanyingjie updated PHOENIX-4584:
----------------------------------
    Description: 
{code:java}
scala> val df = sqlContext.read.format("org.apache.phoenix.spark").option("table", "xx.xx").option("zkUrl",
"xxxx:2181").load().cache()

scala> df.filter(df("locationid") === 523714).count()
res0: Long = 0
{code}
  !snipaste_20180206_143130.bmp!

!snipaste_20180206_143447.bmp!  

  was:
{code:java}
scala> val df = sqlContext.read.format("org.apache.phoenix.spark").option("table", "xx.xx").option("zkUrl",
"xxxx:2181").load().cache()

scala> df.filter(df("locationid") === 523714).count()
res0: Long = 0
{code}
  !snipaste_20180206_143130.bmp!

 


> when use phoenix-spark reading phoenix data, there will be data loss in spark DataFrame
> ---------------------------------------------------------------------------------------
>
>                 Key: PHOENIX-4584
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4584
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.8.0
>            Reporter: iduanyingjie
>            Priority: Major
>         Attachments: snipaste_20180206_143130.bmp, snipaste_20180206_143447.bmp
>
>
> {code:java}
> scala> val df = sqlContext.read.format("org.apache.phoenix.spark").option("table",
"xx.xx").option("zkUrl", "xxxx:2181").load().cache()
> scala> df.filter(df("locationid") === 523714).count()
> res0: Long = 0
> {code}
>   !snipaste_20180206_143130.bmp!
> !snipaste_20180206_143447.bmp!  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message