ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From percent620 <percent...@163.com>
Subject Re: Embedded mode ignite on spark
Date Fri, 12 Aug 2016 01:47:47 GMT
I verified this code as below

val ic = new IgniteContext[Int, Int](sc, () => new
IgniteConfiguration(),false)
    val sharedRDD = ic.fromCache("sharedBaselineCacheRDD")
    val initalRDD = sc.parallelize(1 to 100000,10).map(i => (i, i))
    println("initalRDD.couner=/. " + initalRDD.count() +"\tparition=> " +
initalRDD.partitions.size)
    sharedRDD.savePairs(initalRDD)
    println("=====>totalcounter" + sharedRDD.count + "\t paris => " +
sharedRDD.partitions.size)
    println("=====>" + sharedRDD.filter(_._2 > 50000).count)

but this result is not what i need, 

define shared context start
define shared context end                                                       
[Stage 1:=====================================================>   (28 + 2) /
30][09:29:21] New version is available at ignite.apache.org: 1.7.0
initalRDD.couner=/. 100000      parition=> 10                                   
=====>totalcounter40000  paris => 1024  (need to be 10000)                         
              
=====>10000                                                                     
==


Can anyone help me on this issues? Thanks!!!



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Embedded-mode-ignite-on-spark-tp6942p7001.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Mime
View raw message