在写Spark累加器的时候,把代码写在main方法中,累加的和是正确的,但是我实现App特质时,每次运行都是出现不同的结果,这是什么原因呀?
import org.apache.spark.{SparkConf, SparkContext}
object AccumulatorDemo extends App{
val conf = new SparkConf().setAppName("AccumulatorDemo").setMaster("local
- "
- )
val sc = new SparkContext(conf)
val sum = sc.accumulator(0)
val numbers = sc.parallelize(Array(1,2,3,4,5,6),2)
numbers.foreach(num => sum+=num)
println(sum)
sc.stop()
}