Friday, 15 February 2019

square root of an RDD



Change the input as RDD

scala> val input = sc.parallelize(List(1,2,3,4))
input: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[21]
at parallelize at <console>:24


Apply the square formula in map
scala> val result = input.map(x => x*x)
result: org.apache.spark.rdd.RDD[Int] = MapPartitionsRDD[22]
at map at <console>:26

Print the result as string comma seperated
scala> println(result.collect().mkString(","))
1,4,9,16 

Same output as space sperated
scala> println(result.collect().mkString(" "))
1 4 9 16                                

No comments:

Post a Comment