pyspark.streaming.DStream.transformWith

DStream.transformWith(func, other, keepSerializer=False)

Return a new DStream in which each RDD is generated by applying a function on each RDD of this DStream and ‘other’ DStream.

func can have two arguments of (rdd_a, rdd_b) or have three arguments of (time, rdd_a, rdd_b)

pyspark.streaming.DStream.transform pyspark.streaming.DStream.union