pyspark.streaming.DStream.checkpoint

DStream.checkpoint(interval)

Enable periodic checkpointing of RDDs of this DStream

Parameters:

intervalint

time in seconds, after each period of that, generated RDD will be checkpointed

pyspark.streaming.DStream.cache pyspark.streaming.DStream.cogroup