Check out PySpark's documentation on the missing observation methods: https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrameNaFunctions