因此,我有一个包含多个列的数据帧,但真正重要的列称为A和B。如果列A不包含值X,或者列B不包含值Y,则必须删除该行。True)
A value is trying to be set on a copy of a slice from a DataFrameSee the caveats in the documentation: https:/&
为此,我在我创建的dataframe上调用"foreachPartition(inside)“方法。"inside“函数需要dataframe值。dataframe如下所示:DataFrame[lon: double, lat: double, t: bigint]def inside(iterator0:20000,:] #take sample of rows from big dataset
small_df=sql