使用这里的指南:https://sedona.apache.org/setup/install-python/
尝试在google的python中使用。但是,遵循指南将得到一个TypeError
。有什么想法吗?
!pip install apache-sedona[spark]
from pyspark.sql import SparkSession
from sedona.register import SedonaRegistrator
from sedona.utils import SedonaKryoRegistrator, KryoSerializer
spark = SparkSession. \
builder. \
appName('appName'). \
config("spark.serializer", KryoSerializer.getName). \
config("spark.kryo.registrator", SedonaKryoRegistrator.getName). \
config('spark.jars.packages',
'org.apache.sedona:sedona-python-adapter-3.0_2.12:1.2.0-incubating,'
'org.datasyslab:geotools-wrapper:1.1.0-25.2'). \
getOrCreate()
SedonaRegistrator.registerAll(spark)
结果:
TypeError Traceback (most recent call last)
<ipython-input-73-3e0f20bf8072> in <module>()
11 'org.apache.sedona:sedona-python-adapter-3.0_2.12:1.0.0-incubating,'
12 'org.datasyslab:geotools-wrapper:geotools-24.0').getOrCreate()
---> 13 SedonaRegistrator.registerAll(spark)
14 dfx = spark.sql("SELECT ST_PolygonFromText('-74.0428197,40.6867969,-74.0421975,40.6921336,-74.0508020,40.6912794,-74.0428197,40.6867969', ',') AS polygonshape")
15 dfx
1 frames
/usr/local/lib/python3.7/dist-packages/sedona/register/geo_registrator.py in registerAll(cls, spark)
41 spark.sql("SELECT 1 as geom").count()
42 PackageImporter.import_jvm_lib(spark._jvm)
---> 43 cls.register(spark)
44 return True
45
/usr/local/lib/python3.7/dist-packages/sedona/register/geo_registrator.py in register(cls, spark)
46 @classmethod
47 def register(cls, spark: SparkSession):
---> 48 return spark._jvm.SedonaSQLRegistrator.registerAll(spark._jsparkSession)
49
50
TypeError: 'JavaPackage' object is not callable
发布于 2022-05-20 04:40:52
您必须下载缺少的jar连接器文件,从https://sedona.apache.org/setup/install-python/#prepare-python-adapter-jar中选择一种方法
一个简单的选择是:
cd $SPARK_HOME/jars
wget https://repo1.maven.org/maven2/org/datasyslab/geotools-wrapper/1.1.0-25.2/geotools-wrapper-1.1.0-25.2.jar
wget https://repo1.maven.org/maven2/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.2.0-incubating/sedona-python-adapter-3.0_2.12-1.2.0-incubating.jar
wget https://repo1.maven.org/maven2/org/apache/sedona/sedona-viz-3.0_2.12/1.2.0-incubating/sedona-viz-3.0_2.12-1.2.0-incubating.jar
这个问题与sedona error : java.lang.NoClassDefFoundError: org/opengis/referencing/FactoryException密切相关。
https://stackoverflow.com/questions/71992697
复制相似问题