Apache快速启动"java.lang.NoClassDefFoundError: scala/序列化“
Apache快速启动"java.lang.NoClassDefFoundError: scala/序列化“
提问于 2022-11-30 09:35:32
我正在尝试遵循这个指南https://spark.apache.org/docs/latest/quick-start.html (scala)。然而，当我应该提交jar文件来触发时，我无法完成最后一步。
# Use spark-submit to run your application
$ YOUR_SPARK_HOME/bin/spark-submit \
--class "SimpleApp" \
--master local[4] \
target/scala-2.12/simple-project_2.12-1.0.jar我得到以下异常
Exception in thread "main" java.lang.BootstrapMethodError: java.lang.NoClassDefFoundError: scala/Serializable
at SimpleApp$.main(SimpleApp.scala:9)
at SimpleApp.main(SimpleApp.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:958)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1046)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1055)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NoClassDefFoundError: scala/Serializable
... 14 more
Caused by: java.lang.ClassNotFoundException: scala.Serializable
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
... 14 more知道是什么原因造成的吗？
回答 2
Stack Overflow用户
回答已采纳
发布于 2022-12-01 15:14:32
我发现了问题。我安装了错误的火花版本。我下载了“为ApacheHadoop3.3及更高版本(Scala2.13)预构建”版本。安装“为ApacheHadoop3.3及更高版本构建的预构建”解决了问题。
Stack Overflow用户
发布于 2022-11-30 10:24:02
您需要将依赖项升级到与Scala版本兼容的二进制版本。在本例中，类似于2.12。
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/74625513
复制相关文章
相似问题
腾讯云开发者
