我正在尝试这样做:
val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)这是我的build.sbt文件:
name := "SPARK-SQL"
version := "1.0"
scalaVersion := "2.11.8"
libraryDependencies += "org.apache.spark" % "spark-core_2.11" % "2.0.0-preview"
libraryDependencies += "org.apache.spark" % "spark-sql_2.11" % "2.0.0-preview"
libraryDependencies += "org.apache.spark" % "spark-hive-thriftserver_2.10" % "1.6.2"我所犯的错误:
错误:scalac:在加载类文件'HiveContext.class‘时检测到缺少或无效的依赖关系。
发布于 2018-06-18 18:30:34
看起来你正在尝试使用星星之母库1.6和火花库2.0,我不确定这是否有效。
对于Spark 1.6.x,您可以这样做:
libraryDependencies += "org.apache.spark" %% "spark-hive" % "1.6.3" % "provided"https://stackoverflow.com/questions/38304853
复制相似问题