应用程序偶尔会抛出ConcurrentModificationException->at org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:1361)
at org.apache.spark.streaming.kafka010java.util.HashMap.putVal(HashMap.
package com.scala.sparkStreaming
import org.apache.spark.streaming._
at org.apache.spark.streaming.StreamingContext.validate(StreamingContext.scala:517)
at org.apache.spark.st
简而言之,所有的RDDs /数据帧都必须存储在全局视图中。正如你所看到的,它可以很好地运行几个RDD,然后抛出错误。created after droppingjava.util.ConcurrentModificationExceptionfailed 1 times, most recent failure: Lost task 0.0 in sta
我在共享redis连接池(JedisPool) sparkstreaming应用程序中使用了sparkContext.broadcast。/standalone模式下运行它时,比如 at org.apache.spark.SparkContext.broadcast(SparkContext.scala:809)
at org.culiu
我正在尝试创建一个流上下文,但它一直在创建StreamingContext行中抛出异常,这是我的代码 .builder() at org.apache.spark.streaming.scheduler.JobGenerator.<init>(JobGenerator.scala:51)
at org.apache.spark</e