spark版本:2.4.3,jar包:spark-hive_2.11hive表格式为:orcFailed with exception java.io.IOException:java.lang.RuntimeException: ORCsplitgenerationfailed with exception
我正在尝试将我的RDD保存为orc格式。._它编译得很好,但是不能工作。我得到以下异常:
ERROR ApplicationMaster: User class threw exception: java.lang.AssertionError: assertion failed: The ORC data source can only be used with HiveContex
+ echo 'TPC-H text data generation complete.'TPC-H text data generation complete.
+ echo 'Loading text data into external tables.'_2 -d SOURCE=tpch_text_2 -d BUCKETS=13 -d SCALE=2 -d REDUCERS=2 -d FILE=orc''Command <em