为了窥视SparkSQL执行SQL时的内在机制,新建一个测试表test
,
create table test(key string,value string)
基于这个测试表,执行下面的sql语句,关键字explain extended
可以在console
里打印详细日志。
explain extended select a.key*(2+3),b.value from test a join test b on a.key = b.key and a.key >3;
即:
http://hadoop000:4040/jobs/
页面中看到错误:
run at ThreadPoolExecutor.java:1149
image.png
https://stackoverflow.com/questions/40852622/what-are-threadpoolexecutors-jobs-in-web-ui