问oozie4.1.0怎么调用spark2 ？

Main class        : org.apache.oozie.action.hadoop.SparkMain

Maximum output    : 2048

Arguments         :

Java System Properties:
------------------------
#
#Sat Jun 16 14:08:16 CST 2018
java.runtime.name=Java(TM) SE Runtime Environment
sun.boot.library.path=/usr/java/jdk1.8.0_112/jre/lib/amd64
java.vm.version=25.112-b15
oozie.action.externalChildIDs=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/externalChildIDs
hadoop.root.logger=INFO,CLA
java.vm.vendor=Oracle Corporation
java.vendor.url=http\://java.oracle.com/
path.separator=\:
java.vm.name=Java HotSpot(TM) 64-Bit Server VM
file.encoding.pkg=sun.io
oozie.job.launch.time=1529128440000
user.country=US
sun.java.launcher=SUN_STANDARD
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002
oozie.action.newId=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/newId
java.runtime.version=1.8.0_112-b15
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/usr/java/jdk1.8.0_112/jre/lib/endorsed
os.arch=amd64
oozie.job.id=0001148-180615171243076-oozie-oozi-W
oozie.action.id=0001148-180615171243076-oozie-oozi-W@spark-SparkOozieAction2
yarn.app.container.log.dir=/yarn/container-logs/application_1528857488697_2244/container_1528857488697_2244_01_000002
java.io.tmpdir=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/tmp
line.separator=\n
oozie.action.output.properties=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/output.properties
java.vm.specification.vendor=Oracle Corporation
os.name=Linux
log4j.configuration=container-log4j.properties
sun.jnu.encoding=UTF-8
java.library.path=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/native\:\:/usr/java/packages/lib/amd64\:/usr/lib64\:/lib64\:/lib\:/usr/lib
oozie.action.conf.xml=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/action.xml
hadoop.metrics.log.level=WARN
java.specification.name=Java Platform API Specification
java.class.version=52.0
java.net.preferIPv4Stack=true
sun.management.compiler=HotSpot 64-Bit Tiered Compilers
os.version=3.10.0-693.el7.x86_64
oozie.action.error.properties=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/error.properties
hadoop.root.logfile=syslog
yarn.app.container.log.filesize=0
user.home=/var/lib/hadoop-yarn
user.timezone=Asia/Shanghai
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=UTF-8
java.specification.version=1.8
/*
* 提示：该行代码过长，系统自动注释不进行高亮。一键复制会移除系统注释 
* java.class.path=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002\:job.jar/job.jar\:job.jar/classes/\:job.jar/lib/*\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/avro-mapred-1.7.6-cdh5.13.3-hadoop2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-databind-2.6.7.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hive-shims-0.23-1.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/univocity-parsers-2.5.9.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/breeze-macros_2.11-0.13.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/aopalliance-repackaged-2.4.0-b34.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-module-paranamer-2.7.9.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/javax.servlet-api-3.1.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/metrics-jvm-3.1.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/stringtemplate-3.2.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/chill-java-0.8.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/json4s-ast_2.11-3.2.11.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-compress-1.4.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-streaming-flume_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hive-serde-1.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/arrow-vector-0.8.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/json-20090211.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/antlr-runtime-3.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/datanucleus-rdbms-3.2.9.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-hadoop-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-hive-exec_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/javax.inject-2.4.0-b34.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/orc-mapreduce-1.4.1-nohive.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-streaming-flume-sink_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/core-1.1.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-avro-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-core-2.6.7.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spire-macros_2.11-0.13.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/eigenbase-properties-1.1.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/flume-ng-sdk-1.6.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/snappy-0.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/scala-xml_2.11-1.0.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jul-to-slf4j-1.7.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/httpcore-4.4.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-annotations-2.6.7.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/flume-ng-core-1.6.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-common-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/RoaringBitmap-0.5.11.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-pool-1.5.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-yarn_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/flume-ng-configuration-1.6.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/apache-log4j-extras-1.2.17.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/validation-api-1.1.0.Final.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/arrow-format-0.8.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/json4s-jackson_2.11-3.2.11.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-unsafe_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-server-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jodd-core-3.5.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/opencsv-2.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/chill_2.11-0.8.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/shapeless_2.11-2.3.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/metrics-json-3.1.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-kvstore_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/bonecp-0.7.1.RELEASE.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-collections-3.2.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oozie-sharelib-spark-4.1.0-cdh5.14.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-compiler-3.0.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/osgi-resource-locator-1.0.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/scala-reflect-2.11.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-launcher_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oozie-sharelib-oozie-4.1.0-cdh5.14.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-httpclient-3.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-crypto-1.0.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hk2-api-2.4.0-b34.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/breeze_2.11-0.13.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/calcite-core-1.0.0-incubating.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/stax-api-1.0.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-hadoop-bundle-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/javax.ws.rs-api-2.0.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-guava-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jetty-util-6.1.26.cloudera.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-sketch_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/scalap-2.11.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/javolution-5.5.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/calcite-avatica-1.0.0-incubating.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-cli-1.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-network-common_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oozie-sharelib-oozie.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-math3-3.4.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-graphx_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/scala-compiler-2.11.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/janino-3.0.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/datanucleus-core-3.2.10.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/logredactor-1.0.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oozie-hadoop-utils.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-container-servlet-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hive-metastore-1.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-column-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hk2-utils-2.4.0-b34.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/zstd-jni-1.3.2-2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jdo-api-3.0.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-network-shuffle_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-format-2.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-net-2.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/ivy-2.4.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/flatbuffers-1.2.0-3f79e055.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-lineage_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/arrow-memory-0.8.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/ST4-4.0.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/xbean-asm5-shaded-4.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spire_2.11-0.13.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-core_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-common-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-encoding-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-mllib_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/orc-core-1.4.1-nohive.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-client-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/paranamer-2.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-io-2.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-xc-1.8.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/xz-1.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/json4s-core_2.11-3.2.11.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-streaming_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/avro-ipc-1.7.6-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/joda-time-2.9.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/py4j-0.10.6.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/antlr-2.7.7.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hive-shims-scheduler-1.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/compress-lzf-1.0.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/pyrolite-4.13.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-repl_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/aircompressor-0.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-lang3-3.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/avro-1.7.6-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-logging-1.1.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/metrics-core-3.1.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/netty-3.9.9.Final.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/calcite-linq4j-1.0.0-incubating.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jtransforms-2.4.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jta-1.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oro-2.0.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/parquet-jackson-1.5.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/lz4-java-1.4.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oozie-hadoop-utils-2.6.0-cdh5.14.0.oozie-4.1.0-cdh5.14.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/libthrift-0.9.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/metrics-graphite-3.1.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-catalyst_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-hive_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/macro-compat_2.11-1.1.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-media-jaxb-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hive-shims-1.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hive-shims-common-1.1.0-cdh5.13.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jersey-container-servlet-core-2.22.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/JavaEWAH-0.3.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/scala-parser-combinators_2.11-1.0.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/machinist_2.11-0.6.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/objenesis-2.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-codec-1.10.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/datanucleus-api-jdo-3.2.6.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hk2-locator-2.4.0-b34.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/arpack_combined_all-0.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-mllib-local_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/javassist-3.18.1-GA.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/javax.annotation-api-1.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-module-scala_2.11-2.6.7.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/oozie-sharelib-spark.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/kryo-shaded-3.0.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-lang-2.6.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/scala-library-2.11.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/derby-10.12.1.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/gson-2.2.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jetty-6.1.26.cloudera.4.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/json-simple-1.1.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/fastutil-6.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/antlr4-runtime-4.7.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/mina-core-2.0.0-M5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/minlog-1.3.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/netty-all-4.1.17.Final.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jackson-jaxrs-1.8.8.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/stream-2.7.0.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-sql_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-tags_2.11-2.3.0.cloudera2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/jcl-over-slf4j-1.7.5.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/hppc-0.7.2.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/libfb303-0.9.3.jar\:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/commons-dbcp-1.4.jar\:/etc/hadoop/conf.cloudera.yarn\:/run/cloudera-scm-agent/process/213-yarn-NODEMANAGER\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-annotations.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-auth.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-aws.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-azure-datalake.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-common-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-common.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-nfs.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-nfs-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-common-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-common-2.6.0-cdh5.14.0-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-azure-datalake-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-aws-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-auth-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/hadoop-annotations-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-format.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-format-sources.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-format-javadoc.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-tools.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-thrift.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-test-hadoop2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-scrooge_2.10.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-scala_2.10.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-protobuf.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-pig.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-pig-bundle.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-jackson.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-hadoop.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-hadoop-bundle.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-generator.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-encoding.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-common.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-column.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-cascading.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/parquet-avro.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-lang-2.6.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-net-3.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/curator-recipes-2.7.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-io-2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-httpclient-3.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/httpcore-4.2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/curator-framework-2.7.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/java-xmlbuilder-0.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-configuration-1.6.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jersey-core-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/httpclient-4.2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-math3-3.1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jsr305-3.0.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/gson-2.2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/hue-plugins-3.9.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jersey-json-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-logging-1.1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/zookeeper.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/avro.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/stax-api-1.0-2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/protobuf-java-2.5.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/mockito-all-1.8.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/junit-4.11.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jsch-0.1.42.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jersey-server-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/curator-client-2.7.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-collections-3.2.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-beanutils-1.9.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/azure-data-lake-store-sdk-2.2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/aws-java-sdk-bundle-1.11.134.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/api-util-1.0.0-M20.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/activation-1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/slf4j-log4j12.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/slf4j-api-1.7.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/netty-3.10.5.Final.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/logredactor-1.0.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jets3t-0.9.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/hamcrest-core-1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/lib/commons-digester-1.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/hadoop-hdfs-nfs.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/hadoop-hdfs-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/hadoop-hdfs.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/hadoop-hdfs-nfs-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/hadoop-hdfs-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/hadoop-hdfs-2.6.0-cdh5.14.0-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/xml-apis-1.3.04.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/xercesImpl-2.9.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/netty-3.10.5.Final.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jersey-server-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jersey-core-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/htrace-core4-4.0.1-incubating.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-lang-2.6.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-io-2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-hdfs/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-api.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-client.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-common.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-registry.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-common.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/activation-1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.14.0-yarn-shuffle.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/stax-api-1.0-2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jsr305-3.0.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jline-2.11.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jersey-server-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jersey-json-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jersey-guice-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jersey-core-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jersey-client-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/javax.inject-1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/guice-servlet-3.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/guice-3.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-lang-2.6.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-io-2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/aopalliance-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/zookeeper.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-yarn/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/activation-1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/apacheds-i18n-2.0.0-M15.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/apacheds-kerberos-codec-2.0.0-M15.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/api-asn1-api-1.0.0-M20.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/api-util-1.0.0-M20.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/asm-3.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/avro.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-beanutils-1.9.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-beanutils-core-1.8.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-collections-3.2.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-configuration-1.6.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-digester-1.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-httpclient-3.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-io-2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-lang-2.6.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-logging-1.1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-math3-3.1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/commons-net-3.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/curator-client-2.7.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/curator-framework-2.7.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/curator-recipes-2.7.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/gson-2.2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-ant-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-ant.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-archive-logs-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-archive-logs.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-archives-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-archives.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-auth-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-auth.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-azure-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-azure.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-datajoin-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-datajoin.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-distcp-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-distcp.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-extras-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-extras.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-gridmix-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-gridmix.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-app.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-common.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-tests.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-nativetask.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-openstack-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-openstack.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-rumen-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-rumen.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-sls-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-sls.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-streaming-2.6.0-cdh5.14.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hadoop-streaming.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/hamcrest-core-1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/htrace-core4-4.0.1-incubating.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/httpclient-4.2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/httpcore-4.2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-annotations-2.2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-core-2.2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-databind-2.2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jasper-compiler-5.5.23.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/java-xmlbuilder-0.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/xz-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/stax-api-1.0-2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/protobuf-java-2.5.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/okio-1.4.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/okhttp-2.4.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/mockito-all-1.8.5.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/microsoft-windowsazure-storage-sdk-0.6.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/metrics-core-3.0.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/junit-4.11.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jsr305-3.0.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jsch-0.1.42.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jetty-util-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jetty-6.1.26.cloudera.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/zookeeper.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jets3t-0.9.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jersey-server-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jersey-json-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/jersey-core-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/netty-3.10.5.Final.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/junit-4.11.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/javax.inject-1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/hamcrest-core-1.3.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/guice-3.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/commons-io-2.4.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar\:/opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop-mapreduce/lib/avro.jar\:
*/
user.name=yarn
java.vm.specification.version=1.8
sun.java.command=org.apache.hadoop.mapred.YarnChild 172.16.101.119 42448 attempt_1528857488697_2244_m_000000_0 2
java.home=/usr/java/jdk1.8.0_112/jre
sun.arch.data.model=64
user.language=en
java.specification.vendor=Oracle Corporation
awt.toolkit=sun.awt.X11.XToolkit
java.vm.info=mixed mode
java.version=1.8.0_112
java.ext.dirs=/usr/java/jdk1.8.0_112/jre/lib/ext\:/usr/java/packages/lib/ext
sun.boot.class.path=/usr/java/jdk1.8.0_112/jre/lib/resources.jar\:/usr/java/jdk1.8.0_112/jre/lib/rt.jar\:/usr/java/jdk1.8.0_112/jre/lib/sunrsasign.jar\:/usr/java/jdk1.8.0_112/jre/lib/jsse.jar\:/usr/java/jdk1.8.0_112/jre/lib/jce.jar\:/usr/java/jdk1.8.0_112/jre/lib/charsets.jar\:/usr/java/jdk1.8.0_112/jre/lib/jfr.jar\:/usr/java/jdk1.8.0_112/jre/classes
java.vendor=Oracle Corporation
file.separator=/
oozie.launcher.job.id=job_1528857488697_2244
oozie.action.stats.properties=/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/stats.properties
java.vendor.url.bug=http\://bugreport.sun.com/bugreport/
sun.io.unicode.encoding=UnicodeLittle
sun.cpu.endian=little
sun.cpu.isalist=
------------------------

=================================================================

>>> Invoking Main class now >>>

INFO: loading log4j config file log4j.properties.
INFO: log4j config file log4j.properties loaded successfully.
Fetching child yarn jobs
tag id : oozie-1a1ba64c91ace0ff88e811f5df2fb1dc
Child yarn jobs are found - 
Fetching child yarn jobs
tag id : oozie-1a1ba64c91ace0ff88e811f5df2fb1dc
Child yarn jobs are found - 
Reading Spark config propagated from Oozie server...
Persisted merged Spark configs in file spark-defaults-oozie-generated.properties. Merged properties are: [spark.lineage.enabled, spark.yarn.config.replacementPath, spark.dynamicAllocation.executorIdleTimeout, spark.dynamicAllocation.schedulerBacklogTimeout, spark.yarn.historyServer.allowTracking, spark.extraListeners, spark.ui.enabled, spark.shuffle.service.port, spark.yarn.config.gatewayPath, spark.ui.killEnabled, spark.eventLog.enabled, spark.yarn.am.extraLibraryPath, spark.yarn.historyServer.address, spark.master, spark.sql.queryExecutionListeners, spark.dynamicAllocation.enabled, spark.dynamicAllocation.minExecutors, spark.executor.extraLibraryPath, spark.serializer, spark.lineage.log.dir, spark.shuffle.encryption.enabled, spark.authenticate, spark.authenticate.enableSaslEncryption, spark.driver.extraLibraryPath, spark.shuffle.service.enabled, spark.eventLog.dir]
Spark Version 2.3.0.cloudera2
Spark Action Main class        : org.apache.spark.deploy.SparkSubmit

Oozie Spark action configuration
=================================================================

                    --master
                    yarn
                    --deploy-mode
                    cluster
                    --name
                    sparkjob
                    --class
                    com.hoperun.spark.ReadDB
                    --conf
                    spark.oozie.action.id=0001148-180615171243076-oozie-oozi-W@spark-SparkOozieAction2
                    --conf
                    spark.oozie.child.mapreduce.job.tags=oozie-1a1ba64c91ace0ff88e811f5df2fb1dc
                    --conf
                    spark.oozie.action.sharelib.for.spark=spark2
                    --conf
                    spark.oozie.action.rootlogger.log.level=INFO
                    --conf
                    spark.oozie.job.id=0001148-180615171243076-oozie-oozi-W
                    --conf
                    spark.oozie.action.spark.setup.hadoop.conf.dir=false
                    --conf
                    spark.oozie.HadoopAccessorService.created=true
                    --executor-memory
                    1G
                    --total-executor-cores
                    2
                    --driver-memory
                    1G
                    --jars
                    hdfs://node02:8020/jars/mysql-connector-java-5.1.46.jar
                    --conf
                    spark.eventLog.dir=hdfs://node02:8020/user/spark/spark2ApplicationHistory
                    --conf
                    spark.eventLog.enabled=true
                    --conf
                    spark.yarn.localizeConfig=false
                    --conf
                    spark.executor.extraClassPath=$PWD/*
                    --conf
                    spark.driver.extraClassPath=$PWD/*
                    --conf
                    spark.yarn.tags=oozie-1a1ba64c91ace0ff88e811f5df2fb1dc
                    --conf
                    spark.yarn.security.tokens.hive.enabled=false
                    --conf
                    spark.yarn.security.tokens.hbase.enabled=false
                    --conf
                    spark.executor.extraJavaOptions=-Dlog4j.configuration=spark-log4j.properties
                    --conf
                    spark.driver.extraJavaOptions=-Dlog4j.configuration=spark-log4j.properties
                    --properties-file
                    spark-defaults-oozie-generated.properties
                    --files
/*
* 提示：该行代码过长，系统自动注释不进行高亮。一键复制会移除系统注释 
* hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/distcp#distcp,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/hcatalog#hcatalog,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/hive#hive,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/hive2#hive2,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/mapreduce-streaming#mapreduce-streaming,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie#oozie,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/pig#pig,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/sharelib.properties#sharelib.properties,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark#spark,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2#spark2,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/sqoop#sqoop,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/aopalliance-repackaged-2.4.0-b34.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/libfb303-0.9.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/chill_2.11-0.8.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/kryo-shaded-3.0.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.inject-2.4.0-b34.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flatbuffers-1.2.0-3f79e055.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-annotations-2.6.7.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-graphx_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-tags_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-compiler-2.11.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/avro-1.7.6-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-common-1.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-xml_2.11-1.0.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jul-to-slf4j-1.7.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-httpclient-3.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-parser-combinators_2.11-1.0.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/mina-core-2.0.0-M5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/ST4-4.0.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/breeze_2.11-0.13.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-reflect-2.11.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-core-2.6.7.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/avro-ipc-1.7.6-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jetty-6.1.26.cloudera.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.servlet-api-3.1.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-jaxrs-1.8.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-databind-2.6.7.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.annotation-api-1.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/libthrift-0.9.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/fastutil-6.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-container-servlet-core-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-server-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-lineage_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/objenesis-2.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-hive_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-crypto-1.0.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-metastore-1.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-collections-3.2.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-scheduler-1.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-net-2.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/datanucleus-api-jdo-3.2.6.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/orc-mapreduce-1.4.1-nohive.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/core-1.1.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-sketch_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/bonecp-0.7.1.RELEASE.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-network-shuffle_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hk2-locator-2.4.0-b34.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/macro-compat_2.11-1.1.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/netty-all-4.1.17.Final.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javassist-3.18.1-GA.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hppc-0.7.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-streaming_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/stringtemplate-3.2.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jtransforms-2.4.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-launcher_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-1.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/netty-3.9.9.Final.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-format-2.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/breeze-macros_2.11-0.13.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-core-3.1.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/derby-10.12.1.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-column-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flume-ng-configuration-1.6.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scalap-2.11.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/calcite-linq4j-1.0.0-incubating.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-0.23-1.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-module-paranamer-2.7.9.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-json-3.1.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/compress-lzf-1.0.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flume-ng-core-1.6.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-kvstore_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arpack_combined_all-0.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-module-scala_2.11-2.6.7.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/oro-2.0.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-lang-2.6.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json4s-jackson_2.11-3.2.11.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/chill-java-0.8.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-network-common_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jetty-util-6.1.26.cloudera.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-logging-1.1.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-xc-1.8.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/janino-3.0.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/snappy-0.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-pool-1.5.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/xz-1.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-avro-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/apache-log4j-extras-1.2.17.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-catalyst_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/JavaEWAH-0.3.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jcl-over-slf4j-1.7.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/calcite-avatica-1.0.0-incubating.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spire_2.11-0.13.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/calcite-core-1.0.0-incubating.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-core_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/stax-api-1.0.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/antlr-runtime-3.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-compiler-3.0.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/minlog-1.3.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-compress-1.4.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/antlr4-runtime-4.7.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spire-macros_2.11-0.13.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/shapeless_2.11-2.3.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jdo-api-3.0.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-serde-1.1.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/stream-2.7.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/osgi-resource-locator-1.0.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/oozie-sharelib-spark-4.1.0-cdh5.14.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/datanucleus-core-3.2.10.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/RoaringBitmap-0.5.11.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-lang3-3.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hk2-api-2.4.0-b34.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-sql_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arrow-vector-0.8.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arrow-format-0.8.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/joda-time-2.9.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-jvm-3.1.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-library-2.11.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/oozie-sharelib-spark.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-jackson-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/orc-core-1.4.1-nohive.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-hadoop-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json4s-core_2.11-3.2.11.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-streaming-flume_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arrow-memory-0.8.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-media-jaxb-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-mllib_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-math3-3.4.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/ivy-2.4.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-graphite-3.1.5.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/eigenbase-properties-1.1.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-client-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/paranamer-2.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/httpcore-4.4.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jta-1.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-dbcp-1.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-codec-1.10.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-guava-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/logredactor-1.0.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-cli-1.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-hadoop-bundle-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/pyrolite-4.13.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flume-ng-sdk-1.6.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-common-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/avro-mapred-1.7.6-cdh5.13.3-hadoop2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json4s-ast_2.11-3.2.11.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/xbean-asm5-shaded-4.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hk2-utils-2.4.0-b34.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/zstd-jni-1.3.2-2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-hive-exec_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/opencsv-2.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-streaming-flume-sink_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/datanucleus-rdbms-3.2.9.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/machinist_2.11-0.6.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-io-2.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-repl_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.ws.rs-api-2.0.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json-20090211.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/validation-api-1.1.0.Final.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/univocity-parsers-2.5.9.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-unsafe_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javolution-5.5.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-common-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jodd-core-3.5.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/gson-2.2.4.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/lz4-java-1.4.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-encoding-1.5.0-cdh5.13.3.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-container-servlet-2.22.2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/aircompressor-0.8.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/py4j-0.10.6.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/antlr-2.7.7.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-mllib-local_2.11-2.3.0.cloudera2.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/json-simple-1.1.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-hadoop-utils-2.6.0-cdh5.14.0.oozie-4.1.0-cdh5.14.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-hadoop-utils.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-sharelib-oozie-4.1.0-cdh5.14.0.jar,hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-sharelib-oozie.jar,spark-log4j.properties
*/
                    --conf
                    spark.yarn.jars=hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-yarn_2.11-2.3.0.cloudera2.jar
                    --verbose
                    hdfs://node02:8020/jars/offlineanalysis-1.0-SNAPSHOT.jar

=================================================================

>>> Invoking Spark class now >>>

2018-06-16 14:08:17,952 [main] INFO  org.apache.hadoop.yarn.client.RMProxy  - Connecting to ResourceManager at node07/172.16.101.117:8032
2018-06-16 14:08:17,965 [main] INFO  org.apache.spark.deploy.yarn.Client  - Requesting a new application from cluster with 8 NodeManagers
2018-06-16 14:08:18,049 [main] INFO  org.apache.spark.deploy.yarn.Client  - Verifying our application has not requested more than the maximum memory capability of the cluster (51200 MB per container)
2018-06-16 14:08:18,049 [main] INFO  org.apache.spark.deploy.yarn.Client  - Will allocate AM container, with 1408 MB memory including 384 MB overhead
2018-06-16 14:08:18,050 [main] INFO  org.apache.spark.deploy.yarn.Client  - Setting up container launch context for our AM
2018-06-16 14:08:18,052 [main] INFO  org.apache.spark.deploy.yarn.Client  - Setting up the launch environment for our AM container
2018-06-16 14:08:18,061 [main] INFO  org.apache.spark.deploy.yarn.Client  - Preparing resources for our AM container
2018-06-16 14:08:18,085 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-yarn_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,160 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/jars/offlineanalysis-1.0-SNAPSHOT.jar
2018-06-16 14:08:18,171 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/jars/mysql-connector-java-5.1.46.jar
2018-06-16 14:08:18,174 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/sharelib.properties#sharelib.properties
2018-06-16 14:08:18,178 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/aopalliance-repackaged-2.4.0-b34.jar
2018-06-16 14:08:18,182 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/libfb303-0.9.3.jar
2018-06-16 14:08:18,184 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/chill_2.11-0.8.0.jar
2018-06-16 14:08:18,187 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/kryo-shaded-3.0.3.jar
2018-06-16 14:08:18,191 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.inject-2.4.0-b34.jar
2018-06-16 14:08:18,194 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flatbuffers-1.2.0-3f79e055.jar
2018-06-16 14:08:18,197 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-annotations-2.6.7.jar
2018-06-16 14:08:18,199 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-graphx_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,202 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-tags_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,205 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-compiler-2.11.8.jar
2018-06-16 14:08:18,208 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/avro-1.7.6-cdh5.13.3.jar
2018-06-16 14:08:18,211 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-common-1.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,214 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-xml_2.11-1.0.5.jar
2018-06-16 14:08:18,217 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jul-to-slf4j-1.7.5.jar
2018-06-16 14:08:18,220 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-httpclient-3.1.jar
2018-06-16 14:08:18,223 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-parser-combinators_2.11-1.0.4.jar
2018-06-16 14:08:18,226 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/mina-core-2.0.0-M5.jar
2018-06-16 14:08:18,229 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/ST4-4.0.4.jar
2018-06-16 14:08:18,233 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/breeze_2.11-0.13.2.jar
2018-06-16 14:08:18,236 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-reflect-2.11.8.jar
2018-06-16 14:08:18,239 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-core-2.6.7.jar
2018-06-16 14:08:18,242 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/avro-ipc-1.7.6-cdh5.13.3.jar
2018-06-16 14:08:18,245 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jetty-6.1.26.cloudera.4.jar
2018-06-16 14:08:18,247 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.servlet-api-3.1.0.jar
2018-06-16 14:08:18,251 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-jaxrs-1.8.8.jar
2018-06-16 14:08:18,254 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-databind-2.6.7.1.jar
2018-06-16 14:08:18,257 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.annotation-api-1.2.jar
2018-06-16 14:08:18,260 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/libthrift-0.9.3.jar
2018-06-16 14:08:18,263 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/fastutil-6.3.jar
2018-06-16 14:08:18,266 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-container-servlet-core-2.22.2.jar
2018-06-16 14:08:18,269 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-server-2.22.2.jar
2018-06-16 14:08:18,272 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-lineage_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,275 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/objenesis-2.1.jar
2018-06-16 14:08:18,278 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-hive_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,280 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-crypto-1.0.0.jar
2018-06-16 14:08:18,284 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-metastore-1.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,286 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-collections-3.2.2.jar
2018-06-16 14:08:18,290 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-scheduler-1.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,293 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-net-2.2.jar
2018-06-16 14:08:18,295 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/datanucleus-api-jdo-3.2.6.jar
2018-06-16 14:08:18,298 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/orc-mapreduce-1.4.1-nohive.jar
2018-06-16 14:08:18,301 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/core-1.1.2.jar
2018-06-16 14:08:18,304 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-sketch_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,307 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/bonecp-0.7.1.RELEASE.jar
2018-06-16 14:08:18,309 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-network-shuffle_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,312 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hk2-locator-2.4.0-b34.jar
2018-06-16 14:08:18,315 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/macro-compat_2.11-1.1.1.jar
2018-06-16 14:08:18,318 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/netty-all-4.1.17.Final.jar
2018-06-16 14:08:18,321 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javassist-3.18.1-GA.jar
2018-06-16 14:08:18,324 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hppc-0.7.2.jar
2018-06-16 14:08:18,327 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-streaming_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,330 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/stringtemplate-3.2.1.jar
2018-06-16 14:08:18,332 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jtransforms-2.4.0.jar
2018-06-16 14:08:18,335 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-launcher_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,338 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-1.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,341 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/netty-3.9.9.Final.jar
2018-06-16 14:08:18,344 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-format-2.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,348 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/breeze-macros_2.11-0.13.2.jar
2018-06-16 14:08:18,352 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-core-3.1.5.jar
2018-06-16 14:08:18,355 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/derby-10.12.1.1.jar
2018-06-16 14:08:18,359 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-column-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,363 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flume-ng-configuration-1.6.0-cdh5.13.3.jar
2018-06-16 14:08:18,366 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scalap-2.11.8.jar
2018-06-16 14:08:18,369 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/calcite-linq4j-1.0.0-incubating.jar
2018-06-16 14:08:18,371 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-shims-0.23-1.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,374 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-module-paranamer-2.7.9.jar
2018-06-16 14:08:18,377 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-json-3.1.5.jar
2018-06-16 14:08:18,380 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/compress-lzf-1.0.3.jar
2018-06-16 14:08:18,382 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flume-ng-core-1.6.0-cdh5.13.3.jar
2018-06-16 14:08:18,385 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-kvstore_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,388 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arpack_combined_all-0.1.jar
2018-06-16 14:08:18,391 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-module-scala_2.11-2.6.7.1.jar
2018-06-16 14:08:18,393 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/oro-2.0.8.jar
2018-06-16 14:08:18,396 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-lang-2.6.jar
2018-06-16 14:08:18,398 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json4s-jackson_2.11-3.2.11.jar
2018-06-16 14:08:18,401 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/chill-java-0.8.0.jar
2018-06-16 14:08:18,404 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-network-common_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,406 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jetty-util-6.1.26.cloudera.4.jar
2018-06-16 14:08:18,409 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-logging-1.1.3.jar
2018-06-16 14:08:18,412 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jackson-xc-1.8.8.jar
2018-06-16 14:08:18,414 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/janino-3.0.8.jar
2018-06-16 14:08:18,418 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/snappy-0.2.jar
2018-06-16 14:08:18,420 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-pool-1.5.4.jar
2018-06-16 14:08:18,423 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/xz-1.0.jar
2018-06-16 14:08:18,426 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-avro-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,429 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/apache-log4j-extras-1.2.17.jar
2018-06-16 14:08:18,432 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-catalyst_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,435 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/JavaEWAH-0.3.2.jar
2018-06-16 14:08:18,438 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jcl-over-slf4j-1.7.5.jar
2018-06-16 14:08:18,441 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/calcite-avatica-1.0.0-incubating.jar
2018-06-16 14:08:18,444 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spire_2.11-0.13.0.jar
2018-06-16 14:08:18,447 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/calcite-core-1.0.0-incubating.jar
2018-06-16 14:08:18,450 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-core_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,454 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/stax-api-1.0.1.jar
2018-06-16 14:08:18,457 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/antlr-runtime-3.4.jar
2018-06-16 14:08:18,460 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-compiler-3.0.8.jar
2018-06-16 14:08:18,463 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/minlog-1.3.0.jar
2018-06-16 14:08:18,466 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-compress-1.4.1.jar
2018-06-16 14:08:18,469 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/antlr4-runtime-4.7.jar
2018-06-16 14:08:18,472 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spire-macros_2.11-0.13.0.jar
2018-06-16 14:08:18,475 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/shapeless_2.11-2.3.2.jar
2018-06-16 14:08:18,478 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jdo-api-3.0.1.jar
2018-06-16 14:08:18,481 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hive-serde-1.1.0-cdh5.13.3.jar
2018-06-16 14:08:18,483 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/stream-2.7.0.jar
2018-06-16 14:08:18,486 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/osgi-resource-locator-1.0.1.jar
2018-06-16 14:08:18,488 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/oozie-sharelib-spark-4.1.0-cdh5.14.0.jar
2018-06-16 14:08:18,495 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/datanucleus-core-3.2.10.jar
2018-06-16 14:08:18,497 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/RoaringBitmap-0.5.11.jar
2018-06-16 14:08:18,500 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-lang3-3.5.jar
2018-06-16 14:08:18,504 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hk2-api-2.4.0-b34.jar
2018-06-16 14:08:18,506 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-sql_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,509 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arrow-vector-0.8.0.jar
2018-06-16 14:08:18,512 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arrow-format-0.8.0.jar
2018-06-16 14:08:18,515 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/joda-time-2.9.3.jar
2018-06-16 14:08:18,517 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-jvm-3.1.5.jar
2018-06-16 14:08:18,520 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/scala-library-2.11.8.jar
2018-06-16 14:08:18,523 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/oozie-sharelib-spark.jar
2018-06-16 14:08:18,526 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-jackson-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,528 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/orc-core-1.4.1-nohive.jar
2018-06-16 14:08:18,531 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-hadoop-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,534 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json4s-core_2.11-3.2.11.jar
2018-06-16 14:08:18,537 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-streaming-flume_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,539 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/arrow-memory-0.8.0.jar
2018-06-16 14:08:18,542 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-media-jaxb-2.22.2.jar
2018-06-16 14:08:18,544 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-mllib_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,547 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-math3-3.4.1.jar
2018-06-16 14:08:18,549 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/ivy-2.4.0.jar
2018-06-16 14:08:18,552 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/metrics-graphite-3.1.5.jar
2018-06-16 14:08:18,554 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/eigenbase-properties-1.1.4.jar
2018-06-16 14:08:18,557 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-client-2.22.2.jar
2018-06-16 14:08:18,560 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/paranamer-2.8.jar
2018-06-16 14:08:18,562 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/httpcore-4.4.8.jar
2018-06-16 14:08:18,565 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jta-1.1.jar
2018-06-16 14:08:18,568 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-dbcp-1.4.jar
2018-06-16 14:08:18,571 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-codec-1.10.jar
2018-06-16 14:08:18,574 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-guava-2.22.2.jar
2018-06-16 14:08:18,576 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/logredactor-1.0.3.jar
2018-06-16 14:08:18,579 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-cli-1.2.jar
2018-06-16 14:08:18,582 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-hadoop-bundle-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,585 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/pyrolite-4.13.jar
2018-06-16 14:08:18,588 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/flume-ng-sdk-1.6.0-cdh5.13.3.jar
2018-06-16 14:08:18,590 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-common-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,593 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/avro-mapred-1.7.6-cdh5.13.3-hadoop2.jar
2018-06-16 14:08:18,595 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json4s-ast_2.11-3.2.11.jar
2018-06-16 14:08:18,598 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/xbean-asm5-shaded-4.4.jar
2018-06-16 14:08:18,601 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/hk2-utils-2.4.0-b34.jar
2018-06-16 14:08:18,604 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/zstd-jni-1.3.2-2.jar
2018-06-16 14:08:18,606 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-hive-exec_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,609 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/opencsv-2.3.jar
2018-06-16 14:08:18,611 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-streaming-flume-sink_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,614 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/datanucleus-rdbms-3.2.9.jar
2018-06-16 14:08:18,616 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/machinist_2.11-0.6.1.jar
2018-06-16 14:08:18,619 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/commons-io-2.4.jar
2018-06-16 14:08:18,622 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-repl_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,626 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javax.ws.rs-api-2.0.1.jar
2018-06-16 14:08:18,629 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/json-20090211.jar
2018-06-16 14:08:18,631 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/validation-api-1.1.0.Final.jar
2018-06-16 14:08:18,635 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/univocity-parsers-2.5.9.jar
2018-06-16 14:08:18,637 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-unsafe_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,640 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/javolution-5.5.1.jar
2018-06-16 14:08:18,642 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-common-2.22.2.jar
2018-06-16 14:08:18,645 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jodd-core-3.5.2.jar
2018-06-16 14:08:18,648 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/gson-2.2.4.jar
2018-06-16 14:08:18,650 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/lz4-java-1.4.0.jar
2018-06-16 14:08:18,653 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/parquet-encoding-1.5.0-cdh5.13.3.jar
2018-06-16 14:08:18,655 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/jersey-container-servlet-2.22.2.jar
2018-06-16 14:08:18,658 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/aircompressor-0.8.jar
2018-06-16 14:08:18,660 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/py4j-0.10.6.jar
2018-06-16 14:08:18,664 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/antlr-2.7.7.jar
2018-06-16 14:08:18,666 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/spark2/jars/spark-mllib-local_2.11-2.3.0.cloudera2.jar
2018-06-16 14:08:18,669 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/json-simple-1.1.jar
2018-06-16 14:08:18,675 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-hadoop-utils-2.6.0-cdh5.14.0.oozie-4.1.0-cdh5.14.0.jar
2018-06-16 14:08:18,678 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-hadoop-utils.jar
2018-06-16 14:08:18,680 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-sharelib-oozie-4.1.0-cdh5.14.0.jar
2018-06-16 14:08:18,682 [main] INFO  org.apache.spark.deploy.yarn.Client  - Source and destination file systems are the same. Not copying hdfs://node02:8020/user/oozie/share/lib/lib_20180613153006/oozie/oozie-sharelib-oozie.jar
2018-06-16 14:08:18,686 [main] INFO  org.apache.spark.deploy.yarn.Client  - Uploading resource file:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/container_1528857488697_2244_01_000002/spark-log4j.properties -> hdfs://node02:8020/user/hdfs/.sparkStaging/application_1528857488697_2245/spark-log4j.properties
2018-06-16 14:08:18,800 [main] INFO  org.apache.spark.deploy.yarn.Client  - Uploading resource file:/yarn/nm/usercache/hdfs/appcache/application_1528857488697_2244/spark-101d1b3c-5fc4-4733-a03f-42b7f3b9566d/__spark_conf__1633947074469245327.zip -> hdfs://node02:8020/user/hdfs/.sparkStaging/application_1528857488697_2245/__spark_conf__.zip
2018-06-16 14:08:18,876 [main] INFO  org.apache.spark.SecurityManager  - Changing view acls to: yarn,hdfs
2018-06-16 14:08:18,877 [main] INFO  org.apache.spark.SecurityManager  - Changing modify acls to: yarn,hdfs
2018-06-16 14:08:18,877 [main] INFO  org.apache.spark.SecurityManager  - Changing view acls groups to: 
2018-06-16 14:08:18,878 [main] INFO  org.apache.spark.SecurityManager  - Changing modify acls groups to: 
2018-06-16 14:08:18,878 [main] INFO  org.apache.spark.SecurityManager  - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(yarn, hdfs); groups with view permissions: Set(); users  with modify permissions: Set(yarn, hdfs); groups with modify permissions: Set()
2018-06-16 14:08:18,906 [main] WARN  org.apache.spark.deploy.security.HadoopDelegationTokenManager  - spark.yarn.security.tokens.hive.enabled is deprecated.  Please use spark.security.credentials.hive.enabled instead.
2018-06-16 14:08:18,906 [main] WARN  org.apache.spark.deploy.security.HadoopDelegationTokenManager  - spark.yarn.security.tokens.hbase.enabled is deprecated.  Please use spark.security.credentials.hbase.enabled instead.
2018-06-16 14:08:18,933 [main] INFO  org.apache.spark.deploy.yarn.Client  - Submitting application application_1528857488697_2245 to ResourceManager
2018-06-16 14:08:18,986 [main] INFO  org.apache.hadoop.yarn.client.api.impl.YarnClientImpl  - Submitted application application_1528857488697_2245
2018-06-16 14:08:19,990 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:19,998 [main] INFO  org.apache.spark.deploy.yarn.Client  - 
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.users.hdfs
	 start time: 1529129298958
	 final status: UNDEFINED
	 tracking URL: http://node07:8088/proxy/application_1528857488697_2245/
	 user: hdfs
2018-06-16 14:08:21,000 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:22,002 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:23,003 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:24,005 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:25,007 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:26,011 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:27,013 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:28,014 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:29,016 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:30,018 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:31,020 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: ACCEPTED)
2018-06-16 14:08:32,022 [main] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1528857488697_2245 (state: FAILED)
2018-06-16 14:08:32,023 [main] INFO  org.apache.spark.deploy.yarn.Client  - 
	 client token: N/A
	 diagnostics: Application application_1528857488697_2245 failed 2 times due to AM Container for appattempt_1528857488697_2245_000002 exited with  exitCode: 13
For more detailed output, check application tracking page:http://node07:8088/proxy/application_1528857488697_2245/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1528857488697_2245_02_000001
Exit code: 13
Stack trace: ExitCodeException exitCode=13: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:604)
	at org.apache.hadoop.util.Shell.run(Shell.java:507)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:789)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 13
Failing this attempt. Failing the application.
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.users.hdfs
	 start time: 1529129298958
	 final status: FAILED
	 tracking URL: http://node07:8088/cluster/app/application_1528857488697_2245
	 user: hdfs

<<< Invocation of Spark command completed <<<

Hadoop Job IDs executed by Spark: job_1528857488697_2245


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Application application_1528857488697_2245 finished with failed status
org.apache.spark.SparkException: Application application_1528857488697_2245 finished with failed status
	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1153)
	at org.apache.spark.deploy.yarn.YarnClusterApplication.start(Client.scala:1568)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:892)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
	at org.apache.oozie.action.hadoop.SparkMain.runSpark(SparkMain.java:178)
	at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:90)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:81)
	at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:57)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:235)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

Oozie Launcher failed, finishing Hadoop job gracefully

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://node02:8020/user/hdfs/oozie-oozi/0001148-180615171243076-oozie-oozi-W/spark-SparkOozieAction2--spark/action-data.seq
2018-06-16 14:08:32,091 [main] INFO  org.apache.hadoop.io.compress.zlib.ZlibFactory  - Successfully loaded & initialized native-zlib library
2018-06-16 14:08:32,092 [main] INFO  org.apache.hadoop.io.compress.CodecPool  - Got brand-new compressor [.deflate]
Successfully reset security manager from org.apache.oozie.action.hadoop.LauncherSecurityManager@3db972d2 to null

Oozie Launcher ends

2018-06-16 14:08:32,135 [main] INFO  org.apache.hadoop.mapred.Task  - Task:attempt_1528857488697_2244_m_000000_0 is done. And is in the process of committing
2018-06-16 14:08:32,179 [main] INFO  org.apache.hadoop.mapred.Task  - Task 'attempt_1528857488697_2244_m_000000_0' done.
2018-06-16 14:08:32,280 [main] INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl  - Stopping MapTask metrics system...
2018-06-16 14:08:32,280 [main] INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl  - MapTask metrics system stopped.
2018-06-16 14:08:32,280 [main] INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl  - MapTask metrics
 system shutdown complete.