Spark Environment Info

Last updated: 2023-12-25 15:16:05

Tencent Cloud's EMR offers multi-version support for Spark 3.x and 2.x, with the following software environment information:
Spark is installed on the master node by default.
Upon logging into the machine, use the command su hadoop to switch to the Hadoop user.
The Spark software path is located under /usr/local/service/spark.
The relevant log path is located under /data/emr.
For more detailed information, please refer to the community documentation. This primarily introduces operations related to accessing Tencent Cloud Object Storage based on Spark.