为什么start-all.sh从根本原因“未能启动org.apache.spark.deploy.master.Master: JAVA_HOME未设置”？
为什么start-all.sh从根本原因“未能启动org.apache.spark.deploy.master.Master: JAVA_HOME未设置”？
提问于 2015-11-27 10:43:58
我正在尝试通过运行在cloudera快速启动VM 5.3.0上的独立Spark服务来执行通过Scala构建的Spark应用程序。
我的cloudera帐户JAVA_HOME是/usr/java/default
但是，在从cloudera用户执行start-all.sh命令时，我面临以下错误消息，如下所示：
[cloudera@localhost sbin]$ pwd
/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin
[cloudera@localhost sbin]$ ./start-all.sh
chown: changing ownership of `/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs': Operation not permitted
starting org.apache.spark.deploy.master.Master, logging to /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs/spark-cloudera-org.apache.spark.deploy.master.Master-1-localhost.localdomain.out
/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/spark-daemon.sh: line 151: /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs/spark-cloudera-org.apache.spark.deploy.master.Master-1-localhost.localdomain.out: Permission denied
failed to launch org.apache.spark.deploy.master.Master:
tail: cannot open `/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs/spark-cloudera-org.apache.spark.deploy.master.Master-1-localhost.localdomain.out' for reading: No such file or directory
full log in /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs/spark-cloudera-org.apache.spark.deploy.master.Master-1-localhost.localdomain.out
cloudera@localhost's password:
localhost: chown: changing ownership of `/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/logs': Operation not permitted
localhost: starting org.apache.spark.deploy.worker.Worker, logging to /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/logs/spark-cloudera-org.apache.spark.deploy.worker.Worker-1-localhost.localdomain.out
localhost: /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/spark-daemon.sh: line 151: /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/logs/spark-cloudera-org.apache.spark.deploy.worker.Worker-1-localhost.localdomain.out: Permission denied
localhost: failed to launch org.apache.spark.deploy.worker.Worker:
localhost: tail: cannot open `/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/logs/spark-cloudera-org.apache.spark.deploy.worker.Worker-1-localhost.localdomain.out' for reading: No such file or directory
localhost: full log in /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/logs/spark-cloudera-org.apache.spark.deploy.worker.Worker-1-localhost.localdomain.out我在/etc/default/cloudera-scm-agent中添加了/etc/default/cloudera-scm-agent并运行了sudo service cloudera-scm-agent restart。请参阅首页
我还在locate_java_home函数定义中添加了/usr/share/cmf/bin/cmf-server文件中的/usr/share/cmf/bin/cmf-server，并重新启动了集群和独立星火服务。
但是，在从root用户启动spark服务时，以下错误正在重复
[root@localhost spark]# sbin/start-all.sh
starting org.apache.spark.deploy.master.Master, logging to /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs/spark-root-org.apache.spark.deploy.master.Master-1-localhost.localdomain.out
failed to launch org.apache.spark.deploy.master.Master:
JAVA_HOME is not set
full log in /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/sbin/../logs/spark-root-org.apache.spark.deploy.master.Master-1-localhost.localdomain.out
root@localhost's password:
localhost: Connection closed by UNKNOWN有人能建议如何设置JAVA_HOME，以便在cloudera经理上启动火种独立服务吗？
回答 2
Stack Overflow用户
回答已采纳
发布于 2015-11-27 13:07:10
解决办法很简单，很直接。刚刚在export JAVA_HOME=/usr/java/default中添加了/root/.bashrc，它成功地从root用户启动了spark服务，而没有JAVA_HOME is not set错误。希望它能帮助那些面临同样问题的人。
Stack Overflow用户
发布于 2020-07-12 13:57:22
在JAVA_HOME中设置~/.bashrc变量，如下所示
sudo gedit ~/.bashrc在文件中写入这一行(已安装JDK的地址)
JAVA_HOME="/usr/lib/jvm/java-11-openjdk-amd64"然后命令
source ~/.bashrc页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/33955635
复制相关文章
相似问题
腾讯云开发者
