前往小程序,Get更优阅读体验!
立即前往
首页
学习
活动
专区
工具
TVP
发布
社区首页 >专栏 >昇腾 CANN 开发环境

昇腾 CANN 开发环境

作者头像
GoCoding
发布2021-08-13 16:58:54
1.9K0
发布2021-08-13 16:58:54
举报
文章被收录于专栏:GoCodingGoCoding

昇腾 CANN 是华为开发的 AI 场景的异构计算架构,支持用户快速构建基于昇腾平台的 AI 应用和业务。

本文为 Ubuntu 上手动部署开发环境(与运行环境分离),安装 MindStudio 的过程。

注:也可通过 msInstaller[1] 工具自动安装。只是本文实践时,安装服务遇到了中断问题。故给出了手动安装的方式。

基础说明

要求:

  • Ubuntu x86 18.04

非昇腾设备: 仅能用于代码开发、编译等不依赖于昇腾芯片的纯开发活动。

开发和运行环境分离部署:

获取软件包

  • 软件包(推理)[2]
    • Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run
    • Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run
    • MindStudio_3.0.1_linux.tar.gz

下载页,中英文给到的版本可能不同。

配置用户(可选)

当用户使用非root用户安装时,需要操作该章节,否则请忽略。

创建用户(non-root):

代码语言:javascript
复制
sudo -i

# 创建用户
groupadd HwHiAiUser
useradd -g HwHiAiUser -d /home/HwHiAiUser -m HwHiAiUser -s /bin/bash
passwd HwHiAiUser

# 添加权限
chmod u+w /etc/sudoers
vi /etc/sudoers
  # User privilege specification
  HwHiAiUser ALL=(ALL:ALL) ALL
chmod u-w /etc/sudoers

# 切换用户
su HwHiAiUser

安装依赖

代码语言:javascript
复制
sudo apt update
sudo apt-get install -y gcc g++ make cmake zlib1g zlib1g-dev libsqlite3-dev openssl libssl-dev libffi-dev unzip pciutils net-tools libblas-dev gfortran libblas3 libopenblas-dev

wget https://www.python.org/ftp/python/3.7.5/Python-3.7.5.tgz
tar -zxvf Python-3.7.5.tgz
cd Python-3.7.5
./configure --prefix=$HOME/python3.7.5 --enable-loadable-sqlite-extensions --enable-shared
make -j`nproc`
make install

sudo cp $HOME/python3.7.5/lib/libpython3.7m.so.1.0 /usr/lib

sudo ln -s $HOME/python3.7.5/bin/python3 /usr/bin/python3.7
sudo ln -s $HOME/python3.7.5/bin/pip3    /usr/bin/pip3.7
sudo ln -s $HOME/python3.7.5/bin/python3 /usr/bin/python3.7.5
sudo ln -s $HOME/python3.7.5/bin/pip3    /usr/bin/pip3.7.5

sudo ln -s $HOME/python3.7.5/bin/pip3      /usr/bin/pip3
sudo ln -s $HOME/python3.7.5/lib/python3.7 /usr/lib/python3.7

pip3.7.5 config set global.index-url https://mirrors.aliyun.com/pypi/simple/
pip3.7.5 install attrs psutil decorator numpy protobuf==3.11.3 scipy sympy cffi

安装开发包

代码语言:javascript
复制
$ chmod +x Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run
$ ./Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run --install
Verifying archive integrity...  100%   SHA256 checksums are OK. All good.
Uncompressing ASCEND_RUN_PACKAGE  100%
[Toolkit] [20210610-20:42:05] [INFO] LogFile:/home/HwHiAiUser/var/log/ascend_seclog/ascend_toolkit_install.log
[Toolkit] [20210610-20:42:05] [INFO] install start
[Toolkit] [20210610-20:42:05] [INFO] The install path is /home/HwHiAiUser/Ascend !
[Toolkit] [20210610-20:42:05] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:42:05] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:42:05] [INFO] install package Ascend-acllib-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:42:08] [INFO] Ascend-acllib-1.78.t20.0.b200-linux.x86_64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:42:08] [INFO] install package Ascend-pyACL-3.3.0.alpha003-linux.x86_64.run start
[Toolkit] [20210610-20:42:08] [INFO] Ascend-pyACL-3.3.0.alpha003-linux.x86_64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:42:08] [INFO] install package Ascend-atc-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:42:41] [INFO] Ascend-atc-1.78.t20.0.b200-linux.x86_64.run --devel --pylocal --quiet --nox11   install success
[Toolkit] [20210610-20:42:41] [INFO] install package Ascend-opp-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:43:11] [INFO] Ascend-opp-1.78.t20.0.b200-linux.x86_64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:43:11] [INFO] install package Ascend-toolkit-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:44:11] [INFO] Ascend-toolkit-1.78.t20.0.b200-linux.x86_64.run --devel --pylocal --quiet --nox11   install success
[Toolkit] [20210610-20:44:11] [INFO] install package Ascend310-aicpu_kernels-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:44:12] [INFO] Ascend310-aicpu_kernels-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:44:12] [INFO] install package Ascend910-aicpu_kernels-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:44:13] [INFO] Ascend910-aicpu_kernels-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:44:13] [INFO] install package Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:44:14] [INFO] Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:44:14] [INFO] /home/HwHiAiUser/Ascend/ascend_cann_install.info generate success
[Toolkit] [20210610-20:44:14] [INFO] Please make sure that:
Offline infer develop (cannot coexist with other scenes):
 LD_LIBRARY_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/acllib/lib64:
 PYTHONPATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/pyACL/python/site-packages/acl:
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit/python/site-packages:
 ASCEND_AICPU_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest:
 ASCEND_OPP_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/opp:
 TOOLCHAIN_HOME includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit:
Third party AI framework develop (cannot coexist with other scenes):
 PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/ccec_compiler/bin:
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/bin:
 LD_LIBRARY_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/lib64:
 PYTHONPATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/python/site-packages:
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit/python/site-packages:
 ASCEND_OPP_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/opp:
 ASCEND_AICPU_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest:
 TOOLCHAIN_HOME includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit:
Model transformation and operator develop (cannot coexist with other scenes):
 PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/ccec_compiler/bin:
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/bin:
 LD_LIBRARY_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/lib64:
 PYTHONPATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/python/site-packages:
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit/python/site-packages:
 ASCEND_OPP_PATH includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/opp:
 TOOLCHAIN_HOME includes :
  /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit:
[Toolkit] [20210610-20:44:15] [INFO] Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run install success,The install path is /home/HwHiAiUser/Ascend !
代码语言:javascript
复制
$ chmod +x Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run
$ ./Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run --install
Verifying archive integrity...  100%   SHA256 checksums are OK. All good.
Uncompressing ASCEND_RUN_PACKAGE  100%
[Toolkit] [20210610-20:46:27] [INFO] LogFile:/home/HwHiAiUser/var/log/ascend_seclog/ascend_toolkit_install.log
[Toolkit] [20210610-20:46:27] [INFO] install start
[Toolkit] [20210610-20:46:27] [INFO] The install path is /home/HwHiAiUser/Ascend !
[Toolkit] [20210610-20:46:27] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:46:27] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:46:27] [INFO] The current OS is x86_64
[Toolkit] [20210610-20:46:27] [INFO] install package Ascend-acllib-1.78.t20.0.b200-linux.aarch64.run start
[Toolkit] [20210610-20:46:29] [INFO] Ascend-acllib-1.78.t20.0.b200-linux.aarch64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:46:29] [INFO] install package Ascend310-aicpu_kernels-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:46:31] [INFO] Ascend310-aicpu_kernels-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:46:31] [INFO] install package Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:46:32] [INFO] Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:46:32] [INFO] Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run install success,The install path is /home/HwHiAiUser/Ascend !

创建 Docker 镜像(可选)

代码语言:javascript
复制
docker pull ubuntu:18.04

cat <<-EOF > Dockerfile
# syntax=docker/dockerfile:experimental
FROM ubuntu:18.04

ARG ASCEND_DIR=./ascend
# ./ascend
#  Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run
#  Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run
#  Python-3.7.5.tgz

COPY \${ASCEND_DIR} /ascend

RUN apt-get update \\
 && apt-get install -y gcc g++ make cmake zlib1g zlib1g-dev libsqlite3-dev \\
                       openssl libssl-dev libffi-dev unzip pciutils net-tools \\
 && rm -rf /var/lib/apt/lists/*

RUN cd /ascend \\
 && tar -zxvf Python-3.7.5.tgz \\
 && cd Python-3.7.5 \\
 && ./configure --prefix=/usr/local/python3.7.5 \\
                --enable-loadable-sqlite-extensions --enable-shared \\
 && make -j\$(nproc) && make install \\
 && cp /usr/local/python3.7.5/lib/libpython3.7m.so.1.0 /usr/lib \\
 && ln -s /usr/local/python3.7.5/bin/python3 /usr/bin/python3 \\
 && ln -s /usr/local/python3.7.5/bin/pip3 /usr/bin/pip3 \\
 && ln -s /usr/local/python3.7.5/bin/python3 /usr/bin/python3.7 \\
 && ln -s /usr/local/python3.7.5/bin/pip3 /usr/bin/pip3.7 \\
 && ln -s /usr/local/python3.7.5/bin/python3 /usr/bin/python3.7.5 \\
 && ln -s /usr/local/python3.7.5/bin/pip3 /usr/bin/pip3.7.5 \\
 && pip3.7.5 install attrs psutil decorator numpy protobuf==3.11.3 scipy sympy \\
      cffi -i https://mirrors.aliyun.com/pypi/simple/ \\
 && rm -r /ascend/Python-3.7.5

RUN cd /ascend \\
 && chmod +x *.run \\
 && ./Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run \\
      --install-username=root --install-usergroup=root --install \\
 && ./Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run \\
      --install-username=root --install-usergroup=root --install

RUN echo '\nawk "/Please make sure that:/,/chmod_authority/" /var/log/ascend_seclog/ascend_toolkit_install.log' >> /root/.bashrc

CMD ["/bin/bash"]
EOF

docker build \
-t ascend/cann:5.0.2.alpha003 \
--build-arg ASCEND_DIR=./ascend \
-f ./Dockerfile .

docker run -it --rm ascend/cann:5.0.2.alpha003

安装 MindStudio

代码语言:javascript
复制
tar xzvf MindStudio_3.0.1_linux.tar.gz -C $HOME
sudo ln -s $HOME/MindStudio/bin/MindStudio.sh /usr/local/bin/MindStudio

初次运行 MindStudio 如果提示依赖缺失,则运行提示命令安装:

代码语言:javascript
复制
$ MindStudio
Checking MindStudio environment dependencies...
Success

Checking Python environment dependencies...
Success

Some dependencies are missing. Execute the following command first:
sudo  apt-get -y install xterm fonts-wqy-zenhei fonts-wqy-microhei  && /home/HwHiAiUser/python3.7.5/bin/pip3 install --user  grpcio coverage gnureadline pylint matplotlib requests pandas xlrd absl-py

此外,还需安装 JDK:

代码语言:javascript
复制
sudo apt-get -y install openjdk-8-jdk

最后,即可正常运行 MindStudio

配置 MindStudio

初次提示导入设置:

选择不导入 OK。若有以前设置,可设路径如:$HOME/.config/Huawei/MindStudioMS-3.0

接着选择开发包路径:

之后用户体验改进 Argree

最后进入 MindStudio 首页:

参考

  • Ascend[3]
  • 昇腾CANN[4]

脚注

[1]

msInstaller: https://support.huaweicloud.com/instg-msInstall-cann/atlasde_03_0003.html

[2]

软件包(推理): https://support.huaweicloud.com/instg-msInstall-cann/atlasde_03_0034.html

[3]

Ascend: https://www.hiascend.com/

[4]

昇腾CANN: https://support.huaweicloud.com/cann/

本文参与 腾讯云自媒体分享计划,分享自微信公众号。
原始发表:2021-07-20,如有侵权请联系 cloudcommunity@tencent.com 删除

本文分享自 GoCoding 微信公众号,前往查看

如有侵权,请联系 cloudcommunity@tencent.com 删除。

本文参与 腾讯云自媒体分享计划  ,欢迎热爱写作的你一起参与!

评论
登录后参与评论
0 条评论
热度
最新
推荐阅读
目录
  • 基础说明
  • 获取软件包
  • 配置用户(可选)
  • 安装依赖
  • 安装开发包
  • 创建 Docker 镜像(可选)
  • 安装 MindStudio
  • 配置 MindStudio
  • 参考
    • 脚注
    相关产品与服务
    容器服务
    腾讯云容器服务(Tencent Kubernetes Engine, TKE)基于原生 kubernetes 提供以容器为核心的、高度可扩展的高性能容器管理服务,覆盖 Serverless、边缘计算、分布式云等多种业务部署场景,业内首创单个集群兼容多种计算节点的容器资源管理模式。同时产品作为云原生 Finops 领先布道者,主导开源项目Crane,全面助力客户实现资源优化、成本控制。
    领券
    问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档