
![Apache DolphinScheduler3.1.9+Minio 海报](https://developer.qcloudimg.com/http-save/yehe-11849333/607efd74f56df7bcc31426b7cbf07744.png)


#### 目录

![](https://developer.qcloudimg.com/http-save/yehe-11849333/29a1e070b1885d8c0663f75837e1cf35.jpg)

- [DolphinScheduler 3.1.9 开发环境【IDEA】搭建访问](http://blog.csdn.net#DolphinScheduler_319_IDEA_0)
  - [前提](http://blog.csdn.net#_8)
    - [1、软件要求](http://blog.csdn.net#1_11)
    - [2、克隆代码库](http://blog.csdn.net#2_22)
    - [3、编译源码](http://blog.csdn.net#3_33)
  - [DolphinScheduler 普通开发模式](http://blog.csdn.net#DolphinScheduler__42)
    - [1、编译问题：](http://blog.csdn.net#1_48)
    - [2、启动zookeeper](http://blog.csdn.net#2zookeeper_82)
      - [官方内容](http://blog.csdn.net#_84)
      - [存储配置](http://blog.csdn.net#_90)
      - [启动脚本](http://blog.csdn.net#_94)
    - [3、workspace.xml 修改](http://blog.csdn.net#3workspacexml__103)
    - [4、数据库](http://blog.csdn.net#4_117)
      - [4-1：数据初始化](http://blog.csdn.net#41_119)
      - [4-2：依赖相关修改](http://blog.csdn.net#42_128)
    - [5、application.yaml 修改数据库配置](http://blog.csdn.net#5applicationyaml__138)
      - [5-1：dolphinscheduler-master](http://blog.csdn.net#51dolphinschedulermaster_141)
      - [5-2：dolphinscheduler-worker](http://blog.csdn.net#52dolphinschedulerworker_159)
      - [5-3：dolphinscheduler-api](http://blog.csdn.net#53dolphinschedulerapi_162)
    - [6、logback-spring.xml 修改日志级别](http://blog.csdn.net#6logbackspringxml__166)
      - [6-1：dolphinscheduler-master](http://blog.csdn.net#61dolphinschedulermaster_171)
      - [6-2：dolphinscheduler-worker](http://blog.csdn.net#62dolphinschedulerworker_177)
      - [6-3：dolphinscheduler-api](http://blog.csdn.net#63dolphinschedulerapi_181)
    - [7、启动后端三个服务](http://blog.csdn.net#7_184)
      - [7-1：MasterServer](http://blog.csdn.net#71MasterServer_200)
        - [配置 VM Options](http://blog.csdn.net#_VM_Options_201)
      - [7-2：WorkerServer](http://blog.csdn.net#72WorkerServer_212)
        - [配置 VM Options](http://blog.csdn.net#_VM_Options_213)
      - [7-3：ApiApplicationServer](http://blog.csdn.net#73ApiApplicationServer_220)
        - [配置 VM Options](http://blog.csdn.net#_VM_Options_222)
    - [8、启动前端服务](http://blog.csdn.net#8_232)
      - [命令：](http://blog.csdn.net#_234)
    - [9、浏览器访问](http://blog.csdn.net#9_249)
      - [账号密码：](http://blog.csdn.net#_251)
      - [成功访问：](http://blog.csdn.net#_265)
  - [相关问题](http://blog.csdn.net#_274)
    - [1、存储未启用、租户\\\\用户 指定](http://blog.csdn.net#1__276)
      - [解决方法：](http://blog.csdn.net#_285)
        - [1、minio 创建 dolphinscheduler 桶](http://blog.csdn.net#1minio___dolphinscheduler__292)
        - [2、commom.properties 修改](http://blog.csdn.net#2commomproperties__297)
        - [3、dolphinscheduler 可视化页面添加租户](http://blog.csdn.net#3dolphinscheduler__449)
          - [用户添加租户](http://blog.csdn.net#_455)
  - [演示](http://blog.csdn.net#_460)
    - [创建文件夹、上传文件成功](http://blog.csdn.net#_462)

这里按照官方提供的文档进行操作：

### 前提

官方提供的开发手册位置

![](https://developer.qcloudimg.com/http-save/yehe-11849333/5b21a0ffaf34eb21677e603e772b41e3.jpg)

#### 1、软件要求

在搭建 DolphinScheduler 开发环境之前请确保你已经安装以下软件:

- [Git](https://git-scm.com/downloads)
- [JDK](https://www.oracle.com/technetwork/java/javase/downloads/index.html): v1.8.x (当前暂不支持 jdk 11)
- [Maven](http://maven.apache.org/download.cgi): v3.5+
- [Node](https://nodejs.org/en/download): v16.13+ (dolphinScheduler 版本低于 3.0, 请安装 node v12.20+)
- [Pnpm](https://pnpm.io/installation): v6.x

#### 2、克隆代码库

通过你 git 管理工具下载 git 代码，下面以 git-core 为例

```
mkdir dolphinscheduler
cd dolphinscheduler
git clone git@github.com:apache/dolphinscheduler.git
```

#### 3、编译源码

```
支持的系统:
* MacOS
* Linux
【这个我没有运行试试】
运行 `mvn clean install -Prelease -Dmaven.test.skip=true`
```

### DolphinScheduler 普通开发模式

上面是官方提供的，我觉得有用就复制下来，

这里开始我就按照自己的操作顺序记录

#### 1、编译问题：

```
1、git相关
1-1：开启 Windows Git 长路径支持，
管理员 PowerShell 执行，解决 DolphinScheduler 路径太深导致 git add 失败
git config --system core.longpaths true

1-2：先初始化git仓库，只在本地，不涉及账号、不推远程，Spotless 需要 HEAD
git init
git add .
git commit -m "initial commit"

2、Maven 编译 / 格式化（IDEA 里的 Terminal）
2-1：依赖 Git HEAD，自动修复格式问题
mvn spotless:apply
2-2：编译整个项目（跳过测试），确保所有模块已 install
mvn clean install -DskipTests

3、前端相关：

查看 Node.js 是否已安装
node -v

查看 npm 版本
npm -v

安装 pnpm
npm install -g pnpm
pnpm -v
```

编译都没有问题

![](https://developer.qcloudimg.com/http-save/yehe-11849333/807128450913519995b0108e85c14558.jpg)

#### 2、启动zookeeper

##### 官方内容

下载 [ZooKeeper](https://www.apache.org/dyn/closer.lua/zookeeper/zookeeper-3.6.3)，解压

![](https://developer.qcloudimg.com/http-save/yehe-11849333/bbbde281094829621f77bd8743fa2b75.jpg)

##### 存储配置
![](https://developer.qcloudimg.com/http-save/yehe-11849333/82e4dd2e2d876f77afc7dfc7ddf3c400.jpg)

##### 启动脚本

搞个txt编辑完后，后缀该bat即可

```
@echo off
echo 正在启动 ZooKeeper...
cd /d E:\\install\\ZooKeeper\\zookeeper-3.8.3\\bin
zkServer.cmd
pause
```

#### 3、workspace.xml 修改

【可以不用，我也是看其他文章有添加的，不过我没添加也能正常运行，这里只做记录】

```
在其他文章看到说在这里添加这行，说是让 IDEA 在运行时动态使用模块的 classpath，而不是用启动时生成的静态 classpath。

注意点：
这个作用只会影响本地 IDEA 启动，线上环境如果有问题这个是解决不了的。

"dynamic.classpath": "true",
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/7d99142cc2b815c4473016867d3966f1.jpg)

#### 4、数据库

我这里用的是mysql，所以需要修改

##### 4-1：数据初始化

```
创建名为【dolphinscheduler】的新数据库后，
把这个位置的sql直接拷贝复制执行即可。
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/923f0718a3bddfcd762ca42c12468bc7.jpg)

如图：
![](https://developer.qcloudimg.com/http-save/yehe-11849333/9c25a32108a504269c4a98659a731c00.jpg)

##### 4-2：依赖相关修改

```
如果使用 MySQL 作为元数据库，需要先修改 `dolphinscheduler/pom.xml`，
将 `mysql-connector-java` 依赖的 `scope` 改为 `compile`，
使用 PostgreSQL 则不需要

test 改成 compile
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/d818eea0e0b59046421b70e6cb5cc7a9.jpg)

#### 5、application.yaml 修改数据库配置
![](https://developer.qcloudimg.com/http-save/yehe-11849333/8ae4ba3a5b904f34d0f5d5e26a458f3e.jpg)

##### 5-1：dolphinscheduler-master

```
如图，配置文件中修改这些数据：三个内容都是一样的

spring:
  config:
    activate:
      on-profile: mysql
  datasource:
    driver-class-name: com.mysql.cj.jdbc.Driver
    url: jdbc:mysql://127.0.0.1:3306/dolphinscheduler?useUnicode=true&characterEncoding=utf8&zeroDateTimeBehavior=convertToNull&useSSL=true&serverTimezone=GMT%2B8
    username: 账户名
    password: 数据库密码
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/bcddf40c29e78095da6e65deee9991f2.jpg)

##### 5-2：dolphinscheduler-worker
![](https://developer.qcloudimg.com/http-save/yehe-11849333/1c8bb8e4356892e6e8cacf085f67e1e6.jpg)

##### 5-3：dolphinscheduler-api
![](https://developer.qcloudimg.com/http-save/yehe-11849333/4c6ee4469e32fe4deca9ed972fb19f4b.jpg)

#### 6、logback-spring.xml 修改日志级别
![](https://developer.qcloudimg.com/http-save/yehe-11849333/79b06a1e3ff6427bef732ca12ecaaf3b.jpg)

##### 6-1：dolphinscheduler-master

```
<appender-ref ref="STDOUT"/>
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/7f70a5a2c9d42187089278b4d3129d6c.jpg)

##### 6-2：dolphinscheduler-worker
![](https://developer.qcloudimg.com/http-save/yehe-11849333/0bd3fed823ac6f18d3a669c51cd61eda.jpg)

##### 6-3：dolphinscheduler-api
![](https://developer.qcloudimg.com/http-save/yehe-11849333/8bd74b9ce20643170045d897e2e92f78.jpg)

#### 7、启动后端三个服务

```
我们需要启动三个服务，包括 MasterServer，WorkerServer，ApiApplicationServer

* MasterServer：在 Intellij IDEA 中执行 `org.apache.dolphinscheduler.server.master.MasterServer` 中的 `main` 方法，并配置 *VM Options* `-Dlogging.config=classpath:logback-spring.xml -Ddruid.mysql.usePingMethod=false -Dspring.profiles.active=mysql`

* WorkerServer：在 Intellij IDEA 中执行 `org.apache.dolphinscheduler.server.worker.WorkerServer` 中的 `main` 方法，并配置 *VM Options* `-Dlogging.config=classpath:logback-spring.xml -Ddruid.mysql.usePingMethod=false -Dspring.profiles.active=mysql`

* ApiApplicationServer：在 Intellij IDEA 中执行 `org.apache.dolphinscheduler.api.ApiApplicationServer` 中的 `main` 方法，并配置 *VM Options* `-Dlogging.config=classpath:logback-spring.xml -Dspring.profiles.active=api,mysql`。启动完成可以浏览 Open API 文档，地址为 http://localhost:12345/dolphinscheduler/swagger-ui/index.html

> VM Options `-Dspring.profiles.active=mysql` 中 `mysql` 表示指定的配置文件
```

##### 7-1：MasterServer

###### 配置 VM Options

```
按照操作配置这个：打开后填入即可

-Dlogging.config=classpath:logback-spring.xml -Ddruid.mysql.usePingMethod=false -Dspring.profiles.active=mysql
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/a185d420bdbbb4bc1fd53999b5d92023.jpg)

![](https://developer.qcloudimg.com/http-save/yehe-11849333/8f3c3a93913798b8af3d11bbb8798f8f.jpg)

##### 7-2：WorkerServer

###### 配置 VM Options

跟上面一样操作：

```
-Dlogging.config=classpath:logback-spring.xml -Ddruid.mysql.usePingMethod=false -Dspring.profiles.active=mysql
```

##### 7-3：ApiApplicationServer

###### 配置 VM Options

```
-Dlogging.config=classpath:logback-spring.xml -Dspring.profiles.active=api,mysql
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/262c085b3b9ea8ac30e0a124fd219347.jpg)

总的就这三个：

#### 8、启动前端服务

##### 命令：

```
安装前端依赖并运行前端组件

cd dolphinscheduler-ui
pnpm install
pnpm run dev
```
![](https://developer.qcloudimg.com/http-save/yehe-11849333/1965e08d34acb5a98631b9805416be41.jpg)

![](https://developer.qcloudimg.com/http-save/yehe-11849333/2754a714ee6ca3c798ecee2bc8307b41.jpg)

#### 9、浏览器访问

##### 账号密码：

```
浏览器访问：
http://localhost:5173/home

默认账号密码：

账号：admin
密码：dolphinscheduler123

```

##### 成功访问：
![](https://developer.qcloudimg.com/http-save/yehe-11849333/c4993e1055844124ff888aa976edea9b.jpg)

### 相关问题

#### 1、存储未启用、租户\\用户 指定

问题：测试能否创建文件夹、上传文件等，提示【存储未启用】
![](https://developer.qcloudimg.com/http-save/yehe-11849333/15a9aa0041113bfabf29268b7023a486.jpg)

问题：当前登录用户的租户信息未被指定
![](https://developer.qcloudimg.com/http-save/yehe-11849333/cc1d4e13433165feddf309564991afac.jpg)

##### 解决方法：

[Minio 安装、启动](https://blog.csdn.net/weixin_44411039/article/details/156387536?spm=1001.2014.3001.5502)

我这里直接用minio来尝试：

###### 1、minio 创建 dolphinscheduler 桶
![](https://developer.qcloudimg.com/http-save/yehe-11849333/381695bd5c9c138e7c0069263c9092d8.jpg)

###### 2、commom.properties 修改

配置文件改了这些地方
![](https://developer.qcloudimg.com/http-save/yehe-11849333/3c9dfd5997dddb5a47137ee40d2ce252.jpg)

![](https://developer.qcloudimg.com/http-save/yehe-11849333/bc8acfb5fa0ea12c0db25119e66983e6.jpg)

```
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

# user data local directory path, please make sure the directory exists and have read write permissions
data.basedir.path=/tmp/dolphinscheduler

# resource view suffixs
#resource.view.suffixs=txt,log,sh,bat,conf,cfg,py,java,sql,xml,hql,properties,json,yml,yaml,ini,js

# resource storage type: HDFS, S3, OSS, NONE
# ljh -->   S3 is Minio--------------------------------------
resource.storage.type=S3
# resource store on HDFS/S3 path, resource file will store to this base path, self configuration, please make sure the directory exists on hdfs and have read write permissions. "/dolphinscheduler" is recommended
resource.storage.upload.base.path=/dolphinscheduler

# ljh --> The account and password of MinIO-------------------------------
# The AWS access key. if resource.storage.type=S3 or use EMR-Task, This configuration is required
resource.aws.access.key.id=minioadmin
# The AWS secret access key. if resource.storage.type=S3 or use EMR-Task, This configuration is required
resource.aws.secret.access.key=minioadmin
# The AWS Region to use. if resource.storage.type=S3 or use EMR-Task, This configuration is required
resource.aws.region=cn-north-1
# ljh --> add bucket ------------------------------
# The name of the bucket. You need to create them by yourself. Otherwise, the system cannot start. All buckets in Amazon S3 share a single namespace; ensure the bucket is given a unique name.
resource.aws.s3.bucket.name=dolphinscheduler
# You need to set this parameter when private cloud s3. If S3 uses public cloud, you only need to set resource.aws.region or set to the endpoint of a public cloud such as S3.cn-north-1.amazonaws.com.cn
# ljh --> localhost convert  127.0.0.1
resource.aws.s3.endpoint=http://127.0.0.1:9000

# alibaba cloud access key id, required if you set resource.storage.type=OSS
resource.alibaba.cloud.access.key.id=<your-access-key-id>
# alibaba cloud access key secret, required if you set resource.storage.type=OSS
resource.alibaba.cloud.access.key.secret=<your-access-key-secret>
# alibaba cloud region, required if you set resource.storage.type=OSS
resource.alibaba.cloud.region=cn-hangzhou
# oss bucket name, required if you set resource.storage.type=OSS
resource.alibaba.cloud.oss.bucket.name=dolphinscheduler
# oss bucket endpoint, required if you set resource.storage.type=OSS
resource.alibaba.cloud.oss.endpoint=https://oss-cn-hangzhou.aliyuncs.com

# if resource.storage.type=HDFS, the user must have the permission to create directories under the HDFS root path
resource.hdfs.root.user=hdfs
# if resource.storage.type=S3, the value like: s3a://dolphinscheduler; if resource.storage.type=HDFS and namenode HA is enabled, you need to copy core-site.xml and hdfs-site.xml to conf dir
resource.hdfs.fs.defaultFS=hdfs://mycluster:8020

# whether to startup kerberos
hadoop.security.authentication.startup.state=false

# java.security.krb5.conf path
java.security.krb5.conf.path=/opt/krb5.conf

# login user from keytab username
login.user.keytab.username=hdfs-mycluster@ESZ.COM

# login user from keytab path
login.user.keytab.path=/opt/hdfs.headless.keytab

# kerberos expire time, the unit is hour
kerberos.expire.time=2

# resourcemanager port, the default value is 8088 if not specified
resource.manager.httpaddress.port=8088
# if resourcemanager HA is enabled, please set the HA IPs; if resourcemanager is single, keep this value empty
yarn.resourcemanager.ha.rm.ids=192.168.xx.xx,192.168.xx.xx
# if resourcemanager HA is enabled or not use resourcemanager, please keep the default value; If resourcemanager is single, you only need to replace ds1 to actual resourcemanager hostname
yarn.application.status.address=http://ds1:%s/ws/v1/cluster/apps/%s
# job history status url when application number threshold is reached(default 10000, maybe it was set to 1000)
yarn.job.history.status.address=http://ds1:19888/ws/v1/history/mapreduce/jobs/%s

# datasource encryption enable
datasource.encryption.enable=false

# datasource encryption salt
datasource.encryption.salt=!@#$%^&*

# data quality option
data-quality.jar.name=dolphinscheduler-data-quality-dev-SNAPSHOT.jar

#data-quality.error.output.path=/tmp/data-quality-error-data

# Network IP gets priority, default inner outer

# Whether hive SQL is executed in the same session
support.hive.oneSession=false

# use sudo or not, if set true, executing user is tenant user and deploy user needs sudo permissions; if set false, executing user is the deploy user and doesn't need sudo permissions
sudo.enable=true
setTaskDirToTenant.enable=false

# network interface preferred like eth0, default: empty
#dolphin.scheduler.network.interface.preferred=

# network IP gets priority, default: inner outer
#dolphin.scheduler.network.priority.strategy=default

# system env path
#dolphinscheduler.env.path=dolphinscheduler_env.sh

# development state
development.state=false

# rpc port
alert.rpc.port=50052

# set path of conda.sh
conda.path=/opt/anaconda3/etc/profile.d/conda.sh

# Task resource limit state
task.resource.limit.state=false

# mlflow task plugin preset repository
ml.mlflow.preset_repository=https://github.com/apache/dolphinscheduler-mlflow
# mlflow task plugin preset repository version
ml.mlflow.preset_repository_version="main"

# ljh --> minio must open path style
resource.aws.s3.path.style.access=true

```

###### 3、dolphinscheduler 可视化页面添加租户

安全中心 - 租户管理 - 创建租户
![](https://developer.qcloudimg.com/http-save/yehe-11849333/b276a1b599458a42224176f374aebfc3.jpg)

###### 用户添加租户
![](https://developer.qcloudimg.com/http-save/yehe-11849333/9152e91d47fb6ce574800093e515698f.jpg)

### 演示

#### 创建文件夹、上传文件成功
![](https://developer.qcloudimg.com/http-save/yehe-11849333/d86ff915e146ae0268635c2260ded03c.jpg)

如图，数据已经存放在我指定的minio文件夹里面了
![](https://developer.qcloudimg.com/http-save/yehe-11849333/e93b9c68bc18373cbdab7a38fa3dd073.jpg)


Node: v16.13+ (dolphinScheduler 版本低于 3.0, 请安装 node v12.20+)

DolphinScheduler 3.1.9 + Minio 开发环境【IDEA】搭建访问及相关问题处理

这里按照官方提供的文档进行操作。

编程语言

DolphinScheduler 3.1.9开发环境搭建指南，包含IDEA配置、MySQL数据库初始化、Zookeeper启动、前后端服务部署等完整流程。详细讲解配置文件修改、日志级别设置、MinIO存储配置及租户管理，帮助开发者快速搭建本地开发环境。提供常见问题解决方案，如存储未启用错误处理。

PostgreSQL

数据库

MySQL

Linux

MacOS

HDFS

AI驱动 智领未来

bigdata-class

tencentdb-catalog

腾讯云数据库特惠，新用户首单0.5折起


postgres

文章

问答

视频

教程

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云智能顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

聚焦“写作效率、视觉美观与运行性能”三方面进行全面升级，为您提供更高效、稳定的创作环境

社区富文本&Markdown编辑器全新改版上线，欢迎大家体验!

诚挚邀请您参与本次调研，分享您的真实使用感受与建议。您的反馈至关重要，感谢您的支持与参与！

社区新版编辑器体验调研

DolphinScheduler 3.1.9 + Minio 开发环境【IDEA】搭建访问及相关问题处理-腾讯云开发者社区-腾讯云

DolphinScheduler 3.1.9 + Minio 开发环境【IDEA】搭建访问及相关问题处理

DolphinScheduler 3.1.9 + Minio 开发环境【IDEA】搭建访问及相关问题处理

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐