External data and managed storage data of Data Lake Compute can be managed through the data management page, by executing standard SQL statements, or via API. The data management console allows you to create and edit data directories, as well as create, query, and delete database tables.
Create catalog
Note:
The platform will automatically create a DataLakeCatalog for you to manage your lake data.
When you have external data sources that you wish to analyze in a federated manner, you can follow the process below to create a data catalog for the external data source.
3. Enter the data source creation visual interface. After filling in the connection information, complete the network configuration to establish a connection between the engine and the external data source.
4. After filling in the data source information, click Confirm to complete the creation of the data source.
5. In the catalog list, you can view connection information, status, creator, and other details.
Edit Data Catalog
1. Click Data Catalog List > Operation > Edit to modify the description, network configuration, username, password, and running cluster of the data catalog.
2. After making modifications, click Create to recreate the data catalog.
Create a database
1. Log in to the Data Lake Compute DLC Console, select the service region. The logged-in account must have the permission to create a new database.
2. Navigate to Data Management, click on the catalog name under the data catalog to view the databases in that catalog.
3. Click Create Database to enter the visual interface for database creation.
4. After filling in the relevant database information and saving it, the database creation is complete. When creating a database, you can enable data governance for the entire database.
Database Name: Globally unique, supports uppercase and lowercase letters, digits, and underscores (_). It must not start with a digit and can contain up to 128 characters.
Description: Supports both Chinese and English, up to 2048 characters.
A primary account can create up to 100 databases.
View Database
1. Log in to the Data Lake Compute DLC console, select the service region. The logged-in account must have database query permissions.
2. Navigate to Data Management > Database, select the data catalog, and click on the Database Name to access the database details. You can manage the database tables from here. For detailed operation guide, refer to Table Management.
Deleting database
1. Log in to the Data Lake Compute DLC Console, select the service region. The logged-in account must have database deletion permissions.
2. Navigate to Data Management, click Delete, and after confirming twice, the database can be deleted.