Resource Monitor provides resource dashboards for you to view metrics related to resources and business, allowing you to evaluate resource usage and task operation status. Currently, you can view the Resource Monitor panel in Enterprise Management and Workspace. Within the Workspace, you can only view metrics related to the current workspace's business, while Enterprise Management allows you to view resource and business-related metrics across all workspaces.
Resource dimension:
Supports displaying monitoring metrics by a resource dimension, including the number of GPU cards, GPU allocation rate, task utilization, and GPU utilization.
Supports viewing monitoring metrics of resource groups by a dimension of resource groups, including the number of GPU cards, GPU allocation rate, task utilization, and GPU utilization.
Supports displaying the GPU card hours occupied by each GPU model, categorized by usage team tag.
Business dimension:
Supports displaying monitoring metrics by a business/task dimension, including the number of tasks and services, tasks that have been run, and low-utilization tasks.
Supports displaying metrics such as GPU utilization and first token latency by a service dimension (only for services with monitoring of LLMs).