亚马逊DRKG使用体验

Bo_hemian

发布于 2020-09-11 13:02:38

1.3K0

发布于 2020-09-11 13:02:38

文章被收录于专栏：machine_learningmachine_learning

基于文章：探索「老药新用」最短路径：亚马逊AI Lab开源大规模药物重定位知识图谱DRKG，记录了该项目的实际部署与探索过程，供参考。

1. DRKG介绍

大规模药物重定位知识图谱 Drug Repurposing Knowledge Graph (DRKG) 是一种涉及基因、化合物、疾病、生物学过程、副作用和症状的综合性生物知识图。DRKG包括来自六个现有数据库的信息，包括DrugBank、Hetionet、GNBR、String、IntAct 、DGIdb，以及从最近的出版物收集的数据，特别是与Covid19相关的数据。它包括属于13种实体类型的97238个实体，以及分属于107种关系类型的5874261 个三元组数据。还包括一堆关于如何使用DRKG完成探索和分析统计，基于机器学习方法完成知识图嵌入等任务。

2. 开发环境

python==3.6.1
torch==1.2.0+cpu
dgl==0.4.3
dglke==0.1.1

3. 数据源

DRKG包括Hetionet等 6个生物数据库信息以及最近出版的论文数据集，然而，具体数据获取方式并未公开，以下是部分生物数据库介绍。

3.1 Hetionet

地址： https://het.io/about/

3.2 DrugBank

https://www.drugbank.ca/

3.3 String

4. 知识图谱信息

DRKG.tsv：包含了知识图谱的所有三元组，包含13类实体，如下：

17类实体关系：

5. 预备知识

基于TransE算法完成实体、关系、边嵌入向量构造。

关于知识图谱嵌入模型可点击以下链接了解：知识图谱嵌入的Translate模型汇总（TransE，TransH，TransR，TransD）

6. DRKG使用

6.1 知识图谱嵌入向量预训练

在亚马逊DRKG中，提供了封装好的脚本实现知识图谱嵌入向量的训练模型：

在原始代码中，执行脚本为：

由于个人采用windows环境，且没有配置GPU集群，需要修改执行脚本为：

!dglke_train --dataset DRKG --data_files DRKG_train.tsv DRKG_valid.tsv DRKG_test.tsv --format raw_udd_hrt --model_name TransE_l2 --batch_size 2048 \ --neg_sample_size 256 --hidden_dim 400 --gamma 12.0 --lr 0.1 --max_step 100000 --log_interval 1000 --batch_size_eval 16 -adv --regularization_coef 1.00E-07 --test --num_thread 1 --neg_sample_size_eval 10000 --async_update

其中dglke_train 的可选参数有以下：

--model_name {TransE,TransE_l1,TransE_l2,TransR,RESCAL,DistMult,ComplEx,RotatE}. The models provided by DGL-KE.
--data_path DATA_PATH. The path of the directory where DGL-KE loads knowledge graph data.
--dataset DATASET The name of the builtin knowledge graph. Currently,the builtin knowledge graphs include FB15k, FB15k-237,wn18, wn18rr and Freebase. DGL-KE automatically downloads the knowledge graph and keep it under data_path.
--format FORMAT The format of the dataset. For builtin knowledge graphs,the foramt should be built_in. For users own knowledge graphs,it needs to be raw_udd_{htr} or udd_{htr}.
--data_files DATA_FILES [DATA_FILES ...]. A list of data file names. This is used if users want to train KGEon their own datasets. If the format is raw_udd_{htr},users need to provide train_file [valid_file] [test_file].If the format is udd_{htr}, users need to provideentity_file relation_file train_file [valid_file] [test_file].In both cases, valid_file and test_file are optional.
--delimiter DELIMITER. Delimiter used in data files. Note all files should use the same delimiter.
--save_path SAVE_PATH the path of the directory where models and logs are saved.
--no_save_emb Disable saving the embeddings under save_path.
--max_step MAX_STEP The maximal number of steps to train the model.A step trains the model with a batch of data.
--batch_size BATCH_SIZE. The batch size for training.
--batch_size_eval BATCH_SIZE_EVAL.The batch size used for validation and test.
--neg_sample_size NEG_SAMPLE_SIZE. The number of negative samples we use for each positive sample in the training.
--neg_deg_sample Construct negative samples proportional to vertex degree in the training.When this option is turned on, the number of negative samples per positive edgewill be doubled. Half of the negative samples are generated uniformly whilethe other half are generated proportional to vertex degree.
--neg_deg_sample_eval. Construct negative samples proportional to vertex degree in the evaluation.
--neg_sample_size_eval NEG_SAMPLE_SIZE_EVAL. The number of negative samples we use to evaluate a positive sample.
--eval_percent EVAL_PERCENT. Randomly sample some percentage of edges for evaluation.
--no_eval_filter Disable filter positive edges from randomly constructed negative edges for evaluation
--log LOG_INTERVAL, --log_interval LOG_INTERVAL. Print runtime of different components every x steps.
--eval_interval EVAL_INTERVAL. Print evaluation results on the validation dataset every x stepsif validation is turned on
--test Evaluate the model on the test set after the model is trained.
--num_proc NUM_PROC The number of processes to train the model in parallel.In multi-GPU training, the number of processes by default is set to match the number of GPUs.If set explicitly, the number of processes needs to be divisible by the number of GPUs.
--num_thread NUM_THREAD The number of CPU threads to train the model in each process.This argument is used for multiprocessing training.
--force_sync_interval FORCE_SYNC_INTERVAL. We force a synchronization between processes every x steps formultiprocessing training.This potentially stablizes the training processto get a better performance. For multiprocessing training, it is set to 1000 by default.
--hidden_dim HIDDEN_DIM. The embedding size of relation and entity
--lr LR The learning rate. DGL-KE uses Adagrad to optimize the model parameters.
-g GAMMA, --gamma GAMMA. The margin value in the score function. It is used by TransX and RotatE.
-de, --double_ent Double entitiy dim for complex number It is used by RotatE.
-dr, --double_rel Double relation dim for complex number.
-adv, --neg_adversarial_sampling Indicate whether to use negative adversarial sampling.It will weight negative samples with higher scores more.
-a ADVERSARIAL_TEMPERATURE, --adversarial_temperature ADVERSARIAL_TEMPERATUR. The temperature used for negative adversarial sampling.
-rc REGULARIZATION_COEF, --regularization_coef REGULARIZATION_COEF. The coefficient for regularization.
-rn REGULARIZATION_NORM, --regularization_norm REGULARIZATION_NORM norm used in regularization.
--gpu GPU [GPU ...] A list of gpu ids, e.g. 0 1 2 4
--mix_cpu_gpu Training a knowledge graph embedding model with both CPUs and GPUs.The embeddings are stored in CPU memory and the training is performed in GPUs.This is usually used for training a large knowledge graph embeddings.
--valid Evaluate the model on the validation set in the training.
--rel_part Enable relation partitioning for multi-GPU training.
--async_update Allow asynchronous update on node embedding for multi-GPU training.This overlaps CPU and GPU computation to speed up.