输入:data/local/train/text data/local/dict/lexicon.txt
输出:data/local/lm (含text.no_oov, word.counts, unigram.counts, word_map, 3gram-mincount/lm_unpruned.gz)
local/train_lms.sh || exit 1;
流程:
通过get_word_map.pl生成word_map,输入unigram.counts中的单词并加入"<s>" "</s>" "<UNK>"
备注:
一个arpa文件包含三部分内容:probability word(s) [backoff probability]
backoff prob