前往小程序,Get更优阅读体验!
立即前往
首页
学习
活动
专区
工具
TVP
发布
社区首页 >专栏 >GitHub项目:自然语言处理领域的相关干货整理

GitHub项目:自然语言处理领域的相关干货整理

作者头像
AiTechYun
发布2018-03-05 16:09:22
2.8K0
发布2018-03-05 16:09:22
举报
文章被收录于专栏:ATYUN订阅号

自然语言处理(NLP)是计算机科学,人工智能,语言学关注计算机和人类(自然)语言之间的相互作用的领域。本文作者为NLP初学者整理了一份庞大的自然语言处理领域的概览。选取的参考文献与资料都侧重于最新的深度学习研究成果。这些资源能为想要深入钻研一个NLP任务的人们提供一个良好的开端。

指代消解

  • https://github.com/Kyubyong/nlp_tasks#coreference-resolution

论文自动评分

  • 论文:Automatic Text Scoring Using Neural Networks(使用神经网络的自动文本评分):https://arxiv.org/abs/1606.04289
  • 论文:A Neural Approach to Automated Essay Scoring(一种自动将论文评分的神经学方法):http://www.aclweb.org/old_anthology/D/D16/D16-1193.pdf
  • 挑战:Kaggle:The Hewlett Foundation: Automated Essay Scoring(Kaggle:The Hewlett Foundation:论文自动评分系统):https://www.kaggle.com/c/asap-aes
  • 项目:Enhanced AI Scoring Engine(增强的人工智能得分引擎):https://github.com/edx/ease

自动语音识别

  • 维基百科: 语言识别:https://en.wikipedia.org/wiki/Speech_recognition
  • 论文:DeepSpeech 2: End-to-End Speech Recognition in English and Mandarin(深度语音2:用英语和普通话进行端对端语音识别):https://arxiv.org/abs/1512.02595
  • 论文:WaveNet:A Generative Model for Raw Audio(WaveNet:原始音频的生成模型):https://arxiv.org/abs/1609.03499
  • 项目:A TensorFlow implementation of Baidu’s Deep Speech architecture(百度深度语音架构的一个TensorFlow实现:https://github.com/mozilla/DeepSpeech
  • 项目:Speech-to-Text-WaveNet: End-to-end sentence level English speech recognition using DeepMind’s WaveNet(Speech-to-Text-WaveNet: 使用DeepMind的WaveNet,对端到端句子的英语水平语音识别):https://github.com/buriburisuri/speech-to-text-wavenet
  • 挑战:The 5th CHiME Speech Separation and Recognition Challenge(第五届CHiME语音的分离和识别挑战):http://spandh.dcs.shef.ac.uk/chime_challenge/
  • 资料:The 5thCHiME Speech Separation and Recognition Challenge(第五届CHiME语音的分离和识别挑战):http://spandh.dcs.shef.ac.uk/chime_challenge/download.html
  • 资料:CSTRVCTK Corpus :http://homepages.inf.ed.ac.uk/jyamagis/page3/page58/page58.html
  • 资料:LibriSpeech ASR corpus:http://www.openslr.org/12/
  • 资料:Switchboard-1 Telephone Speech Corpus:https://catalog.ldc.upenn.edu/ldc97s62
  • 资料:TED-LIUM Corpus:http://www-lium.univ-lemans.fr/en/content/ted-lium-corpus

自动摘要

  • 维基百科:自动摘要:https://en.wikipedia.org/wiki/Automatic_summarization
  • 书籍:Automatic Text Summarization(自动本文摘要):https://www.amazon.com/Automatic-Text-Summarization-Juan-Manuel-Torres-Moreno/dp/1848216688/ref=sr_1_1?s=books&ie=UTF8&qid=1507782304&sr=1-1&keywords=Automatic+Text+Summarization
  • 论文:Text Summarization Using Neural Networks(使用神经网络进行文本摘要):http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.823.8025&rep=rep1&type=pdf
  • 论文:Ranking with Recursive Neural Networks and Its Application to Multi-DocumentSummarization(使用递归神经网络及其应用程序对多文档摘要进行排序):https://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/viewFile/9414/9520
  • 资料:Text Analytics Conferences(文本分析会议):https://tac.nist.gov/data/index.html
  • 资料:Document Understanding Conferences(文书理解会议):http://www-nlpir.nist.gov/projects/duc/data.html

共指消解

  • 信息:共指消解:https://nlp.stanford.edu/projects/coref.shtml
  • 论文:Deep Reinforcement Learning for Mention-Ranking Coreference Models(对Mention-Ranking的共指模型进行深度强化学习:https://arxiv.org/abs/1609.08667
  • 论文:Improving Coreference Resolution by Learning Entity-Level Distributed Representations(通过学习实体级分布式表示来改善相关的解决方案):https://arxiv.org/abs/1606.01323
  • 挑战:CoNLL 2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes(CoNLL 2012共享任务:在OntoNotes中对多语言的不受限制的共指进行建模):http://conll.cemantix.org/2012/task-description.html
  • 挑战:CoNLL 2011 Shared Task: Modeling Unrestricted Coreference in OntoNotes(CoNLL 2011共享任务:在OntoNotes中对多语言的不受限制的共指进行建模):http://conll.cemantix.org/2011/task-description.html

语法错误校正

  • 论文:Neural Network Translation Models for Grammatical Error Correction(语法错误校正的神经网络翻译模型):https://arxiv.org/abs/1606.00189
  • 挑战:CoNLL 2013 Shared Task: Grammatical Error Correction(CoNLL 2013共享任务:语法错误校正):http://www.comp.nus.edu.sg/~nlp/conll13st.html
  • 挑战:CoNLL 2014Shared Task: Grammatical Error Correction(CoNLL 2014共享任务:语法错误校正):http://www.comp.nus.edu.sg/~nlp/conll14st.html
  • 资料:NUSNon-commercial research/trial corpus license:http://www.comp.nus.edu.sg/~nlp/conll14st/nucle_license.pdf
  • 资料:Lang-8 Learner Corpora:http://cl.naist.jp/nldata/lang-8/
  • 资料:Cornell Movie–Dialogs Corpus:http://www.cs.cornell.edu/~cristian/Cornell_Movie-Dialogs_Corpus.html
  • 项目:Deep Text Corrector(深度文本校正器):https://github.com/atpaino/deep-text-corrector
  • 产品:deep grammar:http://deepgrammar.com/

字素转换到音素

  • 论文:Grapheme-to-Phoneme Models for (Almost) Any Language(适合(几乎)任何语言的字素到音素的模型):https://pdfs.semanticscholar.org/b9c8/fef9b6f16b92c6859f6106524fdb053e9577.pdf
  • 论文:Polyglot Neural Language Models: A Case Study in Cross-Lingual Phonetic Representation Learning(多语言神经语言模型:跨语语音表达学习的案例研究):https://arxiv.org/pdf/1605.03832.pdf
  • 论文:Multi task Sequence-to-Sequence Models for Grapheme-to-Phoneme Conversion(多任务序列到序列的字素到音素转换的模型):https://pdfs.semanticscholar.org/26d0/09959fa2b2e18cddb5783493738a1c1ede2f.pdf
  • 项目:Sequence-to-Sequence G2P toolkit(序列到序列G2P工具包):https://github.com/cmusphinx/g2p-seq2seq
  • 资料:Multilingual Pronunciation Data(多语种发音数据):https://drive.google.com/drive/folders/0B7R_gATfZJ2aWkpSWHpXUklWUmM

语种识别

  • 维基百科: 语种识别:https://en.wikipedia.org/wiki/Language_identification
  • 论文:AUTOMATIC LANGUAGE IDENTIFICATION USING DEEP NEURAL NETWORKS(使用深度神经网络的自动语言识别):https://repositorio.uam.es/bitstream/handle/10486/666848/automatic_lopez-moreno_ICASSP_2014_ps.pdf?sequence=1
  • 挑战: 2015 Language Recognition Evaluation(2015语言识别评估):https://www.nist.gov/itl/iad/mig/2015-language-recognition-evaluation

语言建模

  • 维基百科:语言模型:https://en.wikipedia.org/wiki/Language_model
  • 工具包: KenLM Language Model Toolkit(KenLM语言模型工具包):http://kheafield.com/code/kenlm/
  • 论文:Distributed Representations of Words and Phrases and their Compositionality(词汇和短语的分布表示及其组合性):http://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf
  • 论文:Character-Aware Neural Language Models(Character-Aware神经语言模型):https://www.aaai.org/ocs/index.php/AAAI/AAAI16/paper/viewFile/12489/12017
  • 资料: Penn Treebank :https://github.com/townie/PTB-dataset-from-Tomas-Mikolov-s-webpage/tree/master/data

词形还原

  • 维基百科:词形还原:https://en.wikipedia.org/wiki/Lemmatisation
  • 工具包:WordNet Lemmatizer:http://www.nltk.org/api/nltk.stem.html#nltk.stem.wordnet.WordNetLemmatizer.lemmatize
  • 资料:Treebank-3:https://catalog.ldc.upenn.edu/ldc99t42

唇语辨别

  • 维基百科:唇读法:https://en.wikipedia.org/wiki/Lip_reading
  • 论文:Lip Reading Sentences in the Wild (在野外读懂唇语):https://arxiv.org/abs/1611.05358
  • 论文:3D Convolutional Neural Networks for Cross Audio-Visual Matching Recognition(交叉视听匹配识别的3D卷积神经网络):https://arxiv.org/abs/1706.05739
  • 项目: Lip Reading – Cross Audio-Visual Recognition using 3D Convolutional Neural Networks(唇读法—使用3D卷积神经网络的交叉视听识别:https://github.com/astorfi/lip-reading-deeplearning
  • 资料: The GRID audiovisual sentence corpus:http://spandh.dcs.shef.ac.uk/gridcorpus/

机器翻译

  • 论文:Neural Machine Translation by Jointly Learning to Align and Translate(通过共同学习来调整和翻译神经机器翻译):https://arxiv.org/abs/1409.0473
  • 论文:Neural Machine Translation in Linear Tim(在线性时间中的神经机器翻译):https://arxiv.org/abs/1610.10099
  • 挑战: ACL2014 NINTH WORKSHOP ON STATISTICAL MACHINE TRANSLATION(ACL2014第九届统计机器翻译研讨会):http://www.statmt.org/wmt14/translation-task.html#download
  • 资料:OpenSubtitles2016:http://opus.lingfil.uu.se/OpenSubtitles2016.php
  • 资料: WIT3:Web Inventory of Transcribed and Translated Talks:https://wit3.fbk.eu/
  • 资料: The QCRI Educational Domain (QED) Corpus:http://alt.qcri.org/resources/qedcorpus/

命名实体识别

  • 维基百科:命名实体识别:https://en.wikipedia.org/wiki/Named-entity_recognition
  • 论文:Neural Architectures for Named Entity Recognition(命名实体识别的神经结构):https://arxiv.org/abs/1603.01360
  • 项目: OSU Twitter NLP Tool:https://github.com/aritter/twitter_nlp
  • 挑战: Named Entity Recognition in Twitter(在推特上被命名的实体识别):https://noisy-text.github.io/2016/ner-shared-task.html
  • 资料:CoNLL-2002 NER corpus:https://github.com/teropa/nlp/tree/master/resources/corpora/conll2002
  • 资料:CoNLL-2003 NER corpus:https://github.com/synalp/NER/tree/master/corpus/CoNLL-2003

释义检测

  • 论文:Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection(动态池和展开递归自动编码器的释义检测):http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.650.7199&rep=rep1&type=pdf
  • 项目:Paralex: Paraphrase-Driven Learning for Open Question Answering(Paralex:释义驱动学习的开放问答):http://knowitall.cs.washington.edu/paralex/
  • 资料:Microsoft Research Paraphrase Corpus:https://www.microsoft.com/en-us/download/details.aspx?id=52398
  • 资料:Microsoft Research Video Description Corpus :https://www.microsoft.com/en-us/download/details.aspx?id=52422&from=http%3A%2F%2Fresearch.microsoft.com%2Fen-us%2Fdownloads%2F38cf15fd-b8df-477e-a4e4-a4680caa75af%2F
  • 资料: Pascal Dataset:http://nlp.cs.illinois.edu/HockenmaierGroup/pascal-sentences/index.html
  • 资料:Flicker Dataset:http://nlp.cs.illinois.edu/HockenmaierGroup/8k-pictures.html
  • 资料: TheSICK data set:http://clic.cimec.unitn.it/composes/sick.html
  • 资料: PPDB:The Paraphrase Database:http://www.cis.upenn.edu/~ccb/ppdb/
  • 资料:WikiAnswers Paraphrase Corpus:http://knowitall.cs.washington.edu/paralex/wikianswers-paraphrases-1.0.tar.gz

语法分析

  • 维基百科:语法分析:https://en.wikipedia.org/wiki/Parsing
  • 工具包:The Stanford Parser: A statistical parser:https://nlp.stanford.edu/software/lex-parser.shtml
  • 工具包: spaCyparser:https://spacy.io/docs/usage/dependency-parse
  • 论文:A fastand accurate dependency parser using neural networks(快速而准确地使用神经网络的依赖解析器):http://www.aclweb.org/anthology/D14-1082
  • 挑战:CoNLL2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies(CoNLL2017共享任务:从原始文本到通用依赖项的多语言解析):http://universaldependencies.org/conll17/
  • 挑战:CoNLL2016 Shared Task: Multilingual Shallow Discourse Parsing(CoNLL2016共享任务:多语言的浅会话解析):http://www.cs.brandeis.edu/~clp/conll16st/

词性标记

  • 维基百科:词性标记:https://en.wikipedia.org/wiki/Part-of-speech_tagging
  • 论文:Unsupervised Part-Of-Speech Tagging with Anchor Hidden Markov Models(有Anchor Hidden Markov模型的非监督性的词性标记):https://transacl.org/ojs/index.php/tacl/article/viewFile/837/192
  • 资料:Treebank-3:https://catalog.ldc.upenn.edu/ldc99t42
  • 工具包:nltk.tag package:http://www.nltk.org/api/nltk.tag.html

拼音与中文转换

  • 论文:Neural Network Language Model for Chinese Pinyin Input Method Engine(中文拼音输入法引擎的神经网络语言模型):http://aclweb.org/anthology/Y15-1052
  • 项目:Neural Chinese Transliterator:https://github.com/Kyubyong/neural_chinese_transliterator

问答系统

  • 维基百科:问答系统:https://en.wikipedia.org/wiki/Question_answering
  • 论文:Ask Me Anything: Dynamic Memory Networks for Natural Language Processing(自然语言处理的动态内存网络):http://www.thespermwhale.com/jaseweston/ram/papers/paper_21.pdf
  • 论文:Dynamic Memory Networks for Visual and Textual Question Answering(用于视觉和文本的问答系统的动态记忆网络):http://proceedings.mlr.press/v48/xiong16.pdf
  • 挑战:TREC Question Answering Task(TREC问答系统任务):http://trec.nist.gov/data/qamain.html
  • 挑战:SemEval-2017 Task 3: Community Question Answering:http://alt.qcri.org/semeval2017/task3/
  • 资料:MSMARCO: Microsoft MAchine Reading COmprehension Dataset(MSMARCO:微软机器阅读理解数据集)http://www.msmarco.org/
  • 资料:Maluuba NewsQA:https://github.com/Maluuba/newsqa
  • 资料:SQuAD:100,000+ Questions for Machine Comprehension of Text(SQuAD:100,000+个文本的机器理解的问题):https://rajpurkar.github.io/SQuAD-explorer/
  • 资料:Graph Questions: A Characteristic-rich Question Answering Dataset(图形问题:一个特征丰富的问题回答数据集):https://github.com/ysu1989/GraphQuestions
  • 资料: Story Cloze Test and ROC Stories Corpora:http://cs.rochester.edu/nlp/rocstories/
  • 资料:Microsoft Research WikiQA Corpus:https://www.microsoft.com/en-us/download/details.aspx?id=52419&from=http%3A%2F%2Fresearch.microsoft.com%2Fen-us%2Fdownloads%2F4495da01-db8c-4041-a7f6-7984a4f6a905%2Fdefault.aspx
  • 资料:DeepMind Q&A Dataset:http://cs.nyu.edu/~kcho/DMQA/
  • 资料: QASent:http://cs.stanford.edu/people/mengqiu/data/qg-emnlp07-data.tgz

关系提取

  • 维基百科:关系提取:https://en.wikipedia.org/wiki/Relationship_extraction
  • 论文:A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm(一种从社会生产范例的互动情境中提取关系深度学习的方法):http://www.sciencedirect.com/science/article/pii/S0950705116001210

语义角色标记

  • 维基百科:语义角色标记:https://en.wikipedia.org/wiki/Semantic_role_labeling
  • 书籍:Semantic Role Labeling(语义角色标记):https://www.amazon.com/Semantic-Labeling-Synthesis-Lectures-Technologies/dp/1598298313/ref=sr_1_1?s=books&ie=UTF8&qid=1507776173&sr=1-1&keywords=Semantic+Role+Labeling
  • 论文:End-to-end Learning of Semantic Role Labeling Using Recurrent Neural Networks(使用循环神经网络对语义角色标签进行端到端学习):http://www.aclweb.org/anthology/P/P15/P15-1109.pdf
  • 论文:Neural Semantic Role Labeling with Dependency Path Embeddings(有着依赖路径嵌入的神经语义角色标记):https://arxiv.org/abs/1605.07515
  • 挑战:CoNLL-2005 Shared Task: Semantic Role Labeling(CoNLL-2005共享任务:语义角色标记):http://www.cs.upc.edu/~srlconll/st05/st05.html
  • 挑战:CoNLL-2004 Shared Task: Semantic Role Labeling(CoNLL-2004共享任务:语义角色标记):http://www.cs.upc.edu/~srlconll/st04/st04.html
  • 工具包:Illinois Semantic Role Labeler(SRL):http://cogcomp.org/page/software_view/SRL
  • 资料:CoNLL-2005 Shared Task: Semantic Role Labeling(CoNLL-2005共享任务:语义角色标记):http://www.cs.upc.edu/~srlconll/soft.html

语句边界消歧

  • 维基百科:语句边界消歧:https://en.wikipedia.org/wiki/Sentence_boundary_disambiguation
  • 论文:A Quantitative and Qualitative Evaluation of Sentence Boundary Detection for theClinical Domain(对临床领域的语句边界检测进行定量和定性的评估):https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5001746/
  • 工具包: NLTK Tokenizers:http://www.nltk.org/_modules/nltk/tokenize.html
  • 资料: The British National Corpus:http://www.natcorp.ox.ac.uk/
  • 资料:Switchboard-1 Telephone Speech Corpus:https://catalog.ldc.upenn.edu/ldc97s62

情绪分析

  • 维基百科:情绪分析:https://en.wikipedia.org/wiki/Sentiment_analysis
  • 信息:Awesome Sentiment Analysis(了不起的情绪分析):https://github.com/xiamx/awesome-sentiment-analysis
  • 挑战:Kaggle: UMICH SI650 – Sentiment Classification(Kaggle: UMICH SI650 – 情绪分类):https://www.kaggle.com/c/si650winter11#description
  • 挑战:SemEval-2017 Task 4: Sentiment Analysis in Twitter(SemEval-2017任务4:推特上的情绪分析):http://alt.qcri.org/semeval2017/task4/
  • 项目:SenticNet:http://sentic.net/about/
  • 资料:Multi-Domain Sentiment Dataset(version2.0):http://www.cs.jhu.edu/~mdredze/datasets/sentiment/
  • 资料:Stanford Sentiment Treebank:https://nlp.stanford.edu/sentiment/code.html
  • 资料:Twitter Sentiment Corpus:http://www.sananalytics.com/lab/twitter-sentiment/
  • 资料:Twitter Sentiment Analysis Training Corpus:http://thinknook.com/twitter-sentiment-analysis-training-corpus-dataset-2012-09-22/

源分离

  • 维基百科:源分离:https://en.wikipedia.org/wiki/Source_separation
  • 论文:From Blind to Guided Audio Source Separation(从盲目到有指导性的音频源分离):https://hal-univ-rennes1.archives-ouvertes.fr/hal-00922378/document
  • 论文:Joint Optimization of Masks and Deep Recurrent Neural Networks for Monaural Source Separation (对单声道分离的掩膜和深层循环神经网络的联合优化):https://arxiv.org/abs/1502.04149
  • 挑战:Signal Separation Evaluation Campaign(信号分离评估活动):https://sisec.inria.fr/
  • 挑战: CHiME Speech Separation and Recognition Challenge(CHiME语音分离和识别的挑战):http://spandh.dcs.shef.ac.uk/chime_challenge/

说话者识别

  • 维基百科:说话者识别:https://en.wikipedia.org/wiki/Speaker_recognition
  • 论文:A NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK(一种使用语音识别的深度神经网络的新方案):https://pdfs.semanticscholar.org/204a/ff8e21791c0a4113a3f75d0e6424a003c321.pdf
  • 论文:DEEP NEURAL NETWORKS FOR SMALL FOOTPRINT TEXT-DEPENDENT SPEAKER VERIFICATION(深度神经网络,用于小范围的文本依赖的说话者验证):https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/41939.pdf
  • 挑战: NIST Speaker Recognition Evaluation(NIST说话者识别评价):https://www.nist.gov/itl/iad/mig/speaker-recognition

语音分段

  • 维基百科:语音分段:https://en.wikipedia.org/wiki/Speech_segmentation
  • 论文:Word Segmentation by 8-Month-Olds: When Speech Cues Count More Than Statistics(8个月大婴儿的单词分段:当语音提示比统计数字更重要时):http://www.utm.toronto.edu/infant-child-centre/sites/files/infant-child-centre/public/shared/elizabeth-johnson/Johnson_Jusczyk.pdf
  • 论文:Unsupervised Word Segmentation and Lexicon Discovery Using Acoustic Word Embeddings(不受监督的单词分割和使用声学词嵌入的词汇发现):https://arxiv.org/abs/1603.02845
  • 资料:CALLHOME Spanish Speech:https://catalog.ldc.upenn.edu/ldc96s35

语音合成

  • 维基百科:语音合成:https://en.wikipedia.org/wiki/Speech_synthesis
  • 论文:WaveNet:A Generative Model for Raw Audio(WaveNet:原始音频的生成模型):https://arxiv.org/abs/1609.03499
  • 论文:Tacotron:Towards End-to-End Speech Synthesis(Tacotron:对端到端的语音合成):https://arxiv.org/abs/1703.10135
  • 资料: The World English Bible:https://github.com/Kyubyong/tacotron
  • 资料: LJ Speech Dataset:https://github.com/keithito/tacotron
  • 资料: Lessac Data:http://www.cstr.ed.ac.uk/projects/blizzard/2011/lessac_blizzard2011/
  • 挑战:Blizzard Challenge 2017:https://synsig.org/index.php/Blizzard_Challenge_2017
  • 项目: The Festvox project:http://www.festvox.org/index.html
  • 工具包:Merlin: The Neural Network (NN) based Speech Synthesis System(Merlin:基于神经网络的语音合成系统):https://github.com/CSTR-Edinburgh/merlin

语音增强

  • 维基百科:语音增强:https://en.wikipedia.org/wiki/Speech_enhancement
  • 书籍: Speech enhancement: theory and practice(语音增强:理论与实践):https://www.amazon.com/Speech-Enhancement-Theory-Practice-Second/dp/1466504218/ref=sr_1_1?ie=UTF8&qid=1507874199&sr=8-1&keywords=Speech+enhancement%3A+theory+and+practice
  • 论文 An Experimental Study on Speech Enhancement Based on Deep Neural Network(一项基于深度神经网络的语音增强实验):http://staff.ustc.edu.cn/~jundu/Speech%20signal%20processing/publications/SPL2014_Xu.pdf
  • 论文: A Regression Approach to Speech Enhancement Based on Deep Neural Networks(一种基于深度神经网络的语音增强的回归方法):https://www.researchgate.net/profile/Yong_Xu63/publication/272436458_A_Regression_Approach_to_Speech_Enhancement_Based_on_Deep_Neural_Networks/links/57fdfdda08aeaf819a5bdd97.pdf
  • 论文:Speech Enhancement Based on Deep Denoising Autoencoder(基于深度降噪自编码的语音增强):https://www.researchgate.net/profile/Yu_Tsao/publication/283600839_Speech_enhancement_based_on_deep_denoising_Auto-Encoder/links/577b486108ae213761c9c7f8/Speech-enhancement-based-on-deep-denoising-Auto-Encoder.pdf

词干提取

  • 维基百科:词干提取:https://en.wikipedia.org/wiki/Stemming
  • 论文: A BACKPROPAGATION NEURAL NETWORK TO IMPROVE ARABIC STEMMING(一个反向传播的神经网络,用来改善阿拉伯语的词干提取):http://www.jatit.org/volumes/Vol82No3/7Vol82No3.pdf
  • 工具包: NLTK Stemmers:http://www.nltk.org/howto/stem.html

术语提取

  • 维基百科:术语提取:https://en.wikipedia.org/wiki/Terminology_extraction
  • 论文: Neural Attention Models for Sequence Classification: Analysis and Application to KeyTerm Extraction and Dialogue Act Detection(序列分类的神经提示模型:分析和应用于关键词提取和对话法检测):https://arxiv.org/pdf/1604.00077.pdf

文本简化

  • 维基百科:文本简化:https://en.wikipedia.org/wiki/Text_simplification
  • 论文:Aligning Sentences from Standard Wikipedia to Simple Wikipedia(调整句子,从标准的维基百科到简单的维基百科):https://ssli.ee.washington.edu/~hannaneh/papers/simplification.pdf
  • 论文:Problems in Current Text Simplification Research: New Data Can Help(当前文本简化研究中的问题:可提供帮助的新数据):https://pdfs.semanticscholar.org/2b8d/a013966c0c5e020ebc842d49d8ed166c8783.pdf
  • 资料:Newsela Data:https://newsela.com/data/

文本蕴涵

  • 维基百科:文本蕴含:https://en.wikipedia.org/wiki/Textual_entailment
  • 项目:Textual Entailment with TensorFlow(文本蕴含与TensorFlow):https://github.com/Steven-Hewitt/Entailment-with-Tensorflow
  • 竞赛:SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge(SemEval-2013任务7:联合学生反应分析和第8届认知文本蕴含挑战):https://www.cs.york.ac.uk/semeval-2013/task7.html

音译

  • 维基百科:音译:https://en.wikipedia.org/wiki/Transliteration
  • 论文:A Deep Learning Approach to Machine Transliteration(一个机器音译的深度学习方法):https://pdfs.semanticscholar.org/54f1/23122b8dd1f1d3067cf348cfea1276914377.pdf
  • 项目:Neural Japanese Transliteration—can you do better than SwiftKey™ Keyboard?(神经日语音译:你能比SwiftKey键盘做得更好吗?):https://github.com/Kyubyong/neural_japanese_transliterator

词嵌入

  • 维基百科:词嵌入:https://en.wikipedia.org/wiki/Word_embedding
  • 工具包:Gensim: word2vec:https://radimrehurek.com/gensim/models/word2vec.html
  • 工具包:fastText:https://github.com/facebookresearch/fastText
  • 工具包:GloVe:Global Vectors for Word Representation:https://nlp.stanford.edu/projects/glove/
  • 信息:Where to get a pretrained model?(哪里能够获得一个预先训练的模型?):https://github.com/3Top/word2vec-api
  • 项目:Pre-trained word vectors of 30+ languages(30多种语言的预先训练的词向量):https://github.com/Kyubyong/wordvectors
  • 项目:Polyglot: Distributed word representations for multilingual NLP(Polyglot:多语言NLP的分布式词汇表征):https://sites.google.com/site/rmyeid/projects/polyglot

词汇预测

  • 信息:What is Word Prediction?(什么是词汇预测?):http://www2.edc.org/ncip/library/wp/what_is.htm
  • 论文: The prediction of character based on recurrent neural network language model(基于循环神经网络语言模型的字符预测):http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7960065
  • 论文: An Embedded Deep Learning based Word Prediction(一个基于深度学习的词汇预测):https://arxiv.org/abs/1707.01662
  • 论文:Evaluating Word Prediction: Framing Keystroke Savings(评估单词预测:框击键保存):http://aclweb.org/anthology/P08-2066
  • 资料:An Embedded Deep Learning based Word Prediction(一个基于深度学习的词汇预测):https://github.com/Meinwerk/WordPrediction/master.zip
  • 项目: Word Prediction using Convolutional Neural Networks—can you do better than iPhone™ Keyboard?(使用卷积神经网络的词汇预测——你能比iPhone键盘做得更好吗?):https://github.com/Kyubyong/word_prediction

词分割

  • 论文: Neural Word Segmentation Learning for Chinese(中文的神经词分割学习):https://arxiv.org/abs/1606.04300
  • 项目:Convolutional neural network for Chinese word segmentation(中文的词分割的卷积神经网络):https://github.com/chqiwang/convseg
  • 工具包:Stanford Word Segmenter:https://nlp.stanford.edu/software/segmenter.html
  • 工具包: NLTK Tokenizers:http://www.nltk.org/_modules/nltk/tokenize.html

词义消歧

  • 维基百科:词义消歧:https://en.wikipedia.org/wiki/Word-sense_disambiguation
  • 论文:Train-O-Matic: Large-Scale Supervised Word Sense Disambiguation in Multiple Languages without Manual Training Data(Train-O-Matic:在没有人工训练数据的情况下,在多种语言中大规模的监督词义消歧):http://www.aclweb.org/anthology/D17-1008
  • 资料:Train-O-Matic Data:http://trainomatic.org/data/train-o-matic-data.zip
  • 资料:BabelNet:http://babelnet.org/

原项目地址:https://github.com/Kyubyong/nlp_tasks#speech-segmentation

本文参与 腾讯云自媒体同步曝光计划,分享自微信公众号。
原始发表:2017-10-17,如有侵权请联系 cloudcommunity@tencent.com 删除

本文分享自 ATYUN订阅号 微信公众号,前往查看

如有侵权,请联系 cloudcommunity@tencent.com 删除。

本文参与 腾讯云自媒体同步曝光计划  ,欢迎热爱写作的你一起参与!

评论
登录后参与评论
0 条评论
热度
最新
推荐阅读
相关产品与服务
NLP 服务
NLP 服务(Natural Language Process,NLP)深度整合了腾讯内部的 NLP 技术,提供多项智能文本处理和文本生成能力,包括词法分析、相似词召回、词相似度、句子相似度、文本润色、句子纠错、文本补全、句子生成等。满足各行业的文本智能需求。
领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档