专栏首页专知【论文推荐】最新七篇知识图谱相关论文—知识表示学习、增强神经网络、链接预测、关系预测与提取、综述、递归特性生成、深度知识感知网络

【论文推荐】最新七篇知识图谱相关论文—知识表示学习、增强神经网络、链接预测、关系预测与提取、综述、递归特性生成、深度知识感知网络

【导读】专知内容组整理了最近七篇知识图谱(Knowledge graphs)相关文章,为大家进行介绍,欢迎查看!

1. Does William Shakespeare REALLY Write Hamlet? Knowledge Representation Learning with Confidence(莎士比亚真的写哈姆雷特吗?有信心的知识表示学习)



作者:Ruobing Xie,Zhiyuan Liu,Fen Lin,Leyu Lin

摘要:Knowledge graphs (KGs), which could provide essential relational information between entities, have been widely utilized in various knowledge-driven applications. Since the overall human knowledge is innumerable that still grows explosively and changes frequently, knowledge construction and update inevitably involve automatic mechanisms with less human supervision, which usually bring in plenty of noises and conflicts to KGs. However, most conventional knowledge representation learning methods assume that all triple facts in existing KGs share the same significance without any noises. To address this problem, we propose a novel confidence-aware knowledge representation learning framework (CKRL), which detects possible noises in KGs while learning knowledge representations with confidence simultaneously. Specifically, we introduce the triple confidence to conventional translation-based methods for knowledge representation learning. To make triple confidence more flexible and universal, we only utilize the internal structural information in KGs, and propose three kinds of triple confidences considering both local and global structural information. In experiments, We evaluate our models on knowledge graph noise detection, knowledge graph completion and triple classification. Experimental results demonstrate that our confidence-aware models achieve significant and consistent improvements on all tasks, which confirms the capability of CKRL modeling confidence with structural information in both KG noise detection and knowledge representation learning.

期刊:arXiv, 2018年2月17日

网址

http://www.zhuanzhi.ai/document/f48a2af484c37c8dd9cc113174aec5cb

2. Learning beyond datasets: Knowledge Graph Augmented Neural Networks for Natural language Processing(超越数据集的学习:知识图增强神经网络的自然语言处理)



作者:K M Annervaz,Somnath Basu Roy Chowdhury,Ambedkar Dukkipati

摘要:Machine Learning has been the quintessential solution for many AI problems, but learning is still heavily dependent on the specific training data. Some learning models can be incorporated with a prior knowledge in the Bayesian set up, but these learning models do not have the ability to access any organised world knowledge on demand. In this work, we propose to enhance learning models with world knowledge in the form of Knowledge Graph (KG) fact triples for Natural Language Processing (NLP) tasks. Our aim is to develop a deep learning model that can extract relevant prior support facts from knowledge graphs depending on the task using attention mechanism. We introduce a convolution-based model for learning representations of knowledge graph entity and relation clusters in order to reduce the attention space. We show that the proposed method is highly scalable to the amount of prior information that has to be processed and can be applied to any generic NLP task. Using this method we show significant improvement in performance for text classification with News20, DBPedia datasets and natural language inference with Stanford Natural Language Inference (SNLI) dataset. We also demonstrate that a deep learning model can be trained well with substantially less amount of labeled training data, when it has access to organised world knowledge in the form of knowledge graph.

期刊:arXiv, 2018年2月16日

网址

http://www.zhuanzhi.ai/document/92532f7deb92f335df4be2441ab3dd04

3. SimplE Embedding for Link Prediction in Knowledge Graphs(基于SimplE Embedding的知识图中链接预测)



作者:Seyed Mehran Kazemi,David Poole

摘要:The aim of knowledge graphs is to gather knowledge about the world and provide a structured representation of this knowledge. Current knowledge graphs are far from complete. To address the incompleteness of the knowledge graphs, link prediction approaches have been developed which make probabilistic predictions about new links in a knowledge graph given the existing links. Tensor factorization approaches have proven promising for such link prediction problems. In this paper, we develop a simple tensor factorization model called SimplE, through a slight modification of the Polyadic Decomposition model from 1927. The complexity of SimplE grows linearly with the size of embeddings. The embeddings learned through SimplE are interpretable, and certain types of expert knowledge in terms of logical rules can be incorporated into these embeddings through weight tying. We prove SimplE is fully-expressive and derive a bound on the size of its embeddings for full expressivity. We show empirically that, despite its simplicity, SimplE outperforms several state-of-the-art tensor factorization techniques.

期刊:arXiv, 2018年2月14日

网址

http://www.zhuanzhi.ai/document/5a5bd90eacc920b1b0698edbafcc4e19

4. Investigations on Knowledge Base Embedding for Relation Prediction and Extraction(基于知识库嵌入的关系预测与提取研究)



作者:Peng Xu,Denilson Barbosa

摘要:We report an evaluation of the effectiveness of the existing knowledge base embedding models for relation prediction and for relation extraction on a wide range of benchmarks. We also describe a new benchmark, which is much larger and complex than previous ones, which we introduce to help validate the effectiveness of both tasks. The results demonstrate that knowledge base embedding models are generally effective for relation prediction but unable to give improvements for the state-of-art neural relation extraction model with the existing strategies, while pointing limitations of existing methods.

期刊:arXiv, 2018年2月7日

网址

http://www.zhuanzhi.ai/document/1d2d4cd255efc0d39384386c05e65490

5. An overview of embedding models of entities and relationships for knowledge base completion(基于实体和关系嵌入模型的知识库完备综述)



作者:Dat Quoc Nguyen

摘要:Knowledge bases (KBs) of real-world facts about entities and their relationships are useful resources for a variety of natural language processing tasks. However, because knowledge bases are typically incomplete, it is useful to be able to perform knowledge base completion or link prediction, i.e., predict whether a relationship not in the knowledge base is likely to be true. This article serves as a brief overview of embedding models of entities and relationships for knowledge base completion, summarizing up-to-date experimental results on standard benchmark datasets FB15k, WN18, FB15k-237, WN18RR, FB13 and WN11.

期刊:arXiv, 2018年2月3日

网址

http://www.zhuanzhi.ai/document/a08a755a019c002a672985436f6de794

6. Recursive Feature Generation for Knowledge-based Learning(基于递归特性生成的知识学习)



作者:Lior Friedman,Shaul Markovitch

摘要:When humans perform inductive learning, they often enhance the process with background knowledge. With the increasing availability of well-formed collaborative knowledge bases, the performance of learning algorithms could be significantly enhanced if a way were found to exploit these knowledge bases. In this work, we present a novel algorithm for injecting external knowledge into induction algorithms using feature generation. Given a feature, the algorithm defines a new learning task over its set of values, and uses the knowledge base to solve the constructed learning task. The resulting classifier is then used as a new feature for the original problem. We have applied our algorithm to the domain of text classification using large semantic knowledge bases. We have shown that the generated features significantly improve the performance of existing learning algorithms.

期刊:arXiv, 2018年2月1日

网址

http://www.zhuanzhi.ai/document/899c180ab958b76de5859eee1de5c50d

7. DKN: Deep Knowledge-Aware Network for News Recommendation

(DKN:基于深度知识感知网络的新闻推荐)



作者:Hongwei Wang,Fuzheng Zhang,Xing Xie,Minyi Guo

摘要:Online news recommender systems aim to address the information explosion of news and make personalized recommendation for users. In general, news language is highly condensed, full of knowledge entities and common sense. However, existing methods are unaware of such external knowledge and cannot fully discover latent knowledge-level connections among news. The recommended results for a user are consequently limited to simple patterns and cannot be extended reasonably. Moreover, news recommendation also faces the challenges of high time-sensitivity of news and dynamic diversity of users' interests. To solve the above problems, in this paper, we propose a deep knowledge-aware network (DKN) that incorporates knowledge graph representation into news recommendation. DKN is a content-based deep recommendation framework for click-through rate prediction. The key component of DKN is a multi-channel and word-entity-aligned knowledge-aware convolutional neural network (KCNN) that fuses semantic-level and knowledge-level representations of news. KCNN treats words and entities as multiple channels, and explicitly keeps their alignment relationship during convolution. In addition, to address users' diverse interests, we also design an attention module in DKN to dynamically aggregate a user's history with respect to current candidate news. Through extensive experiments on a real online news platform, we demonstrate that DKN achieves substantial gains over state-of-the-art deep recommendation models. We also validate the efficacy of the usage of knowledge in DKN.

期刊:arXiv, 2018年1月30日

网址

http://www.zhuanzhi.ai/document/f18c88d4cd335b0408f90dfe97f6e937

本文分享自微信公众号 - 专知(Quan_Zhuanzhi),作者:专知内容组

原文出处及转载信息见文内详细说明,如有侵权,请联系 yunjia_community@tencent.com 删除。

原始发表时间:2018-03-06

本文参与腾讯云自媒体分享计划,欢迎正在阅读的你也加入,一起分享。

我来说两句

0 条评论
登录 后参与评论

相关文章

  • 【论文推荐】最新七篇知识图谱相关论文—嵌入式知识、Zero-shot识别、知识图谱嵌入、网络库、变分推理、解释、弱监督

    【导读】专知内容组整理了最近七篇知识图谱(Knowledge graphs)相关文章,为大家进行介绍,欢迎查看! 1.Learning over Knowled...

    WZEARW
  • Expressivity,Trainability,and Generalization in Machine Learning

    When I read Machine Learning papers, I ask myself whether the contributions of t...

    WZEARW
  • 【论文推荐】最新七篇视觉问答(VQA)相关论文—融合算子、问题类型引导注意力、交互环境、可解释性、稠密对称联合注意力

    WZEARW
  • 【论文推荐】最新七篇知识图谱相关论文—嵌入式知识、Zero-shot识别、知识图谱嵌入、网络库、变分推理、解释、弱监督

    【导读】专知内容组整理了最近七篇知识图谱(Knowledge graphs)相关文章,为大家进行介绍,欢迎查看! 1.Learning over Knowled...

    WZEARW
  • 知识图谱中什么是正常的什么是奇怪的以及缺少什么(CS AI)

    知识图谱(KGs)在图谱的结构中存储了关于世界的高度异构的信息,对于回答问题和推理等任务非常有用。然而,它们经常包含错误和丢失信息。知识图谱精准化的活跃研究已经...

    RockNPeng
  • 一个用于Android隐私政策文档结构分析的语料库(CS CY)

    随着移动设备的日益普及和移动应用的广泛应用,隐私问题逐渐受到关注。隐私政策作为一种表明法律条款的适当媒介,如GDPR,被认为是约束服务提供商和用户之间的法律协议...

    奥斯特洛夫斯萌
  • Qualcomm - SnapDragon Tech Summit - Key Note - About 5G

    Qualcomm SnapDragon Tech Summit首日Keynote。 Qualcomm对5G现状和未来的理解,及其技术框架。非常重要。

    用户6026865
  • 【论文推荐】最新5篇自动问答相关论文——多关系自动问答、知识图谱联合实体和关系、生物医学问题、维基百科语料数据、多句式旅游推荐

    【导读】专知内容组整理了最近自动问答相关文章,为大家进行介绍,欢迎查看! 1. An Interpretable Reasoning Network for M...

    WZEARW
  • 大数据有助于预防自杀

    作者:Gil Allouche 翻译:coco 校对:孙强 关键词:大数据 自杀 [大数据文摘翻译] 大数据不只是帮助我们寻找更有效的营销和广告方式 它也使这...

    小莹莹
  • 4月14日对话吴恩达(Andrew Ng):超级大咖深度解析人工智能的发展现状与未来沙龙实录

    2016年4月14日(周四)21:00 - 22:30 嘉宾: - 吴恩达(Andrew Ng):百度首席科学家,“百度大脑”、“谷歌大脑”负责人,斯坦福大学计...

    小莹莹

扫码关注云+社区

领取腾讯云代金券