论文阅读7-----基于强化学习的推荐系统
原创论文阅读7-----基于强化学习的推荐系统
原创
DRN: A Deep Reinforcement Learning Framework for News Recommendation
ABSTRACT
In this paper, we propose a novel Deep Reinforcement Learning framework for news recommendation.
我们提出来RL方法用于新闻推荐。
Online personalized news recommendation is a highly challenging problem due to the dynamic nature of news features and user preferences. Although some online recommendation models have been proposed to address the dynamic nature of news recommendation, these methods have three major issues.
新闻推荐挑战很大，因为新闻特征和用户偏好动态变化大。现存的推荐系统方法有如下缺点。
First, they only try to model current reward(e.g., Click Through Rate).
1.仅仅尝试当前的奖励，下文引出RL方法，因为RL方法适用于长期的奖励。
Second, very few studies consider to use user feedback other than click / no click labels (e.g., how frequent user returns) to help improve recommendation.
2.没考虑用户反馈，即使考虑了也不过click/no click labels.(反馈不够丰富，下文提出回归时间凑数)
Third, these methods tend to keep recommending similar news to users, which may cause users to get bored.
3.推荐的物品趋于相似，用户非常不爽。（我们有探索机制，厉害的很）
Therefore, to address the aforementioned challenges,
所以我们的解决方法如下
we propose a Deep Q-Learning based recommendation framework, which can model future reward explicitly.
RL的方法，考虑不仅仅只是近期奖励，还有很多未来的奖励。
We furthe consider user return pattern as a supplement to click / no click label in order to capture more user feedback information.
把用户离开APP（亦或是网页）到再次回来的时间间隔也看做反馈，用户粘念性。
In addition,an effective exploration strategy is incorporated to find new attractive news for users.
我们的探索机制很厉。
Extensive experiments are conducted on the offline dataset and online production environment of a commercial
news recommendation application and have shown the superio performance of our methods.
对了，我们还做了实验，的的确确我们超级厉害。
proposed model
用户的表示，state的形成
用户的反馈---本文用用户再次返回时间做了一个feedback
俺们的探索机制
对于W的minor update上文有所提及
原创声明：本文系作者授权腾讯云开发者社区发表，未经许可，不得转载。
如有侵权，请联系 cloudcommunity@tencent.com 删除。
原创声明：本文系作者授权腾讯云开发者社区发表，未经许可，不得转载。
如有侵权，请联系 cloudcommunity@tencent.com 删除。