【最全开工干货】深度学习书单、文献及数据集(共446项)

新年伊始,相信每个人已经制定好了自己2016年的计划。随着无人机和智能机器人在春晚亮相,想必许多人会对“人工智能”、“机器学习”,“深度学习”这些科技热词充满了好奇。为此,新智元给众多热爱人工智能领域的读者准备了一份丰厚的大理。小编深知许多对人工智能领域感兴趣的读者可能还不知如何入手该领域,那么,小编建议就从了解深度学习开始吧!新智元为学习深度学习的初学者整理了一份非常全面的书单,下面就随小编一起来看看这份书单中包含哪些板块的内容呢?

给深度学习从业者的书单

一、关于矩阵或者单变量微积分计算的文献(共5项)

Introduction to Algorithms by Erik Demaine and Srinivas Devadas.

Single Variable Calculus by David Jerison.

Multivariable Calculus by Denis Auroux.

Differential Equations by Arthur Mattuck, Haynes Miller, Jeremy Orloff, John Lewis.

Linear Algebra by Gilbert Strang.

二、基于深度学习的计算理论,学习理论,神经科学等等(共12项)

Introduction to the Theory of Computation by Michael Sipser.

Artificial Intelligence: A Modern Approach by Stuart Russell and Peter Norvig.

Pattern Recognition and Machine Learning by Christopher Bishop.

Machine Learning: A probabilistic perspective by Kevin Patrick Murphy.

CS229 Machine Learning Course Materials by Andrew Ng at Stanford University.

Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto.

Probabilistic Graphical Models: Principles and Techniques by Daphne Koller and Nir Friedman.

Convex Optimization by Stephen Boyd and Lieven Vandenberghe.

An Introduction to Statistical Learning with application in R by Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani.

Neuronal Dynamics: From single neurons to networks and models of cognition by Wulfram Gerstner, Werner M. Kistler, Richard Naud and Liam Paninski.

Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems by Peter Dayan and Laurence F. Abbott.

Michael I. Jordan Reading List of Machine Learning at Hacker News.

三、关于深度学习基础知识的文献(共5项)

Deep Learning in Neural Networks: An Overview by Jürgen Schmidhuber.

Deep Learning Book by Yoshua Bengio, Ian Goodfellow and Aaron Courville.

Learning Deep Architectures for AI by Yoshua Bengio.

Representation Learning: A Review and New Perspectives by Yoshua Bengio, Aaron Courville, Pascal Vincent.

Reading lists for new LISA students by LISA Lab, University of Montreal.

四、关于深度学习的教材,实用手册以及有用的软件(共17项)

Machine Learning by Andrew Ng.

Neural Networks for Machine Learning by Geoffrey Hinton.

Deep Learning Tutorial by LISA Lab, University of Montreal.

Unsupervised Feature Learning and Deep Learning Tutorial by AI Lab, Stan ford University.

CS231n: Convolutional Neural Networks for Visual Recognition by Stanfor d Uiversity.

CS224d: Deep Learning for Natural Language Processing by Stanford Univer sity.

Theano by LISA Lab, University of Montreal.

PyLearn2 by LISA Lab, University of Montreal.

Caffe by Berkeley Vision and Learning Center (BVLC) and community contrib utor Yangqing Jia.

Torch 7

neon by Nervana.

cuDNN by NVIDIA.

ConvNetJS by Andrej Karpathy.

DeepLearning4j

Chainer: Neural network framework by Preferred Networks, Inc.

Blocks by LISA Lab, University of Montreal.

Fuel by LISA Lab, University of Montreal.

五、关于深度学习和特征学习的文献(共11项)

Automatic Speech Recognition - A Deep Learning Approach by Dong Yu an d Li Deng (Published by Springer, no Open Access)

Backpropagation Applied to Handwritten Zip Code Recognition by Y. LeCu n, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard an d L. D. Jackel.

Comparison of Training Methods for Deep Neural Networks by Patrick O. Glauner.

Deep Learning by Yann LeCun, Yoshua Bengio, Geoffrey Hinton. (NO FREE COPY AVAILABLE)

Distributed Representations of Words and Phrases and their Compositionality by Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado and Jeffrey Dean.

Efficient Estimation of Word Representations in Vector Space by Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean.

Efficient Large Scale Video Classification by Balakrishnan Varadarajan, George Toderici, Sudheendra Vijayanarasimhan, Apostol Natsev.

Foundations and Trends in Signal Processing: DEEP LEARNING — Methods and Applications by Li Deng and Dong Yu.

From Frequency to Meaning: Vector Space Models of Semantics by Peter D. Turney and Patrick Pantel.

LSTM: A Search Space Odyssey by Klaus Greff, Rupesh Kumar Srivastava, Jan Koutník, Bas R. Steunebrink, Jürgen Schmidhuber.

Supervised Sequence Labelling with Recurrent Neural Networks by Alex Graves.

六、最近必读的关于深度学习领域的最新进展(共332项)

A Convolutional Attention Network for Extreme Summarization of Source Code by Miltiadis Allamanis, Hao Peng, Charles Sutton.

A Deep Bag-of-Features Model for Music Auto-Tagging by Juhan Nam, Jorge Herrera, Kyogu Lee.

A Deep Generative Deconvolutional Image Model by Yunchen Pu, Xin Yuan, Andrew Stevens, Chunyuan Li, Lawrence Carin.

A Deep Neural Network Compression Pipeline: Pruning, Quantization, Huffman Encoding by Song Han, Huizi Mao, William J. Dally.

A Deep Pyramid Deformable Part Model for Face Detection by Rajeev Ranjan, Vishal M. Patel, Rama Chellappa.

A Deep Siamese Network for Scene Detection in Broadcast Videos by Lorenzo Baraldi, Costantino Grana, Rita Cucchiara.

A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestion by Alessandro Sordoni, Yoshua Bengio, Hossein Vahabi, Christina Lioma, Jakob G. Simonsen, Jian-Yun Nie.

A Large-Scale Car Dataset for Fine-Grained Categorization and Verification by Linjie Yang, Ping Luo, Chen Change Loy, Xiaoou Tang.

A Lightened CNN for Deep Face Representation by Xiang Wu, Ran He, Zhenan Sun.

A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction by Thomas Wiatowski, Helmut Bölcskei.

A Multi-scale Multiple Instance Video Description Network by Huijuan Xu, Subhashini Venugopalan, Vasili Ramanishka, Marcus Rohrbach, Kate Saenko.

A Recurrent Latent Variable Model for Sequential Data by Junyoung Chung, Kyle Kastner, Laurent Dinh, Kratarth Goel, Aaron Courville, Yoshua Bengio.

A Restricted Visual Turing Test for Deep Scene and Event Understanding by Hang Qi, Tianfu Wu, Mun-Wai Lee, Song-Chun Zhu.

A Sensitivity Analysis of (and Practitioners’ Guide to) Convolutional Neural Networks for Sentence Classification by Ye Zhang, Byron Wallace.

ABC-CNN: An Attention Based Convolutional Neural Network for Visual Question Answering by Kan Chen, Jiang Wang, Liang-Chieh Chen, Haoyuan Gao, Wei Xu, Ram Nevatia.

Accelerating Very Deep Convolutional Networks for Classification and Detection by Xiangyu Zhang, Jianhua Zou, Kaiming He, Jian Sun.

Accurate Image Super-Resolution Using Very Deep Convolutional Networks by Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee.

Action Recognition using Visual Attention by Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov.

Action Recognition With Trajectory-Pooled Deep-Convolutional Descriptors by Limin Wang, Yu Qiao, Xiaoou Tang.

Action-Conditional Video Prediction using Deep Networks in Atari Games by Junhyuk Oh, Xiaoxiao Guo, Honglak Lee, Richard Lewis, Satinder Singh.

Active Object Localization with Deep Reinforcement Learning by Juan C. Caicedo, Svetlana Lazebnik.

adaQN: An Adaptive Quasi-Newton Algorithm for Training RNNs by Nitish Shirish Keskar, Albert S. Berahas.

Adding Gradient Noise Improves Learning for Very Deep Networks by Arvind Neelakantan, Luke Vilnis, Quoc V. Le, Ilya Sutskever, Lukasz Kaiser, Karol Kurach, James Martens.

Adversarial Autoencoders by Alireza Makhzani, Jonathon Shlens, Navdeep Jaitly, Ian Goodfellow.

Adversarial Manipulation of Deep Representations by Sara Sabour, Yanshuai Cao, Fartash Faghri, David J. Fleet.

All you need is a good init by Dmytro Mishkin, Jiri Matas.

An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition by Baoguang Shi, Xiang Bai, Cong Yao.

Answer Sequence Learning with Neural Networks for Answer Selection in Community Question Answering by Xiaoqiang Zhou, Baotian Hu, Qingcai Chen, Buzhou Tang, Xiaolong Wang.

Anticipating the future by watching unlabeled video by Carl Vondrick, Hamed Pirsiavash, Antonio Torralba.

Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering by Haoyuan Gao, Junhua Mao, Jie Zhou, Zhiheng Huang, Lei Wang, Wei Xu.

Artificial Neural Networks Applied to Taxi Destination Prediction by Alexandre de Brébisson, Étienne Simon, Alex Auvolat, Pascal Vincent, Yoshua Bengio.

Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering by Huijuan Xu, Kate Saenko.

Ask Me Anything: Dynamic Memory Networks for Natural Language Processing by Ankit Kumar, Ozan Irsoy, Jonathan Su, James Bradbury, Robert English, Brian Pierce, Peter Ondruska, Ishaan Gulrajani, Richard Socher.

Ask Me Anything: Free-form Visual Question Answering Based on Knowledge from External Sources by Qi Wu, Peng Wang, Chunhua Shen, Anton van den Hengel, Anthony Dick.

Ask Your Neurons: A Neural-based Approach to Answering Questions about Images by Mateusz Malinowski, Marcus Rohrbach, Mario Fritz.

Associative Long Short-Term Memory by Ivo Danihelka, Greg Wayne, Benigno Uria, Nal Kalchbrenner, Alex Graves.

AttentionNet: Aggregating Weak Directions for Accurate Object Detection by Donggeun Yoo, Sunggyun Park, Joon-Young Lee, Anthony Paek, In So Kweon.

Attention-Based Models for Speech Recognition by Jan Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk, Kyunghyun Cho, Yoshua Bengio.

Attention to Scale: Scale-aware Semantic Image Segmentation by Liang-Chieh Chen, Yi Yang, Jiang Wang, Wei Xu, Alan L. Yuille.

Attention with Intention for a Neural Network Conversation Model by Kaisheng Yao, Geoffrey Zweig, Baolin Peng.

AtomNet: A Deep Convolutional Neural Network for Bioactivity Prediction in Structure-based Drug Discovery by Izhar Wallach, Michael Dzamba, Abraham Heifets.

七、数据集(共13项)

Caltech 101 by L. Fei-Fei, R. Fergus and P. Perona.

Caltech 256 by G. Griffin, AD. Holub, P. Perona.

CIFAR-10 by Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton.

CIFAR-100 by Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton.

The Comprehensive Cars (CompCars) dataset by Linjie Yang, Ping Luo, Chen Change Loy, Xiaoou Tang.

Flickr30k by Peter Young, Alice Lai, Micah Hodosh, Julia Hockenmaier.

ImageNet by Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg and Li Fei-Fei.

Microsoft COCO by Microsoft Research.

MNIST by Yann LeCun, Corinna Cortes, Christopher J.C. Burges.

Places by MIT Computer Science and Artificial Intelligence Laboratory.

STL-10 by Adam Coates, Honglak Lee, Andrew Y. Ng.

SVHN by Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, Andrew Y. Ng.

WWW Crowd Dataset by Jing Shao, Kai Kang, Chen Change Loy, and Xiaogang Wang.

八、关于学习深度学习的博客、访谈栏目等等(共4项)

Talking Machines hosted by Katherine Gorman and Ryan Adams.

Machine Learning & Computer Vision Talks by computervisiontalks.

How we’re teaching computers to understand pictures by Fei-Fei Li, Stanford University.

Deep Learning Community

九、亚马逊提供的用于深度学习的公共AMI网络服务(共3项)

DGYDLGPUv4 (ami-ba516ee8) [Based on g2.2xlarge]

DGYDLGPUXv1 (ami-52516e00) [Based on g2.8xlarge]

Caffe/CuDNN built 2015-05-04 (ami-763a331e) [For both g2.2xlarge and g2.8xlarge]

十、实用的深度神经网络—从GPU计算的角度来看(共26项)

Slides(8项)

Introduction

Python Platform for Scientific Computing

Theano Crash Course

Machine Learning Basics

Softmax Regression

Feedforward Neural Networks

Convolutional Neural Networks

Recurrent Neural Networks

Practical tutorials(8项)

Python Warm-up, pre-processing

Feedforward Layer

Softmax Regression

Multi Layer Perceptron Network

Feedforward Model

Auto-encoder

Convolutional Neural Networks

Recurrent Neural Networks

Codes

Telauges (10项)

A new deep learning library for learning DL.

MLP Layers: Tanh Layer, Sigmoid Layer, Identity Layer, ReLU Layer

Softmax Regression

ConvNet layers: Tanh Layer, Sigmoid Layer, Identity Layer, ReLU Layer

Max-Pooling layer

Max-Pooling same size

Feedforward Model

Auto-Encoder Model

SGD, Adagrad, Adadelta, RMSprop, Adam

Dropout

看到这里,各位热爱深度学习的狂粉们是不是也和小编一样想将这些宝贝资料收藏起来呢?那么,下面再跟随小编来看看怎样来获取这些宝贝资料吧。

深度学习书单获取步骤:

(1)首先,关注新智元公众号(ID:AI_era)

(2)其次,进入新智元公众号,在新智元公众号处回复关键字 160215

(3)回复关键字后,会出现网址链接,打开链接,即可看到书单中上述各个板块的内容,若想查看板块中具体的一个书目,选中蓝色的标题,右击选择“打开超链接”即可看到书中具体的内容。

你想成为深度学习领域的小能手吗?想真正地了解“深度学习”、“机器学习”、“人工智能”这些科技热词到底是怎么回事吗?答案就从关注新智元,从获取这份深度学习的书单开始寻找吧!!!

原文发布于微信公众号 - 新智元(AI_era)

原文发表时间:2016-02-15

本文参与腾讯云自媒体分享计划,欢迎正在阅读的你也加入,一起分享。

发表于

我来说两句

0 条评论
登录 后参与评论

相关文章

来自专栏新智元

ICLR 2017深度学习(提交)论文汇总:NLP、无监督学习、自动编码、RL、RNN(150论文下载)

【新智元导读】ICLR 2017 将于2017年4月24日至26日在法国土伦(toulon)举行,11月4日已经停止接收论文。本文汇总了本年度NLP、无监督学习...

524100
来自专栏SIGAI学习与实践平台

机器学习与深度学习经典论文整理

这篇文章整理出了机器学习、深度学习领域的经典论文。为了减轻大家的阅读负担,只列出了最经典的一批,如有需要,可以自己根据实际情况补充。

30230
来自专栏目标检测和深度学习

全球最全计算机视觉资料(6:问答|边缘检测|姿态估计|图像生成)

16420
来自专栏AI科技大本营的专栏

ICLR vs arxiv-sanity

我觉得交叉对比 ICLR 2017(一个备受欢迎的深度学习大会)的论文决策(分为四类:Oral、Poster、Workshop 和 Reject)与所有论文在 ...

42850
来自专栏目标检测和深度学习

全球最全计算机视觉资料(5:图像和视频标注)

14910
来自专栏CreateAMind

awesome-self-supervised-learning papers

https://github.com/jason718/awesome-self-supervised-learning

42120
来自专栏专知

【论文推荐】最新六篇自动问答(QA)相关论文—复杂序列问答、注意力机制、长短时记忆、文本推理、多因素注意力、主动的问答智能体

【导读】专知内容组整理了最近六篇自动问答(Question Answering)相关文章,为大家进行介绍,欢迎查看! 1. Complex Sequential...

60780
来自专栏专知

【论文推荐】最新七篇视觉问答(VQA)相关论文—差别注意力机制、视觉问题推理、视觉对话、数据可视化、记忆增强网络、显式推理

29820
来自专栏CVer

人工智能 | 中国计算机学会推荐国际学术刊物/会议

关注CVer公众号的群体大多以学生为主,特别是研究生。相信在帮boss做事的时候,论文也是核心工作。Amusi平时爱推送一些论文速递,但这么多论文,怎么快速区分...

22010
来自专栏专知

【论文推荐】最新六篇自动问答相关论文—排序函数、文本摘要评估、信息抽取框架、层次递归编码器、半监督问答

23230

扫码关注云+社区

领取腾讯云代金券